Next_Word_Prediction_Model.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "provenance": [],
      "toc_visible": true,
      "authorship_tag": "ABX9TyMYFTQ9qNrwr8BNHGW9YFBR",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/hussain0048/Projects/blob/master/Next_Word_Prediction_Model.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Introduction**"
      ],
      "metadata": {
        "id": "Z6FcOtuKD-45"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "Most of the keyboards in smartphones give next word prediction features; google also uses next word prediction based on our browsing history. So a preloaded data is also stored in the keyboard function of our smartphones to predict the next word correctly."
      ],
      "metadata": {
        "id": "ZSlATptKEE0Z"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Table of Content**"
      ],
      "metadata": {
        "id": "W47NdJsKEIwv"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Techniques and Libraries**"
      ],
      "metadata": {
        "id": "hYdz0Dd8EPK_"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "\n",
        "\n",
        "*    Keras library\n",
        "*   \n",
        "\n"
      ],
      "metadata": {
        "id": "g-txLfUVEhY_"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Import libraries**"
      ],
      "metadata": {
        "id": "RlQs8u0kEtpP"
      }
    },
    {
      "cell_type": "code",
      "source": [],
      "metadata": {
        "id": "pyuDMENBFSlo"
      },
      "execution_count": null,
      "outputs": []
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "L6ZhWXfY2b5e"
      },
      "outputs": [],
      "source": [
        "import numpy as np\n",
        "from nltk.tokenize import RegexpTokenizer\n",
        "from keras.models import Sequential, load_model\n",
        "from keras.layers import LSTM, Dense, Activation # import Dense and Activation directly from keras.layers\n",
        "from keras.optimizers import RMSprop\n",
        "import matplotlib.pyplot as plt\n",
        "import pickle\n",
        "import heapq\n",
        "import pandas as pd"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **Load Dataset**"
      ],
      "metadata": {
        "id": "XgJg16XtLxNe"
      }
    },
    {
      "cell_type": "code",
      "source": [
        "\n",
        "from google.colab import drive\n",
        "drive.mount('/content/gdrive')"
      ],
      "metadata": {
        "id": "cPgLVAO4J-Kq",
        "outputId": "67ed261d-930d-4bf9-8a35-054b6c95e978",
        "colab": {
          "base_uri": "https://localhost:8080/"
        }
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "Mounted at /content/gdrive\n"
          ]
        }
      ]
    },
    {
      "cell_type": "code",
      "source": [
        "\n",
        "path = '/content/gdrive/MyDrive/Datasets (1)/Next Word Prediction/1661-0.txt'\n",
        "text = open(path).read().lower()\n",
        "print('corpus length:', len(text))"
      ],
      "metadata": {
        "id": "NnhZrjI-KfS5",
        "outputId": "515e7d93-5085-4134-e1f6-f5da57da8088",
        "colab": {
          "base_uri": "https://localhost:8080/"
        }
      },
      "execution_count": null,
      "outputs": [
        {
          "output_type": "stream",
          "name": "stdout",
          "text": [
            "corpus length: 581888\n"
          ]
        }
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "# **References**"
      ],
      "metadata": {
        "id": "Rfq5lKZ32hgM"
      }
    },
    {
      "cell_type": "markdown",
      "source": [
        "[1-Next Word Prediction Model](https://thecleverprogrammer.com/2020/07/20/next-word-prediction-model/)\n",
        "\n",
        "[2-Next-Word-Prediction-with-NLP-and-Deep-Learning](https://github.com/Bharath-K3/Next-Word-Prediction-with-NLP-and-Deep-Learning)\n",
        "\n",
        "[3-Text Generation AI - Next Word Prediction in Python](https://www.youtube.com/watch?v=tEV_Jtmx2cc)"
      ],
      "metadata": {
        "id": "DORoprVG2nxg"
      }
    }
  ]
}