Chapters/Chapter-06/advanced_rag.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://mng.bz/8wdg\" target=\"_blank\">\n",
    "    <img src=\"../../Assets/Images/NewMEAPHeader.png\" alt=\"New MEAP\" style=\"width: 100%;\" />\n",
    "</a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Chapter 06 - Progression of RAG Systems: Naïve to Advanced, and Modular RAG"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have familiarized ourselves with the utility of RAG along with the development and evaluation of a basic RAG system. The basic, or the Naïve RAG approach that we have seen so far is, generally, inadequate when it comes to production-grade systems."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://mng.bz/8wdg\" target=\"_blank\">\n",
    "    <img src=\"../../Assets/Images/6.1.png\" alt=\"Naive RAG Challenges\" style=\"width: 100%;\" />\n",
    "</a>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this chapter we will focus on more advanced concepts in RAG that make RAG possible in production. Let's begin by installing dependencies."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Installing Dependencies"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "All the necessary libraries for running this notebook along with their versions can be found in __requirements.txt__ file in the root directory of this repository\n",
    "\n",
    "You should go to the root directory and run the following command to install the libraries\n",
    "\n",
    "```\n",
    "pip install -r requirements.txt\n",
    "```\n",
    "\n",
    "This is the recommended method of installing the dependencies\n",
    "\n",
    "___\n",
    "Alternatively, you can run the command from this notebook too. The relative path may vary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3.1\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m24.2\u001b[0m\n",
      "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpip install --upgrade pip\u001b[0m\n",
      "Note: you may need to restart the kernel to use updated packages.\n"
     ]
    }
   ],
   "source": [
    "%pip install -r ../../requirements.txt --quiet"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Advanced RAG Techniques"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Advanced techniques in RAG have continued to emerge since the earliest experiments with Naïve RAG. There are three stages in which we can discuss these techniques – \n",
    "1.\tPre-retrieval Stage: Like the name suggests, there are certain interventions that can be employed before the retriever comes into action. This broadly covers two aspects \n",
    "    - Index Optimization – The way documents are stored in the knowledge base\n",
    "    - Query Optimization – Optimizing the user query so it aligns better to the retrieval and generation tasks\n",
    "2.\tRetrieval Stage: Certain strategies can improve the recall and precision of the retrieval process. This goes beyond the capability of the underlying retrieval algorithms that we discussed in Chapter 4.\n",
    "3.\tPost-retrieval Stage: Once the information has been retrieved, the context can be further optimized to better align with the generation task and the downstream LLM.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a href=\"https://mng.bz/8wdg\" target=\"_blank\">\n",
    "    <img src=\"../../Assets/Images/6.2.png\" alt=\"Naive RAG Challenges\" style=\"width: 50%;\" />\n",
    "</a>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We will explore these techniques one by one."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To initialize the __OpenAI client__, we need to pass the api key.\n",
    "\n",
    "Creating a .env file for storing the API key and using it # Recommended\n",
    "\n",
    "Install the __dotenv__ library\n",
    "\n",
    "_The dotenv library is a popular tool used in various programming languages, including Python and Node.js, to manage environment variables in development and deployment environments. It allows developers to load environment variables from a .env file into their application's environment._\n",
    "\n",
    "- Create a file named .env in the root directory of their project.\n",
    "- Inside the .env file, then define environment variables in the format VARIABLE_NAME=value. \n",
    "\n",
    "e.g.\n",
    "\n",
    "OPENAI_API_KEY=YOUR API KEY"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Success: .env file found with some environment variables\n"
     ]
    }
   ],
   "source": [
    "from dotenv import load_dotenv\n",
    "import os\n",
    "\n",
    "if load_dotenv():\n",
    "    print(\"Success: .env file found with some environment variables\")\n",
    "else:\n",
    "    print(\"Caution: No environment variables found. Please create .env file in the root directory or add environment variables in the .env file\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "OPENAI_API_KEY is set and is valid\n"
     ]
    }
   ],
   "source": [
    "api_key=os.environ[\"OPENAI_API_KEY\"]\n",
    "\n",
    "from openai import OpenAI\n",
    "\n",
    "client = OpenAI()\n",
    "\n",
    "\n",
    "if api_key:\n",
    "    try:\n",
    "        client.models.list()\n",
    "        print(\"OPENAI_API_KEY is set and is valid\")\n",
    "    except openai.APIError as e:\n",
    "        print(f\"OpenAI API returned an API Error: {e}\")\n",
    "        pass\n",
    "    except openai.APIConnectionError as e:\n",
    "        print(f\"Failed to connect to OpenAI API: {e}\")\n",
    "        pass\n",
    "    except openai.RateLimitError as e:\n",
    "        print(f\"OpenAI API request exceeded rate limit: {e}\")\n",
    "        pass\n",
    "\n",
    "else:\n",
    "    print(\"Please set you OpenAI API key as an environment variable OPENAI_API_KEY\")\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. Pre-retrieval Stage\n",
    "\n",
    "The primary objective of employing pre-retrieval techniques is to facilitate better retrieval. Retrieval failures can happen because of 2 reasons.\n",
    "    \n",
    "- Knowledge Base is not suited for retrieval\n",
    "    \n",
    "- Retriever doesn’t completely understand the input query"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1.1 INDEX OPTIMIZATION\n",
    "\n",
    "The objective of index Optimization is to set up the knowledge base for better retrieval. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Context Enriched Chunking\n",
    "\n",
    "This method adds the summary of the larger document to each chunk to enrich the context of the smaller chunk"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Import FAISS class from vectorstore library\n",
    "from langchain_community.vectorstores import FAISS\n",
    "\n",
    "# Import OpenAIEmbeddings from the library\n",
    "from langchain_openai import OpenAIEmbeddings\n",
    "\n",
    "# Instantiate the embeddings object\n",
    "embeddings=OpenAIEmbeddings(model=\"text-embedding-3-large\")\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "from langchain_community.document_loaders import AsyncHtmlLoader\n",
    "from langchain_community.document_transformers import Html2TextTransformer"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [],
   "source": [
    "url=\"https://en.wikipedia.org/wiki/2023_Cricket_World_Cup\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Fetching pages: 100%|##########| 1/1 [00:00<00:00,  2.10it/s]\n"
     ]
    }
   ],
   "source": [
    "loader = AsyncHtmlLoader (url)\n",
    "data = loader.load()\n",
    "html2text = Html2TextTransformer()\n",
    "data_transformed = html2text.transform_documents(data)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [],
   "source": [
    "document_text=data_transformed[0].page_content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [],
   "source": [
    "summary_prompt = f\"Summarize the given document in a single paragraph\\ndocument: {document_text}\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The 2023 ICC Men's Cricket World Cup, held from October 5 to November 19, 2023,\n",
      "in India, was the tournament's 13th edition, featuring ten teams competing in a\n",
      "round-robin and knockout format. Australia emerged victorious, claiming their\n",
      "sixth title by defeating India in the final. Virat Kohli was crowned Player of\n",
      "the Tournament and top scorer with 765 runs, while Mohammed Shami led in wickets\n",
      "taken with 24. The tournament saw a record attendance of 1,250,307 fans, with\n",
      "the final viewed by 518 million people in India. This World Cup was noted for\n",
      "being the first to be solely hosted by India and included new rules for slow\n",
      "over-rates and enhanced broadcast features.\n"
     ]
    }
   ],
   "source": [
    "# Importing the OpenAI library\n",
    "from openai import OpenAI\n",
    "\n",
    "# Instantiate the OpenAI client\n",
    "client = OpenAI()\n",
    "\n",
    "# Make the API call passing the augmented prompt to the LLM\n",
    "response = client.chat.completions.create(\n",
    "  model=\"gpt-4o-mini\",\n",
    "  messages=\t[\n",
    "    {\"role\": \"user\", \"content\": summary_prompt}\n",
    "  \t\t]\n",
    ")\n",
    "\n",
    "# Extract the answer from the response object\n",
    "answer=response.choices[0].message.content\n",
    "\n",
    "import textwrap\n",
    "print(textwrap.fill(answer, width=80))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [],
   "source": [
    "from langchain_text_splitters import RecursiveCharacterTextSplitter\n",
    "#Set the CharacterTextSplitter parameters\n",
    "text_splitter = RecursiveCharacterTextSplitter(\n",
    "chunk_size=1000, #Number of characters in each chunk \n",
    "chunk_overlap=200, #Number of overlapping characters between chunks\n",
    ")\n",
    "#Create Chunks\n",
    "chunks=text_splitter.split_text(data_transformed[0].page_content)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [],
   "source": [
    "context_enriched_chunks = [answer + \"\\n\" + chunk for chunk in chunks]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [],
   "source": [
    "embedding = OpenAIEmbeddings(openai_api_key=api_key)\n",
    "vector_store = FAISS.from_texts(context_enriched_chunks, embedding)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [],
   "source": [
    "query = \"What records did Virat Kohli make?\"\n",
    "retrieved_docs = vector_store.similarity_search(query, k=2)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The 2023 ICC Men's Cricket World Cup, hosted solely by India from October 5 to November 19, was the 13th edition of this prestigious tournament, featuring ten national teams in a One Day International format. Australia emerged victorious, claiming their sixth title by defeating India by six wickets in the final held at the Narendra Modi Stadium in Ahmedabad. Virat Kohli was named Player of the Tournament, scoring the most runs (765) and Mohammed Shami led in wickets taken (24). The tournament featured 48 matches across ten venues and set attendance and viewership records, with over 1.25 million people attending, and 518 million viewers tuning into the final match in India. The event marked a significant moment in cricket, showcasing competitive matches and new broadcasting innovations, contributing to a successful and highly viewed World Cup.\n",
      "The tournament was contested by ten national teams, maintaining the same\n",
      "format used in 2019. After six weeks of round-robin matches, India, South\n",
      "Africa, Australia, and New Zealand finished as the top four and qualified for\n",
      "the knockout stage. In the knockout stage, India and Australia beat New\n",
      "Zealand and South Africa, respectively, to advance to the final, played on 19\n",
      "November at the Narendra Modi Stadium in Ahmedabad. Australia won the final by\n",
      "six wickets, winning their sixth Cricket World Cup title.\n",
      "\n",
      "Virat Kohli was named the player of the tournament and also scored the most\n",
      "runs, while Mohammed Shami was the leading wicket-taker. A total of 1,250,307\n",
      "spectators attended the matches, the highest number in any Cricket World Cup\n",
      "to date.[1] The tournament final set viewership records in India, drawing 518\n",
      "million viewers, with a peak of 57 million streaming viewers.\n",
      "\n",
      "## Background\n"
     ]
    }
   ],
   "source": [
    "print(retrieved_docs[0].page_content)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Metadata Enhancement\n",
    "\n",
    "This method adds the summary of the larger document to each chunk to enrich the context of the smaller chunk"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 125,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Fetching pages: 100%|##########| 1/1 [00:00<00:00,  1.45it/s]\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"player_1\": \"Virat Kohli\",\n",
      "  \"player_2\": \"Mohammed Shami\",\n",
      "  \"player_3\": \"Wesley Barresi\",\n",
      "  \"player_4\": \"Noor Ahmad\",\n",
      "  \"player_5\": \"\",\n",
      "  \"team_1\": \"India\",\n",
      "  \"team_2\": \"Australia\",\n",
      "  \"team_3\": \"New Zealand\",\n",
      "  \"team_4\": \"South Africa\",\n",
      "  \"team_5\": \"Afghanistan\",\n",
      "  \"keyword_1\": \"ICC\",\n",
      "  \"keyword_2\": \"Cricket World Cup\",\n",
      "  \"keyword_3\": \"One Day International\",\n",
      "  \"keyword_4\": \"2023\",\n",
      "  \"keyword_5\": \"hosts\"\n",
      "}\n",
      "{\n",
      "  \"player_1\": \"Pathum Nissanka\",\n",
      "  \"player_2\": \"Tanzid Hasan\",\n",
      "  \"player_3\": \"Mohammad Rizwan\",\n",
      "  \"player_4\": \"Rachin Ravindra\",\n",
      "  \"player_5\": \"Kusal Mendis\",\n",
      "  \"team_1\": \"Sri Lanka\",\n",
      "  \"team_2\": \"Bangladesh\",\n",
      "  \"team_3\": \"Pakistan\",\n",
      "  \"team_4\": \"New Zealand\",\n",
      "  \"team_5\": \"Afghanistan\",\n",
      "  \"keyword_1\": \"Warm-up matches\",\n",
      "  \"keyword_2\": \"2023\",\n",
      "  \"keyword_3\": \"Cricket World Cup\",\n",
      "  \"keyword_4\": \"Hyderabad\",\n",
      "  \"keyword_5\": \"Guwahati\"\n",
      "}\n",
      "{\n",
      "  \"player_1\": \"\",\n",
      "  \"player_2\": \"\",\n",
      "  \"player_3\": \"\",\n",
      "  \"player_4\": \"\",\n",
      "  \"player_5\": \"\",\n",
      "  \"team_1\": \"England\",\n",
      "  \"team_2\": \"New Zealand\",\n",
      "  \"team_3\": \"Pakistan\",\n",
      "  \"team_4\": \"Netherlands\",\n",
      "  \"team_5\": \"Afghanistan\",\n",
      "  \"keyword_1\": \"World Cup\",\n",
      "  \"keyword_2\": \"2023\",\n",
      "  \"keyword_3\": \"cricket\",\n",
      "  \"keyword_4\": \"knockout\",\n",
      "  \"keyword_5\": \"\"\n",
      "}\n",
      "{\n",
      "  \"player_1\": \"Virat Kohli\",\n",
      "  \"player_2\": \"Rohit Sharma\",\n",
      "  \"player_3\": \"Quinton de Kock\",\n",
      "  \"player_4\": \"Daryl Mitchell\",\n",
      "  \"player_5\": \"Mohammed Shami\",\n",
      "  \"team_1\": \"India\",\n",
      "  \"team_2\": \"Australia\",\n",
      "  \"team_3\": \"South Africa\",\n",
      "  \"team_4\": \"New Zealand\",\n",
      "  \"team_5\": \"Pakistan\",\n",
      "  \"keyword_1\": \"World Cup\",\n",
      "  \"keyword_2\": \"semi-finals\",\n",
      "  \"keyword_3\": \"final\",\n",
      "  \"keyword_4\": \"trophy\",\n",
      "  \"keyword_5\": \"broadcasting\"\n",
      "}\n",
      "{\n",
      "  \"player_1\": \"\",\n",
      "  \"player_2\": \"\",\n",
      "  \"player_3\": \"\",\n",
      "  \"player_4\": \"\",\n",
      "  \"player_5\": \"\",\n",
      "  \"team_1\": \"India\",\n",
      "  \"team_2\": \"Pakistan\",\n",
      "  \"team_3\": \"Netherlands\",\n",
      "  \"team_4\": \"Sri Lanka\",\n",
      "  \"team_5\": \"West Indies\",\n",
      "  \"keyword_1\": \"2023 World Cup\",\n",
      "  \"keyword_2\": \"ODI\",\n",
      "  \"keyword_3\": \"ICC\",\n",
      "  \"keyword_4\": \"champions\",\n",
      "  \"keyword_5\": \"viewership\"\n",
      "}\n",
      "{\n",
      "  \"player_1\": \"\",\n",
      "  \"player_2\": \"\",\n",
      "  \"player_3\": \"\",\n",
      "  \"player_4\": \"\",\n",
      "  \"player_5\": \"\",\n",
      "  \"team_1\": \"\",\n",
      "  \"team_2\": \"\",\n",
      "  \"team_3\": \"\",\n",
      "  \"team_4\": \"\",\n",
      "  \"team_5\": \"\",\n",
      "  \"keyword_1\": \"ICC\",\n",
      "  \"keyword_2\": \"World Cup 2023\",\n",
      "  \"keyword_3\": \"Broadcast\",\n",
      "  \"keyword_4\": \"Digital records\",\n",
      "  \"keyword_5\": \"Squads\"\n",
      "}\n",
      "{\n",
      "  \"player_1\": \"\",\n",
      "  \"player_2\": \"\",\n",
      "  \"player_3\": \"\",\n",
      "  \"player_4\": \"\",\n",
      "  \"player_5\": \"\",\n",
      "  \"team_1\": \"India\",\n",
      "  \"team_2\": \"Afghanistan\",\n",
      "  \"team_3\": \"Australia\",\n",
      "  \"team_4\": \"Bangladesh\",\n",
      "  \"team_5\": \"England\",\n",
      "  \"keyword_1\": \"Cricket World Cup\",\n",
      "  \"keyword_2\": \"2023\",\n",
      "  \"keyword_3\": \"International Cricket Council\",\n",
      "  \"keyword_4\": \"Tournament\",\n",
      "  \"keyword_5\": \"Super League\"\n",
      "}\n",
      "Document: ### Results\n",
      "\n",
      "The ICC released the fixture details on 27 June 2023.[30]\n",
      "\n",
      "5 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**England **  \n",
      "282/9 (50 overs) | **v** | **New Zealand**  \n",
      "283/1 (36.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**New Zealand won by 9 wickets**  \n",
      "Narendra Modi Stadium, Ahmedabad  \n",
      "---  \n",
      "  \n",
      "6 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Pakistan **  \n",
      "286 (49 overs) | **v** | **Netherlands**  \n",
      "205 (41 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Pakistan won by 81 runs**  \n",
      "Rajiv Gandhi International Stadium, Hyderabad  \n",
      "---  \n",
      "  \n",
      "7 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Afghanistan **  \n",
      "156 (37.2 overs) | **v** | **Bangladesh**  \n",
      "158/4 (34.4 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Bangladesh won by 6 wickets**  \n",
      "HPCA Stadium, Dharamshala  \n",
      "---  \n",
      "  \n",
      "7 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**South Africa **  \n",
      "428/5 (50 overs) | **v** | **Sri Lanka**  \n",
      "326 (44.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 102 runs**  \n",
      "Arun Jaitley Stadium, Delhi  \n",
      "---  \n",
      "  \n",
      "8 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "199 (49.3 overs) | **v** | **India**  \n",
      "201/4 (41.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 6 wickets**  \n",
      "M. A. Chidambaram Stadium, Chennai  \n",
      "---  \n",
      "  \n",
      "9 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**New Zealand **  \n",
      "322/7 (50 overs) | **v** | **Netherlands**  \n",
      "223 (46.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**New Zealand won by 99 runs**  \n",
      "Rajiv Gandhi International Stadium, Hyderabad  \n",
      "---  \n",
      "  \n",
      "10 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**England **  \n",
      "364/9 (50 overs) | **v** | **Bangladesh**  \n",
      "227 (48.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**England won by 137 runs**  \n",
      "HPCA Stadium, Dharamshala  \n",
      "---  \n",
      "  \n",
      "10 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "344/9 (50 overs) | **v** | **Pakistan**  \n",
      "345/4 (48.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Pakistan won by 6 wickets**  \n",
      "Rajiv Gandhi International Stadium, Hyderabad  \n",
      "---  \n",
      "  \n",
      "11 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Afghanistan **  \n",
      "272/8 (50 overs) | **v** | **India**  \n",
      "273/2 (35 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 8 wickets**  \n",
      "Arun Jaitley Stadium, Delhi  \n",
      "---  \n",
      "  \n",
      "12 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**South Africa **  \n",
      "311/7 (50 overs) | **v** | **Australia**  \n",
      "177 (40.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 134 runs**  \n",
      "BRSABV Ekana Cricket Stadium, Lucknow  \n",
      "---  \n",
      "  \n",
      "13 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Bangladesh **  \n",
      "245/9 (50 overs) | **v** | **New Zealand**  \n",
      "248/2 (42.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**New Zealand won by 8 wickets**  \n",
      "M. A. Chidambaram Stadium, Chennai  \n",
      "---  \n",
      "  \n",
      "14 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Pakistan **  \n",
      "191 (42.5 overs) | **v** | **India**  \n",
      "192/3 (30.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 7 wickets**  \n",
      "Narendra Modi Stadium, Ahmedabad  \n",
      "---  \n",
      "  \n",
      "15 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Afghanistan **  \n",
      "284 (49.5 overs) | **v** | **England**  \n",
      "215 (40.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Afghanistan won by 69 runs**  \n",
      "Arun Jaitley Stadium, Delhi  \n",
      "---  \n",
      "  \n",
      "16 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "209 (43.3 overs) | **v** | **Australia**  \n",
      "215/5 (35.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 5 wickets**  \n",
      "BRSABV Ekana Cricket Stadium, Lucknow  \n",
      "---  \n",
      "  \n",
      "17 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Netherlands **  \n",
      "245/8 (43 overs) | **v** | **South Africa**  \n",
      "207 (42.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Netherlands won by 38 runs**  \n",
      "HPCA Stadium, Dharamshala  \n",
      "---  \n",
      "  \n",
      "18 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**New Zealand **  \n",
      "288/6 (50 overs) | **v** | **Afghanistan**  \n",
      "139 (34.4 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**New Zealand won by 149 runs**  \n",
      "M. A. Chidambaram Stadium, Chennai  \n",
      "---  \n",
      "  \n",
      "19 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Bangladesh **  \n",
      "256/8 (50 overs) | **v** | **India**  \n",
      "261/3 (41.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 7 wickets**  \n",
      "Maharashtra Cricket Association Stadium, Pune  \n",
      "---  \n",
      "  \n",
      "20 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "367/9 (50 overs) | **v** | **Pakistan**  \n",
      "305 (45.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 62 runs**  \n",
      "M. Chinnaswamy Stadium, Bangalore  \n",
      "---  \n",
      "  \n",
      "21 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Netherlands **  \n",
      "262 (49.4 overs) | **v** | **Sri Lanka**  \n",
      "263/5 (48.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Sri Lanka won by 5 wickets**  \n",
      "BRSABV Ekana Cricket Stadium, Lucknow  \n",
      "---  \n",
      "  \n",
      "21 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**South Africa **  \n",
      "399/7 (50 overs) | **v** | **England**  \n",
      "170 (22 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 229 runs**  \n",
      "Wankhede Stadium, Mumbai  \n",
      "---  \n",
      "  \n",
      "22 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**New Zealand **  \n",
      "273 (50 overs) | **v** | **India**  \n",
      "274/6 (48 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 4 wickets**  \n",
      "HPCA Stadium, Dharamshala  \n",
      "---  \n",
      "  \n",
      "23 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Pakistan **  \n",
      "282/7 (50 overs) | **v** | **Afghanistan**  \n",
      "286/2 (49 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Afghanistan won by 8 wickets**  \n",
      "M. A. Chidambaram Stadium, Chennai  \n",
      "---  \n",
      "  \n",
      "24 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**South Africa **  \n",
      "382/5 (50 overs) | **v** | **Bangladesh**  \n",
      "233 (46.4 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 149 runs**  \n",
      "Wankhede Stadium, Mumbai  \n",
      "---  \n",
      "  \n",
      "25 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "399/8 (50 overs) | **v** | **Netherlands**  \n",
      "90 (21 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 309 runs**  \n",
      "Arun Jaitley Stadium, Delhi  \n",
      "---  \n",
      "  \n",
      "26 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**England **  \n",
      "156 (33.2 overs) | **v** | **Sri Lanka**  \n",
      "160/2 (25.4 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Sri Lanka won by 8 wickets**  \n",
      "M. Chinnaswamy Stadium, Bangalore  \n",
      "---  \n",
      "  \n",
      "27 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Pakistan **  \n",
      "270 (46.4 overs) | **v** | **South Africa**  \n",
      "271/9 (47.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 1 wicket**  \n",
      "M. A. Chidambaram Stadium, Chennai  \n",
      "---  \n",
      "  \n",
      "28 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "388 (49.2 overs) | **v** | **New Zealand**  \n",
      "383/9 (50 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 5 runs**  \n",
      "HPCA Stadium, Dharamshala  \n",
      "---  \n",
      "  \n",
      "28 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Netherlands **  \n",
      "229 (50 overs) | **v** | **Bangladesh**  \n",
      "142 (42.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Netherlands won by 87 runs**  \n",
      "Eden Gardens, Kolkata  \n",
      "---  \n",
      "  \n",
      "29 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "229/9 (50 overs) | **v** | **England**  \n",
      "129 (34.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 100 runs**  \n",
      "BRSABV Ekana Cricket Stadium, Lucknow  \n",
      "---  \n",
      "  \n",
      "30 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "241 (49.3 overs) | **v** | **Afghanistan**  \n",
      "242/3 (45.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Afghanistan won by 7 wickets**  \n",
      "Maharashtra Cricket Association Stadium, Pune  \n",
      "---  \n",
      "  \n",
      "31 October 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Bangladesh **  \n",
      "204 (45.1 overs) | **v** | **Pakistan**  \n",
      "205/3 (32.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Pakistan won by 7 wickets**  \n",
      "Eden Gardens, Kolkata  \n",
      "---  \n",
      "  \n",
      "1 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**South Africa **  \n",
      "357/4 (50 overs) | **v** | **New Zealand**  \n",
      "167 (35.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 190 runs**  \n",
      "Maharashtra Cricket Association Stadium, Pune  \n",
      "---  \n",
      "  \n",
      "2 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "357/8 (50 overs) | **v** | **Sri Lanka**  \n",
      "55 (19.4 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 302 runs**  \n",
      "Wankhede Stadium, Mumbai  \n",
      "---  \n",
      "  \n",
      "3 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Netherlands **  \n",
      "179 (46.3 overs) | **v** | **Afghanistan**  \n",
      "181/3 (31.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Afghanistan won by 7 wickets**  \n",
      "BRSABV Ekana Cricket Stadium, Lucknow  \n",
      "---  \n",
      "  \n",
      "4 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**New Zealand **  \n",
      "401/6 (50 overs) | **v** | **Pakistan**  \n",
      "200/1 (25.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Pakistan won by 21 runs (DLS method)**  \n",
      "M. Chinnaswamy Stadium, Bangalore  \n",
      "---  \n",
      "  \n",
      "4 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "286 (49.3 overs) | **v** | **England**  \n",
      "253 (48.1 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 33 runs**  \n",
      "Narendra Modi Stadium, Ahmedabad  \n",
      "---  \n",
      "  \n",
      "5 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "326/5 (50 overs) | **v** | **South Africa**  \n",
      "83 (27.1 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 243 runs**  \n",
      "Eden Gardens, Kolkata  \n",
      "---  \n",
      "  \n",
      "6 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "279 (49.3 overs) | **v** | **Bangladesh**  \n",
      "282/7 (41.1 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Bangladesh won by 3 wickets**  \n",
      "Arun Jaitley Stadium, Delhi  \n",
      "---  \n",
      "  \n",
      "7 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Afghanistan **  \n",
      "291/5 (50 overs) | **v** | **Australia**  \n",
      "293/7 (46.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 3 wickets**  \n",
      "Wankhede Stadium, Mumbai  \n",
      "---  \n",
      "  \n",
      "8 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**England **  \n",
      "339/9 (50 overs) | **v** | **Netherlands**  \n",
      "179 (37.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**England won by 160 runs**  \n",
      "Maharashtra Cricket Association Stadium, Pune  \n",
      "---  \n",
      "  \n",
      "9 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "171 (46.4 overs) | **v** | **New Zealand**  \n",
      "172/5 (23.2 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**New Zealand won by 5 wickets**  \n",
      "M. Chinnaswamy Stadium, Bangalore  \n",
      "---  \n",
      "  \n",
      "10 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Afghanistan **  \n",
      "244 (50 overs) | **v** | **South Africa**  \n",
      "247/5 (47.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**South Africa won by 5 wickets**  \n",
      "Narendra Modi Stadium, Ahmedabad  \n",
      "---  \n",
      "  \n",
      "11 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**Bangladesh **  \n",
      "306/8 (50 overs) | **v** | **Australia**  \n",
      "307/2 (44.4 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 8 wickets**  \n",
      "Maharashtra Cricket Association Stadium, Pune  \n",
      "---  \n",
      "  \n",
      "11 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**England **  \n",
      "337/9 (50 overs) | **v** | **Pakistan**  \n",
      "244 (43.3 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**England won by 93 runs**  \n",
      "Eden Gardens, Kolkata  \n",
      "---  \n",
      "  \n",
      "12 November 2023  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "410/4 (50 overs) | **v** | **Netherlands**  \n",
      "250 (47.5 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**India won by 160 runs**  \n",
      "M. Chinnaswamy Stadium, Bangalore  \n",
      "---  \n",
      "  \n",
      "## Knockout stage\n",
      "\n",
      "Main article: 2023 Cricket World Cup knockout stage\n",
      "Metadata: {'source': 'https://en.wikipedia.org/wiki/2023_Cricket_World_Cup', 'category': 'cricket world cup', 'extracted_metadata': {'player_1': '', 'player_2': '', 'player_3': '', 'player_4': '', 'player_5': '', 'team_1': 'England', 'team_2': 'New Zealand', 'team_3': 'Pakistan', 'team_4': 'Netherlands', 'team_5': 'Afghanistan', 'keyword_1': 'World Cup', 'keyword_2': '2023', 'keyword_3': 'cricket', 'keyword_4': 'knockout', 'keyword_5': ''}}\n",
      "Document: ## External links\n",
      "\n",
      "  * Official website\n",
      "  * Tournament – home at ESPNcricinfo\n",
      "\n",
      "Portals:\n",
      "\n",
      "  * Australia\n",
      "  * India\n",
      "  * Cricket\n",
      "  * Sports\n",
      "  * World\n",
      "\n",
      "  * v\n",
      "  * t\n",
      "  * e\n",
      "\n",
      "2023 Cricket World Cup  \n",
      "---  \n",
      "  \n",
      "  * International Cricket Council\n",
      "  * Cricket World Cup\n",
      "  * International cricket in 2023–24\n",
      "  * 2023 in sports\n",
      "\n",
      "  \n",
      "Stages|\n",
      "\n",
      "  * Warm-up matches\n",
      "  * Group stage\n",
      "  * Knockout stage\n",
      "  * Final\n",
      "\n",
      "  \n",
      "Qualifying|\n",
      "\n",
      "  * CWC Super League\n",
      "  * CWC Qualifier\n",
      "    * CWC Qualifier Play-off\n",
      "    * CWC League 2\n",
      "    * CWC Challenge League\n",
      "\n",
      "  \n",
      "Teams| | Host| \n",
      "\n",
      "  * India\n",
      "\n",
      "  \n",
      "---|---  \n",
      "Super League|\n",
      "\n",
      "  * Afghanistan\n",
      "  * Australia\n",
      "  * Bangladesh\n",
      "  * England\n",
      "  * New Zealand\n",
      "  * Pakistan\n",
      "  * South Africa\n",
      "\n",
      "  \n",
      "CWC Qualifier|\n",
      "\n",
      "  * Sri Lanka\n",
      "  * Netherlands\n",
      "\n",
      "  \n",
      "  \n",
      "Grounds| | Warm-up| \n",
      "\n",
      "  * Guwahati\n",
      "  * Hyderabad\n",
      "  * Thiruvananthapuram\n",
      "\n",
      "  \n",
      "---|---  \n",
      "Tournament|\n",
      "\n",
      "  * Ahmedabad\n",
      "  * Kolkata\n",
      "  * Mumbai\n",
      "  * Hyderabad\n",
      "  * Chennai\n",
      "  * Lucknow\n",
      "  * Delhi\n",
      "  * Bangalore\n",
      "  * Pune\n",
      "  * Dharamshala\n",
      "\n",
      "  \n",
      "  \n",
      "Information|\n",
      "\n",
      "  * Squads\n",
      "  * Statistics\n",
      "  * Officials\n",
      "\n",
      "  \n",
      "2019 Cricket World Cup 2027 Cricket World Cup  \n",
      "  \n",
      "  * v\n",
      "  * t\n",
      "  * e\n",
      "\n",
      "Cricket World Cup  \n",
      "---  \n",
      "International Cricket Council  \n",
      "Tournaments|\n",
      "\n",
      "  * England 1975\n",
      "  * England 1979\n",
      "  * England / Wales 1983\n",
      "  * India / Pakistan 1987\n",
      "  * Australia / New Zealand 1992\n",
      "  * Pakistan / India / Sri Lanka 1996\n",
      "  * England / Scotland / Wales / Ireland / Netherlands 1999\n",
      "  * South Africa / Zimbabwe / Kenya 2003\n",
      "  * West Indies 2007\n",
      "  * India / Sri Lanka / Bangladesh 2011\n",
      "  * Australia / New Zealand 2015\n",
      "  * England / Wales 2019\n",
      "  * India 2023\n",
      "  * _South Africa / Zimbabwe / Namibia 2027_\n",
      "\n",
      "  \n",
      "Finals|\n",
      "\n",
      "  * 1975\n",
      "  * 1979\n",
      "  * 1983\n",
      "  * 1987\n",
      "  * 1992\n",
      "  * 1996\n",
      "  * 1999\n",
      "  * 2003\n",
      "  * 2007\n",
      "  * 2011\n",
      "  * 2015\n",
      "  * 2019\n",
      "  * 2023\n",
      "\n",
      "  \n",
      "Squads|\n",
      "\n",
      "  * 1975\n",
      "  * 1979\n",
      "  * 1983\n",
      "  * 1987\n",
      "  * 1992\n",
      "  * 1996\n",
      "  * 1999\n",
      "  * 2003\n",
      "  * 2007\n",
      "  * 2011\n",
      "  * 2015\n",
      "  * 2019\n",
      "  * 2023\n",
      "\n",
      "  \n",
      "Statistics|\n",
      "\n",
      "  * 1975\n",
      "  * 1979\n",
      "  * 1983\n",
      "  * 1987\n",
      "  * 1992\n",
      "  * 1996\n",
      "  * 1999\n",
      "  * 2003\n",
      "  * 2007\n",
      "  * 2011\n",
      "  * 2015\n",
      "  * 2019\n",
      "  * 2023\n",
      "\n",
      "  \n",
      "Qualification|\n",
      "\n",
      "  * 1975\n",
      "  * 1979\n",
      "  * 1983\n",
      "  * 1987\n",
      "  * 1992\n",
      "  * 1996\n",
      "  * 1999\n",
      "  * 2003\n",
      "  * 2007\n",
      "  * 2011\n",
      "  * 2015\n",
      "  * 2019\n",
      "  * 2023\n",
      "  * 2027\n",
      "\n",
      "  \n",
      "  \n",
      "  * Awards\n",
      "  * Format\n",
      "  * History\n",
      "  * Records\n",
      "  * Centuries\n",
      "  * Five-wicket hauls\n",
      "  * Teams\n",
      "  * Trophy\n",
      "\n",
      "  \n",
      "  \n",
      "  * v\n",
      "  * t\n",
      "  * e\n",
      "\n",
      "International cricket in 2023–24  \n",
      "---  \n",
      "Preceding season: International cricket in 2023  \n",
      "September 2023|\n",
      "\n",
      "  * Asian Games\n",
      "    * M\n",
      "    * W\n",
      "  * New Zealand in Bangladesh\n",
      "  * Australia in India\n",
      "  * New Zealand women in South Africa\n",
      "  * Namibia women in the UAE\n",
      "  * Men's T20 World Cup Asia Qualifier A\n",
      "  * Estonia in Gibraltar\n",
      "  * Men's T20 World Cup Americas Qualifier\n",
      "\n",
      "  \n",
      "October 2023|\n",
      "\n",
      "  * West Indies women in Australia\n",
      "  * West Africa Trophy\n",
      "  * Cricket World Cup\n",
      "  * Serbia in Gibraltar\n",
      "  * Chile women in Argentina\n",
      "  * Luxembourg in Gibraltar\n",
      "  * Ireland women against Scotland in Spain\n",
      "  * Nepal Tri-Nation Series\n",
      "  * Men's South American Championship\n",
      "  * Zimbabwe in Namibia\n",
      "  * Pakistan women in Bangladesh\n",
      "  * Men's T20 World Cup Asia Qualifier\n",
      "\n",
      "  \n",
      "November 2023|\n",
      "\n",
      "  * Hong Kong Women's Quadrangular Series\n",
      "  * Cambodia in Indonesia\n",
      "  * Men's T20 World Cup Africa Qualifier\n",
      "\n",
      "  \n",
      "December 2023|\n",
      "\n",
      "  * Pakistan women in New Zealand\n",
      "  * Bangladesh women in South Africa\n",
      "  * England in the West Indies\n",
      "  * England women in India\n",
      "  * ACA Cup North-West/East Qualifier\n",
      "  * Ireland in Zimbabwe\n",
      "  * Women's T20 World Cup Africa Division One\n",
      "  * India in South Africa\n",
      "  * ACA Africa T20 Cup\n",
      "  * Pakistan in Australia\n",
      "  * Bangladesh in New Zealand\n",
      "  * Australia women in India\n",
      "  * Philippines in Indonesia\n",
      "  * Afghanistan in the UAE\n",
      "  * Singapore women in Philippines\n",
      "\n",
      "  \n",
      "January 2024|\n",
      "\n",
      "  * Zimbabwe in Sri Lanka\n",
      "  * Afghanistan in India\n",
      "  * Pakistan in New Zealand\n",
      "  * Women's Pacific Cup\n",
      "  * West Indies in Australia\n",
      "  * Ireland women in Zimbabwe\n",
      "  * England in India\n",
      "  * South Africa women in Australia\n",
      "  * ACC Men's Challenger Cup\n",
      "\n",
      "  \n",
      "February 2024|\n",
      "\n",
      "  * Afghanistan in Sri Lanka\n",
      "  * South Africa in New Zealand\n",
      "  * Kuwait women in Malaysia\n",
      "  * Canada in Nepal\n",
      "  * ACC Women's Premier Cup\n",
      "  * Thailand Quadrangular Series\n",
      "  * East Asia Cup\n",
      "  * Nepal Tri-Nation Series\n",
      "  * Australia in New Zealand\n",
      "  * CWC Challenge League Play-off\n",
      "  * Nigeria Invitational\n",
      "  * Hong Kong in Qatar\n",
      "  * Ireland v Afghanistan in the UAE\n",
      "  * UAE Tri-Nation Series\n",
      "\n",
      "  \n",
      "March 2024|\n",
      "\n",
      "  * Sri Lanka in Bangladesh\n",
      "  * Malaysia Open Championship\n",
      "  * PNG in Oman\n",
      "  * African Games\n",
      "    * M\n",
      "    * W\n",
      "  * Hong Kong Tri-Nation Series\n",
      "  * Scotland in the UAE\n",
      "  * PNG in Malaysia\n",
      "  * England women in New Zealand\n",
      "  * Australia women in Bangladesh\n",
      "  * PNG women in Zimbabwe\n",
      "  * Sri Lanka women in South Africa\n",
      "  * Lesotho in Eswatini\n",
      "\n",
      "  \n",
      "Ongoing|\n",
      "\n",
      "  * World Test Championship\n",
      "  * Women's Championship\n",
      "  * Cricket World Cup League 2\n",
      "  * Associate T20I cricket\n",
      "\n",
      "  \n",
      "Following Season: International cricket in 2024  \n",
      "  \n",
      "  * v\n",
      "  * t\n",
      "  * e\n",
      "\n",
      "World championships in 2023  \n",
      "---  \n",
      "Summer sports &  \n",
      "indoor sports|\n",
      "\n",
      "  * Archery\n",
      "  * Association football (women)\n",
      "  * Aquatics\n",
      "    * artistic swimming\n",
      "    * diving\n",
      "    * open water swimming\n",
      "    * swimming\n",
      "    * water polo\n",
      "  * Athletics \n",
      "    * cross country\n",
      "    * ~~indoor~~\n",
      "    * masters\n",
      "    * outdoor\n",
      "    * road running\n",
      "  * Badminton \n",
      "    * individual\n",
      "    * mixed team\n",
      "  * Baseball (men)\n",
      "  * Basketball \n",
      "    * men\n",
      "    * 3x3\n",
      "  * Beach soccer (men)\n",
      "  * Beach volleyball\n",
      "  * Bowls \n",
      "    * outdoor\n",
      "    * indoor WBT\n",
      "    * indoor WB/IIBC\n",
      "  * Boxing \n",
      "    * men\n",
      "    * women\n",
      "  * Breaking\n",
      "  * Canoeing \n",
      "    * slalom\n",
      "    * sprint\n",
      "    * marathon\n",
      "  * Climbing\n",
      "  * Cricket \n",
      "    * Test\n",
      "    * ODI\n",
      "    * women T20\n",
      "  * Cycling\n",
      "    * road\n",
      "    * track\n",
      "  * Fencing\n",
      "  * Field hockey (men)\n",
      "  * Gymnastics \n",
      "    * artistic\n",
      "    * rhythmic\n",
      "  * Handball \n",
      "    * men\n",
      "    * women\n",
      "  * Indoor hockey \n",
      "    * men\n",
      "    * women\n",
      "  * Judo\n",
      "  * Karate\n",
      "  * Korfball\n",
      "  * Lacrosse (men)\n",
      "  * Minifootball\n",
      "  * Modern pentathlon\n",
      "  * Netball\n",
      "  * Nine-pin bowling\n",
      "  * Orienteering\n",
      "  * Real Tennis \n",
      "    * men\n",
      "    * women\n",
      "  * Rowing\n",
      "  * Rugby union (men)\n",
      "  * Sailing\n",
      "  * Shooting\n",
      "  * Sitting Volleyball \n",
      "    * Men\n",
      "    * Women\n",
      "  * Socca\n",
      "  * Squash \n",
      "    * men\n",
      "    * women\n",
      "  * Surfing\n",
      "  * Table tennis\n",
      "  * Taekwondo\n",
      "  * Weightlifting\n",
      "  * Wrestling\n",
      "  * Wushu\n",
      "\n",
      "  \n",
      "Winter sports|\n",
      "\n",
      "  * Alpine skiing\n",
      "  * Bandy \n",
      "    * men\n",
      "    * women\n",
      "  * Biathlon\n",
      "  * Bobsleigh / Skeleton\n",
      "  * Curling \n",
      "    * men\n",
      "    * women\n",
      "    * mixed doubles\n",
      "  * Figure skating\n",
      "  * Freestyle skiing\n",
      "  * Ice hockey \n",
      "    * men\n",
      "    * women\n",
      "  * Luge\n",
      "  * Nordic skiing\n",
      "  * Ski mountaineering\n",
      "  * Snowboarding\n",
      "  * Speed skating \n",
      "    * single distances\n",
      "    * short track\n",
      "\n",
      "  \n",
      "Cue & mind sports|\n",
      "\n",
      "  * Chess \n",
      "    * open\n",
      "    * women\n",
      "  * Draughts \n",
      "    * open\n",
      "    * women\n",
      "  * Darts \n",
      "    * PDC\n",
      "    * WDF\n",
      "  * Snooker \n",
      "    * open\n",
      "    * women\n",
      "\n",
      "  \n",
      "Motor sports|\n",
      "\n",
      "  * Air Sports \n",
      "    * F3P\n",
      "  * Endurance auto racing\n",
      "  * Endurance moto racing\n",
      "  * Enduro\n",
      "  * Formula E\n",
      "  * Formula One\n",
      "  * Motocross \n",
      "    * men\n",
      "    * women\n",
      "    * team\n",
      "  * MotoGP\n",
      "    * Moto2\n",
      "    * Moto3\n",
      "    * MotoE\n",
      "  * Rally\n",
      "  * Rallycross\n",
      "  * Rally raid\n",
      "    * FIA Bajas\n",
      "    * FIM Bajas\n",
      "  * Sidecarcross\n",
      "  * Speedway \n",
      "    * individual\n",
      "    * team\n",
      "    * longtrack\n",
      "  * Superbike\n",
      "    * Supersport\n",
      "    * Supersport 300\n",
      "  * Supercross\n",
      "\n",
      "  \n",
      "  \n",
      "Retrieved from\n",
      "\"https://en.wikipedia.org/w/index.php?title=2023_Cricket_World_Cup&oldid=1247277257\"\n",
      "\n",
      "Categories:\n",
      "\n",
      "  * 2023 Cricket World Cup\n",
      "  * 2023 in Indian sport\n",
      "  * 2023 in cricket\n",
      "  * International cricket competitions in India\n",
      "  * Cricket events postponed due to the COVID-19 pandemic\n",
      "  * October 2023 sports events in India\n",
      "  * November 2023 sports events in India\n",
      "\n",
      "Hidden categories:\n",
      "\n",
      "  * Articles with short description\n",
      "  * Short description is different from Wikidata\n",
      "  * Wikipedia extended-confirmed-protected pages\n",
      "  * Use dmy dates from July 2023\n",
      "  * Articles with excerpts\n",
      "\n",
      "  * This page was last edited on 23 September 2024, at 16:21 (UTC).\n",
      "  * Text is available under the Creative Commons Attribution-ShareAlike License 4.0; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia® is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization.\n",
      "\n",
      "  * Privacy policy\n",
      "  * About Wikipedia\n",
      "  * Disclaimers\n",
      "  * Contact Wikipedia\n",
      "  * Code of Conduct\n",
      "  * Developers\n",
      "  * Statistics\n",
      "  * Cookie statement\n",
      "  * Mobile view\n",
      "\n",
      "  *   * \n",
      "\n",
      "  *[Pos]: Position\n",
      "  *[v]: View this template\n",
      "  *[t]: Discuss this template\n",
      "  *[e]: Edit this template\n",
      "  *[Pld]: Played\n",
      "  *[W]: Won\n",
      "  *[L]: Lost\n",
      "  *[T]: Tied\n",
      "  *[NR]: No result\n",
      "  *[Pts]: Points\n",
      "  *[NRR]: Net run rate\n",
      "  *[Inns]: Innings\n",
      "  *[HS]: High score\n",
      "  *[Ave]: Average\n",
      "  *[SR]: Strike rate\n",
      "  *[100]: Hundreds scored\n",
      "  *[50]: Fiftys scored\n",
      "  *[4s]: Fours hit\n",
      "  *[6s]: Sixes hit\n",
      "  *[Wkts]: Wickets\n",
      "  *[Econ]: Economy rate\n",
      "  *[BBI]: Best innings bowling\n",
      "  *[5W]: 5 wicket haul\n",
      "  *[transl.]: translation\n",
      "Metadata: {'source': 'https://en.wikipedia.org/wiki/2023_Cricket_World_Cup', 'category': 'cricket world cup', 'extracted_metadata': {'player_1': '', 'player_2': '', 'player_3': '', 'player_4': '', 'player_5': '', 'team_1': 'India', 'team_2': 'Afghanistan', 'team_3': 'Australia', 'team_4': 'Bangladesh', 'team_5': 'England', 'keyword_1': 'Cricket World Cup', 'keyword_2': '2023', 'keyword_3': 'International Cricket Council', 'keyword_4': 'Tournament', 'keyword_5': 'Super League'}}\n",
      "Document: ## Warm-up matches\n",
      "\n",
      "Warm-up matches were held from 29 September to 3 October 2023 at Rajiv Gandhi\n",
      "International Cricket Stadium in Hyderabad, Assam Cricket Association Stadium\n",
      "in Guwahati, and Greenfield International Stadium in Thiruvananthapuram.[7]\n",
      "\n",
      "India's warm-up fixtures were announced on 27 June. The complete warm-up\n",
      "fixtures were announced on 23 August.[25] The matches were broadcast live on\n",
      "television.[26][27]\n",
      "\n",
      "Warm-up matches\n",
      "\n",
      "29 September 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "263 (49.1 overs) | **v** | **Bangladesh**  \n",
      "264/3 (42 overs)  \n",
      "---|---|---  \n",
      "Pathum Nissanka 68 (64)  \n",
      "Mahedi Hasan 3/36 (9 overs) |  | Tanzid Hasan 84 (88)   \n",
      "Lahiru Kumara 1/30 (6 overs)  \n",
      "**Bangladesh won by 7 wickets**  \n",
      "Assam Cricket Association Stadium, Guwahati  \n",
      "Umpires: Saiyed Khalid (Ind) and Vinod Seshan (Ind)  \n",
      "---  \n",
      "  \n",
      "  * Sri Lanka won the toss and elected to bat. \n",
      "\n",
      "29 September 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**South Africa **  \n",
      "| **v** | **Afghanistan**  \n",
      "  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Match abandoned**  \n",
      "Greenfield International Stadium, Thiruvananthapuram  \n",
      "Umpires: Anil Chaudhary (Ind) and Rohan Pandit (Ind)  \n",
      "---  \n",
      "  \n",
      "  * No toss.\n",
      "  * No play was possible due to rain. \n",
      "\n",
      "29 September 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**Pakistan **  \n",
      "345/5 (50 overs) | **v** | **New Zealand**  \n",
      "346/5 (43.4 overs)  \n",
      "---|---|---  \n",
      "Mohammad Rizwan 103* (94)  \n",
      "Mitchell Santner 2/39 (8 overs) |  | Rachin Ravindra 97 (72)   \n",
      "Usama Mir 2/68 (10 overs)  \n",
      "**New Zealand won by 5 wickets**  \n",
      "Rajiv Gandhi International Stadium, Hyderabad  \n",
      "Umpires: Parashar Joshi (Ind) and Akshay Totre (Ind)  \n",
      "---  \n",
      "  \n",
      "  * Pakistan won the toss and elected to bat. \n",
      "\n",
      "30 September 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "| **v** | **England**  \n",
      "  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**No result**  \n",
      "Assam Cricket Association Stadium, Guwahati  \n",
      "Umpires: Saiyed Khalid (Ind) and Saidarshan Kumar (Ind)  \n",
      "---  \n",
      "  \n",
      "  * India won the toss and elected to bat.\n",
      "  * No play was possible due to rain. \n",
      "\n",
      "30 September 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "166/7 (23 overs) | **v** | **Netherlands**  \n",
      "84/6 (14.2 overs)  \n",
      "---|---|---  \n",
      "Steve Smith 55 (42)  \n",
      "Roelof van der Merwe 2/12 (3 overs) |  | Colin Ackermann 31* (37)   \n",
      "Mitchell Starc 3/18 (3 overs)  \n",
      "**No result**  \n",
      "Greenfield International Stadium, Thiruvananthapuram  \n",
      "Umpires: Rohan Pandit (Ind) and Virender Sharma (Ind)  \n",
      "---  \n",
      "  \n",
      "  * Australia won the toss and elected to bat.\n",
      "  * The match was reduced to 23 overs per side due to rain.\n",
      "  * Rain prevented any further play. \n",
      "\n",
      "2 October 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**Bangladesh **  \n",
      "188/9 (37 overs) | **v** | **England**  \n",
      "197/6 (24.1 overs)  \n",
      "---|---|---  \n",
      "Mehidy Hasan 74 (89)  \n",
      "Reece Topley 3/23 (5 overs) |  | Moeen Ali 56 (39)   \n",
      "Mustafizur Rahman 2/23 (3 overs)  \n",
      "**England won by 4 wickets (DLS method)**  \n",
      "Assam Cricket Association Stadium, Guwahati  \n",
      "Umpires: Nitin Menon (Ind) and Sharfuddoula (Ban)  \n",
      "---  \n",
      "  \n",
      "  * Bangladesh won the toss and elected to bat.\n",
      "  * The match was reduced to 37 overs per side due to rain.\n",
      "  * England were set a revised target of 197 runs from 37 overs due to rain. \n",
      "\n",
      "2 October 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**New Zealand **  \n",
      "321/6 (50 overs) | **v** | **South Africa**  \n",
      "211/4 (37 overs)  \n",
      "---|---|---  \n",
      "Devon Conway 78 (73)  \n",
      "Lungi Ngidi 3/33 (7 overs) |  | Quinton de Kock 84* (89)   \n",
      "Trent Boult 2/20 (5 overs)  \n",
      "**New Zealand won by 7 runs (DLS method)**  \n",
      "Greenfield International Stadium, Thiruvananthapuram  \n",
      "Umpires: Chris Gaffaney (NZ) and Richard Kettleborough (Eng)  \n",
      "---  \n",
      "  \n",
      "  * New Zealand won the toss and elected to bat.\n",
      "  * South Africa innings curtailed at 37 overs due to rain; DLS par score was 219. \n",
      "\n",
      "3 October 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**Sri Lanka **  \n",
      "294 (46.2 overs) | **v** | **Afghanistan**  \n",
      "261/4 (38.1 overs)  \n",
      "---|---|---  \n",
      "Kusal Mendis 158 (87)  \n",
      "Mohammad Nabi 4/44 (8 overs) |  | Rahmanullah Gurbaz 119 (92)   \n",
      "Kasun Rajitha 1/18 (7 overs)  \n",
      "**Afghanistan won by 6 wickets (DLS method)**  \n",
      "Assam Cricket Association Stadium, Guwahati  \n",
      "Umpires: Ahsan Raza (Pak) and Joel Wilson (WI)  \n",
      "---  \n",
      "  \n",
      "  * Afghanistan won the toss and elected to field.\n",
      "  * Afghanistan were set a revised target of 257 runs from 42 overs due to rain. \n",
      "\n",
      "3 October 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "| **v** | **Netherlands**  \n",
      "  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Match abandoned**  \n",
      "Greenfield International Stadium, Thiruvananthapuram  \n",
      "Umpires: Michael Gough (Eng) and Alex Wharf (Eng)  \n",
      "---  \n",
      "  \n",
      "  * No toss.\n",
      "  * No play was possible due to rain. \n",
      "\n",
      "3 October 2023  \n",
      "14:00  \n",
      "Scorecard  \n",
      "---  \n",
      "**Australia **  \n",
      "351/7 (50 overs) | **v** | **Pakistan**  \n",
      "337 (47.4 overs)  \n",
      "---|---|---  \n",
      "Glenn Maxwell 77 (71)  \n",
      "Usama Mir 2/31 (5 overs) |  | Babar Azam 90 (59)   \n",
      "Marnus Labuschagne 3/78 (8.4 overs)  \n",
      "**Australia won by 14 runs**  \n",
      "Rajiv Gandhi International Stadium, Hyderabad  \n",
      "Umpires: Paul Reiffel (Aus) and Rod Tucker (Aus)  \n",
      "---  \n",
      "  \n",
      "  * Australia won the toss and elected to bat. \n",
      "\n",
      "## Group stage\n",
      "\n",
      "Main article: 2023 Cricket World Cup group stage\n",
      "\n",
      "The ICC announced the World Cup schedule on 27 June 2023 at an event in Mumbai\n",
      "with a countdown of 100 days to the opening match of the World Cup on 5\n",
      "October. The group stage started with the match between the finalists of the\n",
      "2019 Cricket World Cup, New Zealand and England, at Narendra Modi Stadium.[7]\n",
      "On 9 August 2023, nine fixtures, including the match between India and\n",
      "Pakistan, were rescheduled by the ICC.[28] The top seven teams in the\n",
      "tournament, excluding Pakistan who qualify automatically as host, qualified\n",
      "for the 2025 ICC Champions Trophy.[29]\n",
      "\n",
      "### Points table\n",
      "\n",
      "Pos | Team\n",
      "\n",
      "  * v\n",
      "  * t\n",
      "  * e\n",
      "\n",
      "| Pld | W | L | T | NR | Pts | NRR | Qualification   \n",
      "---|---|---|---|---|---|---|---|---|---  \n",
      "1  |  India (H) | 9  | 9  | 0  | 0  | 0  | 18  | 2.570  | Advanced to the semi-finals and  \n",
      "qualified for the 2025 ICC Champions Trophy  \n",
      "2  |  South Africa | 9  | 7  | 2  | 0  | 0  | 14  | 1.261   \n",
      "3  |  Australia (C) | 9  | 7  | 2  | 0  | 0  | 14  | 0.841   \n",
      "4  |  New Zealand | 9  | 5  | 4  | 0  | 0  | 10  | 0.743   \n",
      "5  |  Pakistan | 9  | 4  | 5  | 0  | 0  | 8  | −0.199  | Qualified for the 2025 ICC Champions Trophy  \n",
      "6  |  Afghanistan | 9  | 4  | 5  | 0  | 0  | 8  | −0.336   \n",
      "7  |  England | 9  | 3  | 6  | 0  | 0  | 6  | −0.572   \n",
      "8  |  Bangladesh | 9  | 2  | 7  | 0  | 0  | 4  | −1.087   \n",
      "9  |  Sri Lanka | 9  | 2  | 7  | 0  | 0  | 4  | −1.419  |   \n",
      "10  |  Netherlands | 9  | 2  | 7  | 0  | 0  | 4  | −1.825   \n",
      "  \n",
      "Source: ICC  \n",
      "(C) Champions; (H) Host\n",
      "\n",
      "  \n",
      "\n",
      "### Results\n",
      "\n",
      "The ICC released the fixture details on 27 June 2023.[30]\n",
      "Metadata: {'source': 'https://en.wikipedia.org/wiki/2023_Cricket_World_Cup', 'category': 'cricket world cup', 'extracted_metadata': {'player_1': 'Pathum Nissanka', 'player_2': 'Tanzid Hasan', 'player_3': 'Mohammad Rizwan', 'player_4': 'Rachin Ravindra', 'player_5': 'Kusal Mendis', 'team_1': 'Sri Lanka', 'team_2': 'Bangladesh', 'team_3': 'Pakistan', 'team_4': 'New Zealand', 'team_5': 'Afghanistan', 'keyword_1': 'Warm-up matches', 'keyword_2': '2023', 'keyword_3': 'Cricket World Cup', 'keyword_4': 'Hyderabad', 'keyword_5': 'Guwahati'}}\n"
     ]
    }
   ],
   "source": [
    "import faiss\n",
    "from langchain_community.vectorstores import FAISS\n",
    "from langchain_community.docstore.in_memory import InMemoryDocstore\n",
    "from langchain_openai import OpenAIEmbeddings\n",
    "from langchain_core.documents import Document\n",
    "from langchain_community.document_loaders import AsyncHtmlLoader\n",
    "from langchain_community.document_transformers import Html2TextTransformer\n",
    "from langchain_text_splitters import RecursiveCharacterTextSplitter\n",
    "from openai import OpenAI\n",
    "\n",
    "# Initialize the OpenAI client\n",
    "client = OpenAI()\n",
    "\n",
    "# Function to extract fixed metadata using GPT-4o-mini with JSON response\n",
    "def extract_fixed_metadata_from_chunk(chunk_text):\n",
    "    prompt = f\"\"\"\n",
    "    Extract the following fixed metadata in JSON format from the given text:\n",
    "    {{\n",
    "      \"player_1\": \"\",\n",
    "      \"player_2\": \"\",\n",
    "      \"player_3\": \"\",\n",
    "      \"player_4\": \"\",\n",
    "      \"player_5\": \"\",\n",
    "      \"team_1\": \"\",\n",
    "      \"team_2\": \"\",\n",
    "      \"team_3\": \"\",\n",
    "      \"team_4\": \"\",\n",
    "      \"team_5\": \"\",\n",
    "      \"keyword_1\": \"\",\n",
    "      \"keyword_2\": \"\",\n",
    "      \"keyword_3\": \"\",\n",
    "      \"keyword_4\": \"\",\n",
    "      \"keyword_5\": \"\"\n",
    "    }}\n",
    "    Here's the text:\n",
    "    {chunk_text}\n",
    "    \"\"\"\n",
    "    \n",
    "    # Call GPT-4o-mini to extract structured metadata in JSON format\n",
    "    response = client.chat.completions.create(\n",
    "        model=\"gpt-4o-mini\",\n",
    "        messages=[{\"role\": \"user\", \"content\": prompt}],\n",
    "        response_format={ \"type\": \"json_object\" }\n",
    "    )\n",
    "    \n",
    "    # Extract the response in JSON format\n",
    "    metadata_response = response.choices[0].message.content\n",
    "    print(metadata_response)\n",
    "    try:\n",
    "        # Convert the response into a dictionary\n",
    "        metadata = eval(metadata_response)  # This ensures it is a valid dictionary\n",
    "    except Exception as e:\n",
    "        print(f\"Error parsing metadata: {e}\")\n",
    "        metadata = {\n",
    "            \"player_1\": \"\", \"player_2\": \"\", \"player_3\": \"\", \"player_4\": \"\", \"player_5\": \"\",\n",
    "            \"team_1\": \"\", \"team_2\": \"\", \"team_3\": \"\", \"team_4\": \"\", \"team_5\": \"\",\n",
    "            \"keyword_1\": \"\", \"keyword_2\": \"\", \"keyword_3\": \"\", \"keyword_4\": \"\", \"keyword_5\": \"\"\n",
    "        }\n",
    "    return metadata\n",
    "\n",
    "# Step 1: Load data from a URL (Wikipedia page)\n",
    "url = \"https://en.wikipedia.org/wiki/2023_Cricket_World_Cup\"\n",
    "loader = AsyncHtmlLoader(url)\n",
    "data = loader.load()\n",
    "\n",
    "# Step 2: Transform the HTML content to plain text\n",
    "html2text = Html2TextTransformer()\n",
    "data_transformed = html2text.transform_documents(data)\n",
    "\n",
    "# Step 3: Split the text into smaller chunks using RecursiveCharacterTextSplitter\n",
    "text_splitter = RecursiveCharacterTextSplitter(\n",
    "    chunk_size=10000,  # Number of characters in each chunk\n",
    "    chunk_overlap=200  # Number of overlapping characters between chunks\n",
    ")\n",
    "chunks = text_splitter.split_text(data_transformed[0].page_content)\n",
    "\n",
    "# Step 4: Initialize OpenAI Embeddings model\n",
    "embedding_model = OpenAIEmbeddings(model=\"text-embedding-ada-002\")\n",
    "\n",
    "# Step 5: Initialize FAISS index for L2 (Euclidean) distance\n",
    "embedding_dim = len(embedding_model.embed_query(\"hello world\"))\n",
    "index = faiss.IndexFlatL2(embedding_dim)\n",
    "\n",
    "# Step 6: Initialize the InMemoryDocstore to store documents and metadata in memory\n",
    "docstore = InMemoryDocstore()\n",
    "\n",
    "# Step 7: Create FAISS vector store using the embedding function, FAISS index, and docstore\n",
    "vector_store = FAISS(\n",
    "    embedding_function=embedding_model,\n",
    "    index=index,\n",
    "    docstore=docstore,\n",
    "    index_to_docstore_id={}\n",
    ")\n",
    "\n",
    "# Step 8: Add chunks (documents) with extracted metadata and embeddings to FAISS vector store\n",
    "documents = []\n",
    "for i, chunk in enumerate(chunks):\n",
    "    # Extract fixed metadata using the LLM\n",
    "    extracted_metadata = extract_fixed_metadata_from_chunk(chunk)\n",
    "    \n",
    "    # Create a document object with both the chunk content and the extracted metadata\n",
    "    document = Document(\n",
    "        page_content=chunk, \n",
    "        metadata={\n",
    "            \"source\": url, \n",
    "            \"category\": \"cricket world cup\",\n",
    "            \"extracted_metadata\": extracted_metadata  # Store the structured metadata\n",
    "        }\n",
    "    )\n",
    "    \n",
    "    # Append the document to the list\n",
    "    documents.append(document)\n",
    "\n",
    "# Create unique IDs for each chunk\n",
    "ids = [f\"chunk_{i}\" for i in range(len(chunks))]\n",
    "\n",
    "# Add the documents and their embeddings to the FAISS vector store\n",
    "vector_store.add_documents(documents=documents, ids=ids)\n",
    "\n",
    "# Step 9: Define a function to extract metadata from a query\n",
    "def extract_fixed_metadata_from_query(query_text):\n",
    "    prompt = f\"\"\"\n",
    "    Extract the following fixed metadata in JSON format from the query:\n",
    "    {{\n",
    "      \"player_1\": \"\",\n",
    "      \"player_2\": \"\",\n",
    "      \"player_3\": \"\",\n",
    "      \"player_4\": \"\",\n",
    "      \"player_5\": \"\",\n",
    "      \"team_1\": \"\",\n",
    "      \"team_2\": \"\",\n",
    "      \"team_3\": \"\",\n",
    "      \"team_4\": \"\",\n",
    "      \"team_5\": \"\",\n",
    "      \"keyword_1\": \"\",\n",
    "      \"keyword_2\": \"\",\n",
    "      \"keyword_3\": \"\",\n",
    "      \"keyword_4\": \"\",\n",
    "      \"keyword_5\": \"\"\n",
    "    }}\n",
    "    Here's the query:\n",
    "    {query_text}\n",
    "    \"\"\"\n",
    "    \n",
    "    # Call GPT-4o-mini to extract structured metadata from the query\n",
    "    response = client.chat.completions.create(\n",
    "        model=\"gpt-4o-mini\",\n",
    "        messages=[{\"role\": \"user\", \"content\": prompt}],\n",
    "        response_format={ \"type\": \"json_object\" }\n",
    "    )\n",
    "    \n",
    "    # Extract the response in JSON format\n",
    "    metadata_response = response.choices[0].message.content\n",
    "    try:\n",
    "        # Convert the response into a dictionary\n",
    "        metadata = eval(metadata_response)\n",
    "    except Exception as e:\n",
    "        print(f\"Error parsing metadata: {e}\")\n",
    "        metadata = {\n",
    "            \"player_1\": \"\", \"player_2\": \"\", \"player_3\": \"\", \"player_4\": \"\", \"player_5\": \"\",\n",
    "            \"team_1\": \"\", \"team_2\": \"\", \"team_3\": \"\", \"team_4\": \"\", \"team_5\": \"\",\n",
    "            \"keyword_1\": \"\", \"keyword_2\": \"\", \"keyword_3\": \"\", \"keyword_4\": \"\", \"keyword_5\": \"\"\n",
    "        }\n",
    "    return metadata\n",
    "\n",
    "# Step 10: Extract metadata from the query\n",
    "query = \"Virat Kohli records in 2023 Cricket World Cup\"\n",
    "query_metadata = extract_fixed_metadata_from_query(query)\n",
    "\n",
    "# Step 11: Define a metadata filter based on the query's extracted metadata\n",
    "def metadata_filter(doc_metadata):\n",
    "    query_players = {query_metadata[f\"player_{i}\"] for i in range(1, 6) if query_metadata[f\"player_{i}\"]}\n",
    "    query_teams = {query_metadata[f\"team_{i}\"] for i in range(1, 6) if query_metadata[f\"team_{i}\"]}\n",
    "    query_keywords = {query_metadata[f\"keyword_{i}\"] for i in range(1, 6) if query_metadata[f\"keyword_{i}\"]}\n",
    "    doc_players = {doc_metadata[\"extracted_metadata\"][f\"player_{i}\"] for i in range(1, 6) if doc_metadata[\"extracted_metadata\"][f\"player_{i}\"]}\n",
    "    doc_teams = {doc_metadata[\"extracted_metadata\"][f\"team_{i}\"] for i in range(1, 6) if doc_metadata[\"extracted_metadata\"][f\"team_{i}\"]}\n",
    "    doc_keywords = {doc_metadata[\"extracted_metadata\"][f\"keyword_{i}\"] for i in range(1, 6) if doc_metadata[\"extracted_metadata\"][f\"keyword_{i}\"]}\n",
    "    \n",
    "    # Check if there's any overlap between the query metadata and document metadata\n",
    "    return bool(query_players & doc_players or query_teams & doc_teams or query_keywords & doc_keywords)\n",
    "\n",
    "# Step 12: Perform a similarity search on the stored chunks with the metadata filter\n",
    "results = vector_store.similarity_search(query=query, k=3, filter=metadata_filter)\n",
    "\n",
    "# Step 13: Display the results with metadata\n",
    "for doc in results:\n",
    "    print(f\"Document: {doc.page_content}\")\n",
    "    print(f\"Metadata: {doc.metadata}\")\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 1.2 QUERY OPTIMIZATION\n",
    "\n",
    "The objective of this stage is to optimize the input user query in a manner that makes it better suited for the retrieval tasks"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Query Expansion\n",
    "\n",
    "In query expansion, the original user query is enriched with the aim of retrieving more relevant information. This helps in increasing the recall of the system and overcomes the challenge of incomplete or very brief user queries."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "original_query=\"How does climate change affect polar bears?\"\n",
    "num=5"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {},
   "outputs": [],
   "source": [
    "response_structure='''\n",
    "{\n",
    "    \"queries\": [\n",
    "        {\n",
    "            \"query\": \"query\",\n",
    "    },\n",
    "    ...\n",
    "]}\n",
    "'''"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {},
   "outputs": [],
   "source": [
    "expansion_prompt=f\"Generate {num} variations of the following query: {original_query}. Respond in JSON format.\\Stick to this Structure :\\n{response_structure}\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "step_back_expansion_prompt = f\"Given the query: '{original_query}', generate a more abstract, higher-level conceptual query.\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "sub_query_expansion_prompt=f\"Break down the following query into {num} sub-queries targeting different aspects of the query: '{original_query}'. Respond in JSON format.\"\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Importing the OpenAI library\n",
    "from openai import OpenAI\n",
    "\n",
    "# Instantiate the OpenAI client\n",
    "client = OpenAI()\n",
    "\n",
    "# Make the API call passing the augmented prompt to the LLM\n",
    "response = client.chat.completions.create(\n",
    "  model=\"gpt-4o-mini\",\n",
    "  messages=\t[\n",
    "    {\"role\": \"user\", \"content\": expansion_prompt}\n",
    "  \t\t],\n",
    "          response_format={ \"type\": \"json_object\" }\n",
    ")\n",
    "\n",
    "# Extract the answer from the response object\n",
    "answer=response.choices[0].message.content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "    \"queries\": [\n",
      "        {\n",
      "            \"query\": \"What is the impact of climate change on polar bear populations?\"\n",
      "        },\n",
      "        {\n",
      "            \"query\": \"In what ways does climate change threaten polar bears?\"\n",
      "        },\n",
      "        {\n",
      "            \"query\": \"How are polar bears affected by changing climate conditions?\"\n",
      "        },\n",
      "        {\n",
      "            \"query\": \"What are the consequences of climate change for polar bear habitats?\"\n",
      "        },\n",
      "        {\n",
      "            \"query\": \"How does global warming influence the survival of polar bears?\"\n",
      "        }\n",
      "    ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "print(answer)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n",
    "\n",
    "# Make the API call passing the augmented prompt to the LLM\n",
    "response = client.chat.completions.create(\n",
    "  model=\"gpt-4o-mini\",\n",
    "  messages=\t[\n",
    "    {\"role\": \"user\", \"content\": step_back_expansion_prompt}\n",
    "  ]\n",
    ")\n",
    "\n",
    "# Extract the answer from the response object\n",
    "answer=response.choices[0].message.content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "'What are the broader ecological impacts of climate change on Arctic biodiversity?'\n"
     ]
    }
   ],
   "source": [
    "print(answer)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n",
    "# Make the API call passing the augmented prompt to the LLM\n",
    "response = client.chat.completions.create(\n",
    "  model=\"gpt-4o-mini\",\n",
    "  messages=\t[\n",
    "    {\"role\": \"user\", \"content\": sub_query_expansion_prompt}\n",
    "  ],\n",
    "  response_format={ \"type\": \"json_object\" }\n",
    ")\n",
    "\n",
    "# Extract the answer from the response object\n",
    "answer=response.choices[0].message.content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"sub_queries\": [\n",
      "    {\n",
      "      \"id\": 1,\n",
      "      \"aspect\": \"Habitat Loss\",\n",
      "      \"query\": \"What specific changes in sea ice patterns are impacting polar bear habitats due to climate change?\"\n",
      "    },\n",
      "    {\n",
      "      \"id\": 2,\n",
      "      \"aspect\": \"Food Availability\",\n",
      "      \"query\": \"How does climate change affect the availability of seals, the primary food source for polar bears?\"\n",
      "    },\n",
      "    {\n",
      "      \"id\": 3,\n",
      "      \"aspect\": \"Reproductive Challenges\",\n",
      "      \"query\": \"In what ways does climate change influence the reproductive success and behavior of polar bears?\"\n",
      "    },\n",
      "    {\n",
      "      \"id\": 4,\n",
      "      \"aspect\": \"Health Issues\",\n",
      "      \"query\": \"What health issues are polar bears facing as a result of climate change and altered environmental conditions?\"\n",
      "    },\n",
      "    {\n",
      "      \"id\": 5,\n",
      "      \"aspect\": \"Conservation Efforts\",\n",
      "      \"query\": \"What conservation strategies are being implemented to protect polar bears from the effects of climate change?\"\n",
      "    }\n",
      "  ]\n",
      "}\n"
     ]
    }
   ],
   "source": [
    "print(answer)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Query Transformation\n",
    "\n",
    "Compared to query expansion, in query transformation, instead of the original user query retrieval happens on a transformed query which is more suitable for the retriever"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "original_query=\"How does climate change affect polar bears?\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [],
   "source": [
    "system_prompt=\"You are an expert in climate change and arctic life.\"\n",
    "hyde_prompt=f\"Generate an answer to the question: {original_query}\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n",
    "# Make the API call passing the augmented prompt to the LLM\n",
    "response = client.chat.completions.create(\n",
    "  model=\"gpt-4o-mini\",\n",
    "  messages=\t[\n",
    "    {\"role\": \"system\", \"content\": system_prompt},\n",
    "    {\"role\": \"user\", \"content\": hyde_prompt}\n",
    "  ]\n",
    ")\n",
    "\n",
    "# Extract the answer from the response object\n",
    "answer=response.choices[0].message.content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Climate change significantly affects polar bears, primarily through its impact on their sea ice habitat. As global temperatures rise, Arctic sea ice is melting at an alarming rate, which is critical for polar bears for several reasons:\n",
      "\n",
      "1. **Habitat Loss**: Polar bears rely on sea ice as a platform for hunting seals, their primary food source. As the ice melts, bears have to travel greater distances to find food, which can lead to malnutrition or starvation.\n",
      "\n",
      "2. **Breeding and Denning**: Female polar bears typically build maternity dens on stable sea ice or on land where conditions are suitable. Warmer temperatures and irregular ice patterns can disrupt the timing of den construction and affect cub survival rates.\n",
      "\n",
      "3. **Increased Competition**: As ice diminishes, polar bears may encounter increased competition for food, particularly in areas where their ranges overlap with other bear populations or where seals are less available.\n",
      "\n",
      "4. **Health and Reproduction**: The stress of longer fasting periods and reduced access to food can lead to poorer overall health, lower cub survival rates, and reduced reproductive success in female bears.\n",
      "\n",
      "5. **Human-Bear Interactions**: As polar bears are forced to travel further inland in search of food, they may come into closer contact with human settlements, leading to increased conflicts and negative outcomes for both bears and people.\n",
      "\n",
      "Overall, climate change poses a significant threat to polar bear populations, affecting their survival, health, and reproductive success, thereby contributing to concerns about their long-term viability in the wild.\n"
     ]
    }
   ],
   "source": [
    "print(answer)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The embedding dimension is: 3072\n"
     ]
    }
   ],
   "source": [
    "# Initialize the OpenAIEmbeddings model\n",
    "embeddings = OpenAIEmbeddings(model=\"text-embedding-3-large\")\n",
    "\n",
    "# Create embedding for the hypothetical answer\n",
    "hyde_embedding = embeddings.embed_query(answer)\n",
    "\n",
    "# Check and print the dimension of the embedding\n",
    "embedding_dimension = len(hyde_embedding)\n",
    "print(f\"The embedding dimension is: {embedding_dimension}\")\n",
    "\n",
    "# Optionally, you can add error handling\n",
    "if embedding_dimension != 3072:  # 3072 is the expected dimension for text-embedding-3-large\n",
    "    print(f\"Warning: Unexpected embedding dimension. Expected 3072, got {embedding_dimension}\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. Retrieval Strategies"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Interventions in the pre-retrieval stage can bring significant improvements in the performance of the RAG system if the query and the knowledge base becomes well aligned with the retrieval algorithm. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Hybrid Retrieval"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 137,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Fetching pages: 100%|##########| 1/1 [00:00<00:00,  1.65it/s]\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Retrieval Type: dense\n",
      "Result: 35. **^** \"It's official! India set up 2023 World Cup semi-final against New Zealand in 2019 rematch; Pakistan knocked out\". _Hindustan Times_. 11 November 2023. Archived from the original on 14 November 2023. Retrieved 12 November 2023.\n",
      "  36. **^** \"2023 World Cup Cricket Batting Records & Stats runs\". _ESPNcricinfo_. Archived from the original on 18 October 2023. Retrieved 19 October 2023.\n",
      "\n",
      "Retrieval Type: dense\n",
      "Result: 37. **^** \"2023 World Cup Cricket bowling Records & Stats wickets\". _ESPNcricinfo_. Archived from the original on 9 October 2023. Retrieved 10 October 2023.\n",
      "  38. **^** \"India star named Player of the Tournament at ICC Men's Cricket World Cup\". _Cricket World Cup_. Archived from the original on 19 November 2023. Retrieved 19 November 2023.\n",
      "\n",
      "Retrieval Type: dense\n",
      "Result: Main article: 2023 Cricket World Cup final\n",
      "\n",
      "19 November 2023  \n",
      "14:00 (D/N)  \n",
      "Scorecard  \n",
      "---  \n",
      "**India **  \n",
      "240 (50 overs) | **v** | **Australia**  \n",
      "241/4 (43 overs)  \n",
      "---|---|---  \n",
      "|  |   \n",
      "**Australia won by 6 wickets**  \n",
      "Narendra Modi Stadium, Ahmedabad  \n",
      "---  \n",
      "  \n",
      "## Statistics\n",
      "\n",
      "Main article: 2023 Cricket World Cup statistics\n",
      "\n",
      "### Most runs\n",
      "\n",
      "Retrieval Type: dense\n",
      "Result: 51. ^ _**a**_ _**b**_ Pennington, Adrian. \"Behind the ICC Men's Cricket World Cup 2023 innovations with vertical video feed plus ball and player tracking\". _SVG Europe_. Retrieved 15 February 2024.\n",
      "  52. ^ _**a**_ _**b**_ \"Disney sets India cricket viewership record for TV, streaming during world cup\". _Reuters_. 23 November 2023. Retrieved 14 February 2024.\n",
      "\n",
      "Retrieval Type: dense\n",
      "Result: 36. **^** \"2023 World Cup Cricket Batting Records & Stats runs\". _ESPNcricinfo_. Archived from the original on 18 October 2023. Retrieved 19 October 2023.\n",
      "  37. **^** \"2023 World Cup Cricket bowling Records & Stats wickets\". _ESPNcricinfo_. Archived from the original on 9 October 2023. Retrieved 10 October 2023.\n",
      "\n",
      "Retrieval Type: sparse\n",
      "Result: Virat Kohli was named the player of the tournament and also scored the most\n",
      "runs, while Mohammed Shami was the leading wicket-taker. A total of 1,250,307\n",
      "spectators attended the matches, the highest number in any Cricket World Cup\n",
      "to date.[1] The tournament final set viewership records in India, drawing 518\n",
      "million viewers, with a peak of 57 million streaming viewers.\n",
      "\n",
      "## Background\n",
      "\n",
      "Retrieval Type: sparse\n",
      "Result: ---  \n",
      "Dates| 5 October – 19 November 2023  \n",
      "Administrator(s)| International Cricket Council  \n",
      "Cricket format| One Day International (ODI)  \n",
      "Tournament format(s)| Round-robin and knockout  \n",
      "Host(s)|  India  \n",
      "Champions|  Australia (6th title)  \n",
      "Runners-up|  India  \n",
      "Participants| 10  \n",
      "Matches| 48  \n",
      "Attendance| 1,250,307 (26,048 per match)  \n",
      "Player of the series|  Virat Kohli  \n",
      "Most runs|  Virat Kohli (765)  \n",
      "Most wickets|  Mohammed Shami (24)  \n",
      "Official website| cricketworldcup.com\n",
      "\n",
      "Retrieval Type: sparse\n",
      "Result: Attendance| 1,250,307 (26,048 per match)  \n",
      "Player of the series|  Virat Kohli  \n",
      "Most runs|  Virat Kohli (765)  \n",
      "Most wickets|  Mohammed Shami (24)  \n",
      "Official website| cricketworldcup.com  \n",
      "<- 2019 _2027_ ->  \n",
      "  \n",
      "The **2023 ICC Men's Cricket World Cup** (also referred to as simply the\n",
      "**2023 Cricket World Cup**) was the 13th edition of the  Cricket World Cup, a\n",
      "quadrennial One Day International (ODI) cricket tournament organized by the\n",
      "\n",
      "Retrieval Type: sparse\n",
      "Result: ### Team of the tournament\n",
      "\n",
      "The ICC announced its team of the tournament on 21 November 2023 with Virat\n",
      "Kohli being named as player of the tournament,[38] and Rohit Sharma as captain\n",
      "of the team.[39]\n",
      "\n"
     ]
    }
   ],
   "source": [
    "import faiss\n",
    "from langchain_community.vectorstores import FAISS\n",
    "from langchain_community.docstore.in_memory import InMemoryDocstore\n",
    "from langchain_openai import OpenAIEmbeddings\n",
    "from langchain_core.documents import Document\n",
    "from langchain_community.document_loaders import AsyncHtmlLoader\n",
    "from langchain_community.document_transformers import Html2TextTransformer\n",
    "from langchain_text_splitters import RecursiveCharacterTextSplitter\n",
    "from langchain_community.retrievers import BM25Retriever\n",
    "\n",
    "# Step 1: Load data from a URL (Wikipedia page)\n",
    "url = \"https://en.wikipedia.org/wiki/2023_Cricket_World_Cup\"\n",
    "loader = AsyncHtmlLoader(url)\n",
    "data = loader.load()\n",
    "\n",
    "# Step 2: Transform the HTML content to plain text\n",
    "html2text = Html2TextTransformer()\n",
    "data_transformed = html2text.transform_documents(data)\n",
    "\n",
    "# Step 3: Split the text into smaller chunks using RecursiveCharacterTextSplitter\n",
    "text_splitter = RecursiveCharacterTextSplitter(\n",
    "    chunk_size=500,  # Number of characters in each chunk\n",
    "    chunk_overlap=200  # Number of overlapping characters between chunks\n",
    ")\n",
    "chunks = text_splitter.split_text(data_transformed[0].page_content)\n",
    "\n",
    "# Step 4: Dense Retrieval (FAISS + OpenAI Embeddings)\n",
    "\n",
    "# Initialize OpenAI Embeddings model for dense retrieval\n",
    "embedding_model = OpenAIEmbeddings(model=\"text-embedding-ada-002\")\n",
    "\n",
    "# Initialize FAISS index for dense retrieval\n",
    "embedding_dim = len(embedding_model.embed_query(\"hello world\"))\n",
    "index = faiss.IndexFlatL2(embedding_dim)\n",
    "\n",
    "# Create an in-memory document store to support adding documents\n",
    "docstore = InMemoryDocstore()\n",
    "\n",
    "# Initialize FAISS vector store\n",
    "vector_store = FAISS(embedding_function=embedding_model, index=index, docstore=docstore, index_to_docstore_id={})\n",
    "\n",
    "# Add chunks to FAISS vector store\n",
    "documents = [Document(page_content=chunk) for chunk in chunks]\n",
    "vector_store.add_documents(documents)\n",
    "\n",
    "# Step 5: Sparse Retrieval (BM25 using LangChain's BM25Retriever)\n",
    "\n",
    "# Initialize BM25Retriever\n",
    "bm25_retriever = BM25Retriever.from_documents(documents)\n",
    "\n",
    "# Step 6: Hybrid Retrieval Strategy\n",
    "\n",
    "def hybrid_search(query, k=5):\n",
    "    # Step 6.1: Perform dense retrieval using FAISS\n",
    "    dense_results = vector_store.similarity_search(query=query, k=k)\n",
    "    \n",
    "    # Step 6.2: Perform sparse retrieval using BM25Retriever\n",
    "    sparse_results = bm25_retriever.get_relevant_documents(query)\n",
    "    \n",
    "    # Limit sparse results to top-k\n",
    "    sparse_results = sparse_results[:k]\n",
    "    \n",
    "    # Step 6.3: Combine dense and sparse results\n",
    "    combined_results = []\n",
    "    for dense_doc in dense_results:\n",
    "        combined_results.append((\"dense\", dense_doc.page_content))\n",
    "\n",
    "    for sparse_doc in sparse_results:\n",
    "        combined_results.append((\"sparse\", sparse_doc.page_content))\n",
    "\n",
    "    # Optionally, re-rank or further process combined results\n",
    "    return combined_results\n",
    "\n",
    "# Step 7: Perform a hybrid search\n",
    "query = \"Virat Kohli records in 2023 Cricket World Cup\"\n",
    "hybrid_results = hybrid_search(query)\n",
    "\n",
    "# Step 8: Display the results\n",
    "for retrieval_type, result in hybrid_results:\n",
    "    print(f\"Retrieval Type: {retrieval_type}\")\n",
    "    print(f\"Result: {result}\\n\")\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3. Post Retrieval Stage"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "At the post-retrieval stage the approaches of reranking and compression help in providing better context to the LLM for generation."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Compression"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In prompt compression, language models are used to detect and remove unimportant and irrelevant tokens"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [],
   "source": [
    "document_to_compress=retrieved_docs[0].page_content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [],
   "source": [
    "compress_prompt = f\"Compress the following document into very short sentences, retaining only the extremely essential information:\\n\\n{document_to_compress}\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Make the API call passing the augmented prompt to the LLM\n",
    "response = client.chat.completions.create(\n",
    "  model=\"gpt-4o-mini\",\n",
    "  messages=\t[\n",
    "    {\"role\": \"user\", \"content\": compress_prompt}\n",
    "  ]\n",
    ")\n",
    "\n",
    "# Extract the answer from the response object\n",
    "answer=response.choices[0].message.content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The 2023 ICC Men's Cricket World Cup took place in India from October 5 to\n",
      "November 19. Australia won, defeating India by six wickets in the final. Virat\n",
      "Kohli was Player of the Tournament with 765 runs; Mohammed Shami led with 24\n",
      "wickets. The event included 48 matches at ten venues with over 1.25 million\n",
      "attendees and 518 million viewers for the final, setting records. The top four\n",
      "teams were India, South Africa, Australia, and New Zealand. Australia claimed\n",
      "their sixth title.\n"
     ]
    }
   ],
   "source": [
    "print(textwrap.fill(answer, width=80))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "The 2023 ICC Men's Cricket World Cup, hosted solely by India from October 5 to\n",
      "November 19, was the 13th edition of this prestigious tournament, featuring ten\n",
      "national teams in a One Day International format. Australia emerged victorious,\n",
      "claiming their sixth title by defeating India by six wickets in the final held\n",
      "at the Narendra Modi Stadium in Ahmedabad. Virat Kohli was named Player of the\n",
      "Tournament, scoring the most runs (765) and Mohammed Shami led in wickets taken\n",
      "(24). The tournament featured 48 matches across ten venues and set attendance\n",
      "and viewership records, with over 1.25 million people attending, and 518 million\n",
      "viewers tuning into the final match in India. The event marked a significant\n",
      "moment in cricket, showcasing competitive matches and new broadcasting\n",
      "innovations, contributing to a successful and highly viewed World Cup. The\n",
      "tournament was contested by ten national teams, maintaining the same format used\n",
      "in 2019. After six weeks of round-robin matches, India, South Africa, Australia,\n",
      "and New Zealand finished as the top four and qualified for the knockout stage.\n",
      "In the knockout stage, India and Australia beat New Zealand and South Africa,\n",
      "respectively, to advance to the final, played on 19 November at the Narendra\n",
      "Modi Stadium in Ahmedabad. Australia won the final by six wickets, winning their\n",
      "sixth Cricket World Cup title.  Virat Kohli was named the player of the\n",
      "tournament and also scored the most runs, while Mohammed Shami was the leading\n",
      "wicket-taker. A total of 1,250,307 spectators attended the matches, the highest\n",
      "number in any Cricket World Cup to date.[1] The tournament final set viewership\n",
      "records in India, drawing 518 million viewers, with a peak of 57 million\n",
      "streaming viewers.  ## Background\n"
     ]
    }
   ],
   "source": [
    "print(textwrap.fill(document_to_compress, width=80))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<img src=\"../../Assets/Images/profile_s.png\" width=100> \n",
    "\n",
    "Hi! I'm Abhinav! I am an entrepreneur and Vice President of Artificial Intelligence at Yarnit. I have spent over 15 years consulting and leadership roles in data science, machine learning and AI. My current focus is in the applied Generative AI domain focussing on solving enterprise needs through contextual intelligence. I'm passionate about AI advancements constantly exploring emerging technologies to push the boundaries and create positive impacts in the world. Let’s build the future, together!\n",
    "\n",
    "[If you haven't already, please subscribe to the MEAP of A Simple Guide to Retrieval Augmented Generation here](https://mng.bz/8wdg)\n",
    "\n",
    "<a href=\"https://mng.bz/8wdg\" target=\"_blank\">\n",
    "    <img src=\"../../Assets/Images/NewMEAPFooter.png\" alt=\"New MEAP\" style=\"width: 100%;\" />\n",
    "</a>\n",
    "\n",
    "#### If you'd like to chat, I'd be very happy to connect\n",
    "\n",
    "[![GitHub followers](https://img.shields.io/badge/Github-000000?style=for-the-badge&logo=github&logoColor=black&color=orange)](https://github.com/abhinav-kimothi)\n",
    "[![LinkedIn](https://img.shields.io/badge/LinkedIn-000000?style=for-the-badge&logo=linkedin&logoColor=orange&color=black)](https://www.linkedin.com/comm/mynetwork/discovery-see-all?usecase=PEOPLE_FOLLOWS&followMember=abhinav-kimothi)\n",
    "[![Medium](https://img.shields.io/badge/Medium-000000?style=for-the-badge&logo=medium&logoColor=black&color=orange)](https://medium.com/@abhinavkimothi)\n",
    "[![Insta](https://img.shields.io/badge/Instagram-000000?style=for-the-badge&logo=instagram&logoColor=orange&color=black)](https://www.instagram.com/akaiworks/)\n",
    "[![Mail](https://img.shields.io/badge/email-000000?style=for-the-badge&logo=gmail&logoColor=black&color=orange)](mailto:abhinav.kimothi.ds@gmail.com)\n",
    "[![X](https://img.shields.io/badge/Follow-000000?style=for-the-badge&logo=X&logoColor=orange&color=black)](https://twitter.com/abhinav_kimothi)\n",
    "[![Linktree](https://img.shields.io/badge/Linktree-000000?style=for-the-badge&logo=linktree&logoColor=black&color=orange)](https://linktr.ee/abhinavkimothi)\n",
    "[![Gumroad](https://img.shields.io/badge/Gumroad-000000?style=for-the-badge&logo=gumroad&logoColor=orange&color=black)](https://abhinavkimothi.gumroad.com/)\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": ".myenv",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}