Embedding Wikipedia articles for search

# Embedding Wikipedia articles for search This notebook shows how we prepared a dataset of Wikipedia articles for search, used in [Question_answering_using_embeddings.ipynb](Question_answering_using_embeddings.ipynb). Procedure: 0. Prerequisites: Import libraries, set API key (if needed) 1. Collect: We download a few hundred Wikipedia articles about the 2022 Olympics 2. Chunk: Documents are split into short, semi-self-contained sections to be embedded 3. Embed: Each section is embedded with the OpenAI API 4. Store: Embeddings are saved in a CSV file (for large datasets, use a vector database)