File:Retrieval-Augmented Generation chatbot, part 1- LangChain, Hugging Face, FAISS, AWS.webm
Original file (WebM audio/video file, VP9/Opus, length 24 min 7 s, 1,920 × 1,080 pixels, 531 kbps overall, file size: 91.49 MB)
Captions
Summary
[edit]DescriptionRetrieval-Augmented Generation chatbot, part 1- LangChain, Hugging Face, FAISS, AWS.webm |
English: In this video, I'll guide you through the process of creating a Retrieval-Augmented Generation (RAG) chatbot using open-source tools and AWS services, such as LangChain, Hugging Face, FAISS, Amazon SageMaker, and Amazon TextTract.
Part 2: scaling indexing and search with Amazon OpenSearch Serverless! ⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at https://julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️ We begin by working with PDF files in the Energy domain. Our first step involves leveraging Amazon TextTract to extract valuable information from these PDFs. Following the extraction, we break down the text into smaller, more manageable chunks. These chunks are then enriched using a Hugging Face feature extraction model before being organized and stored within a FAISS index for efficient retrieval. To ensure a seamless workflow, we employ LangChain to orchestrate the entire process. With LangChain as our backbone, we query a Mistral Large Language Model (LLM) deployed on Amazon SageMaker. These queries include semantically relevant context retrieved from our FAISS index, enabling our chatbot to provide accurate and context-aware responses. - Notebook: https://gitlab.com/juliensimon/huggingface-demos/-/tree/main/langchain/rag-demo-sagemaker-textract - LangChain: https://www.langchain.com/ - FAISS: https://github.com/facebookresearch/faiss - Embedding leaderboard: https://huggingface.co/spaces/mteb/leaderboard - Embedding model: https://huggingface.co/BAAI/bge-small-en-v1.5 - LLM: https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1 |
Date | |
Source | YouTube: Retrieval-Augmented Generation chatbot, part 1: LangChain, Hugging Face, FAISS, AWS – View/save archived versions on archive.org and archive.today |
Author | Julien Simon |
Licensing
[edit]- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
This file, which was originally posted to an external website, has not yet been reviewed by an administrator or reviewer to confirm that the above license is valid. See Category:License review needed for further instructions.
|
File history
Click on a date/time to view the file as it appeared at that time.
Date/Time | Thumbnail | Dimensions | User | Comment | |
---|---|---|---|---|---|
current | 15:47, 11 September 2024 | 24 min 7 s, 1,920 × 1,080 (91.49 MB) | Prototyperspective (talk | contribs) | Imported media from https://www.youtube.com/watch?v=7kDaMz3Xnkw |
You cannot overwrite this file.
File usage on Commons
The following page uses this file:
Transcode status
Update transcode statusMetadata
This file contains additional information such as Exif metadata which may have been added by the digital camera, scanner, or software program used to create or digitize it. If the file has been modified from its original state, some details such as the timestamp may not fully reflect those of the original file. The timestamp is only as accurate as the clock in the camera, and it may be completely wrong.
Software used |
---|