Sparse retrieval with BM25
Time to try out a sparse retrieval implementation! You'll create a BM25 retriever to ask questions about an academic paper on RAG, which has already been split into chunks called chunks. An OpenAI chat model and prompt have also been defined as llm and prompt, respectively. You can view the prompt provided by printing it in the console.
Este ejercicio forma parte del curso
Retrieval Augmented Generation (RAG) with LangChain
Instrucciones del ejercicio
- Create a BM25 sparse retriever from the documents stored in
chunks; configure it to return5documents in retrieval. - Create an LCEL retrieval chain to integrate the BM25 retriever with the
llmandpromptprovided.
Ejercicio interactivo práctico
Prueba este ejercicio y completa el código de muestra.
# Create a BM25 retriever from chunks
retriever = ____
# Create the LCEL retrieval chain
chain = ({"context": ____, "question": ____}
| ____
| ____
| StrOutputParser()
)
print(chain.invoke("What are knowledge-intensive tasks?"))