Creating a Ragas evaluation
To evaluate using ragas, you will need to choose an LLM, create an evaluation dataset, and choose a set of metrics to evaluate against. As you learned in the previous video, two key Graph RAG metrics are context precision and noise sensitivity.
An llm has been defined for you, along with example results (cypher_result) that that demonstrate the differences between plain vector retrieval, text-to-cypher, and hybrid retrieval.
Den här övningen är en del av kursen
Graph RAG with LangChain and Neo4j
Interaktiv övning med praktiskt arbete
Testa den här övningen genom att slutföra den här exempelkoden.
# Create an evaluation LLM
evaluator_llm = ____(llm)