Creating a Ragas evaluation
To evaluate using ragas
, you will need to choose an LLM, create an evaluation dataset, and choose a set of metrics to evaluate against. As you learned in the previous video, two key Graph RAG metrics are context precision and noise sensitivity.
An llm
has been defined for you, along with example results (cypher_result
) that that demonstrate the differences between plain vector retrieval, text-to-cypher, and hybrid retrieval.
This exercise is part of the course
Graph RAG with LangChain and Neo4j
Hands-on interactive exercise
Have a go at this exercise by completing this sample code.
# Create an evaluation LLM
evaluator_llm = ____(llm)