Get startedGet started for free

Creating a Ragas evaluation

To evaluate using ragas, you will need to choose an LLM, create an evaluation dataset, and choose a set of metrics to evaluate against. As you learned in the previous video, two key Graph RAG metrics are context precision and noise sensitivity.

An llm has been defined for you, along with example results (cypher_result) that that demonstrate the differences between plain vector retrieval, text-to-cypher, and hybrid retrieval.

This exercise is part of the course

Graph RAG with LangChain and Neo4j

View Course

Hands-on interactive exercise

Have a go at this exercise by completing this sample code.

# Create an evaluation LLM
evaluator_llm = ____(llm)
Edit and Run Code