Aan de slagBegin gratis

Creating a Ragas evaluation

To evaluate using ragas, you will need to choose an LLM, create an evaluation dataset, and choose a set of metrics to evaluate against. As you learned in the previous video, two key Graph RAG metrics are context precision and noise sensitivity.

An llm has been defined for you, along with example results (cypher_result) that that demonstrate the differences between plain vector retrieval, text-to-cypher, and hybrid retrieval.

Deze oefening maakt deel uit van de cursus

Graph RAG with LangChain and Neo4j

Bekijk cursus

Interactieve oefening met praktijkervaring

Probeer deze oefening door deze voorbeeldcode aan te vullen.

# Create an evaluation LLM
evaluator_llm = ____(llm)
Code bewerken en uitvoeren