1. Learn
    2. /
  2. Courses
    3. /
  3. Introduction to LLMs in Python
Connected

Exercise

Evaluating with EM

Exact Match helps us evaluate models when it comes to extractive question and answering but looking for, you guessed it, exact matches! Once again, you have been provided some predictions and references for evaluation. The evaluate library has been loaded for you.

Instructions

100 XP
  • Load the Exact Match metric.
  • Compute the Exact Match score and print the results.