The feedback loop

1. The feedback loop

A Genie space is a living system. Let's learn to monitor and improve it with the feedback loop.

2. Why monitoring matters

Even a well-configured Genie space won't answer every question correctly the first time. The most common failure isn't a technical crash; it's a semantic gap. Users ask questions using internal slang that doesn't exist in your column names. Monitoring helps you catch these language mismatches and continuously improve.

3. The monitoring page

The Monitoring page shows every conversation in your space. Look for status badges, Answered or Unanswered, and the thumbs-up and thumbs-down icons to identify queries that need attention.

4. Diagnosing failures

To diagnose failures, check the Reasoning and Generated SQL. Empty SQL means Genie didn't recognize the nouns, so add synonyms. Wrong table joins mean Genie guessed the relationship, so add relationships. Correct SQL but wrong math means Genie needs SQL examples.

5. The feedback loop

Here's the cycle. Step one: Review. Regularly check the History tab for unanswered queries or thumbs down.

6. The feedback loop

Step two: Diagnose. Was it missing terminology, broken paths, or complex logic? That tells you whether to add Synonyms, Relationships, or SQL Examples.

7. The feedback loop

Step three: Curate. Apply the fix in the curation tools.

8. The feedback loop

Step four: Verify. Re-run the user's exact query to ensure Genie has learned the lesson. This cycle continuously improves accuracy.

9. Turning failures into examples

One powerful technique: when a query fails, don't just fix it. Turn it into an example. If someone asked "show me franchise revenue by region" and it failed because Genie didn't know how to join sales_transactions and sales_franchises, add a SQL example for that pattern. Now that question will always work, and similar questions will benefit too.

10. Let's practice!

Diagnose real failure patterns and apply the right curation fix. Let's practice!

Create Your Free Account

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.