Dictionary term
Evals
Also called Evaluations
Agentic AIIntermediate
Structured tests that measure an AI system's quality on defined tasks using example inputs and scoring criteria, used to compare prompts, models, or versions.
In plain English
A repeatable test for your AI: a fixed set of sample questions with a way to score the answers, so you can tell whether a change made it better or worse.
Analogy
Like a graded quiz for your AI: a fixed set of questions with an answer key to score performance.
Why it matters
Evals tell you whether a prompt or model change actually improved your automation instead of guessing.
In practice
Running 50 sample support tickets through two prompts and scoring which gives more accurate replies.
Related terms
Sources
Browse all terms →Last verified