Dictionary term
Inference
AI FoundationsBeginner
Inference is the process of running a trained model to generate an output from an input, as opposed to training the model in the first place.
In plain English
Inference is the AI actually doing the work: you send it a question and it produces an answer, using what it already learned.
Analogy
Like a chef cooking a dish from a recipe they already learned, rather than the time spent learning to cook.
Why it matters
Every time your automation calls Claude, you are paying for inference, so understanding it helps you reason about latency and cost per step.
In practice
Sending a prompt to the Claude API and getting a reply back is one inference call.
Related terms
Sources
Browse all terms →Last verified