Definition
What it means
Inference is the operational phase in which a trained model responds to new input. Feedback and evaluations from inference can later inform another training cycle.
Why it matters
Role in the system
This is where model capabilities meet users, real tools, latency limits, and real-world consequences.
Example
In practice
A deployed model reads a support request and drafts a response using company policy.