Inputs
Define the real workload.
The audit begins with prompts and success criteria that resemble the production distribution.
- Representative prompt set and model configuration
- Critical information and structure definitions
- Current input cost, latency, and cache assumptions