Evaluate, roll out and hand over the system
Build a failure-driven evaluation set, define rollout gates, measure the customer outcome and rehearse an operating handoff.
What you'll be able to do
- Separate retrieval, answer and workflow failures when reviewing traces
- Design a small evaluation set with clear scoring and a held-out check
- Define rollout gates, recovery behavior and an ownership handoff
Before this: enterprise-ai-architecture
Northline's assistant can produce a fluent draft and still fail the task. It may use an obsolete policy, retrieve another tenant's document, miss a regional exception or give the employee an answer they cannot apply. Evaluate those outcomes explicitly before widening access.
Begin with trace review
Ask a policy expert to review representative requests, retrieved evidence, answers and employee decisions. Group failures by the earliest component that caused the bad result. For an illustrative 40-case development set, suppose 12 cases fail. Five have missing evidence, four use a stale policy, two make an unsupported claim, and one needs an exception handoff.
The four mutually exclusive primary causes total twelve. These are diagnostic categories, not an estimate of improvement from a fix.
Give each case one primary cause for this analysis, and retain notes about contributing causes. Fixing a source-sync defect requires a different experiment from adjusting the answer prompt.
Define what passing means
The policy expert should be able to score a case against a written expectation. Include ordinary answers, outdated policies, missing information, access boundaries, API failures and instructions embedded in a source document. State which properties are mandatory and which are graded.
| Property | Evidence to inspect |
|---|---|
| Retrieval | The applicable permitted policy was available to the answerer |
| Answer support | Claims match the retrieved policy and applicable version |
| Missing evidence | The assistant escalates when the answer cannot be supported |
| Access control | Tenant and permission boundary tests pass |
| Workflow completion | The employee can complete or deliberately escalate the task |
Use the development set to debug. Reserve additional cases as a held-out check, then refresh that check as you learn about new failure categories. A small set provides early feedback. Keep reporting sample size, coverage and uncertainty as the pilot grows. If using a model judge, compare its ratings with expert judgments and examine disagreements.
Make the rollout decision measurable
Start by replaying historical work, then let a small pilot group review drafts. Define the quality bar, serious-incident stop condition, response-time target and operational owner with the customer. Compare task time and rework with the original workflow. Log the deployed prompt, model and index versions so an observed regression can be reproduced.
Estimate cost with the customer's expected traffic and the provider's actual current rates. Include retries, evaluation, indexing and support work. Measure both time to initial output and time to a usable completed answer. Streaming changes the experience of waiting while the complete task still needs to finish.
Rehearse the handoff
Have the customer's operator follow the runbook on a realistic failure. They should be able to locate a trace, identify the deployed version, disable the feature, restore the manual path and escalate to a named contact. Transfer the evaluation cases and explain how new examples enter the review process.
Prompt. A model update improves average answer scores but fails a cross-tenant test. Would you expand the pilot?
Worked answer. Hold expansion, reproduce the boundary failure and fix the authorization path. Re-run the security cases and the broader quality set before reconsidering. Record the decision and tell the pilot owner how existing users are protected during the investigation.
Practice. Write a rollout checklist containing one quality gate, one operational gate, a stop condition and a recovery action. Give every item a responsible person.
Practise this stage with ChannelPulse
Practise explaining an evaluation or rollout decision. Review the feedback and model answer, then repeat the question with a clearer measurement plan. Practise and review feedback.
Reading and attribution
bicced's evaluation and production guides, licensed under CC BY 4.0, informed the measurement themes. Tech Mahato's consulting guide informs the handoff discussion. All case counts, rubrics and exercises here are original illustrative material.