T14The Fourteen

Sahayak Services

Piloting an AI system with real users

The case

A customer support outsourcer. An AI assistant drafts replies to customer emails. In the lab it drafts in 8 seconds and scores 92% on a 200-item internal test set. Leadership approves a company-wide rollout.

What is in it

12 teaching steps, one animation each
29 labs, checked live against the case data
60 step questions, every option explained
22 final paper questions, marked on submission
12 Claude prompts, optional

The steps

1Eight seconds and ninety-two per cent · THE LAB
2What the lab measured · THE LAB
3Designing the pilot · THE LAB
4The major-edit rate · WHAT REAL WORK REVEALED
5Where the time actually goes · WHAT REAL WORK REVEALED
6A segment the test set missed · WHAT REAL WORK REVEALED
7One privacy incident · WHAT REAL WORK REVEALED
8Workarounds · WHAT REAL WORK REVEALED
9What was changed · FIX AND RE-TEST
10The re-test · FIX AND RE-TEST
11Adoption multiplies everything · FIX AND RE-TEST
12Go, extend or stop · FIX AND RE-TEST