Lab

Sample managed-operations dashboard.

This is a labelled sample, not a live client view. It shows the shape of what a Managed AI Operations engagement actually tracks week to week. Numbers are illustrative.

Plain English: nothing on this page is a real client. Nothing is fetched from anywhere. There are no live integrations and no telemetry. It is a static representation of an internal review pack we maintain for clients on Managed Operations.

Sample · not live Last review: 2026-05-06, 14:30 AEST

Reviewed by: ops on call · Next review: 2026-05-13

Active pilots3Inbox triage, quote follow-up, intake summary

Open escalations1Quote follow-up: tone drift flagged

Review queue12Drafts awaiting human sign-off

Exception rate (7d)2.1%Below 5% threshold

Assistant uptime (30d)99.6%Vendor outage on 2026-04-28 (44 min)

Human interventions (7d)38Of 612 outputs reviewed

Documented changes (30d)5All in changelog if client-visible

Kill-criteria statusAll greenNo triggers tripped this period

Active pilots

Inbox triage

Classifies inbound emails into 5 categories, drafts a one-line summary, routes to a human queue. Owner: ops lead.

Healthy

Quote follow-up draft

Drafts a follow-up email when a Xero quote has been quiet for 7 days. Drafts only, never auto-send. Owner: sales lead.

Watch

Intake call summary

Summarises captured intake notes into a structured handover for the assigned tech. Owner: dispatch.

Healthy

Escalations & exceptions

2026-05-05. Quote follow-up: 4 of 22 drafts flagged for tone drift after vendor model update. Pilot moved to Watch. Sample size doubled for next period.
2026-05-02. Intake summary: one record had a missing customer reference. Root cause: source field empty at handover. Validation rule added.
2026-04-28. Vendor outage 44 minutes. Off-switch verified, manual fallback ran. No customer impact.

Review log (last 4 weeks)

2026-05-06. 30 outputs sampled across 3 pilots. 2 borderline drafts coached. No kill criteria tripped.
2026-04-29. 30 sampled. 1 escalation logged. Vendor outage resolved.
2026-04-22. 30 sampled. Inbox triage misroute rate dropped to 1.4% from 2.1%.
2026-04-15. 30 sampled. Refined quote follow-up tone guide.

Documented changes (this period)

Tightened tone rules for quote follow-up after drift flag.
Added validation: intake handover must include customer reference.
Increased sampling on quote follow-up from 10 to 20 per period.
Tested off-switch end-to-end on inbox triage (passed, 38 seconds).
Updated runbook for vendor outage fallback with screenshots.

If you would want this kind of view of your AI-assisted work, that is the idea.

Managed AI Operations exists so business owners get a weekly written view of what was reviewed, what was flagged, and what was changed. Not a chart. A short document a human read and signed.

Email us about Managed Operations