FXVPS is a multi-tenant SaaS I run solo. Over years, customer-facing copy accumulates (onboarding emails, refund replies, affiliate terms, SLA language) written by different hands, at different times, against different versions of the policy. Individually each message is fine. Collectively, they drift out of agreement with each other and with the actual terms. Nobody re-reads years of email to check.
The problem
Contradictory commitments are a quiet liability. If one email promises a refund window the policy does not offer, or an SLA the infrastructure cannot meet, you have created an obligation you did not intend, and you will not find out until a customer holds you to it.
What I built
An LLM content-audit pipeline that ingests customer-facing emails, extracts every explicit commitment (refunds, affiliate terms, retention, SLA), and cross-checks them against the canonical policy and against each other. It flags contradictions with the specific sentences and a suggested correction, so the output is a worklist, not a vibe.
The run
Across 126 emails it surfaced four real contradictions: refund, affiliate, retention, and SLA. I reviewed each, shipped corrections to 38 active customers with zero failures, then wrapped the audit in a monthly cron hook so the corpus can never drift that far again.
The takeaway
Agents are not only for the headline product features. The highest-ROI place to point them is often the unglamorous operational risk no human has the hours to read. Pick a corpus that is too big to police manually and too consequential to ignore. That is where an agent pays for itself in week one.