Case study

The Pivot Through a Shadow AI Tool

This is an illustrative scenario, not a report of a specific incident. No real company is described. The mechanism is drawn from observed failure patterns; the figures are indicative, not measured.

The situation

A developer team adopted an AI analytics tool to make sense of product usage data. It was genuinely useful, so people connected it to more systems. Nobody in security knew it existed until it was breached.

What went wrong

Attackers compromised the third-party analytics provider. From inside that provider, they found what the customer's employees had granted it: broad, write-level API keys into the developer infrastructure. The breach of a small vendor became a breach of the customer.

The mechanism worth understanding

The pivot did not require breaking anything at the customer. Every permission used was legitimately granted. The attacker did not need a vulnerability in the target; they needed one in anyone the target trusted.

Shadow AI tools are especially dangerous in this respect, because they are adopted by the people with the most access and the least procurement process. A marketing tool with read-only scope is a nuisance. A developer tool with write scope is a foothold.

What actually prevents this

  • A registry of approved AI integrations — and a process for the ones that arrive without asking.
  • Read-only by default. Write scope should require a stated reason and a named approver.
  • Credential rotation on a schedule, so a long-forgotten integration expires on its own.
  • SSO enforcement, so unsanctioned tools cannot quietly obtain standing credentials.

What it costs when it happens

Incident response, forensics, notification and remediation for an SME-scale breach typically reaches six figures. Indicative, not measured.

The question to ask this week

List the third-party tools that hold a credential into your codebase or your customer data. Not the approved ones — all of them. The gap between those two lists is your actual attack surface.