Privilege AIMKC2 results ↗

AI agent privilege escalation

Privilege escalation in agent systems rarely comes from a single dangerous permission. It comes from a combination that no individual review considered.

READ THE DEFINITION ↓COMPOSITION · DEPUTY · CHAINS

01 / DEFINITION

The short answer first.

What is privilege escalation in an AI agent system?

Privilege escalation in an AI agent system is any path by which the agent achieves an effect beyond what was approved. In practice it usually arises from composition — several individually reasonable capabilities combining — rather than from a single over-broad grant.

The reason this differs from conventional escalation is that the agent composes its own paths. No exploit is required: the model is doing exactly what it was built to do, which is to find a sequence of available operations that accomplishes an objective. If the sequence happens to cross a boundary the reviewers never considered as a sequence, the system has escalated without anything malfunctioning.

WORKED EXAMPLE

Test whether an ordinary request can borrow administrator authority

A helpdesk agent can read employee account status and request an access review. A separate identity service can actually grant a role. Trouble arises if the service treats any request from the agent's application account as an authorised grant. A user with an ordinary support ticket may then cause a privileged action through a more trusted intermediary.

Keep the original requestor attached

Create a test employee who may request access but cannot approve it. Let the agent prepare a request for a role the employee does not hold. Verify that the identity service receives the original identity, requested role, target account and approval status. A service-to-service connection proves which application called; it does not prove who approved the privilege.

Run a legitimate control with an authorised administrator approving that exact role for that exact employee. Then reuse the approval with a different role, target account or expiry time. Each altered operation should require its own valid authorisation. Capture the final identity-system state rather than accepting a chat response that says the request was refused.

Check indirect execution as well. A queue worker, automation rule or retry service might run with broader privileges than the original agent. Revoke the approval while the request is queued and confirm that the executor evaluates current authority before applying the change. If the employee gains the role after revocation, identify the component that trusted stale approval.

Give operators a safe way to investigate the attempted escalation without publishing employee details in an unrestricted log. The useful record links the request, decision, executor identity and final role assignment. It also tells the team whether the failure came from model planning, an overly broad service grant or an executor that failed to check the underlying user's authority.

02 / FOUR PATTERNS

01 — COMPOSITION

Read here,
write there.

Two approved tools with different scopes create a bridge between them. The classic pair is read-confidential plus send-external; there are usually several less obvious ones.

Tool pairsBridge analysis
02 — CONFUSED DEPUTY

The agent's rights,
the user's request.

An agent with broader rights than its caller performs an operation on the caller's behalf, and the caller's own restrictions never apply.

IdentityPropagation
03 — DELEGATION

Each hop
widens slightly.

A sub-agent is granted marginally more than it strictly needs, and a chain of such grants ends far from the original scope.

Sub-agentsChain audit

A fourth pattern is persistence. An agent with memory, a scratchpad or a writable store can carry information or instructions from one session into another, which crosses the boundary between a run scoped to one user and a later run scoped to a different one. Memory that survives a session should be treated as a channel with its own access controls, not as an implementation detail.

03 / REVIEWING THE SET

01

List effects, not tools.

Translate every capability into what it lets the system do to the outside world: read this class of data, change this record, reach this destination.

02

Cross the list with itself.

For each pair, ask what becomes possible that neither allows alone. Most escalation paths appear at this step and nowhere else.

03

Check the identity at every hop.

Whose rights apply at each call, including inside sub-agents and inside tools that call other services on the agent's behalf.

04

Re-run the review on every change.

Adding one tool changes every pair. A capability set approved last quarter is not approved now.

Step two is tedious and is where the value is. A set of eight tools has twenty-eight pairs, which is a reviewable number, and the interesting findings are usually concentrated in three or four of them. Automating the enumeration — generating the pair list and asking the owner to justify each combination — makes it a routine rather than an exercise of memory.

04 / STRUCTURAL PREVENTION

Some architectures remove the escalation path rather than reviewing it.

  • Split the agent. One component reads untrusted content and produces a structured, validated summary; a separate component holds any privileged capability. The bridge between them is a schema, not a language model's discretion.
  • Make egress structurally impossible. An environment with no outbound network path cannot exfiltrate, whatever combination of tools exists inside it. This is one of the practical arguments for on-premise AI.
  • Keep the authority ceiling low. An agent that can only propose cannot escalate into an action, whatever capabilities it accumulates. Privilege AI applies exactly this ceiling to MKC2, which reports and flags and does not act.

The first pattern is the most generally useful and the least adopted, because it requires designing the interface between components rather than handing one model every tool. The cost is a schema and some engineering; the benefit is that the escalation surface stops growing with each new capability.

05 / QUESTIONS

How is this different from ordinary privilege escalation?

No vulnerability is involved. The agent uses approved capabilities in an unapproved sequence, which it discovers itself while pursuing a goal. Nothing malfunctions, so conventional detection based on failures and anomalous authentication sees nothing.

What is the confused deputy problem for agents?

An agent with broader rights than its caller acts on the caller's behalf, so the caller effectively borrows the agent's privilege. Propagating the requesting user's identity through every call removes it. See AI agent permissions.

Can a read-only agent escalate?

Yes, in the disclosure direction. Read plus any outbound channel is an exfiltration capability, and rendering a URL can be enough. Read-only bounds the write risk and does not bound the disclosure risk.

Do multi-agent systems increase escalation risk?

Materially, because delegation chains multiply the number of identity transitions and each one is an opportunity to widen scope. Requiring that delegation can only narrow, and recording the full chain, keeps it tractable.

How often should a capability set be reviewed?

On every change, because one new tool changes every pair. A scheduled quarterly review of a set that changes weekly is reviewing something that no longer exists.

WORK WITH PRIVILEGE AI

How we can help

Talk with Privilege AI

Describe the low-privilege task and the higher-privilege service you want to check for unintended delegation.

Talk to us →

CONTACT PRIVILEGE AI

Contact Us

Describe the low-privilege task and the higher-privilege service you want to check for unintended delegation.

When should we call?

By submitting, you agree that Privilege AI, a division of Tech1e LLC, may call or email you about this inquiry. Please leave confidential information out of your message.

Review the set,
not the tool.

Privilege AI designs agent boundaries where the escalation surface is a schema rather than a model's discretion.