In March, reports described a serious internal incident at Meta. An AI agent responded to an engineering question without being asked, an employee followed its flawed advice, and sensitive company information became accessible to employees who were not authorized to see it. Meta confirmed that an incident occurred and told The Guardian that no user data was mishandled.
The details matter, and public reporting leaves limits on what outsiders can conclude. The management lesson is still useful. A system that begins as an assistant can become part of a decision path. A suggestion can influence a person with privileged access. A capability that looked bounded during approval can participate in a much larger operating chain once people rely on it.
Approval is a snapshot
Most software review processes are organized around the vendor. Security evaluates the company, legal reviews the terms, procurement records the purchase, and IT approves the application. That structure works reasonably well when the product changes at the pace of a normal release cycle and its access stays recognizable. AI products do not always behave that way.
The approved writing assistant may add internal search. The search feature may add connectors to email, cloud storage, tickets, and customer records. The product may introduce a workflow builder, then add the ability to update those systems. A feature that served a small pilot may appear inside the product used by every employee. The vendor is unchanged, while the questions of data access, authority, human review, and consequence are completely different.
This is why an annual vendor review can be current on the vendor and stale on the deployed system. The review needs a way to notice meaningful change between calendar checkpoints. NIST's AI Risk Management Framework calls for ongoing monitoring, periodic review, production monitoring, and change management across the AI lifecycle. That is a useful operating principle even for teams that do not adopt the framework formally.
Re-review when capability changes
The first trigger is a material change in what the tool can do. Summarizing a document is different from searching an entire internal knowledge base. Recommending an action is different from executing it. Drafting a workflow is different from running it on a schedule. The review should compare the approved capability with the new one and ask whether the failure modes, required evidence, or human role have changed.
Do not rely on the vendor's feature name to determine materiality. A small release note can represent a large operating change. Ask whether the system can now retrieve more information, retain more context, call more tools, take more steps, or produce an output that people are likely to treat as a decision.
Re-review when access changes
New data or system access deserves its own trigger. A tool connected only to public material presents a different exposure than the same tool connected to contracts, support transcripts, source code, or employee records. A read-only connector is different from one that can write, delete, send, approve, or publish. Each new integration can increase both usefulness and the consequence of a bad instruction.
The review should record the identity used by the integration, the permissions granted, the data classes in scope, and the actions available. OWASP's guidance for agent data access emphasizes least privilege, per-request authorization, audit logging, and isolation testing. Those are concrete questions for an approval record, not abstract security aspirations.
Re-review when the people or workflow change
A pilot used by five trained analysts is not the same deployment after the feature becomes available to five thousand employees. New user populations bring different roles, permissions, training, and incentives. They also change the scale at which a misunderstanding can repeat. Review should restart when access expands to a materially different group, especially when that group works with sensitive data or consequential decisions.
The workflow matters as much as the headcount. A tool used to brainstorm privately can later feed customer communication, hiring, financial analysis, production code, or compliance decisions. Even if the feature set has not changed, the operating context has. Re-review when an output moves from optional reference to a relied-upon step in important work.
Re-review when authority changes
Authority is the sharpest trigger. An assistant may first suggest a reply, then gain permission to send it. It may identify records for correction, then gain permission to update them. It may recommend a deployment, then join the automation that performs it. Every move from advice toward action should name the approving human, the limits on the action, the evidence retained, and the recovery path.
Human review is not one universal control. A reviewer needs the time, context, expertise, and actual power to reject the action. A click that becomes routine after hundreds of low-quality alerts is not meaningful oversight. The review should test how the human role works in practice and where the workflow proceeds without it.
Re-review material vendor, model, and incident changes
The underlying model, hosting arrangement, subprocessors, retention terms, or training practices may change even when the user interface does not. A vendor may route tasks to a new model or add a third-party service. These changes do not all require a full review, but the approval process should define which ones require notification, evidence, or a new decision.
Incidents are another trigger. A relevant security event, harmful failure, audit finding, or sustained performance regression should reopen the assumptions behind approval. The question is not whether the vendor remains generally reputable. It is whether the event changes the evidence about this deployment, its controls, or the acceptable scope of use.
Keep a review record that can move
Continuous review does not require a committee meeting for every release. It needs a compact record and clear triggers. For each important AI deployment, keep the approved purpose, current capabilities, connected systems, data classes, user population, allowed actions, owner, review requirements, evidence, and last decision. Then define who watches for change and who can accept, narrow, pause, or escalate the deployment.
- Capability: can the system retrieve, reason, remember, create, recommend, or act in a materially new way?
- Access: can it reach new data, applications, identities, permissions, or external destinations?
- Population: is it available to more users or to a group with different responsibilities and access?
- Workflow: has the output entered a consequential business process or become a relied-upon input?
- Authority: can it now execute, send, modify, approve, purchase, publish, or delete?
- Supply chain: did the model, hosting, subprocessor, retention, or data-use arrangement materially change?
- Evidence: did an incident, audit, evaluation, or performance trend weaken a prior assumption?
The evidence package should be proportional to consequence. It may include the current architecture and permission inventory, vendor change notices, evaluation results, access logs, samples of real outputs, incident history, and confirmation that the rollback or deactivation path still works. High-impact uses need stronger evidence and shorter review intervals than a bounded drafting tool.
Visibility keeps the review attached to reality
A trigger-based process still fails if nobody can see that the trigger fired. Security may hold the original approval while employees add connectors, teams build workflows, and vendors introduce agents inside tools the company already owns. The operating record has to connect the approved tool to its actual users, workflows, ownership, and changing use.
Proxon gives leaders visibility into AI usage, tools, agents, workflows, ownership, spend, adoption, and outcomes. It does not enforce runtime permissions or prevent an unsafe action. It helps the company see where AI is being used and how that operating environment changes, so the right owner can ask whether an old approval still fits.
Approval should give a company confidence to use a tool within a defined boundary. It should not turn a fast-changing product into a permanent exception. Keep the decision, the capability, and the real deployment connected. When the tool changes, make sure the approval changes with it.
Research referenced in this post.
- Meta is having trouble with rogue AI agents — TechCrunch
- Meta engineer trusted advice from an AI agent, ended up exposing user data — IT Pro
- AI Risk Management Framework Core — National Institute of Standards and Technology
- Agentic AI: Improper Agent Data Access — OWASP
