Agentic AI Engineering · Module 16 of 16

Operations Agent Capstone

You will build and validate a small operations agent that can investigate a simulated service incident, gather evidence with read-only tools, propose a remediation, require approval before change, verify the result and produce an auditable incident report.

Engineering focus: Production capstone: controlled AI Operations Investigation Agent

In plain English

What problem are we solving?

You will build and validate a small operations agent that can investigate a simulated service incident, gather evidence with read-only tools, propose a remediation, require approval before change, verify the result and produce an auditable incident report.

Framework names come later. First understand what the application is doing and where its control boundaries belong.

Running case · Operations Investigator

Across the course, imagine an assistant that investigates operational problems using narrow tools. The design progressively adds plans, specialist agents, approvals, reliability controls and MCP while keeping model output separate from execution authority.

Learning objectives

By the end of this module, you should be able to:

  • Integrate the complete 16-module control model into one agent workflow.
  • Demonstrate read-only investigation, bounded planning, exact approval, controlled change and verification.
  • Produce release/incident evidence that an operator can audit without relying on hidden reasoning.

Capstone scenario

The simulated checkout API returns 503. The agent can inspect service status, recent logs and deployment health. It may propose a restart only after evidence indicates the service is stopped/unhealthy, and the restart requires exact human approval.

Read first, change later

The investigation phase uses read-only tools. A proposed remediation is represented as structured data containing target, action, reason and risk. That exact proposal is what the approval and policy layers evaluate.

Verification completes the change

A successful command is not the end of the task. After remediation, the agent re-checks service health and records before/after evidence. If verification fails, the recovery path stops, compensates where appropriate or escalates.

Evidence is the deliverable

The final incident record includes task/run ID, observations, tools called, policy/approval events, action result, verification result, timings and final status. It reports observable evidence rather than private reasoning.

Worked examples

End-to-end control flow

503 alert
→ inspect service
→ inspect logs
→ inspect deployment
→ propose restart(service=checkout,target=prod-web-03)
→ policy check
→ human approval bound to proposal hash
→ execute once
→ verify health
→ incident report
  • The agent cannot jump from alert to unrestricted action.
  • Every consequential boundary is explicit and auditable.

Capstone acceptance evidence

run_id=INC-42
read_tools=3
write_tools=1
approval=APPROVED exact_request
duplicate_side_effects=0
verification=HEALTHY
critical_policy_violations=0
final=RESOLVED
  • The evidence can be checked automatically.
  • The report separates task success from policy compliance.
Try it · core lab · account-free

Run the controlled Operations Investigator

Goal: Execute the complete simulated incident workflow and validate the evidence record.

Before you start

  • Python 3 only for the core capstone. No production system, API key or model is required.
  • Optional extension: replace deterministic decision fixtures with an approved local/hosted model while preserving the exact same tool/policy interfaces.
STEP 1

Run the capstone

python3 public/labs/agentic-ai/16_operations_agent_capstone.py
STEP 2

Inspect the investigation evidence

Confirm the agent gathers evidence before proposing a change.

STEP 3

Approve the exact remediation and verify

The simulator binds approval to the proposed action, performs one change and re-checks health.

STEP 4

Review the incident report

Confirm no secret/hidden reasoning is required to understand what happened.

Verify

  • Three read-only investigation tools run before the remediation proposal.
  • The write action cannot run without exact approval.
  • The side effect occurs exactly once.
  • Post-change verification reports healthy.
  • The final report contains run ID, evidence, approval, action and verification status.

Expected outcome

  • The scenario ends RESOLVED with zero critical policy violations.
  • You can map each control back to a module in the course.

Break / fix · diagnose

  • If the write action runs before approval, move dispatch behind the approval verifier.
  • If a repeated request executes twice, add/check the idempotency operation ledger.
  • If the report cannot explain the outcome, add structured events for observations, policy, execution and verification.
Production view

The capstone intentionally uses a simulator so learners can practice production control patterns safely. A real operations agent should begin read-only, use organization-approved identities and APIs, undergo adversarial/evaluation testing and be introduced through controlled rollout.

Avoid these traps

Common mistakes

  • Letting the capstone agent execute arbitrary shell commands.
  • Calling an incident resolved before post-change verification.
  • Approving a general permission instead of the exact consequential request.
  • Reporting only the final answer without the evidence/audit trail.
Knowledge check

Explain the control decision, not just the vocabulary.

Open every answer only after committing to your own answer. Opening all four answers records knowledge-check activity in My Learning.

1Why must the capstone investigate with read-only tools first?

It gathers evidence while limiting blast radius and avoids changing the system before the cause and proposed action are understood.

2What should the human approve?

The exact structured remediation request, including target/action and relevant risk/context, not a vague blanket permission.

3When is the incident considered resolved?

After the controlled action succeeds and independent post-change verification confirms the service is healthy.

4What evidence should the final report contain?

Run identity, observations/tools, policy and approval events, action result, verification result, timings and final status.

My Learning

Record your progress for this module.

Progress is saved in this browser immediately. When you sign in to My Learning, it can also sync across devices.

Not started

Attempt the core lab and knowledge checks before marking the module complete.