We Gave an Agent Production Code Access and Then Tried to Sleep at Night — Moritz Johner, Form3

We Gave an Agent Production Code Access and Then Tried to Sleep at Night — Moritz Johner, Form3

More

Descriptions:

Moritz Johner from Form3, a financial infrastructure company, delivers a frank production case study at AI Engineer about building and operating Patch Pilot — an AI agent system designed to automate CVE remediation across thousands of repositories at scale. His central thesis: the moment an agent receives production credentials and repository write access, it becomes a supply chain actor indistinguishable in risk profile from a human engineer, and should be governed accordingly.

The talk explains why existing tools like Dependabot and Renovate fall short for Form3’s needs. They handle simple manifest bumps but are blind to OS-level vulnerabilities embedded in base images, and they can’t reason about cascading dependency constraints — for example, bumping the Go runtime may require bumping the linter, which introduces new lint rules that break the codebase. Patch Pilot addresses this by combining a deterministic Go orchestration layer (which handles discovery and artifact scanning) with reasoning agents that interpret CI failures and generate complete, valid pull requests. Johner shows a real production diff where the agent correctly identified and removed previously pinned packages that had been superseded by an updated base image — a nuance he admits he likely would have missed manually.

The system’s security architecture splits credentials strictly between the deterministic and agentic layers following least-privilege principles. Per-PR agent traces and aggregated telemetry were added after infosec pushback, giving the team visibility into failure modes at scale. Johner’s practical recommendation: treat coding agents like new contractors — same access reviews, same audit trails, same guardrails.


📺 Source: AI Engineer · Published July 20, 2026
🏷️ Format: Workflow Case Study

1 Item

Channels