Skill issue: Lessons from skilling up coding agents to use Langfuse – Marc Klingen, Clickhouse

Skill issue: Lessons from skilling up coding agents to use Langfuse – Marc Klingen, Clickhouse

More

Descriptions:

Marc Klingen, co-founder of Langfuse — the open-source LLM observability and tracing platform — shares lessons learned from building coding agent skills that let AI assistants like Claude Code autonomously instrument applications with Langfuse. The talk bridges conceptual framing and hands-on engineering: Klingen positions skills as a structured shortcut between rigid workflow automation and fully autonomous agents, giving coding agents a reliable “manual” for complex multi-step integrations.

A key insight is using production execution traces to drive skill development. By tracing how coding agents actually attempt to set up Langfuse — and where they go wrong — the team identified gaps: unexpected data region assumptions, hallucinated CLI parameters, and inefficient documentation navigation across 500+ pages. Each failure mode led to a concrete fix.

The most actionable section walks through specific engineering responses: reducing required environment variables and prompting agents to detect the user’s data region rather than defaulting to Europe; advertising the CLI help flag aggressively to prevent parameter hallucination; building an “agent sitemap” that gives coding agents a structured index of available documentation before they start fetching pages; and exposing markdown content negotiation (appending `.md` to doc URLs) so agents avoid parsing raw HTML. Together these lessons form a practical playbook for any developer team looking to make their product genuinely agent-ready — designing APIs, CLIs, and documentation with autonomous coding agents as first-class consumers.


📺 Source: AI Engineer · Published May 20, 2026
🏷️ Format: Workflow Case Study

1 Item

Channels