Trace-to-Action Workflows
Diagnostic Instrumentation for Prompt Versus Tool Call Failure Isolation in Production Agents
Span-level instrumentation isolates whether agent failures stem from bad prompts or broken tools.
Story: Tomás Erhlich
Trace-to-Action Workflows
12 stories in Trace-to-Action Workflows
Trace-to-Action Workflows
Curating a Production Trace Corpus That Makes Replay Eval Meaningful
Structuring production traces for reliable agent regression testing beyond final answers.
Story: Kwame Asante-Briggs
Trace-to-Action Workflows
Operationalizing Trace-Driven Improvement Cadences for Production Agent Teams
Teams improve production agents by treating traces as structured inputs to a diagnostic cadence.
Story: Tomás Erhlich
Trace-to-Action Workflows
Closing the Loop From Observability Signal to Agent Improvement Without Guesswork
Traces pinpoint the agent layer responsible for each failure, enabling targeted fixes.
Story: Kwame Asante-Briggs
Trace-to-Action Workflows
Layer-Pinned Failure Signals Every Agent Observability Dashboard Must Surface
Dashboards must label every failure to its originating agent layer to enable targeted fixes.
Story: Tomás Erhlich
Trace-to-Action Workflows
Taxonomy of Agent Failure Modes by Harness Layer
Separating failures by harness layer reveals where debugging actually moves the needle.
Story: Tomás Erhlich
Trace-to-Action Workflows
Extracting Implicit Feedback Signals From Live Agent Sessions
Behavioral patterns in agent logs reveal quality issues that explicit ratings miss.
Story: Tomás Erhlich
Trace-to-Action Workflows
Prioritizing Agent Fix Backlog Using Production Failure Evidence
Use production traces to rank agent fixes by actual failure impact, not complaint volume.
Story: Tomás Erhlich
Trace-to-Action Workflows
Prompt Versioning and Rollback in Production Agent Systems
How to version prompts and safely promote changes in production agent systems.
Story: Kwame Asante-Briggs
Trace-to-Action Workflows
Replay-Based Eval Workflow for Agent Prompt Changes
Test prompt changes against real production failures before shipping them live.
Story: Kwame Asante-Briggs
Trace-to-Action Workflows
Turning Production Agent Failures Into Regression Tests
Catch silent agent failures by replaying production traces as regression tests.
Story: Tomás Erhlich
Trace-to-Action Workflows
Root Cause Attribution Across Agent Harness Layers
Searching agent traces layer by layer reveals root causes traditional diagnosis misses.
Story: Kwame Asante-Briggs