Agentboarding
Agentboarding is a CLI tool for DevTools in the agent era.
Core trick
Runs a sandboxed agent against public docs, logs each step, classifies failures by root cause, and re-runs after a fix to score whether the gap closed.
Description
Agentboarding is a CLI tool for DevTools in the agent era. AI coding agents like Claude Code are becoming the buyers and integrators of developer tools — a developer asks an agent "how do I use X?", and the agent reads the docs and tries to set it up itself, in the terminal, with no website visit. When it gets stuck, it quietly gives up and picks a competitor. That failure is invisible today: you can't see it, reproduce it, or fix it.
Agentboarding makes it visible, reproducible, and fixable. We turn a real, sandboxed Claude Code agent loose on a goal — "from a clean machine, boot a cloud Android device with Genymotion" — using only the product's public docs. We record every step and root-cause each failure into one of five classes: the product is genuinely broken, the docs are ambiguous, the agent hallucinated a flag, a "summarization casualty" (Claude Code reads a lossy AI summary of your page that can silently drop key facts), or a "funding wall" (a paywall with no way for an agent to pay). Then we auto-fix the gap, send a fresh agent through, and prove the gap closed: an "AX Score" moves from red to green. It's Claude Code grading Claude Code, and shipping the fix.
README excerpt
# Agentboarding > **CI for the agent era.** Built at Claude Build Day (Shack15 SF, June 2026). AI coding agents like Claude Code are becoming the buyers and integrators of developer tools: a developer asks an agent "how do I use X?", and the agent reads the docs and tries to set it up itself, in the terminal — no website visit. When it gets stuck, it quietly gives up and picks a competitor, and that failure is invisible today. Agentboarding makes it visible, reproducible, and fixable. It turns a real, sandboxed Claude Code agent loose on a goal — *"from a clean machine, boot a cloud Android device with Genymotion"* — using only the product's public docs, records every step, root-causes each failure (product broken / docs ambiguous / hallucinated flag / **summarization casualty** / **funding wall**), auto-fixes the gap, and re-runs a fresh agent to prove it closed — an **AX Score** moves from red to green. ## Layout | Path | What | |---|---| | `agentboarding/` | orchestrator, sandbox + bash gate, trajectory recorder, HaikuShred replay, root-cause classifier, auto-fix generator, AX Score, x402 funding rail | | `tests/` + `tests/golden/` | pytest suite + recorded golden trajectories | | `geo/`, `analytics/` | support files reused from the Rozz GEO stack (Schema.org hardener, AI-bot traffic classifier, the gmsaas runbook fixtures) | | `hackathon/build-day/` | the brief, rubric, test-suite spec, and demo runbook/script that directed Claude | ## Run the tests ```bash python3 -