Skip to content

Shop Floor Intelligence

Shop Floor Intelligence — an autonomous shop-floor monitoring agent for high-mix job shops.

Code Demo Video Cerebral Valley

Core trick

Webcam frames go to a vision model that tracks named machine regions, flags stoppages, and drafts a shift briefing when one is detected.

Tags

visionproductivity

Description

Shop Floor Intelligence — an autonomous shop-floor monitoring agent for high-mix job shops. Point a cheap webcam at otherwise-uninstrumented manual machines and Claude Opus 4.8 vision turns them into monitored ones: the agent watches each machine, catches a stoppage or a blocked camera the moment it happens, investigates the surrounding frames, and drafts the next action plus a shift briefing — with utilization and availability as supporting context. You set it up in plain English ("the green lathe is on the left, the blue CNC is on the right") and it tracks each named machine by region. The product is the autonomous watch → catch → draft loop, not a dashboard or an image analyzer.
ZebAnderson/shop-floor-intelligence★ 00 forksTypeScriptCreated Jun 13, 2026 · last push Jun 13, 2026

README excerpt

# Shop Floor Intelligence

**Live:** https://shop-floor-intelligence.vercel.app
Built for the Claude Build Day, running on **Claude Opus 4.8**.

An **autonomous shop-floor agent** for high-mix job shops. A cheap webcam plus Claude
vision turns an uninstrumented manual machine into a monitored one. The agent watches the
feed, keeps running notes, **catches a machine stoppage or a blocked camera live**,
investigates the surrounding frames, and **drafts the next action plus a shift briefing**
— with utilization, time-in-state, and availability as supporting context. The user is the
line operator or plant manager; "working" is the agent catching a stop nobody flagged and
proposing the next step. Frame classification is plumbing underneath this, never the
headline (this is an agent, not an image analyzer or a dashboard).

## What it does

- **Plain-English onboarding (`/setup`).** Describe your machines in natural language —
  typed or **spoken** ("the machine on the left is Lathe 1, the middle one is a sander, the
  blue one on the right is a CNC"). Claude Opus 4.8 vision grounds each named machine into a
  labeled **region** of the frame; you edit/confirm, save (localStorage, editable), then
  monitoring tracks each named machine separately. This is how the agent knows *which*
  machine is down.
- **Watch → catch → draft loop.** Classifies each frame (running / idle / stopped /
  obstructed), debounces a sustained stoppage, and drafts a Claude-authored action + a
  one-line shif

Team