Finalist
SidelineAI
An AI-powered sports commentary that adapts to every viewer, explaining rules for beginners, diving deep for experts, and celebrating your favorite players by name and interacting with YOU while watching the game,
Core trick
Captures YouTube frames at 15 FPS, sends them to Claude for play analysis, and speaks commentary through Cartesia TTS synced to playback.
Description
An AI-powered sports commentary that adapts to every viewer, explaining rules for beginners, diving deep for experts, and celebrating your favorite players by name and interacting with YOU while watching the game,
README excerpt
# AI Sports Commentator
Real-time, personalized AI commentary for any sports video playing in your browser. A Chrome Extension captures video frames from YouTube (or any streaming platform), streams them to a backend powered by Claude and Cartesia, and delivers synchronized play-by-play, tactical analysis, and personalized reactions — all with expressive text-to-speech.
Built for the **Cartesia x Anthropic x Notion Voice Agent Hackathon**.
## How It Works
```
YouTube Tab Chrome Extension Side Panel
┌──────────────────────┐ ┌──────────────────────────────┐
│ │ frames │ Synced delayed video │
│ <video> element ────┼────────────►│ ┌──────────────────────┐ │
│ │ (15 FPS) │ │ ▶ Delayed playback │ │
│ [AI Commentary │ │ └──────────────────────┘ │
│ Active — watch │ │ │
│ in sidebar] │ │ 🏈 Football ⚽ Soccer │
│ │ │ │
└──────────────────────┘ │ ┌──────────────────────┐ │
│ │ DANNY excited │ │
every 5th frame (3 FPS) │ │ TOUCHDOWN! What a │ │
via WebSocket │ │ run by #26! │ │
│ │ ├──────────────────────┤ │
▼ │ │ COACH KAY thoughtful│