Director's Cut
Director's Cut is an emotion-adaptive film engine that turns passive viewing into a personalized story.
Core trick
Webcam frames sampled every 10 seconds go to Gemini for emotion labels, which a director agent uses to choose the next story branch.
Description
Director's Cut is an emotion-adaptive film engine that turns passive viewing into a personalized story. A short mystery plays on screen while your webcam silently reads your facial expressions every 10 seconds — Gemini Flash analyzes whether you're engaged, tense, bored, or surprised in real time. A Director Agent weighs your emotional arc against the story's branching structure and picks the path most likely to unsettle, move, or captivate you specifically. Scene visuals and narration are then regenerated on the fly to match your mood, delivered through a low-latency WebSocket loop. The result: no two screenings are
alike, and the film always knows exactly how you feel.
README excerpt
# Director's Cut > An adaptive short film that reshapes itself around your emotions in real time. Built for the **Gemini 3 NYC Hackathon**. A mystery film plays while your webcam watches you. Every 10 seconds Gemini analyzes your face. A Director Agent reads your emotion history and picks the next story branch. Scene visuals and narration are generated on the fly — uniquely yours, every run. --- ## Architecture ``` ┌──────────────────────────────────────────────────────────────────────────────┐ │ BROWSER (Netlify) │ │ │ │ ┌─────────┐ frame every 10s ┌───────────────────────────────────────┐ │ │ │ Webcam │──────────────────▶│ Gemini Live API (client-side) │ │ │ └─────────┘ │ emotion detection, real-time │ │ │ │ (fallback when └────────────────┬──────────────────────┘ │ │ │ Gemini Live unavail.) │ EmotionReading │ │ │ ▼ │ │ │ ┌───────────────────────────────────────┐ │ │ └────────────────────────▶│ useBackendWS (wss://railway-url) │ │ │ raw frame relay │ reconnects automatically, 2.5s delay │ │ │ └────────────────┬──────────────────────┘ │ │