Mystery Pigeon
Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games.
Core trick
Canvas snapshots go to Gemini every few seconds, and the resulting description is fed to an ElevenLabs voice agent.
Description
Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games.
How it works:
Draw — Kids draw anything on a sketchbook-style canvas (a house, a rocket, an animal, etc.)
AI Recognition — Gemini multimodal AI analyzes the canvas every few seconds and describes what it sees
Voice Agent — An ElevenLabs conversational voice agent reacts to the drawing in real time, talking to the kid about what they drew — excited, encouraging, and specific
Character Creation — When ready, the kid taps "Let's Play!" and the AI turns their drawing into a named character (e.g. "Zoomy the Rocket") with a description and optional "Magic Upgrade"
Mini-Games — The kid picks from three educational games starring their character:
Sort & Stack — Drag colored blocks to matching zones (color recognition, motor skills)
Math Runner — Solve addition and subtraction problems (arithmetic)
Quiz Quest — Answer AI-generated questions about their drawing (comprehension, creativity)
Voice Guidance Throughout — The voice agent helps at every step: narrating the drawing, guiding game selection, cheering correct answers, and coaching through mistakes
Tech stack: Next.js (App Router), HTML5 Canvas, Google Gemini (multimodal image analysis + content generation), ElevenLabs Conversational AI (real-time voice), Tailwind CSS, TypeScript.