Skip to content

Mystery Pigeon

Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games.

Core trick

Canvas snapshots go to Gemini every few seconds, and the resulting description is fed to an ElevenLabs voice agent.

Tags

Description

Mystery Pigeon is an interactive, kid-friendly web application that combines free-form drawing with AI-powered voice interaction and educational mini-games. How it works: Draw — Kids draw anything on a sketchbook-style canvas (a house, a rocket, an animal, etc.) AI Recognition — Gemini multimodal AI analyzes the canvas every few seconds and describes what it sees Voice Agent — An ElevenLabs conversational voice agent reacts to the drawing in real time, talking to the kid about what they drew — excited, encouraging, and specific Character Creation — When ready, the kid taps "Let's Play!" and the AI turns their drawing into a named character (e.g. "Zoomy the Rocket") with a description and optional "Magic Upgrade" Mini-Games — The kid picks from three educational games starring their character: Sort & Stack — Drag colored blocks to matching zones (color recognition, motor skills) Math Runner — Solve addition and subtraction problems (arithmetic) Quiz Quest — Answer AI-generated questions about their drawing (comprehension, creativity) Voice Guidance Throughout — The voice agent helps at every step: narrating the drawing, guiding game selection, cheering correct answers, and coaching through mistakes Tech stack: Next.js (App Router), HTML5 Canvas, Google Gemini (multimodal image analysis + content generation), ElevenLabs Conversational AI (real-time voice), Tailwind CSS, TypeScript.
Baladhurgesh/mystery-pigeon★ 00 forksTypeScriptCreated Mar 21, 2026 · last push Mar 21, 2026

Team