Color My Voice
Color My Voice is an engaging mobile web app that translates human speech into beautiful, frameable sound-art posters based on the historical pitch-color associations of classical composer Nikolai Rimsky-Korsakov, a rekn
Core trick
Extracts pitch and prosody numbers from speech, maps them to a historical pitch-color scheme, and stores only anonymized summaries.
Description
Color My Voice is an engaging mobile web app that translates human speech into beautiful, frameable sound-art posters based on the historical pitch-color associations of classical composer Nikolai Rimsky-Korsakov, a reknowned synesthete.
While roughly 4% of the world experiences synesthesia (blended senses), researchers lack large, diverse datasets to study it. Our app solves this by turning clinical voice collection into a fun, zero-friction creative experience. With explicit consent, it securely crowdsources anonymized, numerical voice summaries into a local research database—giving scientists the global data scale they need while keeping participant data completely private.
README excerpt
# Color My Voice ### *A Breathtaking Voice-to-Visual Synesthesia PWA & GDPR-Sanitized SQLite Research Data Engine* Built for the **Google I/O DeepMind Hackathon 2026**, **Color My Voice** turns human speech prosody into dynamic, frameable sound art, while simultaneously crowdsourcing anonymized acoustic summaries for global cross-modal science. --- ### Why We Built It & Who It Is For In cognitive science and speech therapy, **vocal prosody**—the rhythm, stress, and intonation of speech—is known as the "music of language." It carries our emotional intent, yet traditional studies on cross-modal perception (synesthesia) have been bottlenecked by small, Western-centric laboratory cohorts due to high hardware and test friction. We built **Color My Voice** to democratize this research at a global scale. It is a dual-nature instrument designed for: * **Participants**: A delightful, instantly rewarding creative tool that turns their voice into custom-colored, frameable physical art prints. * **Neuroscientists & Cognitive Researchers**: A clean, GDPR-compliant, child-safe crowdsourcing engine collecting precise acoustic summaries to study cross-modal mapping across diverse languages. ### Long-Term Value & Real-World Clinical Utility (Beyond the Hackathon) **Color My Voice** has immediate, transformative utility in the real world: 1. **Speech Therapy & Neuro-Rehabilitation**: It acts as a **visual biofeedback tool** for stroke survivors and individuals recovering from vocal