Echoverse
Every sound has a universe hiding in it.
Core trick
Gemini identifies sound sources from recorded audio, then checks generated frames for sound-visual alignment and refines the scene when they mismatch.
Description
Every sound has a universe hiding in it.
Echoverse records ambient sounds and generates fictional universes where those sounds are native. A coffee shop's clinking cups become crystalline chime-beetles in an underground bazaar. Traffic hum becomes the breath of colossal stone guardians.
Built entirely on Google AI — Gemini for imagination, Imagen 4 for visuals, Veo 3.1 for video.
README excerpt
# Echoverse
**Every sound has a universe hiding in it.**
Echoverse records ambient sounds and generates fictional universes where those sounds are native. A coffee shop's clinking cups become crystalline chime-beetles in an underground bazaar. Traffic hum becomes the breath of colossal stone guardians.
Built entirely on Google AI — Gemini for imagination, Imagen 4 for visuals, Veo 3.1 for video.
## How It Works
1. **Record** — capture 5-30 seconds of ambient sound
2. **Analyze** — Gemini 2.5 Flash identifies individual sound sources, spatial qualities, and atmosphere
3. **Imagine** — 3 parallel universe concepts are generated and auto-evaluated; the most creative wins
4. **Generate** — Imagen 4 renders the fictional world; Gemini verifies sound-visual alignment and refines if needed
5. **Reveal** — side-by-side: your reality vs. the Echoverse
Optional: generate an 8-second video with Veo 3.1, composited with your original audio.
## Architecture
```
Browser (mic) → FastAPI → Gemini 2.5 Flash (analysis + world-building)
→ Imagen 4 (reality + fantasy images)
→ Gemini verification loop (score < 7 → regenerate)
→ Veo 3.1 (optional video)
→ ffmpeg (stitch + composite)
```
**Key techniques:**
- 3 world branches generated in parallel via `ThreadPoolExecutor`, auto-evaluated by Gemini
- Reality image + world exploration run concurrently
- Cross-modal verification: generated image f