Skip to content

Lumen-Sonic

Lumen-Sonic turns any light source into an original music track.

Core trick

Gemini Vision extracts color temperature, flicker rate, and brightness from camera frames, then writes a prompt that Lyria turns into a WAV.

Tags

Description

Lumen-Sonic turns any light source into an original music track. Point your phone at a lamp, candle, or neon sign — Gemini 3 Vision analyzes the light's color temperature, flicker rate, and brightness arc, then writes a music prompt. Lyria generates a 30-second WAV file from that prompt. No two lights sound the same, and the same light can sound different on different phones due to sensor and white-balance variance.
VassoD/lumen-sonic★ 10 forksHTMLCreated Mar 14, 2026 · last push May 3, 2026

README excerpt

# Lumen-Sonic

Point light at your camera. Get a matching music track back.

Built at the Gemini 3 Paris Hackathon 2026 using Gemini Vision + Lyria.

**Live demo: [https://gemini3-hackathon-production.up.railway.app](https://gemini3-hackathon-production.up.railway.app)**

---

## The Concept

Light is everywhere — sunlight through a window, a candle, an LED, a neon sign. Lumen-Sonic treats light as a musical instrument.

Point your phone at any light source. The app reads the light's physical properties — color temperature, flicker rate, brightness variations — and uses Gemini Vision to translate them into a music description. Lyria then generates a 30-second original track from that description.

The result is **synesthesia as a service**: the same light, heard instead of seen.

---

## Why light specifically?

Most video-to-music tools analyze everything — faces, objects, scenes. We constrained the model to light only, because:

- Light has direct musical analogues: warm color → warm tone, fast flicker → fast tempo, dim → quiet
- It creates an unexpected, almost magical connection — point a lamp at your phone and music appears
- It's universal: every environment has light, making the tool usable anywhere

---

## The phone as a unique musical lens

Different phones capture the same light differently — sensor size, white balance algorithms, HDR processing, exposure handling all vary by manufacturer. A Pixel filming a candle will produce different music than an iPhone filming

Team