Tract Star
Tract Star: Discover the physics of your voice Your voice is an instrument unlike anyone else’s.
Core trick
Sends a known acoustic sweep into the vocal tract, fits a native simulator to the response, and freezes predictions before each recording.
Description
Tract Star: Discover the physics of your voice
Your voice is an instrument unlike anyone else’s. Your singing coach should understand how it works - but even the best human singing coaches rely on what they hear, and what they can see on the outside. They can't look under the hood.
Tract Star combines iPhone LiDAR, active acoustic probing and physical simulation to build a personalized model of your vocal instrument - with Astra as its scientific brain.
Most singing apps measure pitch and tell you to try again. Tract Star investigates why your voice sounds the way it does, then uses that understanding to guide your next experiment.
We turn your phone into a vocal research lab. LiDAR captures visible geometry that helps distinguish anatomical hypotheses. Our sound-sweep method sends a known acoustic signal and analyzes its response, adding information that ordinary singing recordings alone cannot provide. A native vocal-tract simulator then tests competing explanations for how anatomy, articulation and sound production interact.
Astra closes the loop. It examines the evidence, chooses an informative next exercise, explains what to try and incorporates the results. Predictions are frozen before the next recording, so each attempt becomes a real test of the model—not a story invented afterward.
The technical challenge is connecting fundamentally different signals: depth measurements, acoustic responses, recorded voice and simulated physiology. We bring them into one experimental system that can compare alternatives, update its understanding and make the mechanics of singing tangible.
We’re not using Astra to put a chatbot on a pitch detector. We’re using it to orchestrate a personalized physics lab for the human voice.
README excerpt
# TractStar A private singing-research prototype combining live movement and audio views, native vocal-tract fitting, prospective acoustic experiments, and an Astra coach. The app runs capture preparation, fitting, experiment selection, scoring and personal sensation memory; inferred internal anatomy remains an unvalidated research hypothesis. ## Run locally Requires Node.js 22.12+ and npm. Complete the one-time [scientific Python and native-engine setup](science/README.md#setup) first. Chrome is recommended for the prototype. This is developer installation; learners do not run backend commands between recordings. ```sh npm install npm run build npm run science:local ``` Open http://127.0.0.1:5173. The launcher starts the local app and persistent scientific worker together. `SINGING_PYTHON` can select an existing scientific Python environment; otherwise it uses `science/.venv/bin/python`. For same-Wi-Fi phone capture, complete [trusted local HTTPS setup](docs/implementation/LOCAL-PHONE.md), then use `npm run science:private` to start both services with phone HTTPS. Use `npm run dev` for UI-only development; it does not provide the backend APIs. Camera and microphone request access automatically when the app opens. Allow access and frame your face and shoulders in even light. If the browser suspends Web Audio until a gesture, select **Enable audio**. Try an easy sustained vowel. **Stop camera** releases the webcam; the microphone has its own Stop control. **Demo** display