Aura
A voice-first mental wellness app where you simply speak about your day — no typing, no forms.
Core trick
Sends raw audio to Gemini's multimodal input to extract emotional signals without transcription, with per-signal opt-out before dashboard display.
Description
A voice-first mental wellness app where you simply speak about your day — no typing, no forms. Using Gemini's native multimodal audio capabilities, the app listens to your raw voice and extracts deep emotional signals directly from speech, without converting to text first.
For every entry, AI surfaces: mood patterns, stress and energy levels, recurring themes, specific emotions tied to life events, and a breakdown of positive vs. negative self-talk with identified anxiety triggers. Users can review and opt out of any signal before it hits their dashboard — keeping them in full control of their emotional data.
Over time, the dashboard becomes a personal emotional map: visual charts and trend analysis let users track their mental well-being journey across days, weeks, months, or years. The app learns what patterns precede a spiral and intervenes in real time — triggering breathing exercises, guided grounding, ambient music, physical movement prompts, or suggested journal entries tailored to what actually works for that user.
The goal: steer every user toward positive self-talk, surface actionable insights for mental well-being, and catch emotional spirals before they happen.
README excerpt
# Voice-First Smart Journal A voice-first mental wellness app where you simply speak about your day — no typing, no forms. Using Gemini's native multimodal audio capabilities, the app listens to your raw voice and extracts deep emotional signals directly from speech, without converting to text first. --- ## Features - **Voice-native journaling** — speak naturally, Gemini processes audio directly via multimodal inference - **Emotional signal extraction** — mood, stress level, energy level, recurring themes, and spiral risk scored per entry - **Self-talk analysis** — tracks frequency of positive vs. negative self-talk with specific examples and identified triggers - **Life event mapping** — links specific emotions to the events that triggered them - **Real-time spiral intervention** — detects when a user is heading toward an emotional spiral and intervenes with breathing exercises, guided grounding, ambient music, physical movement prompts, or journaling suggestions - **Apple Watch integration** — enriches analysis with HRV, sleep, resting heart rate, steps, and activity data for clinically-grounded insights - **Opt-out control** — users review extracted signals and remove anything they don't want reflected in their dashboard - **Longitudinal dashboard** — visual charts and trend analysis to track emotional well-being across days, weeks, months, and years --- ## Tech Stack - **Frontend** — React 19, Vite, Tailwind CSS, Framer Motion - **Backend** — Express (dev) / Vercel