Pocket Soul
Pocket soul is a holographic friend for kids to engage in a 3d world and take them around wherever they go - magic they can see.
Core trick
Streams phone camera frames and voice to a cloud model, returning synthesized speech and animation cues for a holographic character.
Description
Pocket soul is a holographic friend for kids to engage in a 3d world and take them around wherever they go - magic they can see.
README excerpt
# 🔮 Pocket Soul - Holographic AI Companion  [](https://opensource.org/licenses/MIT) [](https://nodejs.org/) [](https://www.python.org/) > A $3 holographic AI companion that brings emotional AI conversations to life through real-time video streaming and voice synthesis. ## ✨ What is Pocket Soul? Pocket Soul transforms any smartphone into a **holographic AI companion** that can see, hear, speak, and express emotions through dynamic character animations. Using cutting-edge AI services, it creates an immersive conversational experience with: > **Example Character**: See [`assets/sad_character.mp4`](assets/sad_character.mp4) for reference character format and styling. - 🎤 **Real-time voice conversations** (Whisper + Gemini + ElevenLabs) - 🎬 **Emotion-based video streaming** with character animations - 📱 **Holographic display** optimized for smartphone hologram projectors - 👁️ **Computer vision** for gesture recognition and user presence detection - ⚡ **Ultra-low latency** streaming for natural interactions ## 🎯 Features ### Core Capabilities - **Voice Conversations**: Speech-to-text, AI responses, and text-to-speech in real-time - **Emotional Intelligence**: AI detects conversation emotions and displays matching charac