Best of Challenge 3: Real-Time “Tool Tips”
MLB Brain
Real-time MLB game insights powered by Gemini
Core trick
Passes live game state to Gemini for play explanations, then voices replies with ElevenLabs text-to-speech.
Tags
Built with
geminireacttailwind
Description
Inspiration
No one likes to be watching the game with all your friends and not really know what's going on. You don't know the key plays or why the scoreboard keeps changing and it can be a bit embarrassing to ask. So I built a tool to solve that problem.
What it does
MLB Brain is like having a really knowledgeable friend sitting next to you during the game:
Explains plays in simple terms as they happen
Chat with it whenever you're confused
Ask it questions through voice
And my favourite - hit the "Big Brain" button when you want to drop some expert knowledge and impress your friends 🧠
How we built it
Threw together some cool tech to make this happen:
React + Tailwind for making it look nice
Google's Gemini AI for the smarts
Eleven Labs for the voice stuff
Mocked up some MLB data to show how it'd work with real games
README excerpt
# MLB Brain **Real-time MLB game insights powered by AI.** ## Overview MLB Brain provides intelligent, real-time commentary and insights for MLB games, leveraging AI to analyze game situations and historical context. ## Features - Real-time game analysis and commentary - AI-powered game insights using Google Gemini - Integrated ElevenLabs voice synthesis widget - UI built with React and Tailwind CSS ## Live Demo Frontend: [https://mlb-voice-dashboard.vercel.app](https://mlb-voice-dashboard.vercel.app) ## Quick Start ### Frontend Setup ```bash # Clone repo git clone https://github.com/acstener/mlb-voice-dashboard.git # Install dependencies npm install # Run development server npm run dev ``` ### Backend Setup The backend code is maintained in a separate repository: [mlb-brain-backend](https://github.com/acstener/mlb-brain-backend) ```bash # Clone backend repo git clone https://github.com/acstener/mlb-brain-backend.git # Navigate to backend directory cd mlb-brain-backend # Create and activate virtual environment python -m venv venv source venv/bin/activate # On Windows use: venv\Scripts\activate # Install dependencies pip install -r requirements.txt # Run the backend server python app.py ``` ## Environment Setup: ### Backend Environment Variables Create a `.env` file in the backend directory with: ```bash GOOGLE_CLOUD_PROJECT=your-project-id GOOGLE_CLOUD_REGION=us-central1 GOOGLE_APPLICATION_CREDENTIALS=config/keys/your-credentials.json GOOGLE_API_KEY=your-api-