LocalMind AI
LocalMind AI is a mobile-first assistant built to help people make sense of the world around them, right when they need it.
Core trick
Sends a camera frame, GPS coordinates, and a question together to Gemini 1.5 Flash for location-specific answers.
Tags
Description
LocalMind AI is a mobile-first assistant built to help people make sense of the world around them, right when they need it. Instead of searching the internet or guessing local rules, users can simply point their phone’s camera at a street sign, bus stop, or shop, or ask a question in their own language. Using multimodal reasoning powered by Gemini, the app understands what the user is seeing, where they are, and what they’re asking, then responds with clear, practical guidance—like parking rules, bus fares, fair prices, or safety context—tailored to that exact location. Designed with India in mind, LocalMind AI speaks multiple local languages, adapts to regional nuances, and turns everyday confusion into confident, informed decisions through a simple, natural conversation.
README excerpt
# LocalMind AI 🇮🇳 LocalMind AI is a hyperlocal, multimodal AI assistant for India. It uses your camera, location, and Gemini 1.5 Flash to provide real-time, actionable intelligence about your surroundings. ## Features 🚀 - **Multimodal Analysis**: Understands what it sees (Camera) and where it is (GPS). - **Hyperlocal Intelligence**: Identifies shops, street signs, and estimates local prices/rules in India. - **Multilingual**: Responds in English, Hindi/Hinglish based on context. - **Hackathon Ready**: One-command backend deployment. ## Tech Stack 🛠️ - **Frontend**: Expo (React Native) - Android First. - **Backend**: FastAPI (Python) + Google Gemini 1.5 Flash. - **Infrastructure**: Docker & Docker Compose. ## Prerequisites 📋 - **Docker** & **Docker Compose** (v2) installed. - **Node.js** (v20+) & **npm** installed. - **Expo Go** app on your Android/iOS device. - **Gemini API Key**: [Get it here](https://aistudio.google.com/app/apikey). ## Quick Start 🏁 ### 1. Backend Setup The project includes a `deploy.sh` script to spin up the backend. ```bash cd localmind-ai # Initial setup (first time only) cp .env.example .env # EDITOR .env <-- Add your GEMINI_API_KEY here! # Deploy ./deploy.sh ``` This will start the backend on `http://localhost:8000`. ### 2. Frontend Setup ```bash cd localmind-ai/frontend npm install npm start ``` Scan the QR code with the **Expo Go** app on your phone. > **Note for Emulator**: If running on Android Emulator, the