Project Name
Project Name: CodeMix Global Intelligent Multimodal Cross-Language Communication Assistant ๐ Problem Traveling to a foreign country without knowing the local language creates real communication barriers.
Core trick
Extracts speech from uploaded video, detects language and tone, and returns a structured translation with intent and slang flags.
Description
Project Name: CodeMix Global
Intelligent Multimodal Cross-Language Communication Assistant
๐ Problem
Traveling to a foreign country without knowing the local language creates real communication barriers. Traditional translation apps only convert text โ they do not interpret tone, emotion, dialect, slang, or cultural nuance.
This often leads to misunderstandings, especially in urgent or sensitive situations.
๐ Solution
CodeMix Global is a multimodal AI-powered communication assistant that enables context-aware, two-way communication between people who do not share a common language.
Unlike traditional translators, CodeMix Global:
i)Analyzes video and audio input
ii)Extracts speech from video
iii)Detects language and dialect
iv)Identifies tone and emotional state
v)Detects slang and abusive language
vi)Determines primary intent
vii)Provides structured contextual translation
viii)Supports multi-language output based on user preferences
README excerpt
<div align="center"> <img width="1200" height="475" alt="GHBanner" src="https://github.com/user-attachments/assets/0aa67016-6eaf-458a-adb2-6e31a0763ed6" /> </div> # Run and deploy your AI Studio app This contains everything you need to run your app locally. View your app in AI Studio: https://ai.studio/apps/drive/1kfaneYtHyGlW4C_3HN5x5IDfSAQu1QdV ## Run Locally **Prerequisites:** Node.js 1. Install dependencies: `npm install` 2. Set the `GEMINI_API_KEY` in [.env.local](.env.local) to your Gemini API key 3. Run the app: `npm run dev`