Smart Glass Supervisor
Smart Glass Supervisor is an AI-powered supervision platform, designed for Android smart glasses, that uses Gemini 3.1 Flash's multimodal capabilities to provide real-time guidance for smart glass users and field employe
Core trick
Streams smart-glass camera frames to Gemini 3.1 Flash, returning teleprompter-style step overlays and QC scores in real time.
Description
Smart Glass Supervisor is an AI-powered
supervision platform, designed for Android
smart glasses, that uses Gemini 3.1 Flash's
multimodal capabilities to provide real-time
guidance for smart glass users and field
employees. The application solves the
challenge of onboarding, training, and quality
control for distributed workforces by:
1. Real-time Video Processing - Captures live
camera feeds from smart glasses and processes
them through Gemini's multimodal inference
2. Intelligent Guidance System - Delivers
teleprompter-style overlays and voice coaching
for step-by-step procedures
3. Training Augmentation - AI-powered
procedure coaching that adapts to user context
4. QC Verification - Automated quality control
checkpoints with AI-powered scoring and photo
evidence capture
Built with a Cloud Run + Vercel architecture:
Cloud Run handles backend API and Gemini CV
processing, while Vercel serves the Next.js
frontend. Uses Google Gemini 3.1 Flash,
targeting the "AI-native Consumer Experiences"
and "Consumer Agents" tracks.
The linked repo returns 404, so it was deleted or made private.