Skip to content

Ref Zero

Ref Zero is an intelligent referee assistant that combines computer vision, multimodal AI, and autonomous web agents to analyze sports plays in real-time.

Code Video Cerebral Valley

Core trick

Uses MediaPipe motion tracking to trigger five-second clip capture, then a browser agent checks Gemini's cited rule against the live rulebook.

Tags

visionagents

Description

Ref Zero is an intelligent referee assistant that combines computer vision, multimodal AI, and autonomous web agents to analyze sports plays in real-time. Using Gemini 3.0 Flash's vision capabilities, the system detects potential fouls, cites official rulebook violations, and autonomously verifies rule citations through live web searches - transforming how sports are officiated. How it works: Real-time Vision: MediaPipe tracks player movements and detects potential violations Smart DVR: Automatically captures critical 5-second clips when action is detected AI Analysis: Gemini 3.0 Flash analyzes video frame-by-frame, identifying fouls and citing specific rules Autonomous Verification: Browser-use agent independently looks up official rulebook citations to validate AI decisions
yashwanth008/Google-Super-Hack★ 00 forksPythonCreated Jan 31, 2026 · last push Feb 2, 2026

README excerpt

# Ref Zero - AI-Powered Sports Referee Assistant

<div align="center">



**The world's first AI referee that analyzes plays in real-time and cites the official rulebook.**

[ Watch Demo](#demo) | [ Quick Start](#quick-start) | [Documentation](#how-it-works) | [ Hackathon](#built-for-cerebral-valley-hackathon)

[![Gemini 3.0](https://img.shields.io/badge/Gemini-2.0%20Flash-4285F4?logo=google)](https://ai.google.dev/)
[![LiveKit](https://img.shields.io/badge/LiveKit-Enabled-00D9FF?logo=webrtc)](https://livekit.io/)
[![License](https://img.shields.io/badge/License-MIT-green.svg)](LICENSE)

</div>

---

##  The Problem

Every year, **controversial referee calls** cost teams championships, millions in revenue, and fans' trust:

- **NFL**: 450+ officials, 256 games, split-second decisions
- **NBA**: Missed calls swing playoff games
- **Soccer**: VAR exists, but still relies on human interpretation
- **Youth Sports**: 90% of games have NO video review capability

**The bigger issue?** Even with video replay, refs must:
1.  Stop the game for 2-5 minutes
2.  Watch footage frame-by-frame manually
3.  Recall rules from a 200+ page rulebook
4.  Make judgment calls under pressure

---

##  Our Solution

**Ref Zero** is an AI assistant that gives every referee superhuman capabilities:
```
 Live Video Stream  →   AI Analysis  →   Rule Verification  →   Instant Verdict
    (5 seconds)            (Gemini 3.0)      (Browser Agent)         (JSON Output)
```

### Key Features

| Feature | Techn

Team