Skip to content

FlyMe

FlyMe tells you if you can fly your car.

Core trick

Gemini builds a 3D street model from four phone clips, then a simulator tests 800 flight paths against nine safety checks.

Tags

Description

FlyMe tells you if you can fly your car. It plans a flying car's flight down a real street, and won't fly unless we decide proves it's safe. 1. Scan. You film four short phone clips from where the car is parked: front, right, back, left. Gemini 4 Argon watches them and builds a 3D model of the street: parked cars, poles, overhead wires, trees, and people, including which way they're walking and how fast. 2. Self-check. The browser draws Argon's 3D model from each camera's exact viewpoint (with Three.js), with a label on every object and a grid on the ground every 5 m. Argon compares each drawing to the real photo from the same camera, scores the match, and returns exact fixes ("o3 is 2 m farther", "missed a pole"). We apply them and repeat, up to 3 rounds. 3. Real footage in 3D. We project the real photos back onto the 3D model, like four slide projectors at the car. From the driver's seat it matches the footage exactly; from other angles you see the real street painted onto Argon's model. 4. Pick a spot. Safe parking spots are shaded green, and you tap where you want to land. 5. Plan. Our simulator tries 800 flight paths, every combination of height, flight time, bending left or right, and climb style, and runs 9 safety checks on each: no collisions, at least 0.5 m clearance, staying away from people (who keep moving during the flight), thruster limits, a soft landing, landing on target, and at least 25 kg of air left. A Gemini Managed Agent reviews the safe routes next to the real footage, looking for what the simulator can't see, like someone heading for the sidewalk or a car about to pull out. It can design and test its own routes in the simulator, then picks one and explains why in plain English. If nothing is safe, the app says why and suggests the nearest safe spot. 6. Fly. The car flies the chosen route. The simulator alone decides what's safe; the AI's text never does. Try it live: https://flyme-111809628719.us-west1.run.app (add ?replay=1 to watch a saved run instantly)
jbyoung12/flyme★ 00 forksJavaScriptCreated Oct 25, 2026 · last push Oct 26, 2026

README excerpt

# flyme — 3D Street Reconstruction & Verified Thruster-Hop Planner

> **Your flying car looks around with its own cameras, rebuilds the street in 3D, checks the rebuild against the footage, and won't hop until a simulation proves the landing is safe.**

**Try it live:** https://flyme-111809628719.us-west1.run.app (add `?replay=1` to watch a cached run instantly)

Built live at the **Gemini 4 Argon SF Hackathon (Shack15, Sunday 2026-10-25)** for **Problem Statement 2: "More Dimensions"** (*"Build a system that renders what it made, watches the result, critiques it against the goal, and fixes it in a loop"*) and **Best Use of Managed Agents**.

---

## Why Only Possible with Gemini 4 Argon + Antigravity Managed Agents

On October 15, 2026, a cold-gas thruster sports car hopped over five vehicles on a closed course. Doing that on a **real city street**—with parked SUVs, street lights, tree canopies, overhead catenary wires, and moving pedestrians—requires combining spatial perception, semantic judgment, and deterministic physics verification:

1. **Multimodal Video + Ground-Anchor Ranging → 3D Metric Scene (`gemini-4-argon`):** Ingests 4–5 car-camera video clips (`front`, `right`, `back`, `left`, optional `up`) with HDR-to-SDR tonemapping and sharpest-keyframe extraction. Argon identifies every static and moving hazard, estimates horizon lines (`camera_horizons`) and ground-contact pixel coordinates (`anchor`), and [`server/anchors.js`](server/anchors.js) deterministically inter

Team