Skip to content

Reality Git

Reality Git brings the idea of a Git diff into the physical world.

Code Video Cerebral Valley

Core trick

Pairs a vision model's object reacquisition with LiDAR and ARKit world coordinates to store a surface and show a red-versus-green positional diff.

Tags

visionrobotics/hardware

Description

Reality Git brings the idea of a Git diff into the physical world. Point your iPhone at an object and tap it or draw around it. The app remembers its original position and visible shape. When you move it, a translucent red ghost marks where it was, while green highlights its observed location. Returning the object clears the diff. GPT-6 Astra recognizes and reacquires the object, while LiDAR and AR tracking connect that understanding to physical space. Native Gaussian splats visualize the captured surfaces. The current prototype focuses on one object in one room during a single AR session.
akhileshrangani4/reality-git★ 00 forksSwiftCreated Sep 8, 2026 · last push Sep 9, 2026

README excerpt

# Reality Git

An iPhone AR prototype that remembers an object's place and shows what changed.

Sign in with ChatGPT on the iPhone, choose an image model, then tap an object or draw around it. A red captured surface marks its remembered place; green shows its latest measured position. Returning the object clears the difference.

## Intelligence and hardware

- **Codex subscription models:** Select, label, outline, and find the same object in subsequent camera frames. GPT-6 Astra is the default when available. Settings loads each account's image-capable models that support low effort; all scans use low effort.
- **iPhone camera, ARKit, and LiDAR:** Supply images, depth, calibration, and world coordinates. Measured depth inside the model's outline creates the immutable saved surface.
- **Vision:** Advances the model's pixels between replies. It cannot independently identify or reacquire the object. Model-confirmed depth can establish movement even if this local advance fails.
- **RealityKit:** Renders native Gaussian splats. Slow white particles match the camera controls, scatter toward the selected surface, and fade at contact. Reduce Motion disables the capture animation.
- **Fast capture:** A tap immediately previews a bounded patch of measured depth while Astra confirms the object. The preview is never saved as a reference or used to establish movement. Cached pixel continuity carries Astra's outline forward, with tracking scheduled up to 30 times per second. GPU resources,

Team