Nudge
Nudge is a local-first, physical-to-digital state tracking framework.
Core trick
A cheap local model tracks people and objects per frame and calls Gemini only when the tracked state changes.
Description
Nudge is a local-first, physical-to-digital state tracking framework.
It bridges physical environments (people, objects, interactions) with digital agents.
A cheap local model handles continuous, private frame-by-frame entity and pose tracking.
Only when physical state changes, Nudge calls Gemini Flash for gated semantic analysis and clustering-keeping API costs near-zero and user data fully private.
It then nudges digital agents or human workflows (via Telegram, WhatsApp, etc.) to trigger real-world actions like purchases.