Otis
Otis is your macos second eyes and ears which protects you from scams and phising attacks - (especially for indian customers)
Core trick
Streams macOS screen and microphone audio into a live Gemini session that overlays warnings only when scam cues appear.
Description
Otis is your macos second eyes and ears which protects you from scams and phising attacks - (especially for indian customers)
README excerpt
# Otis Ambient AI guardian for macOS. Watches the screen and mic via the **Gemini Live API**, stays silent, and intervenes with overlays when it detects Indian-style scams, fraud, phishing, or misinformation. See `docs/idea.md` and `docs/plan.md` for the product and build plan. ## Setup ```bash npm install cp .env.example .env # then paste your key into .env # GEMINI_API_KEY=... # https://aistudio.google.com/apikey npm run smoke # Gemini Live connection check npm run brain-test # one-shot brain test with phishing fixture npm run dev # Electron app (overlay + hidden capture) ``` ## macOS permissions On first capture run, macOS will prompt for **Microphone** and **Screen Recording** for the app (or for the terminal / Electron during `npm run dev`). If screen frames are black: System Settings → Privacy & Security → Screen Recording — grant access to Electron (or your terminal), then **fully restart** the app. If the mic is silent: grant Microphone access the same way, then restart. First `osascript` control of Chrome/QuickTime (Milestone 6) also triggers an Automation permission prompt — grant each once during setup, before any demo. Debug dumps (first frame JPEG, 5s mic PCM) land in: `~/Library/Application Support/otis/debug/` ```bash # Convert mic dump to wav ffmpeg -f s16le -ar 16000 -ac 1 \ -i "$HOME/Library/Application Support/otis/debug/mic-5s.raw" \ "$HOME/Library/Application Supp