Skip to content

Otis

Otis is your macos second eyes and ears which protects you from scams and phising attacks - (especially for indian customers)

Core trick

Streams macOS screen and microphone audio into a live Gemini session that overlays warnings only when scam cues appear.

Tags

Description

Otis is your macos second eyes and ears which protects you from scams and phising attacks - (especially for indian customers)
PriyanshuDangi/otis★ 00 forksTypeScriptCreated Jul 11, 2026 · last push Jul 12, 2026

README excerpt

# Otis

Ambient AI guardian for macOS. Watches the screen and mic via the **Gemini Live API**, stays silent, and intervenes with overlays when it detects Indian-style scams, fraud, phishing, or misinformation.

See `docs/idea.md` and `docs/plan.md` for the product and build plan.

## Setup

```bash
npm install
cp .env.example .env             # then paste your key into .env
# GEMINI_API_KEY=...             # https://aistudio.google.com/apikey
npm run smoke                    # Gemini Live connection check
npm run brain-test               # one-shot brain test with phishing fixture
npm run dev                      # Electron app (overlay + hidden capture)
```

## macOS permissions

On first capture run, macOS will prompt for **Microphone** and **Screen Recording** for the app (or for the terminal / Electron during `npm run dev`).

If screen frames are black: System Settings → Privacy & Security → Screen Recording — grant access to Electron (or your terminal), then **fully restart** the app.

If the mic is silent: grant Microphone access the same way, then restart.

First `osascript` control of Chrome/QuickTime (Milestone 6) also triggers an Automation permission prompt — grant each once during setup, before any demo.

Debug dumps (first frame JPEG, 5s mic PCM) land in:
`~/Library/Application Support/otis/debug/`

```bash
# Convert mic dump to wav
ffmpeg -f s16le -ar 16000 -ac 1 \
  -i "$HOME/Library/Application Support/otis/debug/mic-5s.raw" \
  "$HOME/Library/Application Supp

Team