Skip to content

Memory Recall Assistant

A private, on-device memory assistant for cognitive decline. Using ExecuTorch on Snapdragon 8 Elite NPU, it identifies faces, transcribes conversations via Whisper, and generates warm recall cues via Llama 3.2 1B - fully offline, zero cloud.

Core trick

Matches the center-frame face to enrolled 512-dimensional ArcFace embeddings by cosine similarity, running entirely on the phone's NPU via ExecuTorch.

Tags

Description

$29
Vanshika2021/Synapse-Riders★ 21 forksKotlinMITCreated Jun 27, 2026 · last push Aug 18, 2026

README excerpt

# Synapse Riders - Memory Recall Assistant

A fully **on-device** memory-recall assistant for the **Samsung Galaxy S25 Ultra (Snapdragon 8 Elite)**.
Point the camera at the person you're talking to; the app recognizes them, recalls your shared history,
and answers questions about past conversations — **100% locally, no cloud, works in airplane mode.**

Built for people who need a memory aid (e.g. early-stage memory loss) and their caregivers, where
**privacy is non-negotiable**: faces, audio, and conversations never leave the device.

---

## What it does

- **Center-crop targeting** — identifies the face closest to the frame center (the person you're
  intentionally talking to), not random bystanders.
- **On-device identity** — CavaFace ArcFace embeddings (512-d) matched by cosine similarity.
- **Always-live capture** — a foreground service samples camera + microphone + location every ~5 s,
  persisting only *meaningful* events (a face, speech, or a scene change) into a local knowledge graph.
- **Recall** — press Recall on a person → suggested questions → grounded answers with **cited
  evidence** (the exact past sessions that back the answer).
- **Enrollment** — capture 5 centered frames to register a new person.
- **Speech** — Whisper transcribes the rolling 30 s audio window on-device.
- **Language** — Llama 3.2 1B (via QAIRT Genie) phrases recall cues and answers.

Everything degrades gracefully: a missing model, permission, or sensor never crashes the app.

---

## On-d

Team