Skip to content

Balatro enjoyer

- When friends aren't colocated they need networked activities to stay connected - Video games are great for that but also update very frequently and it's hard to keep up with changes - Tagteam uses Gemini's latest faste

Code Demo Cerebral Valley

Core trick

Captures the game screen, retrieves product-specific knowledge via RAG, and sends the gamestate to Gemini for tiered in-game assistance.

Tags

agents

Description

- When friends aren't colocated they need networked activities to stay connected - Video games are great for that but also update very frequently and it's hard to keep up with changes - Tagteam uses Gemini's latest fastest model in combination with product-specific RAG to ingest actual gamestate and give you a customizable level of support - Tagteam apis and modalities are generalizeable to non-gaming usecases, use an AI co-pilot to help learning or be decisive for you in any desktop application
dahrk/tagteam★ 00 forksTypeScriptMITCreated Mar 21, 2026 · last push Mar 22, 2026

README excerpt

# tagteam

macOS-first gaming copilot built with Tauri (Rust) + React.

## DEMO
https://drive.google.com/file/d/1y6JxpUGUeCM4R4-JNj0WvbcIhgL_fBH3/view?usp=drive_link

## Phase 1 Status (MVP Core)

Phase 1 is implemented as a working scaffold for the core assist flow:

- Hotkey command surface is wired in backend command state.
- Assist pipeline runs: screenshot capture -> game detect -> context + knowledge load -> Gemini request -> schema validation -> fallback handling -> event persistence.
- Assist history is available to the frontend panel.
- Typed request/response contracts exist in both Rust and TypeScript.

## Current Project Structure

- `src-tauri/src/commands.rs`: command entrypoints and runtime guards.
- `src-tauri/src/game_assist/pipeline.rs`: core orchestration path.
- `src-tauri/src/game_assist/schema.rs`: structured response parsing/validation.
- `src-tauri/src/db.rs`: assist event/context/knowledge record storage abstraction.
- `src/App.tsx`: app shell combining controls, overlay, settings, and history.
- `src/components/GameAssistPanel.tsx`: assist history UI.

## Development

### Prerequisites

- [Bun](https://bun.sh) (`curl -fsSL https://bun.sh/install | bash`)
- [Rust + Cargo](https://rustup.rs)
- [Google Cloud SDK](https://cloud.google.com/sdk/docs/install) (for Vertex AI multi-modal embeddings)

### Multi-Modal Game Knowledge (RAG)

The project includes a hybrid cloud/local RAG pipeline for game-specific knowledge. 
Currently, Balatro is supported with bo

Team