Cody
We wanted to reimagine what coding interfaces could look like.
Core trick
Captures optional desktop screenshots as context for OpenAI chat inside a transparent always-on-top Live2D overlay window.
Description
We wanted to reimagine what coding interfaces could look like. Currently, coding interfaces are either in the terminal or websites. We built Cody, which is an AI companion that can stay on your screen while you play games or do literally anything. You can build apps on it, keep a check on your agents running in the background.
README excerpt
# Oto Desktop A desktop Live2D character companion with AI chat integration. Oto Desktop creates a transparent overlay with an animated character that can see your screen, have conversations with you, and provide AI-assisted responses. <div align="center"> https://github.com/user-attachments/assets/001b865c-987d-4eb4-9187-47205b2d3fdb </div> ## Features - **Live2D Character Overlay**: Animated character rendered using Live2D Cubism SDK - **AI Chat Integration**: Powered by OpenAI GPT models for intelligent conversations - **Screen Awareness**: Optionally capture screenshots to give the AI context about what you're working on - **Two Conversation Levels**: - **Assistant**: General AI assistant with character commentary - **Character**: Direct dialogue with the character personality - **Cross-Platform**: Works on macOS, Windows, and Linux - **Global Shortcuts**: Quick access keyboard shortcuts - **Head Tracking**: Character follows your cursor movement ## Installation ### Prerequisites - [Bun](https://bun.sh/) (JavaScript runtime) - [Rust](https://rustup.rs/) (for building the Tauri backend) - OpenAI API key ### macOS / Linux ```bash ./setup.sh bun run dev ``` ### Windows ```powershell Set-ExecutionPolicy -ExecutionPolicy RemoteSigned -Scope CurrentUser .\setup.ps1 bun run dev ``` ## Building ```bash # macOS (Universal binary) bun run build:mac # Windows bun run build:windows #