ZeroRL
ZeroRL is an AI-powered RL environment generator built for the Codex Hackathon.
Core trick
An LLM writes a Gymnasium environment from a text description, then validates it before generating training and eval scripts.
Description
ZeroRL is an AI-powered RL environment generator built for the Codex Hackathon.
It solves the bottleneck of RL prototyping: users describe an environment in natural language, and the system generates a working Gymnasium environment, validates it, and prepares training/eval workflows with a live interactive UI.
README excerpt
# 0RL — From Words to Worlds
Describe RL environments in natural language — 0RL builds working Gymnasium / Genesis environments with validation, training scripts, and live 3D preview.
```
"Create a 3-DOF robotic arm reaching task"
→ env.py + config.py + train.py + live viewer
```
---
## Architecture
```
┌─────────────────────────────────────────────────────────────────────┐
│ Frontend (Next.js) │
│ ┌──────────┐ ┌──────────────┐ ┌──────────────┐ │
│ │ Chat UI │ │ 3D Viewer │ │ Code Viewer │ │
│ │ (prompt- │ │ (R3F/Three) │ │ (file tabs) │ │
│ │ kit) │ │ STL · URDF │ │ │ │
│ └────┬─────┘ └──────┬───────┘ └──────────────┘ │
│ │ │ │
│ │ WebSocket │ WebSocket (frames) │
└───────┼───────────────┼────────────────────────────────────────────┘
│ │
┌───────┼───────────────┼────────────────────────────────────────────┐
│ Backend (FastAPI) │ │
│ │ │ │
│ ┌────▼─────┐ ┌─────▼──────┐ │
│ │ /ws/chat │ │ /ws/env/ │ │
│ │ handler │ │ frame │ │
│ └────┬────