Cerebral Valley · Meta · 2026-03-07 to 2026-03-08
Public gallery: every submissionEvent page ↗
Kube SRE Gym is a self-improving RL environment where a small language model (Qwen3-1.7B) learns to diagnose and fix real Kubernetes production incidents from scratch.
Sidhartha Reddy Potu, Ashish Ranjan, Guangting Yu
RL environment for autonomous biologist agents.
Sean Chang, Minh Truong, Kevin Vo
ShopRLVE-GYM HF Blog https://huggingface.co/blog/thebajajra/shop-rlve-gym
RAHUL BAJAJ, Jaya Nupur
Voyager-VRAM is a long-horizon workplace simulator where LLM agents must navigate a realistic office environment ( emails, Slack, shared drive, spreadsheets, calendars ) using 31 tools to complete multi-step project mana
Himalaya Dua, Pranav Patel
Our agent uses OpenEnv to build a curriculum of video game environments that train a TinyLlama 1.1B agent via GRPO reinforcement learning.
Abraham Bhatti
GAIA is an OpenEnv-compatible geospatial reasoning environment where an AI agent infers hidden real-world locations using multi-step tool calls (terrain, weather, sun angle, language, architecture, street/aerial cues) un
Problem Existing RL setups lack the organizational complexity, role-based coordination, and dynamic market conditions that define how real companies operate.
Bharat Bhavnasi, Harshal Hirpara, Jeeya K
OpenRange is a multi-agent cybersecurity gymnasium where Red and Blue agents co-evolve on validated enterprise networks that mutate between episodes, requiring long-horizon planning across 50–100 step trajectories with s
Anto Joseph, Lars Talian Stangebye-Hansen, Aaron Brown
An OpenEnv-compatible RL environment that simulates enterprise HR onboarding and offboarding workflows.
Ravi Theja Desetty, Dev Aggarwal
EHRGym addresses a core clinical-AI challenge: the long, friction-filled reality of EHR workflows that hinder practical use far beyond diagnosis and treatment.
Adrian Serapio
Our project is an environment designed for an agent to oversee 7 agents playing a popular strategy game Diplomacy.
Masaki Tanaka Allwardt, Ronok Tanvir, Aryan Gupta
The bottleneck for RL-trained LLMs isn't algorithms — it's environments.
Jithin James
InsureClaim AI: Teaching LLMs to Investigate Before They Decide Insurance claims cost $40B annually.
Pramod Misra
A PyTorch-based Generative Adversarial Network (GAN) for training and generating pixel art images.
Lily Su, Cal Cu, sam sam
SalaryNegotiationArena is an OpenEnv MCP environment where LLM agents learn salary negotiation by sparring with 5 AI hiring experts with hidden priorities and styles (analytical, aggressive, collaborative, bureaucratic,
Yash Joshi
Our project solves the problem of AI alignment by creating a game-theory inspired environment where models take actions and receive rewards.
Lukasz G Bartoszcze, Jakub Towarek
RL-IVR is a three-layered RL environment that trains voice agents to replace legacy IVR systems.
Harshit Rajgarhia, Abhishek Mukherji, Karl Johannes
WatchDog is an RL environment training AI oversight agents to detect errors in real-time.
Mooizz Abdul, Abhilash Ganga, Raghu Vamshi Hemadri
An email marketing simulation for an e-commerce brand to increase sales
Gleb Tsyganov
LifeOps is an OpenEnv environment for training AI agents to act as intelligent personal scheduling assistants.
Hilary Chung, Andrea Victoria Lukas
WorldEnv is an OpenEnv environment factory powered by canvas-engineering and a General Unified World Model (GUWM).
Jacob Valdez
Frontier models are surprisingly bad at using tools.
Lily Zhang
🔬 HYPOTHESIS ENGINE Teaching AI to Reason Like a Scientist THE GAP Existing RL environments treat reasoning as retrieval.
Sameer Kashyap, Abhinav Sudhakar Dubey
Modern data science workflows are fragmented and slow: answering a single business question often requires multiple specialists (data engineers, analysts, scientists) and weeks of manual work cleaning, transforming, and
Ricardo Alanis, Isra Mata
OpenEnv environment for training a trader in a scarce-GPU market with scripted background actors, hidden incentives, delayed rewards, and partial observability.
Kian Kyars
An env where an agent manages a team's calendar in a dynamic world.
Lucas Zheng
We built an OpenEnv RL environment that trains an LLM to act as a Staffing Agency CEO over a 52-week simulated year.
Karthik Raja Anandan, Shubham Gaur
We sought to build the best NFL coach the world has ever seen.
Calvin Beighle, Anthony Fletcher
Temporal Agents: We gave agents the ability to rewind time.
Ayush Paul, Shubham Patil
RL Environment for Adversarial Robustness Training.
Nelson Lai
GitHub: https://github.com/Sidra/opsgate W&B: https://wandb.ai/code-happy-sf/opsgate OpsGate is a simulation-based reliability gate for enterprise AI agents.
Sidra Miconi
Hypernoa Astrum is an adaptive RL environment built on OpenEnv 0.2.1 that trains AI to reason, adapt, and align — not just solve tasks.
Appalanaidu Bobbili
ComputeExchange is the Expedia or Uber or AirBNB of compute resources.
Sachin Keswani
MarketForge is an AI-powered market intelligence platform that uses reinforcement learning to train smart agents to make optimal trading and negotiation decisions.
Kaniska Mandal
Repository-to-RLEnv converts real Python repositories into executable RL environments for code agents.
Artemii Shirokov
Diplomatic Negotiation RL Environment - OpenEnv Hackathon 2026
Samuel Dinkayehu
Urban traffic congestion degrades commute times, increases emissions, and strains infrastructure, primarily because fixed-cycle traffic lights can't adapt to real-time conditions.
Aditya Mangalampalli, Kevin Truong
Upskiller is an RL environment that trains LLMs to agentically invoke skills — deciding which to load, when to unload, and when to submit under a context budget.
Nikhil Pujari
A self-improving environment where LLM agents rewrite their own skill instructions through a generate → evaluate → optimize loop.
Kabalan Gaspard, Lifei Chen
Road Traffic Simulator — OpenEnv RL Environment An OpenEnv-compliant RL sandbox for global traffic flow optimization on real road networks.
Yury Kirpichev, George Karpenkov
Adaptive Navigation OpenEnv is a partially observable exploration environment designed for training and evaluating LLM agents on multi-step planning tasks.
Harish Chaurasia
The Wise Negotiator is a universal negotiation environment where an LLM agent learns WHO it’s talking to using Bayesian belief updates — and shifts strategy accordingly.
Murugs Karmegam
RoboReplan is a tabletop planning environment for OpenEnv that targets Problem Statement 3.1 (World Modeling: Professional Tasks).
Jwalin Shah
This is an environment to do RL training and other forms where an LLM can play the game teeworlds https://teeworlds.com/, 4 bots shown in video
VendSim VB2 is an OpenEnv 0.2.1 environment that drops an LLM agent into a 365-day vending machine business simulation.
Robert Amanfu
The RANS paper ( https://arxiv.org/abs/2310.07393 ) was implemented and the OpenEnv interface wrapped around it.
Daniel Pang
Enterprise QA Multi-Agent Environment is an adversarial reinforcement learning simulation where an AI "Taskmaster" generates complex, domain-specific business questions (finance, operations, real estate) and pits them ag
Building an environment to train both a Coordinating LLM and an LLM agent to run on the Pollen Robotic's Reachy Mini.
Steven Pousty
WRL-Dragon automates reinforcement learning policy development using a hierarchical multi-agent interaction system.
Warren Low, Farhan Navas
Reinforced medical diagnosis reasoning using ICD-10 as a diagnosis scaffold.
Patrick Damaso, Aaron Fanous
10 OpenEnv cognitive primitives that train generalist agents.
Jon Yeazel
LedgerLab LedgerLab is a memory-first Jupyter workspace environment for training long-horizon business agents with OpenEnv.
vivek shukla
This openEnv is a prototype where the stellarator community can look at it as a reference for how to build a RL env for stellarator parameters optimization.
JungDae Suh
An env to train the ability to design communication protocols for terse agent to agent communication
Ujjwal Nadhani, Shinnosuke Uesaka
**Project Description:** LinguaEnv is an interactive evaluation environment designed to test and train AI agents on **morphological disambiguation**, a core challenge in natural language understanding.
PRANA is an environment for training and evaluating AI agents on clinical administrative workflows.
Pradeep Banavara
Greedy Realtors is a multi-agent execution environment for simulating a realistic real estate market.
David S, VijayaGanesh Mohan, Richard Franklin
We created a simulator to simulate Smash Bros Melee and using a reward system we create the play style of our favorite smash players from scratch.
Brandon Tautuan, Mathew Rolf
GardenRL teaches AI agents to grow hydroponic lettuce through 30-day episodes with delayed rewards.
Yves Hughes
ClinKriya bridges the critical gap between clinical AI capability and real-world EHR workflows by providing the first RL training environment built on FHIR — enabling small, deployable models to learn multi-step clinical
Ananya Mantravadi, Prasanna Desikan
Among LLMs is a game-like OpenEnv benchmark where attacker, defender, and overseer agents interact in sabotage-style workplace tasks.
Barath Anandan, Baladhurgesh Balagurusamy Paramasivan
Openenv Autoscaling Control Center is a packaged OpenEnv environment for training and evaluating agents on cloud-service autoscaling and service stability tasks.
Sriram Madduri
ReplicaLab is an OpenEnv-based multi-agent environment for evaluating and training AI systems to design realistic replication and experiment plans under constraints.
Max Xie, Kush Ise, Ayush Ojha
APEX Labs trains LLM agents to do real professional work — not pass tests.
Raahul Vignesh Manikandan, Vijay Sithambaram
SentinelOps Arena is a multi-agent adversarial reinforcement learning environment for enterprise AI safety.
Nihal Nihalani, Charlie Gillet
An AI auditor learns to catch other agents cheating in a competitive procurement auction market, without ever being told who's dishonest.
Nick Shapiro
Self Supervised task generation for teaching AI Coding Agents to become Recursive language models.
Kevin King
AI-powered world simulation where you can be anyone and be anything!
Soham Patil
We’re building a Waymo-style autonomous driving simulator UI that continuously generates and compares “counterfactual” rollouts driven by an OpenEnv policy.
Steve Kuo, Shryuk Grandhi, Aksh Parekh
Every time you use an AI coding assistant, you correct it.
Natnael Kahssay
We enable models to hillclimb non-computationally verifiable domains through a co-evolutionary training setup, where a Dungeon Master agent procedurally generates increasingly difficult escape-room worlds and a Hero agen
Aarush Gupta
Optigami trains an LLM to generate FOLD-format crease patterns that fold into target origami shapes, using GRPO with Unsloth LoRA on Colab.
Prasanna A P, Sissi Wang, Iana Lin
Killer Sumdoku is a harder version of Sudoku.
Arnav Srivastava
Two-turn OpenEnv benchmark and training environment for egocentric social interaction, built on EgoNormia with benchmark replay and GRPO support for Cosmos-Reason2 policies.
Robert Zhang
ChessEcon is a live multi-agent reinforcement learning environment where two LLM agents — Qwen 2.5-0.5B (White, trainable) and Llama 3.2-1B (Black, frozen) — compete at chess for real economic stakes.
Suvasis Mukherjee
Pushing the frontier model on slide generation artifacts
Subra Arun, Karthik Ragunath Ananda Kumar
AEGIS is the first OpenEnv RL environment for AI security.
Hagen Schmidt
We started with a surrogate discovery env and foudn that it is excellent and beats pytorch.compile (36x) and trioton.autotune (3x) using a gaussian process optimized by out oracle.
Sai Pranav Sripathi, Sidhartha Mani, Aman Nindra
winner takes all survival simulation inspired by squid game glass bridge where the agents must negotiate,trade, collaborate and compete with one another for their own survival
Christine Baek
OpenEnv-WolfeClick is an OpenEnv-compatible environment for training LLMs in competitive Pokemon Showdown battles.
Atharva Walawalkar, Aditya Bangde
KernelForge-OpenEnv is an autonomous CUDA kernel optimization system that uses reinforcement learning to train language models to write high-performance GPU kernels for NVIDIA A100s.
William Chen, Yiying Xie
AlphaWolf is a self-play pipeline that teaches LLMs social deception through the game of Werewolf.
Andres Nino, Lex Hackett
HarFeast is a procedurally generated RL environment that simulates real management consulting engagements for a food manufacturing company.
Pranav Patel, Shasvat Jawahar
My project is to simulate a VC portfolio.
Shradha Agrawal
0x960 is an OpenEnv self-improvement environment where an agent improves a Chess960 engine by editing its evaluation code, benchmarking the result, and iterating through self-play.
Joshua Lin
In real disasters, you can’t rely on maps or connectivity.
Leandra T
Angentic backend that can research and wetlab workflow, run it and learn from the experience
Armin Foroughi
Stack Doctor is an RL environment (OpenEnv) that trains LLMs to diagnose GPU inference stack failures.
Blake Ledden
We built an OpenEnv reinforcement learning environment where an agent learns to act as an optimizer for training machine learning models.
Amogh Maheshwari, Savir D
Eephor—named after the ancient figures of oversight- is an agent oversight solution.
Executive Inbox is an OpenEnv 0.2.1 environment for multi-step personalized assistant workflows under schema drift.
Chung Hoon Hong
OpenEnv Dispatch Demo is an Uber-style ride-dispatch RL environment built on OpenEnv.
Ananta Verma
A reinforcement learning environment built on OpenEnv for training language models to manage personal task overload during natural disasters.
Ed Tan, Smriti Bhardwaj
Trenches is a multi-agent geopolitical crisis simulator and command interface built around six separately finetuned Qwen/Qwen3-8B models representing the US, Israel, Iran, Hezbollah, the Gulf, and an Oversight entity, al
Jerry Xiao, Alazar Manakelew
Varaha is a high-fidelity OpenEnv wildfire logistics benchmark for long-horizon agent training and evaluation.
Atin Kumar Singh
NegotiateEnv is an OpenEnv-compatible RL environment for training LLM agents to negotiate B2B SaaS contracts.
Kushal Atulbhai Adhyaru
**Statement 1: Multi-Agent Interactions** Dynamic Expert-in-the-Loop GRPO Training on Agent World Model What Is This?
karthik ganesan, Sanat Mouli, Mert Hidayetoglu
My project is about Adaptive Multi-Agent Deception: Can AI Learn to Sell to Adversarial Personalities?
Araav Nayak
Multi-agent interactions for vehicle game application, build RL environments, do agentic orchestration, and post-train a base model to improve its performance.
Hossam Elshahaby
Migration isn't a code problem — it's a domain knowledge problem." Copilots suggest lines of code.
Sudhir D
Patronet OpenEnv trains AI agents for critical emergencies like fires, wars, and disasters.
Mansi More, Rohit Korrapolu
Cluedo is a multi-agent Clue murder mystery game built on OpenEnv 0.2.1.
Saurabh Khire
From Scratch to Library.
michelle s
DriftPA trains LLM agents to be reliable personal executive assistants in a world that breaks without warning.
Rajashekar V