Skip to content
Shure MV6

Vox Populi

3D sandbox game where you dynamically interact with AI Agents through speech.

Core trick

Speech is transcribed and sent with world state to each NPC's LLM agent, which replies in character and can trigger in-game actions.

Tags

Built with

elevenfluxnextjsopenaireactthree.js

Description

Inspiration We love playing video games, but even the most opened world games have finite amounts of combination of interactions, stories, or characters, which are time consuming and costly to develop. We feel there are untapped opportunities in the video game industry to have a truly immersive and interactive experience for players. What if you could interact and negotiate with every character in a game, or command a group of NPCs or even generate totally unique assets, using your voice and GenAI? What it does Vox Populi is a 3D game, with fully generated AI agents with a focus on conversation. You play a king and all other characters are your subjects. It focuses on three elements: Single Interaction: having conversations or commanding an action (such as attacking each other) using your voice Group Interaction (AOE): commanding a group of NPCs to perform an action. Unique Asset Generation: Negotiating with the blacksmith to create unique armour or weapons through iterative discussion. How we built it We built out own game engine using NextJS and ThreeJS to handle custom AI entities, voice inputs, world interactions. Developed using Claude and Cursor. Challenges we ran into Complex inter-agent interactions, feature creep, developing a game engine from scratch in JS. Accomplishments that we're proud of We did it ! And got some wonderful core functionality developed. What we learned So much - Mostly to do with designing a reasonable game engine. What's next for Vox Populi We shall see - Lots of interest from other to either play it or open source the code. We shall see ;)

Team