~/projects/echobound
Echobound
A multiplayer game with a voice-controlled companion
Unity 6C#FishNetSteamworkswhisper.unityLLMHDRP
$ overview
I wanted to explore what it would feel like to talk to a game companion rather than choose every command from a menu. Echobound is a multiplayer extraction roguelike in development with a small team, with that interaction at the center of the companion system.
The pipeline captures push-to-talk audio, transcribes it with whisper.unity, and asks an LLM to interpret the request against the companion's available abilities. The resulting command goes through FishNet's server-authoritative networking. The challenge is connecting a loosely worded request like 'follow me' to a specific game action and keeping that action consistent for the other players.
$ implementation notes
- Spoken requests are interpreted against the companion's available abilities before being dispatched as game commands.
- Companion actions run through server-authoritative networking so their execution can be coordinated across players.
- Steamworks supplies lobbies and player identity for multiplayer sessions.