UniGen ๐Ÿš€

October 14, 2025 ยท View on GitHub

90% Faster, 100% Code-Free: MLLM-Driven Zero-Code 3D Game Development

UniGen is the first end-to-end multi-agent framework for automated Unity game creation. From a natural language description, UniGen generates runnable 3D games without requiring a single line of manual code.

Backed by Multimodal Large Language Models (MLLMs), UniGen automates the entire pipeline:

  1. Planning Agent โ€“ interprets natural language into structured blueprints.
  2. Generation Agent โ€“ produces robust Unity C# scripts.
  3. Automation Agent โ€“ builds and configures Unity scenes.
  4. Debugging Agent โ€“ fixes issues interactively via conversational debugging.

๐ŸŽฅ Demo Video
๐Ÿ“„ Paper


โœจ Features

  • Zero-Code Development โ€“ create Unity games with just natural language prompts.
  • End-to-End Automation โ€“ no manual engine configuration, component binding, or script integration.
  • Multi-Agent Framework โ€“ specialized agents for planning, code generation, scene assembly, and debugging.
  • High Efficiency โ€“ reduces development time by 91.4% compared to manual workflows.
  • High Functional Completeness โ€“ achieves >89.5% correctness across diverse game prototypes.
  • Unity Integration โ€“ outputs a ready-to-run Unity project with Editor + Runtime scripts.

๐Ÿ“ฆ Installation

Prerequisites

  • Python 3.8+
  • Unity 2021+ (tested with LTS versions)
  • An OpenAI / MLLM API key (e.g., GPT-4.1 or Gemini-2.5)

๐Ÿš€ Usage

  1. Describe your game idea in plain English
  2. Run the pipeline:bash python blue_pipeline.py
  3. UniGen will: a)Generate Unity C# scripts (PlayerController, UIManager, etc.). b)Build a scene with configured objects and components. c)Save all assets into UnityProject/Assets/. d)Open the Unity project, press play, and your game is ready!
  4. open the Unity project, press play, and your game is ready! ๐ŸŽฎ

๐Ÿ“‚ Project Structure

UniGen/
โ”‚โ”€โ”€ blue_pipeline.py         # Main automation pipeline
โ”‚โ”€โ”€ gpt_interface.py         # GPT/MLLM connector
โ”‚โ”€โ”€ requirements.txt
โ”‚โ”€โ”€ README.md

๐Ÿงช Benchmarks

UniGen was tested on three prototypes:

Game PrototypeFunctional CompletenessDev Time Reduction
Obstacle Run100%91.4%
Coin Collection93.8%91.4%
Haunted Jaunt (Unity demo)89.5%91.4%
  • Average development reduced from 140 mins โ†’ <12 mins.
  • Manual operations reduced from 75 โ†’ <5.

๐Ÿ“Š Architecture

UniGenโ€™s pipeline operates via four agents:

  • Planning Agent โ†’ JSON blueprints of entities & logic.
  • Generation Agent โ†’ Unity-ready C# scripts.
  • Automation Agent โ†’ Scene construction via Unity Editor APIs.
  • Debugging Agent โ†’ Conversational, automated error correction.


โš ๏ธ Limitations

  • Complex NPC behavior trees not yet fully automated.
  • Multiplayer synchronization requires future enhancements.
  • Currently optimized for Unity, but engine-agnostic by design.