MLSLabsRenderer-Lite

April 24, 2026 · View on GitHub

License

English | 中文

Introduction

MLSLabsRenderer-Lite is a high-performance Unreal Engine 5 (UE5) plugin developed by MaLanShan Audio & Video Laboratory. It is designed for real-time visualization, management, and scalable hybrid rendering of 3D Gaussian Splatting (3DGS) and dynamic Volumetric Video (4DGS).

Unlike traditional Niagara-based solutions, this plugin utilizes a custom low-level rendering pipeline. This allows it to maintain exceptionally high frame rates even when processing millions of Gaussians, effectively bypassing common performance bottlenecks.

Since we are at early access, current accessible features are summarized below:

  • High-Performance Static 3DGS: Supports 7M+ Gaussians while maintaining 50+ FPS(tested on NVIDIA RTX 4070 Ti).
  • Dynamic 4DGS Playback: Real-time volumetric video sequence playback supporting 100K+ Gaussians at 100+ FPS(tested on NVIDIA RTX 4070 Ti).
  • Sequencer Integration: Full support for UE Sequencer, allowing keyframe control over volumetric playback.
  • Native Custom Engine: Built from the ground up (Non-Niagara) for maximum throughput and low latency.
  • Production Workflow: Seamless integration with native UE assets and rapid resource importing.

Getting Started

Video Tutorial

Youtube（English）：
How to Use MLSLabsRenderer (Gaussian Splatting) Plugin in UE5(Updated)

B站（中文）：
MLSLabsRenderer（高斯泼溅）插件操作教程

System Requirements

  • Operating System: Windows 10 or 11 (64-bit)
  • Unreal Engine: 5.5.x
  • Graphics API: DirectX 12
  • GPU Requirements: NVIDIA GPU supporting Shader Model 7.5 or higher (Turing architecture and above).
  • Minimum Hardware: NVIDIA GeForce RTX 2060 or better.
  • Recommended Hardware: NVIDIA GeForce RTX 4070Ti or better.

Plugin download

  1. Open github Release page

  1. Select the appropriate plugin version according to the engine version..

  2. Download the zip file.

  1. Installation: To package your project, unzip downloaded zip to your Engine Installation Path Plugins\Marketplace.

If there is no Marketplace directory, please create a new one.

Alternatively, unzip it directly into your project's Plugins\ folder.

Attention, To ensure successful project packaging, unzip the MLSLabsRenderer folder to your UE5.5 Engine directory

This plugin conflicts with the Jawset Postshot UE5 plugin. Please back up the Jawset Postshot plugin to a directory outside the Plugins folder or to the Plugins\Marketplace directory.

  1. Open Unreal Editor，enable the MLSLabsRenderer Plugin, and restart editor.
  1. After launching the Unreal Editor, open the environment setup prompt or click the "Setup Environment" button in the navigation bar.

    

     7. In the Setup Environment window, click "Install Dependencies".

    

     8. The system will begin downloading and installing the LibTorch package. Please wait for the process to complete.

    

If the download fails and the following error occurs:

       

       You can try downloading the libtorch library directly from this link: (https://download.pytorch.org/libtorch/cu128/libtorch-win-shared-with-deps-2.7.0%2Bcu128.zip), and then extract it to the following directory:

       

     9. Once installation is finished, click to restart the Editor automatically.

    

     10. If the automatic restart fails, you must manually restart the Editor. This step is crucial; otherwise, the plugin will not load correctly.

    

It is recommended to download .ply files from TestData Dir, which can then be imported into Unreal Engine (UE) via this plugin for real-time rendering.

Import Static Gaussian Splatting Models

Open Unreal Editor, create a new Demo project, and create a new Level.

1.Click on the 'Import single 3D Gaussian Splatting file' button on the navigation bar.

2.Select your 'ply' file.

3.After importing, drag the Blueprint (BP) asset into the viewport.

4.The scene will render. You can adjust its position using the Move, Rotate, and Scale gizmos. 'Note': The "Splat Data Path" uses an absolute path. If you move the project or clone it to a new machine, ensure you update the path to point to your local .ply file.

Import Animated Gaussian Splatting (4DGS/Volumetric Video)

1.Click the 'Import multiple 3D Gaussian Splatting files' button on the navigation bar.

2.Select the .ply files. (You do not need to select all files; selecting two or more files will load the entire sequence in that directory).

3.Drag the animation BP asset into the viewport.

4.The first frame will render. 'Frame Count' indicates the total number of frames loaded.

You can adjust its position using the Move, Rotate, and Scale gizmos. 'Note': The "Splat Data Path" uses an absolute path. If you move the project or clone it to a new machine, ensure you update the path to point to your local .ply file's directory.

5.You can press the 'F' key to focus on the Gaussian Splatting Actor when it is selected.

6.To enable playback: Click the 'Add' button in the Details panel. Search for and add the 'Volume Actor' component.

Click the 'Play' (Run) button on the top navigation bar.

the Volume video(4DGS) will be played.

Keyframe Control via UE Sequencer

1.Create Level Sequence.

2.Add the selected Animation Gaussian Splatting Actor to the Sequencer.

3.Add the AnimSplattingComponent to the track.

4.Add Frame Index to the track.

5.Add keyframes to the 'Frame Index' track as needed to control playback.

Packaging for Windows

The plugin is currently provided as a Shipping package, so you must set your Build Configuration to Shipping. Packaging environment requirements: Visual Studio 2022, MSVC v143 x64.

Important: After packaging, ensure the .ply files are stored in the same absolute data path on the target machine for the application to run correctly.