๐Ÿš€ GenSmoke-GS

March 26, 2026 ยท View on GitHub

๐Ÿš€ GenSmoke-GS

๐Ÿ”ฅ Results and code released. Gaussian weights (1โ€“20 runs) are now available.


๐Ÿ“Œ Overview

GenSmoke-GS is a reconstruction-oriented multi-stage pipeline designed to improve 3D reconstruction under smoke-degraded multi-view conditions.

It consists of two main modules:

  • ๐Ÿ”ง 2D Enhancement: UDPNet restoration โ†’ DCP dehazing โ†’ MLLM enhancement
  • ๐Ÿงฑ 3D Reconstruction: 3DGS-MCMC training โ†’ multi-run fusion

๐Ÿ–ผ๏ธ Method Pipeline


๐Ÿ”„ Pipeline Summary

Haze Images
   โ†“
UDPNet Restoration
   โ†“
DCP Dehazing
   โ†“
MLLM Enhancement
   โ†“
3DGS-MCMC Reconstruction (91 runs)
   โ†“
Multi-run Averaging
   โ†“
Final NVS Results

๐Ÿ“‚ Repository Structure

2d_enhancement/     # UDPNet + DCP + MLLM enhancement
3d_reconstruction/  # 3DGS-MCMC + FasterGS + fusion
pip.png
README.md

๐Ÿš€ Quick Start

1๏ธโƒฃ 2D Enhancement (UDPNet + DCP)

cd 2d_enhancement

pip install -r requirements.txt
pip install -r dcp_dehaze/requirements.txt

python run_udp_then_dcp.py \
  --scene_roots <input_dataset_dirs> \
  --out_root <output_dir> \
  --ckpt code/UDPNet/UDPNet_checkpoints/ConvIR_UDPNet_ITS.ckpt

๐Ÿ“ฆ External Dependencies & Weights

This module relies on several external methods.


๐Ÿ“Š Our Released Results (After UDPNet + DCP)


๐Ÿง  MLLM Enhancement (GPT-Image-1.5)

This stage performs view-wise enhancement using the OpenAI image generation API.


๐Ÿ”ง Model


๐Ÿ“„ Prompt


๐Ÿ“Š Our Released Results (MLLM Outputs)


๐Ÿงฑ 3๏ธโƒฃ 3D Reconstruction

cd 3d_reconstruction

bash install.sh
sudo apt install -y colmap

./train.sh /path/to/dataset_parent

๐Ÿ“Š Our Released Results (3D Reconstruction)


๐Ÿง  Gaussian Weights (Released)

We additionally provide trained Gaussian splatting weights from runs 1โ€“20:

๐Ÿ“Œ Notes:

  • These weights are obtained from 20 independent runs

  • The performance is comparable to the full 91-run averaging results

  • Useful for:

    • faster evaluation
    • lightweight reproduction
    • ablation studies

๐Ÿ“ Dataset


๐Ÿšง Release Plan

โœ… 2026-03-25

  • Results released

โœ… 2026-03-26

  • Code released

โœ… 2026-03-27

  • Gaussian weights (partial) released

๐Ÿ“ฆ TODO

  • Upload results
  • Upload code
  • Upload Gaussian weights (1โ€“20 runs)

๐Ÿ“ฌ Contact

If you have any questions:

  • Open an Issue
  • Contact the authors