Study on Design of LiDAR Compression

April 15, 2024 · View on GitHub

All the following experiments are conducted with 4 NVIDIA 3090 GPUs on KITTI-360 (64-beam).

Tip: Download the video instead of watching it with the Google Drive's built-in video player provides a better visualization.

Autoencoders (trained with 40k steps, evaluated on reconstruction):

Curvewise
Factor
Patchwise
Factor
Output
Size
rFRID(↓)rFSVD(↓)rFPVD(↓)CD(↓)EMD(↓)#Params (M)DirectoryVisualization of Reconstruction (val)
N/AN/AGround Truth-------Range Image, Point Cloud
4164x256x20.212.913.80.0690.1519.52Google DriveRange Image, Point Cloud
8164x128x30.921.217.40.1410.23010.76Google DriveRange Image, Point Cloud
16164x64x42.831.123.90.2200.26512.43Google DriveRange Image, Point Cloud
32164x32x816.449.038.50.4380.34413.72Google DriveRange Image, Point Cloud
1232x512x21.525.023.80.0960.1782.87Google DriveRange Image, Point Cloud
1416x256x40.615.415.80.1420.23312.45Google DriveRange Image, Point Cloud
188x128x1617.735.733.10.3840.32715.78Google DriveRange Image, Point Cloud
1164x64x6437.168.763.90.6990.41616.25Google DriveRange Image, Point Cloud
2232x256x30.411.212.20.0940.19913.09Google DriveRange Image, Point Cloud
4232x128x43.919.616.60.1970.23614.35Google DriveRange Image, Point Cloud
8232x64x88.025.320.20.2770.29416.06Google DriveRange Image, Point Cloud
16232x32x1621.554.244.60.4910.37117.44Google DriveRange Image, Point Cloud
2416x128x82.516.915.80.2050.27315.07Google DriveRange Image, Point Cloud
4416x128x1613.829.525.40.3410.31716.86Google DriveRange Image, Point Cloud

LiDMs (trained with 10k steps, evaluated on generation):

Curvewise
Factor
Patchwise
Factor
Output
Size
FRID(↓)FSVD(↓)FPVD(↓)JSD(↓)MMD(104^-4,↓)Directory
N/AN/AGround Truth-----
4164x256x22711481180.2625.33Google Drive
8164x128x316285680.2345.03Google Drive
16164x64x41421161060.2325.15Google Drive
1232x512x22051541320.2486.15Google Drive
1416x256x418060550.2305.34Google Drive
188x128x1619288780.2435.14Google Drive
2232x256x316173630.2285.44Google Drive
4232x128x414577680.2225.10Google Drive
8232x64x818883710.2285.33Google Drive
2416x128x816256490.2284.82Google Drive
4416x128x1619580700.2405.84Google Drive

LiDM Performance with Different Scaling Factors: