Pointelligence
May 31, 2026 ยท View on GitHub
Pointelligence
๐ Accelerating Point Cloud Learning for Spatial Intelligence
Installation โข Usage โข Citation โข Concepts
๐ About
Pointelligence is a high-performance library for 3D point cloud deep learning research. It provides efficient GPU-accelerated primitives and ready-to-use neural network architectures for spatial intelligence tasks.
โจ Highlights
| Feature | Description |
|---|---|
| ๐ฏ PointCNN++ | Official implementation of PointCNN++ (CVPR 2026) โ a significant evolution of PointCNN (NeurIPS 2018) |
| โก High Performance | Optimized CUDA kernels for native point convolution with minimal memory overhead |
| ๐ฆ Ragged Tensors | Efficient batching without padding โ process only valid data |
| ๐ง Modular Design | Build custom architectures from composable primitives |
| ๐ณ Docker Ready | One-command setup with pre-built CUDA extensions |
๐ Performance
PointCNN++ delivers state-of-the-art performance with significantly lower memory usage and faster training times compared to existing methods.
Memory Efficiency
Our native point-based approach fundamentally avoids the overhead of voxel-based auxiliary data structures:
|
|
|
Speed Benchmarks
Our custom Triton kernels (MVMR for forward, VVOR for backward) provide exceptional speed in both inference and training:
|
|
|
๐ฅ Clone the Repository
Clone the repository together with its third-party submodules (FCGF and Pointcept):
git clone --recursive https://github.com/ant-research/pointelligence.git
cd pointelligence
If you already cloned without --recursive, fetch the submodules with:
git submodule update --init --recursive
The submodules pin upstream-pristine commits of chrischoy/FCGF and Pointcept/Pointcept โ they are never edited in place. PointCNN++-specific adaptations live under overlays/ and are applied out-of-tree by each submodule's build.sh, which writes a ready-to-use copy under build/:
bash overlays/FCGF/build.sh
bash overlays/Pointcept/build.sh
This keeps examples/FCGF and examples/Pointcept 100% pristine; the build step is idempotent (re-running rebuilds in seconds). See overlays/README.md and docs/reproduction/00_setup_overlay.md for how the overlay system works.
๐ ๏ธ Installation
Option 1: Local Installation
Some operators are implemented in C++/CUDA as PyTorch extensions; build and install them with:
conda create -n pointelligence python=3.10 -y
conda activate pointelligence
pip install -r requirements.txt
cd extensions
pip install --no-build-isolation -e .
Option 2: Docker Installation
Use Docker for a containerized environment with all dependencies pre-installed:
# Build the Docker image
docker build -t pointelligence .
# Test the containerized environment
docker run --gpus all -it -v $(pwd):/workspace pointelligence
# Verify installation
python -m pytest tests/unittest/ -v
The Docker image includes:
- CUDA 12.6 + cuDNN + PyTorch 2.6.0+ with GPU support
- Pre-built CUDA extensions (
sparse_engines_cuda) - All system dependencies and Python packages
- Sample data preloaded
- Ready-to-use development environment
๐ก Basic Usages
Both example pipelines run against the overlay-built submodule trees, so run bash overlays/FCGF/build.sh and bash overlays/Pointcept/build.sh first (see Clone the Repository above) โ the overlay build is what injects PointCNN++ into the otherwise-pristine upstream code, producing ready-to-run copies under build/.
For complete, copy-pasteable train โ evaluate commands, follow the reproduction guide: docs/reproduction/.
Point Cloud Registration โ FCGF
PointCNN++ serves as the backbone of a Fully Convolutional Geometric Features registration pipeline โ it learns per-point descriptors that match corresponding points across two overlapping scans. The reproduction guide covers the 3DMatch (RGB-D) and KITTI (LiDAR) registration benchmarks end to end.
Point Cloud Segmentation โ Pointcept
PointCNN++ plugs into the Pointcept framework as a semantic-segmentation backbone, trained with Pointcept's standard tools/train.py driver and a PointCNN++ model config. The reproduction guide covers self-supervised pretraining and NuScenes semantic-segmentation fine-tuning.
๐ Citation
Pointelligence is the repo for the official implementation of:
- PointCNN++: Performant Convolution on Native Points
Lihan Li, Haofeng Zhong, Rui Bu, Mingchao Sun, Wenzheng Chen, Baoquan Chen, Yangyan Li@misc{li2025pointcnnperformantconvolutionnative, title={PointCNN++: Performant Convolution on Native Points}, author={Lihan Li and Haofeng Zhong and Rui Bu and Mingchao Sun and Wenzheng Chen and Baoquan Chen and Yangyan Li}, year={2025}, eprint={2511.23227}, archivePrefix={arXiv}, primaryClass={cs.CV}, url={https://arxiv.org/abs/2511.23227}, }
๐ Feature Requests and Issues
To ensure they are tracked effectively, please submit feature requests and issue reports here rather than via email.
๐ฌ Core Concepts
For building custom architectures, see docs/ADVANCED.md covering:
- Ragged tensors โ efficient batching without padding
- Neighborhoods โ fixed-radius search producing (i, j) pairs
- Convolution triplets โ extending (i, j) to (i, j, k) to route data through kernel weights
- MVMR โ the sparse convolution operator:
output[i] += weight[k] @ input[j]