YOLOv8-OBB static batch

简体中文 | English

🔧 trtyolo-export is the official ONNX conversion tool for the TensorRT-YOLO project, providing a simple and user-friendly command-line interface to help you convert already-exported YOLO-family ONNX models into TensorRT-YOLO compatible outputs. The converted ONNX files have pre-registered the required TensorRT plugins (including official and custom plugins, supporting detection, segmentation, pose estimation, OBB, etc.), significantly improving model deployment efficiency.

✨ Key Features

• Comprehensive Compatibility: Supports exported ONNX models from YOLOv3 to YOLO26, as well as model families such as YOLO-World and YOLO-Master, covering object detection, instance segmentation, pose estimation, oriented object detection (OBB), and image classification. See 🖥️ Model Support List for details.
• Built-in Plugins: The converted ONNX files have pre-integrated TensorRT official plugins and custom plugins, fully supporting multi-task scenarios such as detection, segmentation, pose estimation, and OBB, greatly simplifying the deployment process.
• Flexible Configuration: Provides parameter options such as target opset conversion, threshold tuning, maximum detections, and optional onnxslim simplification to meet different deployment requirements.
• One-Click Conversion: A concise and intuitive command-line interface with automatic model structure detection, no complex configuration required.

🚀 Performance Comparison

💨 Quick Start

Installation

📦 Recommended Method: Install via pip

In a Python>=3.8 environment, you can quickly install the trtyolo-export package via pip:

pip install trtyolo-export

🔧 Alternative Method: Build from Source

If you need the latest development version or want to make custom modifications, you can build from source:

# Clone the repository (if you don't have a local copy yet)
git clone https://github.com/laugh12321/TensorRT-YOLO

# Enter the project directory (assuming you're already in this directory)
cd TensorRT-YOLO

# Switch to the export branch
git checkout export

# Build and install
pip install build
python -m build
pip install dist/*.whl

Basic Usage

After installation, you can use the conversion functionality through the trtyolo-export command-line tool:

# View installed version
trtyolo-export --version

# View command help information
trtyolo-export --help

# Convert a basic ONNX model
trtyolo-export -i model.onnx -o output/model-trtyolo.onnx

If you need to query the installed version from Python:

python -c "import trtyolo_export; print(trtyolo_export.__version__)"

🛠️ Parameter Description

The trtyolo-export command supports the following parameters:

📝 Usage Examples

Conversion Examples

# Convert a basic ONNX model
trtyolo-export -i yolov8s.onnx -o output/yolov8s-trtyolo.onnx

# Convert with a target opset
trtyolo-export -i yolov10s.onnx -o output/yolov10s-trtyolo.onnx --opset 12

# Tune TensorRT NMS plugin parameters
trtyolo-export -i yolo11n-obb.onnx -o output/yolo11n-obb-trtyolo.onnx --max-dets 100 --iou-thres 0.45 --conf-thres 0.25

# Simplify the converted ONNX with onnxslim
trtyolo-export -i yolo12n-seg.onnx -o output/yolo12n-seg-trtyolo.onnx -s

# Convert quietly
trtyolo-export --quiet -i model.onnx -o output/model-trtyolo.onnx

# Avoid overwriting the source file
# If -o and -i are the same path, the actual output becomes yolo11n-pose-trtyolo.onnx
trtyolo-export -i yolo11n-pose.onnx -o yolo11n-pose.onnx

TensorRT Engine Construction

The converted ONNX model can be further built into a TensorRT engine using the trtexec tool for optimal inference performance:

# Static batch
trtexec --onnx=model.onnx --saveEngine=model.engine --fp16

# Dynamic batch
trtexec --onnx=model.onnx --saveEngine=model.engine --minShapes=images:1x3x640x640 --optShapes=images:4x3x640x640 --maxShapes=images:8x3x640x640 --fp16

# ! Note: For segmentation, pose estimation, and OBB models, you need to specify staticPlugins and setPluginsToSerialize parameters to ensure correct loading of custom plugins compiled by the project

# YOLOv8-OBB static batch
trtexec --onnx=yolov8n-obb.onnx --saveEngine=yolov8n-obb.engine --fp16 --staticPlugins=/your/tensorrt-yolo/install/dir/lib/libcustom_plugins.so --setPluginsToSerialize=/your/tensorrt-yolo/install/dir/lib/libcustom_plugins.so

# YOLO11-OBB dynamic batch
trtexec --onnx=yolo11n-obb.onnx --saveEngine=yolo11n-obb.engine --fp16 --minShapes=images:1x3x640x640 --optShapes=images:4x3x640x640 --maxShapes=images:8x3x640x640 --staticPlugins=/your/tensorrt-yolo/install/dir/lib/custom_plugins.dll --setPluginsToSerialize=/your/tensorrt-yolo/install/dir/lib/custom_plugins.dll

📊 Conversion Structure

The converted ONNX model structure is optimized for TensorRT inference and integrates corresponding plugins (official and custom). The model structures for different task types are as follows:

🖥️ Model Support List

Symbol Explanation: ✅ means trtyolo-export can convert and can inference | 🟢 means the upstream or repository export path can be used directly for inference | - means this task is not provided | ❎ means not supported

❓ Frequently Asked Questions

1. Why do some models require referring to official export tutorials?

Official repositories for models like YOLOv6, YOLOv7, and YOLOv9 already provide ONNX export functionality with EfficientNMS plugins. If those official ONNX files already satisfy your deployment requirements, you may not need an extra conversion step.

2. Which conversion parameters should be adjusted first?

• --max-dets limits the number of final detections produced by appended TensorRT NMS plugins
• --conf-thres filters low-confidence predictions in plugin-based and NMS-free outputs
• --iou-thres controls overlap suppression when TensorRT NMS plugins are appended
• -s, --simplify runs onnxslim; if your downstream toolchain is sensitive, retry without it
• --opset is only needed when your downstream runtime requires a specific ONNX opset version

3. What to do if errors are encountered during the conversion process?

• Ensure that the correct version of dependent libraries is installed in your environment
• Check that the input ONNX file exists and the output path ends with .onnx
• Confirm that the exported ONNX graph you are using is in the support list
• If opset conversion fails, retry without --opset or choose a compatible version
• For models with custom graph modifications, ensure the exported ONNX structure still matches one of the supported conversion patterns