Model card for part-a2.kitti.mmdet3d

A Part-A2 3D object detection model (part-aware two-stage voxel detector). Trained on KITTI.

Model Details

Model Type: 3D object detection
Model Stats:
- Params (M): 54.9
- Input channels: 4
- Classes: 3
- Features: 512
Dataset: KITTI
Metrics: mAP 68.34, AP/Car 79.03, AP/Pedestrian 55.28, AP/Cyclist 70.7
Paper: From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Network
Converted from: open-mmlab/mmdetection3d (Apache-2.0)
Library: torch-pointcloud

Install

pip install torch-pointcloud

This checkpoint also needs spconv, which needs a build matching your torch and CUDA: see the installation guide.

Usage

import torch
import torch_pointcloud as tp
from torch_pointcloud.utils.data import collate

model, info = tp.create_model(
    "part-a2.kitti.mmdet3d",
    pretrained=True,
    return_info=True,
)
model = model.cuda().eval()  # GPU-only kernels

# synthetic sample with the keys a dataset provides
num_points = 8192
sample = {
    "pos": torch.randn(num_points, 3),
    "intensity": torch.rand(num_points, 1),
}
data = info["transform"](sample)
data = collate([data], batch_from="pos_voxel")
data = {key: value.cuda() for key, value in data.items()}

with torch.no_grad():
    out = model(data["voxel"], data["pos_voxel"], data["voxel_num_points"], data["batch"])

Feature extraction

with torch.no_grad():
    features = model.forward_features(
        data["voxel"],
        data["pos_voxel"],
        data["voxel_num_points"],
        data["batch"],
    )  # 512 channels

Citation