All projects
PerceptionResearch
slam3d
Turn a 360° construction walkthrough into an explorable, floor-plan-aligned 3D map.
Overview
slam3d is an offline, stage-based pipeline for panoramic visual SLAM on construction sites. It takes a stitched equirectangular video, or a calibrated dual-fisheye ROS bag, plus a floor plan (mask, drawing, PDF or DXF). It produces timestamped trajectories, dense point clouds, plan overlays, object tracks and reports.
The pipeline runs panorama ingest → stella_vslam with loop closure → gravity and scale estimation → PanoVGGT depth → structural alignment with the plan → open-vocabulary objects lifted into 3D → particle-filter localization against the plan. Stages resume automatically when their configuration hasn't changed.
Highlights
- 01Monocular 360° SLAM with loop closure, gravity alignment and scale recovery.
- 02Floor-plan registration with confidence checks, manual seeding and local drift refinement.
- 03YOLOE open-vocabulary detections lifted into 3D with static/dynamic association.
- 04Causal particle-filter replay for plan-based localization.
- 05Synchronized video / plan / 3D browser viewer, plus an experimental Gaussian-splat world view.