All projects
PerceptionResearch

slam3d

Turn a 360° construction walkthrough into an explorable, floor-plan-aligned 3D map.

Overview

slam3d is an offline, stage-based pipeline for panoramic visual SLAM on construction sites. It takes a stitched equirectangular video, or a calibrated dual-fisheye ROS bag, plus a floor plan (mask, drawing, PDF or DXF). It produces timestamped trajectories, dense point clouds, plan overlays, object tracks and reports.

The pipeline runs panorama ingest → stella_vslam with loop closure → gravity and scale estimation → PanoVGGT depth → structural alignment with the plan → open-vocabulary objects lifted into 3D → particle-filter localization against the plan. Stages resume automatically when their configuration hasn't changed.

Highlights

  • 01Monocular 360° SLAM with loop closure, gravity alignment and scale recovery.
  • 02Floor-plan registration with confidence checks, manual seeding and local drift refinement.
  • 03YOLOE open-vocabulary detections lifted into 3D with static/dynamic association.
  • 04Causal particle-filter replay for plan-based localization.
  • 05Synchronized video / plan / 3D browser viewer, plus an experimental Gaussian-splat world view.

Gallery

The browser viewer keeps the 360° recording, the floor plan and the 3D map in sync.
Experimental Gaussian appearance scene rendered from a processed run.

Command menu

Jump to a section or project