Skip to content

[CSUR 2024] LiDAR-based Place Recognition For Autonomous Driving: A Survey

License

Notifications You must be signed in to change notification settings

ShiPC-AI/LPR-Survey

Repository files navigation

LiDAR-based Place Recognition For Autonomous Driving: A Survey

Yongjun Zhang (张永军), Pengcheng Shi* (史鹏程), Jiayuan Li* (李加元)

Our [Paper] has been published on ACM Computing Surveys (Impact Factor: 23.8), *: Corresponding author

LiDAR has gained popularity in autonomous driving due to advantages like long measurement distance, rich three-dimensional information, and stability in harsh environments. Place Recognition (PR) enables vehicles to identify previously visited locations despite variations in appearance, weather, and viewpoints, even determining their global location within prior maps. This capability is crucial for accurate localization in autonomous driving. Consequently, LiDAR-based Place Recognition (LPR) has emerged as a research hotspot in robotics. However, existing reviews predominantly concentrate on Visual Place Recognition, leaving a gap in systematic reviews on LPR. This article bridges this gap by providing a comprehensive review of LPR methods, thus facilitating and encouraging further research. We commence by exploring the relationship between PR and autonomous driving components. Then, we delve into the problem formulation of LPR, challenges, and relations to previous surveys. Subsequently, we conduct an in-depth review of related research, which offers detailed classifications, strengths and weaknesses, and architectures. Finally, we summarize existing datasets and evaluation metrics and envision promising future directions. This article can serve as a valuable tutorial for newcomers entering the field of place recognition.


News

  • 2024.11: Our has been accepted for ACM Computing Surveys
  • 2024.12: The published paper is available: Published Paper
  • 2025.02: We upload the figures and pdf

Citation

If this work is useful for your research, please cite our paper:

@article{zhang2024lidar,
  title={Lidar-based place recognition for autonomous driving: A survey},
  author={Zhang, Yongjun and Shi, Pengcheng and Li, Jiayuan},
  journal={ACM Computing Surveys},
  volume={57},
  number={4},
  pages={1--36},
  year={2024},
  publisher={ACM New York, NY}
}

Two Key Problems Addressed by PR

  • Question 1: It addresses the problem of "where have I ever been, " also known as Loop Closure Detection (LCD). In this context, PR and localization are interdependent, with PR enhancing localization accuracy through loop closure detection
  • Question 2: It tackles the issue of "where am I," also known as global localization. In this context, PR is a specialized localization method that directly provides the vehicle’s global pose. Taxonomy of LPR methods

Taxonomy of Methods

We categorize methods into handcrafted and learning-based types, further subdividing them, and present detailed introductions to pioneering works. Taxonomy of LPR methods


Methods Organized by Year

2024

  • SGLC: Semantic Graph-Guided Coarse-Fine-Refine Full Loop Closing for LiDAR SLAM | arXiv Learning Badge Paper Badge GitHub

  • CrossLoc3D: Aerial-Ground Cross-Source 3D Place Recognition | ICCV Learning Badge Paper Badge GitHub

  • BTC: A Binary and Triangle Combined Descriptor for 3-D Place Recognition | TRO Handcrafted Badge Paper Badge GitHub

  • A New Horizon: Employing Map Clustering Similarity for LiDAR-based Place Recognition | TIV Handcrafted Badge Paper Badge GitHub

  • Fast and Accurate Deep Loop Closing and Relocalization for Reliable LiDAR SLAM | TRO Learning Badge Paper Badge GitHub

  • P-GAT: Pose-Graph Attentional Network for Lidar Place Recognition | RAL Learning Badge Paper Badge GitHub

  • Effectively Detecting Loop Closures using Point Cloud Density Maps | ICRA Handcrafted Badge Paper Badge GitHub

  • OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition | arXiv Learning Badge Paper Badge GitHub

  • OSK: A Novel LiDAR Occupancy Set Key-Based Place Recognition Method in Urban Environment | TIM Handcrafted Badge Paper Badge GitHub

  • SelFLoc: Selective feature fusion for large-scale point cloud-based place recognition | KBS Learning Badge Paper Badge

  • CVTNet: A Cross-View Transformer Network for LiDAR-Based Place Recognition in Autonomous Driving Environments | TII Learning Badge Paper Badge GitHub

  • Uncertainty-Aware Lidar Place Recognition in Novel Environments | IROS Learning Badge Paper Badge GitHub

2023

  • CCL: Continual Contrastive Learning for LiDAR Place Recognition | RAL Learning Badge Paper Badge GitHub

  • BioSLAM: A Bioinspired Lifelong Memory System for General Place Recognition | TRO Learning Badge Paper Badge GitHub

  • CASSPR: Cross Attention Single Scan Place Recognition | ICCV Learning Badge Paper Badge GitHub

  • Contour Context: Abstract Structural Distribution for 3D LiDAR Loop Detection and Metric Pose Estimation | ICRA Handcrafted Badge Paper Badge GitHub

  • BEVPlace: Learning LiDAR-based Place Recognition using Bird's Eye View Images | ICCV Learning Badge Paper Badge GitHub

  • Uncertainty-Aware Lidar Place Recognition in Novel Environments | IROS Learning Badge Paper Badge GitHub

  • TReR: A Lightweight Transformer Re-Ranking Approach for 3D LiDAR Place Recognition | ITSC Learning Badge Paper Badge

  • STD: Stable Triangle Descriptor for 3D place recognition | ICRA Handcrafted Badge Paper Badge GitHub

  • Place Recognition of Large-Scale Unstructured Orchards With Attention Score Maps | RAL Handcrafted Badge Paper Badge

  • VNI-Net: Vector Neurons-based Rotation-Invariant Descriptor for LiDAR Place Recognition | arXiv Learning Badge Paper Badge GitHub

  • A fast LiDAR place recognition and localization method by fusing local and global search | ISPRSJ Handcrafted Badge Paper Badge GitHub

  • RING++: Roto-Translation Invariant Gram for Global Localization on a Sparse Scan Map | TRO Handcrafted Badge Paper Badge GitHub

  • Place Recognition of Large-Scale Unstructured Orchards With Attention Score Maps | RAL Handcrafted Badge Paper Badge

  • GeoAdapt: Self-Supervised Test-Time Adaptation in LiDAR Place Recognition Using Geometric Priors | RAL Learning Badge Paper Badge

  • ORCHNet: A Robust Global Feature Aggregation approach for 3D LiDAR-based Place recognition in Orchards | arXiv Learning Badge Paper Badge Paper Badge

  • OverlapNetVLAD: A Coarse-to-Fine Framework for LiDAR-based Place Recognition | arXiv Learning Badge Paper Badge Paper Badge

  • Binary Image Fingerprint: Stable Structure Identifier for 3D LiDAR Place Recognition RAL Handcrafted Badge Paper Badge GitHub

  • Spherical Transformer for LiDAR-Based 3D Recognition | CVPR Learning Badge Paper Badge GitHub

2022

  • SphereVLAD++: Attention-Based and Signal-Enhanced Viewpoint Invariant Descriptor | RAL Learning Badge Paper Badge GitHub

  • SVT-Net: Super Light-Weight Sparse Voxel Transformer for Large Scale Place Recognition | AAAI Learning Badge Paper Badge GitHub

  • BoxGraph: Semantic Place Recognition and Pose Estimation from 3D LiDAR | IROS Learning Badge Paper Badge

  • RINet: Efficient 3D Lidar-Based Place Recognition Using Rotation Invariant Neural Network | RAL Learning Badge Paper Badge GitHub

  • Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognition | TIP Learning Badge Paper Badge GitHub

  • AttDLNet: Attention-Based Deep Network for 3D LiDAR Place Recognition | ROBOT Learning Badge Paper Badge GitHub

  • OverlapTransformer: An Efficient and Yaw-Angle-Invariant Transformer Network for LiDAR-Based Place Recognition | RAL Learning Badge Paper Badge GitHub

  • SeqOT: A Spatial–Temporal Transformer Network for Place Recognition Using Sequential LiDAR Data | TIE Learning Badge Paper Badge GitHub

  • Simultaneous viewpoint-and condition-invariant loop closure detection based on LiDAR descriptor for outdoor large-scale environments | TIE Learning Badge Paper Badge

  • HiTPR: Hierarchical Transformer for Place Recognition in Point Cloud | ICRA Learning Badge Paper Badge

  • LoGG3D-Net: Locally Guided Global Descriptor Learning for 3D Place Recognition | ICRA Learning Badge Paper Badge GitHub

  • MinkLoc3D-SI: 3D LiDAR Place Recognition With Sparse Convolutions, Spherical Coordinates, and Intensity | RAL Learning Badge Paper Badge GitHub

  • Improving Point Cloud Based Place Recognition with Ranking-based Loss and Large Batch Training | ICPR Learning Badge Paper Badge GitHub

  • LCDNet: Deep Loop Closure Detection and Point Cloud Registration for LiDAR SLAM | TRO Learning Badge Paper Badge GitHub

  • One RING to Rule Them All: Radon Sinogram for Place Recognition, Orientation and Translation Estimation: | IROS Handcrafted Badge Paper Badge

  • Fresco: Frequency-domain scan context for lidar-based place recognition with translation and rotation invariance: | ICARCV Handcrafted Badge Paper Badge GitHub

  • High Accuracy and Low Complexity Lidar Place Recognition Using Unitary Invariant Frobenius Norm: | IEEE Sensors Handcrafted Badge Paper Badge

  • AdaFusion: Visual-LiDAR Fusion With Adaptive Weights for Place Recognition | RAL Learning Badge Paper Badge GitHub

  • InCloud: Incremental Learning for Point Cloud Place Recognition | IROS Learning Badge Paper Badge GitHub

  • A heterogeneous 3D map-based place recognition solution using virtual LiDAR and a polar grid height coding image descriptor | ISPRSJ Handcrafted Badge Paper Badge GitHub

  • Dh3d: Deep hierarchical 3d descriptors for robust large-scale 6dof relocal- ization | ECCV Learning Badge Paper Badge GitHub

  • DSC: Deep Scan Context Descriptor for Large-Scale Place Recognition | MFI Learning Badge Paper Badge

  • Object Scan Context: Object-centric Spatial Descriptor for Place Recognition within 3D Point Cloud Map | arXiv Learning Badge Paper Badge

  • SC-LPR: Spatiotemporal context based LiDAR place recognition | PRL Learning Badge Paper Badge GitHub

  • Retriever: Point Cloud Retrieval in Compressed 3D Maps | ICRA Learning Badge Paper Badge GitHub

  • Place recognition and navigation of outdoor mobile robots based on random Forest learning with a 3D LiDAR Journal of Intelligent & Robotic Systems Learning Badge Paper Badge

2021

  • NDT-Transformer: Large-Scale 3D Point Cloud Localisation using the Normal Distribution Transform Representation |ICRA Learning Badge Paper Badge GitHub

  • MinkLoc3D: Point Cloud Based Large-Scale Place Recognition |WACV Learning Badge Paper Badge GitHub

  • MinkLoc++: Lidar and Monocular Image Fusion for Place Recognition | IJCNN Learning Badge Paper Badge GitHub

  • EgoNN: Egocentric Neural Network for Point Cloud Based 6DoF Relocalization at the City Scale | RAL Learning Badge Paper Badge GitHub

  • TransLoc3D : Point Cloud based Large-scale Place Recognition using Adaptive Receptive Fields | arXiv Learning Badge Paper Badge GitHub

  • Pyramid Point Cloud Transformer for Large-Scale Place Recognition | ICCV Learning Badge Paper Badge GitHub

  • SSC: Semantic Scan Context for Large-Scale Place Recognition | IROS Learning Badge Paper Badge GitHub

  • A registration-aided domain adaptation network for 3d point cloud based place recognition | IROS Learning Badge Paper Badge

  • SOE-Net: A Self-Attention and Orientation Encoding Network for Point Cloud Based Place Recognition | CVPR Learning Badge Paper Badge GitHub

  • Scan Context++: Structural Place Recognition Robust to Rotation and Lateral Variations in Urban Environments: | TRO Handcrafted Badge Paper Badge GitHub

  • Weighted scan context: Global descriptor with sparse height feature for loop closure detection: | ICCCR Handcrafted Badge Paper Badge

  • Season-Invariant and Viewpoint-Tolerant LiDAR Place Recognition in GPS-Denied Environments | TIE Handcrafted Badge Paper Badge

  • Spherical Multi-Modal Place Recognition for Heterogeneous Sensor Systems | ICRA Learning Badge Paper Badge

  • DiSCO: Differentiable Scan Context With Orientation | RAL Learning Badge Paper Badge GitHub

  • CORAL: Colored structural representation for bi-modal place recognition | IROS Learning Badge Paper Badge GitHub

  • OverlapNet: a siamese network for computing LiDAR scan similarity with applications to loop closing and localization | Autonomous Robots Learning Badge Paper Badge GitHub

  • On the descriptive power of LiDAR intensity images for segment-based loop closing in 3-D SLAM | IROS Learning Badge Paper Badge

  • PSE-Match: A Viewpoint-Free Place Recognition Method With Parallel Semantic Embedding | TITS Learning Badge Paper Badge

2020

  • Voxel-Based Representation Learning for Place Recognition Based on 3D Point Clouds | IROS Learning Badge Paper Badge

  • SpoxelNet: Spherical Voxel-based Deep Place Recognition for 3D Point Clouds of Crowded Indoor Spaces | IROS Learning Badge Paper Badge

  • SRNet: A 3D Scene Recognition Network using Static Graph and Dense Semantic Fusion | Computer Graphics Forum Learning Badge Paper Badge

  • LiDAR Iris for Loop-Closure Detection: | IROS Handcrafted Badge Paper Badge GitHub

  • Intensity Scan Context: Coding Intensity and Geometry Relations for Loop Closure Detection: | ICRA Handcrafted Badge Paper Badge GitHub

  • PIC-Net: Point Cloud and Image Collaboration Network for Large-Scale Place Recognition | arXiv Learning Badge Paper Badge

  • A Fast and Robust Place Recognition Approach for Stereo Visual Odometry Using LiDAR Descriptors | IROS Handcrafted Badge Paper Badge GitHub

  • DAGC: Employing Dual Attention and Graph Convolution for Point Cloud based Place Recognition | ICMR Learning Badge Paper Badge

  • SegMap: Segment-based mapping and localization using data-driven descriptors | IJRR Learning Badge Paper Badge

  • Seed: A Segmentation-Based Egocentric 3D Point Cloud Descriptor for Loop Closure Detection | IROS Handcrafted Badge Paper Badge

  • Learning an Overlap-based Observation Model for 3D LiDAR Localization |IROS Learning Badge Paper Badge GitHub

  • LiPMatch: LiDAR Point Cloud Plane Based Loop-Closure |RAL Handcrafted Badge Paper Badge GitHub

2019

  • OREOS: Oriented Recognition of 3D Point Clouds in Outdoor Scenarios | IROS Learning Badge Paper Badge

  • PCAN: 3D Attention Map Learning Using Contextual Information for Point Cloud Based Retrieval | CVPR Learning Badge Paper Badge GitHub

  • LPD-Net: 3D Point Cloud Learning for Large-Scale Place Recognition and Environment Analysis | ICCV Learning Badge Paper Badge GitHub

  • Semantically Assisted Loop Closure in SLAM Using NDT Histograms | IROS Learning Badge Paper Badge GitHub

  • c-m2dp: A fast point cloud descriptor with color information to perform loop closure detection | CASE Handcrafted Badge Paper Badge

  • 1-Day Learning, 1-Year Localization: Long-Term LiDAR Localization Using Scan Context Image | RAL Learning Badge Paper Badge GitHub

  • SeqLPD: Sequence Matching Enhanced Loop-Closure Detection Based on Large-Scale Point Cloud Description for Self-Driving Vehicles | IROS Learning Badge Paper Badge

  • Loop Closure Detection in Closed Environments | ECMR Handcrafted Badge Paper Badge

2018

  • Scan Context: Egocentric Spatial Descriptor for Place Recognition Within 3D Point Cloud Map | IROS Handcrafted Badge Paper Badge GitHub

  • PointNetVLAD: Deep Point Cloud Based Retrieval for Large-Scale Place Recognition | CVPR Learning Badge Paper Badge GitHub

  • Delight: An Efficient Descriptor for Global Localisation Using LiDAR Intensities | ICRA Handcrafted Badge Paper Badge

  • Seeing the Wood for the Trees: Reliable Localization in Urban and Natural Environments | IROS Learning Badge Paper Badge

  • Stabilize an Unsupervised Feature Learning for LiDAR-based Place Recognition | IROS Learning Badge Paper Badge

2017

  • SegMatch: Segment based place recognition in 3D point clouds | ICRA Handcrafted Badge Paper Badge GitHub

  • Efficient 3D LIDAR based loop closing using deep neural network | ROBIO Learning Badge Paper Badge

2016

  • M2DP: A novel 3D point cloud descriptor and its application in loop closure detection | IROS Handcrafted Badge Paper Badge GitHub

2015

  • A fast histogram-based similarity measure for detecting loop closures in 3-D LIDAR data | IROS Handcrafted Badge Paper Badge

2011

  • Loop closure detection using small-sized signatures from 3D LIDAR data | SSRR Handcrafted Badge Paper Badge

2010

  • Learning to close the loop from 3D point clouds | IROS Learning Badge Paper Badge

2009

  • Appearance-based loop detection from 3d laser data using the normal distributions transform | ICRA Handcrafted Badge Paper Badge

  • Automatic appearance-based loop detection from three-dimensional laser data using the normal distributions transform | JFR Learning Badge Paper Badge

Contact

For any inquiries, feel free to contact me: