一种无人船载激光雷达-相机的融合感知方法

A Method for Fusion Perception of LiDAR-Camera on Unmanned Surface Vehicles

  • 摘要: 无人船环境感知是无人船智能航行的关键技术之一,目前主要依赖于可获取目标空间位置的激光雷达和提供目标类别信息的光学设备。为获得复杂海上环境下目标多维感知信息,提出一种无人船载激光雷达-相机的融合感知方法,融合PR-YOLOv8视觉检测结果和激光雷达三维点云,实现了海上目标高精度识别和空间定位。首先,利用标定板进行激光雷达和相机联合标定,构建了两传感器间的投影关系。随后,对于雷达分支,对目标点云聚类拟合,提取目标的特征信息并投影至图像;对于相机分支,基于YOLOv8提出PR-YOLOv8目标检测模型,获得高识别精度的目标检测边界框。最后,结合两分支检测结果,提出一种新的代价构建因子DSIoU(Distance-Scale Intersection over Union)关联目标,并结合贝叶斯理论,实现了多源感知信息的融合。采用青岛近海和内湖船只感知实验,验证了所提出方法的可行性和有效性。

     

    Abstract: Environmental perception of Unmanned Surface Vehicle (USV) is one of the key technologies for intelligent navigation, which currently relies on LiDAR that can acquire the spatial position of the object and optical devices that provide precise category information of the object. In order to obtain multi-dimensional perception information of objects in complex maritime environments, we propose a fusion perception method of LiDAR-Camera on USV, which fuses PR-YOLOv8 visual detection results and LiDAR 3D point cloud to achieve high-precision recognition and spatial localization of maritime objects. Firstly, the calibration board is used for the joint calibration of LiDAR and camera, and the projection relationship between the two sensors is constructed. Secondly, for the LiDAR branch, the clustering method is used to fit the point cloud to extract the feature information of the object and project it to the image. For the camera branch, the PR-YOLOv8 detection model is proposed based on YOLOv8 to obtain a boundary box for object detection with high recognition accuracy. Finally, combining the detection results of the two branches, a new cost construction factor DSIoU (Distance-Scale Intersection over Union) is used to correlate the object and combined with Bayesian theory, the fusion of multi-source perception information is proposed. The feasibility and validity of the proposed method was verified using Qingdao inland sea and inland lake ship perception experiments.

     

/

返回文章
返回