Skip to the content.

个人主页 to 沈优

项目Demo:

🛠️项目1. 基于增强现实的船载电子装备辅助维修:

任务1:工作台物体类别标注
任务2:发动机维修细节指导
任务3:分布式维修指导
任务4:发动机内部结构展示

🚗项目2. 基于增强现实的数字场景孪生:

原始场景:KITTI-07
数字孪生场景1
全局语义地图
数字孪生场景2

增强现实 实际场景1
虚实融合场景1(图中蓝车)
增强现实 实际场景2
虚实融合场景2(图中坦克和虚拟士兵)

🚜项目3. 基于隐式编码的物体模型优化:

原始描述子
正态分布0.05
正态分布0.1
正态分布0.2

论文 [IROS-2023🤖]
《BSH-Det3D: Improving 3D Object Detection with BEV Shape Heatmap》

📖Arxiv 💻Code 📺Video

摘要: The progress of LiDAR-based 3D object detection has significantly enhanced developments in autonomous driving and robotics. However, due to the limitations of LiDAR sensors, object shapes suffer from deterioration in occluded and distant areas, which creates a fundamental challenge to 3D perception. Existing methods estimate specific 3D shapes and achieve remarkable performance. However, these methods rely on extensive computation and memory, causing imbalances between accuracy and real-time performance. To tackle this challenge, we propose a novel LiDAR-based 3D object detection model named BSH-Det3D, which applies an effective way to enhance spatial features by estimating complete shapes from a bird’s eye view (BEV). Specifically, we design the Pillar-based Shape Completion (PSC) module to predict the probability of occupancy whether a pillar contains object shapes. The PSC module generates a BEV shape heatmap for each scene. After integrating with heatmaps, BSH-Det3D can provide additional information in shape deterioration areas and generate high-quality 3D proposals. We also design an attention-based densification fusion module (ADF) to adaptively associate the sparse features with heatmaps and raw points. The ADF module integrates the advantages of points and shapes knowledge with negligible overheads. Extensive experiments on the KITTI benchmark achieve state-of-the-art (SOTA) performance in terms of accuracy and speed, demonstrating the efficiency and flexibility of BSH-Det3D. The source code is available on https://github.com/mystorm16/BSH-Det3D.