The construction and maintenance of a robocentric map is key to high-level mobile robotic tasks like path planning and smart navigation. But the challenge of dynamic environment and huge amount of dense sensor data makes it hard to be implemented in a real-world application for long-term use. In this paper we present a novel mapping approach by incorporating semantic cuboid object detection and multi-view geometry information. The proposed system can precisely describe the incremental 3D environment in real-time and maintain a long-term map by extracting out moving objects. The representation of the map is a collection of sub-volumes which can be utilized to perform pose graph optimization to address the challenge of building a consistent and scalable map. These sub-volumes are first aligned by localization module and refined by fusing the active volumes using co-visible graph. With the proposed framework we can obtain the object-level constraints and propose a consistent obstacle mapping system combining multi-view geometry with obstacle detection to obtain robust static map in a complex environment. Public dataset and self-collected data demonstrate the efficiency and consistency of our proposed approach.
References
JMM. Mur-Artal Raúl, Montiel and JD. Tardós, "ORB-SLAM: a Versatile and Accurate Monocular SLAM System," IEEE Transactions on Robotics 2015; 31(5): 1147-1163. https://doi.org/10.1109/TRO.2015.2463671
B. Triggs, PF. McLauchlan, RI. Hartley, and AW. Fitzgibbon, "Bundle Adjustment - A Modern Synthesis," in Vision Algorithms: Theory and Practice, vol. 1883, B. Triggs, A. Zisserman, and R. Szeliski, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2000; 298-372. https://doi.org/10.1007/3-540-44480-7_21
S. Izadi et al., "Kinect Fusion: Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera," in Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, New York, NY, USA, 2011, pp. 559-568. https://doi.org/10.1145/2047196.2047270
R. Wagner, U. Frese, and B. Bäuml, "Graph SLAM with signed distance function maps on a humanoid robot," in 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems 2014; 2691-2698. https://doi.org/10.1109/IROS.2014.6942930
T. Whelan, S. Leutenegger, R. Salas-Moreno, B. Glocker, and A. Davison, "ElasticFusion: Dense SLAM without a pose graph," 2015. https://doi.org/10.15607/RSS.2015.XI.001
S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks," in Advances in neural information processing systems 2015; 91-99.
J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You only look once: Unified, real-time object detection," in Proceedings of the IEEE conference on computer vision and pattern recognition 2016; 779-788. https://doi.org/10.1109/CVPR.2016.91
A. Mousavian, D. Anguelov, J. Flynn, and J. Kosecka, "3D Bounding Box Estimation Using Deep Learning and Geometry," in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI 2017; 5632- 5640. https://doi.org/10.1109/CVPR.2017.597
G. Grisetti, C. Stachniss, and W. Burgard, "Improved techniques for grid mapping with rao-blackwellized particle filters," IEEE transactions on Robotics 2007; 23(1): 34-46. https://doi.org/10.1109/TRO.2006.889486
S. Kohlbrecher, J. Meyer, O. von Stryk, and U. Klingauf, "A Flexible and Scalable SLAM System with Full 3D Motion Estimation," in Proc. IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR), 2011. https://doi.org/10.1109/SSRR.2011.6106777
M. Bosse, P. Newman, J. Leonard, M. Soika, W. Feiten, and S. Teller, "An atlas framework for scalable mapping," in Robotics and Automation. Proceedings. ICRA'03. IEEE International Conference on 2003; 2: 1899-1906.
P. Piniés and JD. Tardós, "Scalable SLAM building conditionally independent local maps," in Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference on, 2007; 3466-3471. https://doi.org/10.1109/IROS.2007.4399302
S. Thrun and others, "Robotic mapping: A survey," Exploring artificial intelligence in the new millennium, 2002; 1: 1-35.
A. Elfes, "Using occupancy grids for mobile robot perception and navigation," Computer 1989; 22(6): 46-57. https://doi.org/10.1109/2.30720
F. Oniga and S. Nedevschi, "Processing dense stereo data using elevation maps: Road surface, traffic isle, and obstacle detection," IEEE Transactions on Vehicular Technology 2010; 59(3) 1172-1182. https://doi.org/10.1109/TVT.2009.2039718
N. Bernini, M. Bertozzi, L. Castangia, M. Patander, and M. Sabbatelli, "Real-time obstacle detection using stereo vision for autonomous ground vehicles: A survey," in Intelligent Transportation Systems (ITSC), 2014 IEEE 17th International Conference on, 2014; 873-878. https://doi.org/10.1109/ITSC.2014.6957799
A. Broggi, S. Cattani, M. Patander, M. Sabbatelli, and P. Zani, "A full-3D voxel-based dynamic obstacle detection for urban scenario using stereo vision," in Intelligent Transportation Systems-(ITSC), 2013 16th International IEEE Conference on 2013; 71-76. https://doi.org/10.1109/ITSC.2013.6728213
A. Hornung, KM. Wurm, M. Bennewitz, Cyrill Stachniss, and W. Burgard, "OctoMap: An Efficient Probabilistic 3D Mapping Framework Based on Octrees," Autonomous Robots, 2013. https://doi.org/10.1007/s10514-012-9321-0
M. Keller, D. Lefloch, M. Lambers, S. Izadi, T. Weyrich, and A. Kolb, "Real-time 3d reconstruction in dynamic scenes using point-based fusion," in 3DTV-Conference, 2013 International Conference on, 2013; 1-8. https://doi.org/10.1109/3DV.2013.9
CR. Qi, L. Yi, H. Su, and LJ. Guibas, "PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space," arXiv:1706.02413 [cs
J. Redmon and A. Farhadi, "Yolov3: An incremental improvement," arXiv preprint arXiv:1804.02767, 2018.
M. Wu, C. Zhou, and T. Srikanthan, "Robust and low complexity obstacle detection and tracking," in Intelligent Transportation Systems (ITSC), 2016 IEEE 19th International Conference on, 2016; 1249-1254. https://doi.org/10.1109/ITSC.2016.7795717