The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2013 vol.35)
pp: 1451-1463
Steven A. Holmes , University of Oxford, Oxford
David W. Murray , University of Oxford, Oxford
ABSTRACT
The recovery of structure from motion in real time over extended areas demands methods that mitigate the effects of computational complexity and arithmetical inconsistency. In this paper, we develop SCISM, an algorithm based on relative frame bundle adjustment, which splits the recovered map of 3D landmarks and keyframes poses so that the camera can continue to grow and explore a local map in real time while, at the same time, a bulk map is optimized in the background. By temporarily excluding certain measurements, it ensures that both maps are consistent, and by using the relative frame representation, new results from the bulk process can update the local process without disturbance. The paper first shows how to apply this representation to the parallel tracking and mapping (PTAM) method, a real-time bundle adjuster, and compares results obtained using global and relative frames. It then explains the relative representation's use in SCISM and describes an implementation using PTAM. The paper provides evidence of the algorithm's real-time operation in outdoor scenes, and includes comparison with a more conventional submapping approach.
INDEX TERMS
Cameras, Optimization, Simultaneous localization and mapping, Complexity theory, Real-time systems, Jacobian matrices, Tracking, submapping, Monocular SLAM, relative bundle adjustment, parallel tracking and mapping, split-mapping
CITATION
Steven A. Holmes, David W. Murray, "Monocular SLAM with Conditionally Independent Split Mapping", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 6, pp. 1451-1463, June 2013, doi:10.1109/TPAMI.2012.234
REFERENCES
[1] M.W.M.G. Dissanayake, P.M. Newman, S. Clark, H.F. Durrant-Whyte, and M. Csorba, "A Solution to the Simultaneous Localisation and Map Building (SLAM) Problem," IEEE Trans. Robotics and Automation, vol. 17, no. 3, pp. 229-241, June 2001.
[2] P.M. Newman and J.J. Leonard, "Consistent, Convergent and Constant-Time SLAM," Proc. Int'l Joint Conf. Artificial Intelligence, 2003.
[3] M. Bosse, P. Newman, J. Leonard, and S. Teller, "Simultaneous Localization and Map Building in Large-Scale Cyclic Environments Using the Atlas Framework," Int'l J. Robotics Research, vol. 23, no. 12, pp. 1113-1139, 2004.
[4] M. Montemerlo, S. Thrun, D. Koller, and B. Wegbreit, "FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem," Proc. AAAI Nat'l Conf. Artificial Intelligence, 2002.
[5] T. Bailey, J. Nieto, and E. Nebot, "Consistency of the FastSLAM Algorithm," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 424-429. 2006,
[6] R.C. Smith and P. Cheeseman, "On the Representation and Estimation of Spatial Uncertainty," Int'l J. Robotics Research, vol. 5, no. 4, pp. 56-68, 1986.
[7] J.J. Leonard and H.F. Durrant-Whyte, Directed Sonar Sensing for Mobile Robot Navigation. Kluwer Academic, 1992.
[8] D. Chekhlov, M. Pupilli, W. Mayol-Cuevas, and A. Calway, "Real-Time and Robust Monocular SLAM Using Predictive Multi-Resolution Descriptors," Proc. Second Int'l Symp. Visual Computing, pp. 276-285, 2006,
[9] T. Bailey, J. Nieto, J. Guivant, M. Stevens, and E. Nebot, "Consistency of the EKF-SLAM Algorithm," Proc. IEEE/RSJ Conf. Intelligent Robots and Systems, pp. 3562-3568, Oct. 2006.
[10] S. Julier and J. Uhlmann, "A Counter Example to the Theory of Simultaneous Localization and Map Building," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 4238-4243, 2001.
[11] S. Holmes, G. Klein, and D.W. Murray, "A Square Root Unscented Kalman Filter for Visual MonoSLAM," Proc. IEEE Int'l Conf. Robotics and Automation, 2008.
[12] C. McGlone, E. Mikhail, and J. Bethel, Manual of Photogrammetry, fifth ed. Am. Soc. of Photogrammetry and Remote Sensing, 2004.
[13] W. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon, "Bundle Adjustment—A Modern Synthesis," Proc. Int'l Workshop Vision Algorithms: Theory and Practice, B. Triggs, A. Zisserman, and R. Szeliski, eds., pp. 298-372, 2000.
[14] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2004.
[15] R.M. Eustice, H. Singh, and J.J. Leonard, "Exactly Sparse Delayed-State Filters for View-Based SLAM," IEEE Trans. Robotics, vol. 22, no. 6, pp. 1100-1114, Dec. 2006.
[16] M. Kaess, A. Ranganathan, and F. Dellaert, "iSAM: Fast Incremental Smoothing and Mapping with Efficient Data Association," Proc. IEEE Int'l Conf. Robotics and Automation, 2007.
[17] P. Pinies and J. Tardos, "Scalable SLAM Building Conditionally Independent Local Maps," Proc. IEEE/RSJ Conf. Intelligent Robots and Systems, pp. 3466-3471, Oct./Nov. 2007.
[18] E. Eade and T. Drummond, "Unified Loop Closing and Recovery for Real Time Monocular SLAM," Proc. 18th British Machine Vision Conf., 2008.
[19] A.J. Davison, I.D. Reid, N.D. Molton, and O. Stasse, "MonoSLAM: Real-Time Single Camera SLAM," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 1052-1067, June 2007.
[20] C. Mei, G. Sibley, M. Cummins, P. Newman, and I. Reid, "RSLAM: A System for Large-Scale Mapping in Constant Time Using Stereo," Int'l J. Computer Vision, vol. 94, no. 2, pp. 198-214, 2011.
[21] K. Ni and F. Dellaert, "Multi-Level Submap Based SLAM Using Nested Dissection," Proc. IEEE/RSJ Conf. Intelligent Robots and Systems, pp. 2558-2565, Oct. 2010.
[22] J. Lim, J-M. Frahm, and M. Pollefeys, "Online Environment Mapping," Proc. 24th IEEE Conf. Computer Vision and Pattern Recognition, pp. 3489-3496, 2011.
[23] H. Strasdat, J.M. Montiel, and A.J. Davison, "Drift Aware Large Scale Monocular SLAM," Proc. Robotics: Science and Systems Conf., 2010.
[24] K. Ni, D. Steedly, and F. Dellaert, "Out-of-Core Bundle Adjustment for Large-Scale 3D Reconstruction," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[25] G. Sibley, "Relative Bundle Adjustment," Technical Report 2307/09, Dept. of Eng. Science, Univ. of Oxford, Jan. 2009.
[26] G. Sibley, C. Mei, I. Reid, and P. Newman, "Adaptive Relative Bundle Adjustment," Proc. Robotics: Science and Systems Conf., 2009.
[27] C. Mei, G. Sibley, M. Cummins, P. Newman, and I. Reid, "A Constant Time Efficient Stereo SLAM System," Proc. 19th British Machine Vision Conf., 2009.
[28] G. Sibley, C. Mei, I. Reid, and P. Newman, "Vast Scale Outdoor Navigation Using Adaptive Relative Bundle Adjustment," Int'l J. Robotic Research, vol. 29, no. 8, pp. 958-980, 2010.
[29] G. Klein and D.W. Murray, "Parallel Tracking and Mapping for Small AR Workspaces," Proc. IEEE/ACM Sixth Int'l Symp. Mixed and Augmented Reality, 2007.
[30] S.A. Holmes, G. Sibley, G. Klein, and D.W. Murray, "Using a Relative Representation in Parallel Tracking and Mapping," Proc. IEEE Int'l Conf. Robotics and Automation, 2009.
[31] J.A. Castellanos, R. Martinez-Cantin, J.D. Tardós, and J. Neira, "Robocentric Map Joining: Improving the Consistency of EKF-SLAM," Robotics and Autonomous Systems, vol. 55, no. 1, pp. 21-29, Jan. 2007.
[32] B. Williams, "Simultaneous Localisation and Mapping Using a Single Camera," DPhil dissertation, Dept. of Eng. Science, Univ. of Oxford, 2009.
[33] G. Sibley, G.S. Sukhatme, and L. Matthies, "Constant Time Sliding Window Filter SLAM as a Basis for Metric Visual Perception," Proc. IEEE Int'l Conf. Robotics and Automation, 2007.
[34] A.J. Davison and D.W. Murray, "Sequential Localisation and Map-Building Using Active Vision," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 865-880, July 2002.
[35] K. Levenberg, "A Method for the Solution of Certain Non-Linear Problems in Least Squares," Quarterly Applied Math., vol. 2, pp. 164-168, 1944.
[36] D.W. Marquardt, "An Algorithm for the Least-Squares Estimation of Non-Linear Parameters," J. SIAM, vol. 11, no. 2, pp. 431-441, 1963.
[37] R.M. Murray, Z. Li, and S.S. Sastry, A Mathematical Introduction to Robotic Manipulation. CRC Press, 1994.
[38] G. Klein and D.W. Murray, "Improving the Agility of Keyframe-Based SLAM," Proc. 10th European Conf. Computer Vision, 2008.
[39] R.O. Castle, G. Klein, and D.W. Murray, "Wide-Area Augmented Reality Using Camera Tracking and Mapping in Multiple Regions," Computer Vision and Image Understanding, vol. 115, pp. 854-867, 2011.
[40] O. Faugeras and F. Lustman, "Motion and Structure from Motion in a Piecewise Planar Environment," Int'l J. Pattern Recognition in Artificial Intelligence, vol. 2, pp. 485-508, 1988.
[41] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[42] E. Rosten and T. Drummond, "Machine Learning for High-Speed Corner Detection," Proc. Ninth European Conf. Computer Vision, 2006.
[43] E. Rosten, R. Porter, and T. Drummond, "Faster and Better: A Machine Learning Approach to Corner Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 1, pp. 105-119, Jan. 2010.
[44] S.A. Holmes, "Challenges in Real-Time Slam: Curbing Complexity, Cultivating Consistency," DPhil dissertation, Dept. of Eng. Science, Univ. of Oxford, 2010.
[45] R.O. Castle, G. Klein, and D.W. Murray, "Combining monoSLAM with Object Recognition for Scene Augmentation Using a Wearable Camera," Image and Vision Computing, vol. 28, no. 12, pp. 1548-1556, 2010.
[46] L.A. Clemente, A.J. Davison, I.D. Reid, J. Neira, and J.D. Tardós, "Increasing the Size of Maps Mapping Large Loops with a Single Hand-Held Camera," Proc. Robotics: Science and Systems Conf., 2007.
8 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool