The Community for Technology Leaders
RSS Icon
Issue No.03 - July-Sept. (2013 vol.6)
pp: 257-267
F. Ryden , Dept. of Electr. Eng., Univ. of Washington, Seattle, WA, USA
H. J. Chizeck , Dept. of Electr. Eng., Univ. of Washington, Seattle, WA, USA
This paper presents a new haptic rendering method for streaming point cloud data. It provides haptic rendering of moving physical objects using data obtained from RGB-D cameras. Thus, real-time haptic interaction with moving objects can be achieved using noncontact sensors. This method extends "virtual coupling"-based proxy methods in a way that does not require preprocessing of points and allows for spatial point cloud discontinuities. The key ideas of the algorithm are iterative motion of the proxy with respect to the points, and the use of a variable proxy step size that results in better accuracy for short proxy movements and faster convergence for longer movements. This method provides highly accurate haptic interaction for geometries in which the proxy can physically fit. Another advantage is a significant reduction in the risk of "pop through" during haptic interaction with dynamic point clouds, even in the presence of noise. This haptic rendering method is computationally efficient; it can run in real time on available personal computers without the need for downsampling of point clouds from commercially available depth cameras.
Haptic interfaces, Rendering (computer graphics), Hip, Vectors, Real-time systems, Cameras, Force,point cloud velocity estimation, Haptic rendering, streaming point cloud data
F. Ryden, H. J. Chizeck, "A Proxy Method for Real-Time 3-DOF Haptic Rendering of Streaming Point Cloud Data", IEEE Transactions on Haptics, vol.6, no. 3, pp. 257-267, July-Sept. 2013, doi:10.1109/TOH.2013.20
[1] F. Rydén, S. Nia Kosari, and H. Chizeck, "Proxy Method for Fast Haptic Rendering from Time Varying Point Clouds," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems (IROS '12), pp. 2614-2619, 2011.
[2] J. Colgate, M. Stanley, and J. Brown, "Issues in the Haptic Display of Tool Use," Proc. IEEE/RSJ Int'l Conf. Human Robot Interaction and Cooperative Robots, vol. 3, pp. 140-145, 1995.
[3] C. Zilles and J. Salisbury, "A Constraint-Based God-Object Method for Haptic Display," Proc. IEEE/RSJ Int'l Conf. Human Robot Interaction and Cooperative Robots, vol. 3, pp. 146-151, 1995.
[4] D. Ruspini, K. Kolarov, and O. Khatib, "The Haptic Display of Complex Graphical Environments," Proc. 24th Ann. Conf. Computer Graphics and Interactive Techniques, pp. 345-352, 1997.
[5] L. Linsen, "Point Cloud Representation," technical report, Faculty of Informatics, Univ. of Karlsruhe, Germany, 2001.
[6] W. McNeely, K. Puterbaugh, and J. Troy, "Six Degree-of-Freedom Haptic Rendering Using Voxel Sampling," Proc. 26th Ann. Conf. Computer Graphics and Interactive Techniques, pp. 401-408, 1999.
[7] J. Lee and Y. Kim, "Haptic Rendering of Point Set Surfaces," Proc. Second Joint EuroHaptics Conf. and Symp. Haptic Interfaces Virtual Environment and Teleoperator Systems, pp. 513-518, 2007.
[8] D. Levin, "Mesh-Independent Surface Interpolation," Geometric Modeling for Scientific Visualization, vol. 3, pp. 37-49, 2003.
[9] N. El-Far, N. Georganas, and A. El Saddik, "An Algorithm for Haptically Rendering Objects Described by Point Clouds," Proc. Canadian Conf. Electrical and Computer Engineering (CCECE '08), pp. 001443-001448, May 2008.
[10] J. Cha, S. Kim, I. Oakley, J. Ryu, and K. Lee, "Haptic Interaction with Depth Video Media," Proc. Sixth Pacific-Rim Conf. Advances in Multimedia Information Processing (PCM '05), pp. 420-430, 2005.
[11] J. Cha, M. Eid, and A.E. Saddik, "DIBHR: Depth Image-Based Haptic Rendering," Proc. Sixth Int'l Conf. Haptics: Perception, Devices and Scenarios, pp. 640-650, 2008.
[12] F. Ryden and H. Chizeck, "Forbidden-Region Virtual Fixtures from Streaming Point Clouds: Remotely Touching and Protecting a Beating Heart," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems (IROS '12), pp. 3308-3313, 2012.
[13] A. Leeper, S. Chan, and K. Salisbury, "Point Clouds Can be Represented as Implicit Surfaces for Constraint-Based Haptic Rendering," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA '12), pp. 5000-5005, 2012.
[14] S. Rasool and A. Sourin, "Haptic Interaction with 2D Images," Proc. 10th Int'l Conf. Virtual Reality Continuum and Its Applications Industry, pp. 13-22, 2011.
[15] L. Batteau, A. Liu, J. Maintz, Y. Bhasin, and M. Bowyer, "A Study on the Perception of Haptics in Surgical Simulation," Proc. Int'l Symp. Medical Simulation, pp. 185-192, 2004.
[16] N. Mitra and A. Nguyen, "Estimating Surface Normals in Noisy Point Cloud Data," Proc. 19th Ann. Symp. Computational Geometry, pp. 322-328, 2003.
[17] H. Wendland, "Piecewise Polynomial, Positive Definite and Compactly Supported Radial Functions of Minimal Degree," Advances in computational Math., vol. 4, no. 1, pp. 389-396, 1995.
30 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool