Issue No.03 - Third Quarter (2012 vol.5)
pp: 252-263
Ioannis Sarakoglou , Istituto Italiano Di Tecnologia (IIT), Genova
Nadia Garcia-Hernandez , Istituto Italiano Di Tecnologia (IIT), Genova
Nikos G. Tsagarakis , Istituto Italiano Di Tecnologia (IIT), Genova
Darwin G. Caldwell , Istituto Italiano Di Tecnologia (IIT), Genova
This paper presents the development of a compact tactile display and its integration in teleoperation. The system's operation is based on the display of surface shape to an area of the fingertip through a 4 \times 4 array of tactors moving perpendicularly to the skin surface. The tactors are spring loaded and are actuated remotely by dc motors through a flexible tendon transmission. This novel implementation of conventional actuation principles achieves a compact design with superior performance compared to devices of a similar footprint, demonstrating an excellent combination of tactor spatiotemporal resolution, force, and amplitude. The display's ergonomic design and high performance make it suitable for integration on haptic devices for tactile feedback in VR and in Teleoperation. This paper presents the design, control, and performance of the tactile display and of the transmission system. It also demonstrates its integration on an Omega7 force feedback device for the teleoperation of an LWR KUKA manipulator. An experiment is presented where users teleoperated the stylus of the robot in a 3D contour following task with and without tactile feedback. In this experiment, force feedback from the slave is fused with model-based local tactile feedback. Subjects' performances indicate an improvement in teleoperation when both tactile and force feedback are present.
Haptic interfaces, Force, Tactile sensors, Performance evaluation, DC motors, Shape, and virtual realities., User interfaces, haptic I/O, artificial, augmented
Ioannis Sarakoglou, Nadia Garcia-Hernandez, Nikos G. Tsagarakis, Darwin G. Caldwell, "A High Performance Tactile Feedback Display and Its Integration in Teleoperation", IEEE Transactions on Haptics, vol.5, no. 3, pp. 252-263, Third Quarter 2012, doi:10.1109/TOH.2012.20
[1] D.A. Kontarinis, J.S. Son, W. Peine, and R.D. Howe, "A Tactile Shape Sensing and Display System for Teleoperated Manipulation," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 641-646, 1995.
[2] H. Kawasaki, T. Komatsu, and K. Uchiyama, "Dexterous Anthropomorphic Robot Hand with Distributed Tactile Sensor: Gifu Hand II," IEEE/ASME Trans. Mechatronics, vol. 7, no. 3, pp. 296-303, Sept. 2002.
[3] A. Schmitz, M. Maggiali, L. Natale, B. Bonino, and G. Metta, "A Tactile Sensor for the Fingertips of the Humanoid Robot iCub," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems (IROS), pp. 2212-2217, 2010.
[4] B.D. Argall and A.G. Billard, "A Survey of Tactile Human-Robot Interactions," Robotics and Autonomous Systems, vol. 58, pp. 1159-1176, 2010.
[5] A. Frisoli, M. Solazzi, F. Salsedo, and M. Bergamasco, "A Fingertip Haptic Display for Improving Curvature Discrimination," Presence: Teleoperators and Virtual Environments, vol. 17, pp. 550-561, Dec. 2008.
[6] P. Jaeyoung, A.J. Doxon, W.R. Provancher, D.E. Johnson, and H.Z. Tan, "Edge Sharpness Perception with Force and Contact Location Information," Proc. IEEE World Haptics Conf. (WHC), pp. 517-522, 2011.
[7] M.W.A. Wijntjes, A. Sato, V. Hayward, and A.M.L. Kappers, "Local Surface Orientation Dominates Haptic Curvature Discrimination," IEEE Trans. Haptics, vol. 2, no. 2, pp. 94-102, Apr.-June 2009.
[8] Y. Ueda, I. Yamano, and T. Maeno, "Development of a Grounded Haptic Device and a 5-Fingered Robot Hand for Dexterous Teleoperation," Proc. Int'l Symp. Robotics and Automation, 2004.
[9] M. Fischer, P. van der Smagt, and G. Hirzinger, "Learning Techniques in a Dataglove Based Telemanipulation System for the DLR Hand," Proc. IEEE Int'l Conf. Robotics and Automation, vol.2, pp. 1603-1608, 1998.
[10] P. Letier, E. Motard, and J.P. Verschueren, "EXOSTATION: Haptic Exoskeleton Based Control Station," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA), pp. 1840-1845, 2010.
[11] D.A. Kontarinis and R.D. Howe, "Tactile Display of Vibratory Information in Teleoperation and Virtual Environments," Presence, vol. 4, pp. 387-402, 1995.
[12] Y. Shen, Y. Liu, and L. Kejie, "Haptic Tactile Feedback in Teleoperation of a Multifingered Robot Hand," Proc. Third World Congress Intelligent Control and Automation, vol. 1, pp. 85-90, 2000.
[13] D. Tsetserukou and S. Tachi, "Efficient Object Exploration and Object Presentation in TeleTA, Teleoperationsystem with Tactile Feedback," Proc. World Haptics EuroHaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 97-102, 2009.
[14] E.M. Petriu and W.S. McMath, "Tactile Operator Interface for Semi-Autonomous Robotic Applications," Proc. Int'l Symp. Artificial Intelligence, Robotics and Automation, pp. 77-82, 1992.
[15] G. Moy, C. Wagner, and R. Fearing, "A Compliant Tactile Display for Teletaction.," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 3409-3415, 2000.
[16] M.V. Ottermo and T.A. Johansen, "Design and Performance of a Prototype Tactile Shape Display for Minimally Invasive Surgery," Haptics-e: The Electronic J. Haptic Research, vol. 4, 2008.
[17] G. Moy, Bidigital Teletaction System Design and Performance. Univ. of California, 2002.
[18] A.M. Okamura, "Methods for Haptic Feedback in Teleoperated Robot-Assisted Surgery," The Industrial Robot, vol. 31, pp. 499-508, 2004.
[19] T. Iwamoto, D. Akaho, and H. Shinoda, "High Resolution Tactile Display Using Acoustic Radiation Pressure," Proc. Ann. Conf. SICE, vol. 2, pp. 1239-1244, 2004.
[20] H. Tang and D.J. Beebe, "A Microfabricated Electrostatic Haptic Display for Persons with Visual Impairments," IEEE Trans. Rehabilitation Eng., vol. 6, no. 3, pp. 241-248, Sept. 1998.
[21] N. Magnenat-Thalmann et al., "From Physics-Based Simulation to the Touching of Textiles: The HAPTEX Project," The Int'l J. Virtual Reality, vol. 6, pp. 35-44, 2007.
[22] N.G. Tsagarakis, T. Horne, and D.G. Caldwell, "SLIP AESTHEASIS: A Portable 2D Slip/Skin Stretch Display for the Fingertip," Proc. First Joint Eurohaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005.
[23] V. Hayward and M. Cruz-hernandez, "Tactile Display Device Using Distributed Lateral Skin Stretch," Proc. Haptic Interfaces for Virtual Environment and Teleoperator Systems Symp. (IMECE '00), pp. 1309-1314, 2000.
[24] R. Velazquez, E. Pissaloux, M. Hafez, and J. Szewczyk, "A Low-Cost Highly-Portable Tactile Display Based on Shape Memory Alloy Micro-Actuators," Proc. IEEE Int'l Conf. Virtual Environments, Human-Computer Interfaces and Measurement Systems (VECIMS '05), 2005.
[25] A. Talbi, "Vibrotactile Using Micromachined Electromagnetic Actuators Array," J. Physics: Conf. Series, vol. 34, p. 637, 2006.
[26] K.-U. Kyung and J.-Y. Lee, "Ubi-Pen: A Haptic Interface with Texture and Vibrotactile Display," IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 56-64, Jan./Feb. 2009.
[27] J.H. Killebrew, "A Dense Array Stimulator to Generate Arbitrary Spatio-Temporal Tactile Stimuli," J. Neurosci Methods, vol. 161, pp. 62-74, Mar. 2007.
[28] C.R. Wagner, S.J. Lederman, and R.D. Howe, "Design and Performance of a Tactile Shape Display Using RC Servomotors," Haptics-e: The Electronic J. Haptic Research, vol. 3, 2004.
[29] F. Vidal-Verdú and M. Hafez, "Graphical Tactile Displays for Visually-Impaired People," IEEE Trans. Neural System and Rehabilitation Eng., vol. 15, no. 1, pp. 119-130, Mar. 2007.
[30] N. Asamura, T. Shinohara, Y. Tojo, N. Koshida, and H. Shinoda, "Necessary Spatial Resolution for Realistic Tactile Feeling Display," Proc. IEEE Int'l Conf. Robotics and Automation (ICRA '01), pp. 1851-1856, 2001.
[31] G. Moy, U. Singh, E. Tan, and R.S. Fearing, "Human Tactile Spatial Sensitivity for Tactile Feedback," Proc. Int'l Conf. Robotics and Automation, pp. 776-782, 2000.
[32] W.J. Peine, P.S. Wellman, and R.D. Howe, "Temporal Bandwidth Requirements for Tactile Shape Displays," Proc. Sixth Ann. Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems (ASME), pp. 107-113, 1997.
[33] N. Garcia-Hernandez, N.G. Tsagarakis, and D.G. Caldwell, "Effect of the Tactile Array Density on the Discrimination of Edge Patterns: Implications for Tactile Systems Design," Proc. Int'l Conf. Advanced Robotics (ICAR '09), pp. 1-6, 2009.
[34] A.M. Smith, G. Gosselin, and B. Houde, "Deployment of Fingertip Forces in Tactile Exploration," Experimental Brain Research, vol. 147, pp. 209-218, 2002.
[35] J. Biggs and M.A. Srinivasan, "Tangential versus Normal Displacements of Skin: Relative Effectiveness for Producing Tactile Sensations," Proc. 10th Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 121-128, 2002.
[36] R.J. Gulati and M.A. Srinivasan, "Human Fingerpad Under Indentation I: Static and Dynamic Force Response," Proc. Bioeng. Conf. (BED-29), pp. 261-262, 1995.
[37] K.U. Kyung, M. Ahn, D.S. Kwon, and A.M. Srinivasan, "Compact Broadband Tactile Display and Its Effectiveness in the Display of Tactile Form," Proc. First Joint Eurohaptics Conf. and Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 600-601, 2005.
[38] I.M. Koo, "Development of Soft-Actuator-Based Wearable Tactile Display," IEEE Trans. Robotics, vol. 24, no. 3 pp. 549-558, June 2008.
[39] J. Streque, A. Talbi, P. Pernod, and V. Preobrazhensky, "New Magnetic Microactuator Design Based on PDMS Elastomer and MEMS Technologies for Tactile Display," IEEE Trans. Haptics, vol. 3, no. 2, pp. 88-97, Apr.-June 2010.
[40] R. Bischoff, "The KUKA-DLR Lightweight Robot Arm—A New Reference Platform for Robotics Research and Manufacturing," Proc. 41st Int'l Symp. Robotics (ISR), and Sixth German Conf. Robotics (ROBOTIK), pp. 1-8, 2010.
[41] H. Hyun-Yong and S. Kawamura, "Analysis of Stiffness of Human Fingertip and Comparison with Artificial Fingers," Proc. IEEE Int'l Conf. Systems, Man, and Cybernetics, pp. 800-805, 1999.
[42] C.H. King, "Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery," IEEE Trans. Haptics, vol. 2, no. 2, pp. 103-110, Apr.-June 2009.
[43] T. Debus, T.-J. Jang, P. Dupont, and R. Howe, "Multi-Channel Vibrotactile Display for Teleoperated Assembly," Int'l J. Control, Automation, and Systems, vol. 2, pp. 390-397, Sept. 2004.