Haptic-aware Interaction: Design and Evaluation
Author: 
Ying FangAuthors Info & Claims
Ying FangAuthors Info & ClaimsPages 9350 - 9354
Abstract
The emerging haptic technology has introduced new media perceptions and also increased the immersive experiences of end-users. To date, novel haptic-audio-visual environments and their Quality of Experience (QoE) assessments are still challenging issues. In this work, we investigate the haptic-visual interaction QoE in virtual as well as real-world environments. First, we establish a haptic-visual interaction platform based on a balance ball Virtual Reality (VR) game scene and a haptic-visual interaction platform with data-glove-assisted remote control. Second, we conduct subjective tests to qualitatively and quantitatively analyze the impacts of system-related, user-related and task-related factors on QoE evaluation. Third, we propose learning-based QoE models to effectively evaluate the user-perceived QoE in haptic-visual interaction. In the future work, we aim to focus on the improvement of the two established platforms, with the addition of audio-related influencing factors and more haptic feedback, and optimizing the proposed QoE model for further improvement of haptic-audio-visual interaction applications.
References
[1]
Konstantinos Antonakoglou, Xiao Xu, Eckehard Steinbach, Toktam Mahmoodi, and Mischa Dohler. 2018. Toward Haptic Communications Over the 5G Tactile Internet. IEEE Communications Surveys & Tutorials, Vol. 20, 4 (2018), 3034--3059.
[2]
Rahul Chaudhari, Eckehard Steinbach, and Sandra Hirche. 2011. Towards an objective quality evaluation framework for haptic data reduction. In 2011 IEEE World Haptics Conference. 539--544.
[3]
Jiahui Dong, Jun Zhang, Xiao Ma, Pengyu Ren, Zhenyu Cheryl Qian, and Yingjie Victor Chen. 2019. Virtual Reality Training with Passive Haptic Feedback for CryoEM Sample Preparation. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 892--893.
[4]
Takeshi Fujimoto, Yutaka Ishibashi, and Shinji Sugawara. 2008. Influences of Inter-Stream Synchronization Error on Collaborative Work in Haptic and Visual Environments. In 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. 113--119.
[5]
Abdelwahab Hamam and Abdulmotaleb El Saddik. 2013. Toward a Mathematical Model for Quality of Experience Evaluation of Haptic Applications. IEEE Transactions on Instrumentation and Measurement, Vol. 62, 12 (2013), 3315--3322.
[6]
Abdelwahab Hamam and Abdulmotaleb El Saddik. 2014. A Quality of Experience Model for Haptic Virtual Environments. ACM Transactions on Multimedia Computing, Communications,and Applications, Vol. 10, 28 (2014), 1--23.
[7]
Md. Tanvir Hossan, Mostafa Zaman Chowdhury, Md. Shahjalal, and Yeong Min Jang. 2019. Human Bond Communication with Head-Mounted Displays: Scope, Challenges, Solutions, and Applications. IEEE Communications Magazine, Vol. 57, 2 (2019), 26--32.
[8]
Qian Liu and Tiesong Zhao. 2019. Quality-of-Experience in Human-in-the-Loop Haptic Communications. ZTE Communications, Vol. 17, 1 (2019), 48--55.
[9]
Zhuanghua Shi, Heng Zou, Markus Rank, Lihan Chen, Sandra Hirche, and Hermann J. Muller. 2010. Effects of Packet Loss and Latency on the Temporal Discrimination of Visual-Haptic Events. IEEE Transactions on Haptics, Vol. 3, 1 (2010), 28--36.
[10]
Eckehard Steinbach, Matti Strese, Mohamad Eid, Xun Liu, Amit Bhardwaj, Qian Liu, Mohammad Al-Jaàfreh, Toktam Mahmoodi, Rania Hassen, Abdulmotaleb El Saddik, and Oliver Holland. 2019. Haptic Codecs for the Tactile Internet. Proc. IEEE, Vol. 107, 2 (2019), 447--470.
[11]
Zhongda Sun, Minglu Zhu, Zhaocong Chen, Xuechuan Shan, and Chengkuo Lee. 2021. Haptic-Feedback Ring Enabled Human-Machine Interface (HMI) Aiming at Immersive Virtual Reality Experience. In 2021 21st International Conference on Solid-State Sensors, Actuators and Microsystems (Transducers). 333--336.
[12]
Shuji Tasaka. 2016. Bayesian structural equation modeling of multidimensional QoE in haptic-audiovisual interactive communications. In 2016 IEEE International Conference on Communications (ICC). 1--6.
[13]
Shuji Tasaka. 2019. Bayesian Categorical Modeling of Multidimensional QoE in Haptic-Audiovisual Communications. In ICC 2019 - 2019 IEEE International Conference on Communications (ICC). 1--7.
[14]
Xin Wei, Yuyuan Yao, Haoyu Wang, and Liang Zhou. 2022a. Perception-Aware Cross-Modal Signal Reconstruction: From Audio-Haptic to Visual. IEEE Transactions on Multimedia (2022), 1--12.
[15]
Xin Wei, Meng Zhang, and Liang Zhou. 2022b. Cross-Modal Transmission Strategy. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 32, 6 (2022), 3991--4003.
[16]
Xiaonong Xu, Aiguo Song, Dejing Ni, Huijun Li, Pengwen Xiong, and Chengcheng Zhu. 2016. Visual-Haptic Aid Teleoperation Based on 3-D Environment Modeling and Updating. IEEE Transactions on Industrial Electronics, Vol. 63, 10 (2016), 6419--6428.
[17]
Chenguang Yang, Jing Luo, Chao Liu, Miao Li, and Shilu Dai. 2019. Haptics Electromyography Perception and Learning Enhanced Intelligence for Teleoperated Robot. IEEE Transactions on Automation Science and Engineering, Vol. 16, 4 (2019), 1512--1521.
[18]
Xinbo Yu, Wei He, Qing Li, Yanan Li, and Bin Li. 2021. Human-Robot Co-Carrying Using Visual and Force Sensing. IEEE Transactions on Industrial Electronics, Vol. 68, 9 (2021), 8657--8666.
[19]
Qi Zeng, Yutaka Ishibashi, Norishige Fukushima, Shinji Sugawara, and Konstantinos Psannis. 2013. Influences of inter-stream synchronization errors among haptic media, sound, and video on quality of experience in networked ensemble. In 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE). 466--470.
[20]
Tiesong Zhao, Qian Liu, and Chang Wen Chen. 2017. QoE in Video Transmission: A User Experience-Driven Strategy. IEEE Communications Surveys & Tutorials, Vol. 19, 1 (2017), 285--302.
[21]
Liang Zhou, Dan Wu, Jianxin Chen, and Xin Wei. 2020. Cross-Modal Collaborative Communications. IEEE Wireless Communications, Vol. 27, 2 (2020), 112--117
Index Terms
- Haptic-aware Interaction: Design and Evaluation
Recommendations
Haptic Fidelity Framework: Defining the Factors of Realistic Haptic Feedback for Virtual Reality
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsProviding haptic feedback in virtual reality to make the experience more realistic has become a strong focus of research in recent years. The resulting haptic feedback systems differ greatly in their technologies, feedback possibilities, and overall ...
Haptic pen: a tactile feedback stylus for touch screens
UIST '04: Proceedings of the 17th annual ACM symposium on User interface software and technologyIn this paper we present a system for providing tactile feedback for stylus-based touch-screen displays. The Haptic Pen is a simple low-cost device that provides individualized tactile feedback for multiple simultaneous users and can operate on large ...
The Haptic Tabletop Puck: tactile feedback for interactive tabletops
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesIn everyday life, our interactions with objects on real tables include how our fingertips feel those objects. In comparison, current digital interactive tables present a uniform touch surface that feels the same, regardless of what it presents visually. ...
Comments
Information & Contributors
Information
Published In
October 2023
9913 pages
ISBN:9798400701085
DOI:10.1145/3581783
- General Chairs:
- Abdulmotaleb El Saddik,
- Tao Mei,
- Rita Cucchiara,
- Program Chairs:
- Marco Bertini,
- Diana Patricia Tobon Vallejo,
- Pradeep K. Atrey,
- M. Shamim Hossain
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 October 2023
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
MM '23
Sponsor:
MM '23: The 31st ACM International Conference on Multimedia
October 29 - November 3, 2023
Ottawa ON, Canada
Acceptance Rates
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 126Total Downloads
- Downloads (Last 12 months)91
- Downloads (Last 6 weeks)11
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in