Design of Altered Cognition with Reshaped Bodies
Authors: 
Kenichiro Shirota, Makoto Uju, Yurike Chandra, 
Elaine Czech, Roshan Peiris, Kouta MinamizawaAuthors Info & Claims
Kenichiro Shirota, Makoto Uju, Yurike Chandra, Elaine Czech, Roshan Peiris, Kouta MinamizawaAuthors Info & ClaimsArticle No.: 22, Pages 1 - 10
Abstract
In this research, we aimed to expand humans' physical ability by reshaping natural physicalities that allow body transformation. By modifying the existing body parts, we proposed a system that changed humans' cognition of reality and their environment, and presented its use case. We conducted a study that explored the use of actions: (1) opening and closing of the pinnas (ears) and (2) pulling of the nose to change humans' body schema and humans' cognition of the environment. The results showed that people were able to perceive changes in the position of the pinnas in three different conditions (100% Open, 50% Open, 0% Open) with high accuracy. We also observed that opening and closing the pinnas could alter the cognition of the sound field, as opposed to the normal ears. Furthermore, we found that the feeling of a nose is extending was felt more by using the system. This finding implied that the modified body schema improved our recognition of the odor source and its position.
References
[1]
1940. Pinocchio. Walt Disney studios home entertainment.
[2]
1949. Dumbo, the Flying Elephant. Walt Disney Productions.
[3]
Sun Joo Ahn, Joshua Bostick, Elise Ogle, Kristine L Nowak, Kara T McGillicuddy, and Jeremy N Bailenson. 2016. Experiencing nature: Embodying animals in immersive virtual environments increases inclusion of nature in self and involvement with nature. Journal of Computer-Mediated Communication 21, 6 (2016), 399--419.
[4]
Yuki Ban, Takashi Kajinami, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2012. Modifying an identified curved surface shape using pseudo-haptic effect. In 2012 IEEE Haptics Symposium (HAPTICS). IEEE, 211--216.
[5]
Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2013. Modifying perceived size of a handled object through hand image deformation. Presence: Teleoperators and Virtual Environments 22, 3 (2013), 255--270.
[6]
Domna Banakou, Parasuram D Hanumanthu, and Mel Slater. 2016. Virtual embodiment of white people in a black virtual body leads to a sustained reduction in their implicit racial bias. Frontiers in human neuroscience 10 (2016), 601.
[7]
Domna Banakou, Sameer Kishore, and Mel Slater. 2018. Virtually being einstein results in an improvement in cognitive task performance and a decrease in age bias. Frontiers in psychology 9 (2018), 917.
[8]
Hong-Yu Chang, Wen-Jie Tseng, Chia-En Tsai, Hsin-Yu Chen, Roshan Lalintha Peiris, and Liwei Chan. 2018. Facepush: Introducing normal force on face with head-mounted displays. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 927--935.
[9]
Andy Clark. 1998. Being there: Putting brain, body, and world together again. MIT press.
[10]
Andy Clark. 2001. Natural-born cyborgs?. In International Conference on Cognitive Technology. Springer, 17--24.
[11]
Marcello Costantini and Patrick Haggard. 2007. The rubber hand illusion: sensitivity and reference frame for body ownership. Consciousness and cognition 16, 2 (2007), 229--240.
[12]
Christine Dierk, Sarah Sterman, Molly Jane Pearce Nicholas, and Eric Paulos. 2018. Hairiö: Human hair as interactive material. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 148--157.
[13]
Guy M Goodwin, D Ian McCloskey, and Peter BC Matthews. 1972. Proprioceptive illusions induced by muscle vibration: contribution by muscle spindles to perception? Science 175, 4028 (1972), 1382--1384.
[14]
Da-Yuan Huang, Teddy Seyed, Linjun Li, Jun Gong, Zhihao Yao, Yuchen Jiao, Xiang'Anthony' Chen, and Xing-Dong Yang. 2018. Orecchio: Extending Body-Language through Actuated Static and Dynamic Auricular Postures. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 697--710.
[15]
Yuji Kaneda and Masakazu Matsugu. 2012. Information processing apparatus, eye open/closed degree determination method, computer-readable storage medium, and image sensing apparatus. US Patent 8,130,281.
[16]
Takashi Kikuchi, Yuta Sugiura, Katsutoshi Masai, Maki Sugimoto, and Bruce H Thomas. 2017. EarTouch: turning the ear into an input surface. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 27.
[17]
Konstantina Kilteni, Antonella Maselli, Konrad P Kording, and Mel Slater. 2015. Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in human neuroscience 9 (2015), 141.
[18]
Konstantina Kilteni, Jean-Marie Normand, Maria V Sanchez-Vives, and Mel Slater. 2012. Extending body space in immersive virtual reality:a very long arm illusion. PloS one 7, 7 (2012), e40867.
[19]
Kenri Kodaka and Koyo Mori. 2017. Stretchar (m) makes your arms elastic. In SIGGRAPH Asia 2017 VR Showcase. ACM, 10.
[20]
James R Lackner. 1988. Some proprioceptive influences on the perceptual representation of body shape and orientation. Brain 111, 2 (1988), 281--297.
[21]
Anatole Lecuyer, Sabine Coquillart, Abderrahmane Kheddar, Paul Richard, and Philippe Coiffet. 2000. Pseudo-haptic feedback: can isometric input devices simulate force feedback?. In Proceedings IEEE Virtual Reality 2000 (Cat. No. 00CB37048). IEEE, 83--90.
[22]
Bigna Lenggenhager, Tej Tadi, Thomas Metzinger, and Olaf Blanke. 2007. Video ergo sum: manipulating bodily self-consciousness. Science 317, 5841 (2007), 1096--1099.
[23]
Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 1471--1482. https://doi.org/10.1145/3025453.3025600
[24]
Tomosuke Maeda, Roshan Peiris, Masashi Nakatani, Yoshihiro Tanaka, and Kouta Minamizawa. 2016. Wearable haptic augmentation system using skin vibration sensor. In Proceedings of the 2016 Virtual Reality International Conference. 1--4.
[25]
Keigo Matsumoto, Yuki Ban, Takuji Narumi, Yohei Yanase, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Unlimited corridor: redirected walking techniques using visuo haptic interaction. In ACM SIGGRAPH 2016 Emerging Technologies. ACM, 20.
[26]
Masahiro Miyakami, Takuto Nakamura, and Hiroyuki Kajimoto. 2019. Evaluation of a device reproducing the pseudo-force sensation caused by a clothespin. In Proceedings of the 10th Augmented Human International Conference 2019. ACM, 5.
[27]
Florian floyd Mueller, Richard Byrne, Josh Andres, and Rakesh Patibanda. 2018. Experiencing the Body as Play. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI 18 (Apr 2018).
[28]
Craig D Murray. 2004. An interpretative phenomenological analysis of the embodiment of artificial limbs. Disability and Rehabilitation 26, 16 (2004), 963--973.
[29]
Takuji Narumi. 2017. Technological applications of multisensory perception. Basic psychology research 36, 1 (2017), 129--132. [Translated from Japanese.].
[30]
Takuji Narumi. 2019. Ghost Engineering: Designing Our Cognitive Func-tions by Modifying Our Body. Cognitive Studies 26, 1 (2019), 14--29. [Translated from Japanese.].
[31]
Roger Newport, Kelly Auty, Mark Carey, Katie Greenfield, Ellen M Howard, Natasha Ratcliffe, Hayley Thair, and Kristy Themelis. 2015. Give it a tug and feel it grow: extending body perception through the universal nature of illusory finger stretching. i-Perception 6, 5 (2015), 2041669515599310.
[32]
Nami Ogawa, Yuki Ban, Sho Sakurai, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Metamorphosis hand: dynamically transforming hands. In Proceedings of the 7th Augmented Human International Conference 2016. ACM, 51.
[33]
Roshan Lalintha Peiris, Liwei Chan, and Kouta Minamizawa. 2018. LiquidReality: wetness sensations on the face for virtual reality. In International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, Cham, 366--378.
[34]
Roshan Lalintha Peiris, Wei Peng, Zikun Chen, Liwei Chan, and Kouta Minamizawa. 2017. ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 5452--5456. https://doi.org/10.1145/3025453.3025824
[35]
Luis C Populin and Tom CT Yin. 1998. Pinna movements of the cat during sound localization. Journal of Neuroscience 18, 11 (1998), 4233--4243.
[36]
Vilayanur S Ramachandran, Sandra Blakeslee, and Neil Shah. 1998. Phantoms in the brain: Probing the mysteries of the human mind. William Morrow New York.
[37]
Vilayanur S Ramachandran and William Hirstein. 1998. The perception of phantom limbs. The DO Hebb lecture. Brain: a journal of neurology 121, 9 (1998), 1603--1630.
[38]
Nimesha Ranasinghe, Pravar Jain, Nguyen Thi Ngoc Tram, Koon Chuan Raymond Koh, David Tolley, Shienny Karwita, Lin Lien-Ya, Yan Liangkun, Kala Shamaiah, Chow Eason Wai Tung, and et al. 2018. Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 577, 13 pages. https://doi.org/10.1145/3173574.3174151
[39]
Robin S Rosenberg, Shawnee L Baughman, and Jeremy N Bailenson. 2013. Virtual superheroes: Using superpowers in virtual reality to encourage prosocial behavior. PloS one 8, 1 (2013), e55003.
[40]
MHD Saraiji, Tomoya Sasaki, Kai Kunze, Kouta Minamizawa, and Masahiko Inami. 2018. MetaArmS: Body remapping using feet-controlled artificial arms. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 65--74.
[41]
MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami. 2018. Fusion: Full Body Surrogacy for Collaborative Communication. In ACM SIGGRAPH 2018 Emerging Technologies (SIGGRAPH '18). Association for Computing Machinery, New York, NY, USA, Article Article 7, 2 pages. https://doi.org/10.1145/3214907.3214912
[42]
Kenichiro Shirota, Roshan Lalintha Peiris, and Kouta Minamizawa. 2019. Altered pinna: exploring shape change of pinna for perception and illusion of sound direction change. In Proceedings of the 23rd International Symposium on Wearable Computers. 220--224.
[43]
Makoto Uju, Kenichiro Shirota, Roshan Peiris, and Kouta Minamizawa. 2019. PinocchioVR. In ACM SIGGRAPH 2019 Emerging Technologies (SIGGRAPH '19). Association for Computing Machinery, New York, NY, USA, Article Article 21, 2 pages. https://doi.org/10.1145/3305367.3327992
[44]
Björn Van Der Hoort, Arvid Guterstam, and H Henrik Ehrsson. 2011. Being Barbie: the size of one's own body determines the perceived size of the world. PloS one 6, 5 (2011), e20195.
[45]
Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). Association for Computing Machinery, New York, NY, USA, 365--378. https://doi.org/10.1145/3242587.3242645
Index Terms
- Design of Altered Cognition with Reshaped Bodies
Recommendations
Altered pinna: exploring shape change of pinna for perception and illusion of sound direction change
ISWC '19: Proceedings of the 2019 ACM International Symposium on Wearable ComputersThis study demonstrates that by opening and closing the human pinna, we can change the direction of sound perceived by humans. Each ear was independently transformed into a 100% open, 50% open, and 100% closed state, and all 9 combinations of these ear ...
Animation of Refitted 3D Garment Models for Reshaped Bodies
ICVRV '14: Proceedings of the 2014 International Conference on Virtual Reality and VisualizationWe present a framework for a virtual try-on system. Starting with a template human body mesh, we reshape it to acquire meshes of various body dimensions according to the user specified parameters. These reshaped bodies are further processed in two ...
Effects of Body Duplication and Split on Body Schema
AHs '22: Proceedings of the Augmented Humans International Conference 2022Visual-tactile synchronization or visual-motor synchronization makes a not innate body feel as if it was one’s own body (illusory body ownership). Although recent studies have shown that body ownership can be induced in multiple bodies, it is unclear ...
Comments
Information & Contributors
Information
Published In
March 2020
296 pages
ISBN:9781450376037
DOI:10.1145/3384657
- General Chairs:
- Bo Zhou,
- Jingyuan Cheng,
- Program Chairs:
- Paul Strohmeier,
- Shoya Ishimaru,
- Thomas Kosch
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 06 June 2020
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
AHs '20
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 228Total Downloads
- Downloads (Last 12 months)26
- Downloads (Last 6 weeks)2
Reflects downloads up to 06 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in