abstract

Neo-Noumena

Authors:

Nathan Semertzidis,

Michaela Vranic-Peters,

Florian Floyd MuellerAuthors Info & Claims

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 4

https://doi.org/10.1145/3334480.3383163

Published: 25 April 2020 Publication History

Get Access

Abstract

Communicating emotional experiences is something core to being human, yet also notoriously difficult. With this considered, we acknowledge previous work in bio-responsive and neurofeedback systems which facilitate the externalization of subjective experiences, which highlight potential for the appropriation of Neurofeedback for communication. We present a demonstration that explores this opportunity through "Neo-Noumena", a communicative neuro-responsive system that augments the interpersonal communication of emotion through brain-computer interfacing and artificial intelligence, which interprets the users affective state and dynamically to others in mixed reality through two head-mounted displays. The user will, with a partner, experience their affective state translated into an aural swarm of procedurally generated, emotionally informative fractals.

Supplementary Material

PDF File (int003.pdf)

Video figure captions

Download
288.72 KB

MP4 File (int028pv.mp4)

Preview video

Download
10.68 MB

MP4 File (dein1089vf.mp4)

Supplemental video

Download
15.33 MB

References

[1]

Bai, Zhen, Blackwell, Alan F, and Coulouris, George. 2015. Exploring expressive augmented reality: The FingAR puppet system for social pretend play. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems ACM, 10351044.

Digital Library

Google Scholar

[2]

Bies, Alexander J, Blanc-Goldhammer, Daryn R, Boydston, Cooper R, Taylor, Richard P, and Sereno, Margaret E. 2016. Aesthetic responses to exact fractals driven by physical complexity. Frontiers in human neuroscience 10, 210.

Google Scholar

[3]

Cauchard, Jessica R, Zhai, Kevin Y, Spadafora, Marco, and Landay, James A. 2016. Emotion encoding in human-drone interaction. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) IEEE, 263--270.

Crossref

Google Scholar

[4]

Delgado-Mata, Carlos, Martinez, Jesus Ibanez, Bee, Simon, Ruiz-Rodarte, Rocio, and Aylett, Ruth. 2007. On the use of virtual animals with artificial fear in virtual environments. New Generation Computing 25, 2, 145--169.

Digital Library

Google Scholar

[5]

Faltaous, Sarah, Haas, Gabriel, Barrios, Liliana, Seiderer, Andreas, Rauh, Sebastian Felix, Chae, Han Joo, Schneegass, Stefan, and Alt, Florian. 2019. BrainShare: A Glimpse of Social Interaction for Locked-in Syndrome Patients. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems ACM, LBW0155.

Digital Library

Google Scholar

[6]

Kitson, Alexandra, Dipaola, Steve, and Riecke, Bernhard E. 2019. Lucid Loop: A Virtual Deep Learning Biofeedback System for Lucid Dreaming Practice. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems ACM, LBW1322.

Digital Library

Google Scholar

[7]

Koelstra, Sander, Muhl, Christian, Soleymani, Mohammad, Lee, Jong-Seok, Yazdani, Ashkan, Ebrahimi, Touradj, Pun, Thierry, Nijholt, Anton, and Patras, Ioannis. 2011. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing 3, 1, 18--31.

Google Scholar

[8]

Liu, Yisi, Sourina, Olga, and Nguyen, Minh Khoa. 2010. Real-time EEG-based human emotion recognition and visualization. In 2010 international conference on cyberworlds IEEE, 262--269.

Digital Library

Google Scholar

[9]

Roo, Joan Sol, Gervais, Renaud, and Hachet, Martin. 2016. Inner garden: An augmented sandbox designed for self-reflection. In Proceedings of the TEI'16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction ACM, 570--576.

Digital Library

Google Scholar

[10]

Semertzidis, Nathan Arthur, Andres, Josh, Dwivedi, Brahmi, Kulwe, Yutika, Vranic-Peters, Michaela, Zambetta, Fabio, and Mueller, Florian Floyd. 2020. NeoNoumena: Augmenting Emotion Communication. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems ACM.

Digital Library

Google Scholar

[11]

Semertzidis, Nathan Arthur, Sargeant, Betty, Dwyer, Justin, Mueller, Florian Floyd, and Zambetta, Fabio. 2019. Towards Understanding the Design of Positive Pre-sleep Through a Neurofeedback Artistic Experience. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems ACM, 574.

Digital Library

Google Scholar

[12]

Spehar, Branka, Clifford, Colin Wg, Newell, Ben R, and Taylor, Richard P. 2003. Universal aesthetic of fractals. Computers & Graphics 27, 5, 813--820.

Crossref

Google Scholar

[13]

Tishby, Naftali, Pereira, Fernando C, and Bialek, William. 2000. The information bottleneck method. arXiv preprint physics/0004057.

Google Scholar

Cited By

View all

You CChen HChen PLai WYuan CBi N(2024)Toward Understanding the Impact of Visualized Focus Levels in Virtual Reality on User Presence and ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/36765278:MHCI(1-30)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676527

Index Terms

Neo-Noumena
1. Applied computing
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Neo-Noumena: Augmenting Emotion Communication
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

The subjective experience of emotion is notoriously difficult to interpersonally communicate. We believe that technology can challenge this notion through the design of neuroresponsive systems for interpersonal communication. We explore this through "Neo-...
Emotion and mood recognition in response to video

This paper presents a subject-dependent homogenous emotion recognition method using electroencephalogram (EEG) signals in response to video contents, and a correlation between emotions and moods of subjects in resting state. In the recent years, there ...
Affective brain-computer interfaces (aBCI 2011)
ACII'11: Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II

Recently, many groups (see Zander and Kothe. Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J. Neural Eng., 8, 2011) have worked toward expanding brain-computer interface (BCI)...

Comments

Information & Contributors

Information

Published In

CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

4474 pages

ISBN:9781450368193

DOI:10.1145/3334480

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2020

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
177
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

You CChen HChen PLai WYuan CBi N(2024)Toward Understanding the Impact of Visualized Focus Levels in Virtual Reality on User Presence and ExperienceProceedings of the ACM on Human-Computer Interaction10.1145/36765278:MHCI(1-30)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676527

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplementary Material

References

Cited By

Index Terms

Recommendations

Neo-Noumena: Augmenting Emotion Communication

Emotion and mood recognition in response to video

Affective brain-computer interfaces (aBCI 2011)

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations