extended-abstract

See through the fire: evaluating the augmentation of visual perception of firefighters using depth and thermal cameras

Authors:

Albrecht SchmidtAuthors Info & Claims

UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers

Pages 693 - 696

https://doi.org/10.1145/3123024.3129269

Published: 11 September 2017 Publication History

Get Access

Abstract

Our visual perception is limited to the abilities of our eyes, where we only perceive visible light. This limitation might influence how we perceive and react to our surroundings, however, this limitation might endanger us in certain scenarios e.g. firefighting. In this paper, we explore the potential of augmenting the visual sensing of the firefighters using depth and thermal imaging to increase their awareness about the environment. Additionally, we built and evaluated two form factors, hand held and head mounted display. To evaluate our built prototypes, we conducted two user studies in a simulated fire environment with real firefighters. In this workshop paper, we present our findings from the evaluation of the concept and prototypes with real firefighters.

References

[1]

Yomna Abdelrahman. 2013. Thermal imaging for interactive surfaces. Master's thesis.

Google Scholar

[2]

Yomna Abdelrahman, Pascal Knierim, and Albrecht Schmidt. 2017. Snake View: Exploring Thermal Imaging as a Vision Extender in Mountains. In (UbiMount) ubiquitous computing in the mountains.

Digital Library

Google Scholar

[3]

Yomna Abdelrahman, Alireza Sahami Shirazi, Niels Henze, and Albrecht Schmidt. 2015. Investigation of Material Properties for Thermal Imaging-Based Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 15--18.

Digital Library

Google Scholar

[4]

J. Biswas and M. Veloso. 2012. Depth camera based indoor mobile robot localization and navigation. In Robotics and Automation (ICRA), 2012 IEEE International Conference on. 1697--1702.

Google Scholar

[5]

José Alberto Fuentes, Miguel Oliver, Francisco Montero, Antonio Fernández-Caballero, and Miguel Angel Fernández. 2013. Towards Usability Evaluation of Multimodal Assistive Technologies Using RGB-D Sensors. Springer Berlin Heidelberg, Berlin, Heidelberg, 210--219.

Google Scholar

[6]

Peter Henry, Michael Krainin, Evan Herbst, Xiaofeng Ren, and Dieter Fox. 2010. RGB-D mapping: Using depth cameras for dense 3D modeling of indoor environments. In In the 12th International Symposium on Experimental Robotics (ISER. Citeseer.

Google Scholar

[7]

Alireza Sahami Shirazi, Yomna Abdelrahman, Niels Henze, Stefan Schneegass, Mohammadreza Khalilbeigi, and Albrecht Schmidt. 2014. Exploiting Thermal Reflection for Interactive Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3483--3492.

Digital Library

Google Scholar

Cited By

View all

Li MKatsiuba DDolata MSchwabe G(2024)Firefighters' Perceptions on Collaboration and Interaction with Autonomous Drones: Results of a Field TrialProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642061(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642061
Cantón DLázaro M(2024)Automatic Labeling for Thermal Imaging Datasets Generation2024 7th Iberian Robotics Conference (ROBOT)10.1109/ROBOT61475.2024.10797435(1-7)Online publication date: 6-Nov-2024
https://doi.org/10.1109/ROBOT61475.2024.10797435
Villa SNiess JSchmidt AWelsch R(2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
https://doi.org/10.1145/3610915
Show More Cited By

Index Terms

See through the fire: evaluating the augmentation of visual perception of firefighters using depth and thermal cameras
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

An ontology to represent firefighters data requirements during building fire emergencies
Abstract
Firefighters require accurate and timely information regarding a building and its environment to perform their duty safely and successfully during a fire emergency. However, due to the chaotic nature of building fires, firefighters often receive ...
Proposal of the Fire Fighting Support System for the Volunteer Fire Company
WAINA '15: Proceedings of the 2015 IEEE 29th International Conference on Advanced Information Networking and Applications Workshops

In this research, we built the fire fighting support system for supporting the fire fighting of the volunteer fire company. This system is the mobile application based on Web-GIS. By using this system, the fire corps volunteers can confirm the fire ...
SpaceWalk: Movement and Interaction in Virtual Space with Commodity Hardware
IE2014: Proceedings of the 2014 Conference on Interactive Entertainment

We introduce SpaceWalk, an experimental approach to allow a person to move around a small room while wearing a Head Mounted Display. The goal is to get immersed users in everyday settings out of their seats and naturally experiencing movement within the ...

Comments

Information & Contributors

Information

Published In

UbiComp '17: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers

September 2017

1089 pages

ISBN:9781450351904

DOI:10.1145/3123024

General Chairs:
Seungyon "Claire" Lee
Google
,
Leila Takayama
UC Santa Cruz
,
Khai Truong
University of Toronto

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2017

Check for updates

Author Tags

Qualifiers

Extended-abstract

Funding Sources

European Research Council under the European Union's Horizon 2020 research and innovation programme
German Research Foundation within the SimTech Cluster of Excellence
German Federal Ministry of Education and Research, FeuerWeRR

Conference

UbiComp '17

Sponsor:

UbiComp '17: The 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 11 - 15, 2017

Hawaii, Maui

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
349
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)4

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li MKatsiuba DDolata MSchwabe G(2024)Firefighters' Perceptions on Collaboration and Interaction with Autonomous Drones: Results of a Field TrialProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642061(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642061
Cantón DLázaro M(2024)Automatic Labeling for Thermal Imaging Datasets Generation2024 7th Iberian Robotics Conference (ROBOT)10.1109/ROBOT61475.2024.10797435(1-7)Online publication date: 6-Nov-2024
https://doi.org/10.1109/ROBOT61475.2024.10797435
Villa SNiess JSchmidt AWelsch R(2023)Society's Attitudes Towards Human Augmentation and Performance Enhancement Technologies (SHAPE) ScaleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109157:3(1-23)Online publication date: 27-Sep-2023
https://doi.org/10.1145/3610915
Macdonald SAlotaibi NIslam MKhamis MWard JMcGill MMarky K(2023)Conducting and Mitigating Portable Thermal Imaging Attacks on User Authentication using AI-driven MethodsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3583698(357-359)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3583698
Villa SNiess JNakao TLazar JSchmidt AMachulla T(2023)Understanding Perception of Human Augmentation: A Mixed-Method StudyProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581485(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581485
Clinch SWard J(2023)Augmented CognitionIEEE Pervasive Computing10.1109/MPRV.2023.329601022:3(6-7)Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1109/MPRV.2023.3296010
Villa SKosch TGrelka FSchmidt AWelsch R(2023)The placebo effect of human augmentationComputers in Human Behavior10.1016/j.chb.2023.107787146:COnline publication date: 26-Jul-2023
https://dl.acm.org/doi/10.1016/j.chb.2023.107787
Assiri BHossain M(2022)Face emotion recognition based on infrared thermal imagery by applying machine learning and parallelismMathematical Biosciences and Engineering10.3934/mbe.202304220:1(913-929)Online publication date: 2022
https://doi.org/10.3934/mbe.2023042
Popoveniuc BVatavu R(2022)Transhumanism as a Philosophical and Cultural Framework for Extended Reality Applied to Human Augmentation13th Augmented Human International Conference10.1145/3532525.3532528(1-8)Online publication date: 26-May-2022
https://dl.acm.org/doi/10.1145/3532525.3532528
Stemasov EBotner ARukzio EGugenheimer J(2022)Ephemeral Fabrication: Exploring a Ubiquitous Fabrication Scenario of Low-Effort, In-Situ Creation of Short-Lived Physical ArtifactsProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501331(1-17)Online publication date: 13-Feb-2022
https://dl.acm.org/doi/10.1145/3490149.3501331
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

An ontology to represent firefighters data requirements during building fire emergencies

Proposal of the Fire Fighting Support System for the Volunteer Fire Company

SpaceWalk: Movement and Interaction in Virtual Space with Commodity Hardware

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations