skip to main content
10.1145/3485730.3493692acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
short-paper

A Low-resolution infrared thermal dataset and potential privacy-preserving applications

Published: 15 November 2021 Publication History

Abstract

This paper presents a low-resolution infrared thermal dataset of people and thermal objects, such as a working laptop, in indoor environments. The dataset was collected by a far infrared thermal camera (32x24 pixels), which can capture the position and shape information of thermal objects without privacy issues that enable trustworthy computer vision applications. The dataset consists of 1770 thermal images with high-quality annotation collected from an indoor room with around 15°C. We implemented a privacy-preserving human detection method and trained a multiple object detection (MOD) model based on the dataset. The human detection method reaches 90.3% accuracy. On the other hand, the MOD model achieved 56.8% mean average precision (mAP). Researchers can implement interesting applications based on our dataset, for example, privacy-preserving people counting systems, occupancy estimation systems for smart buildings, and social distance detectors.

References

[1]
IEA-International Energy Agency. 2021. Buildings: A source of enormous untapped efficiency potential. Retrieved on September 20th, 2021 from https://www.iea.org/topics/buildings.
[2]
AI HLEG European Commission. 2018. Ethics Guidelines for Trustworthy AI. (2018). Retrieved on September 20th, 2021 from https://ec.europa.eu/futurium/en/ai-alliance-consultation/guidelines/1.html.
[3]
COCO. 2021. Common Objects in Context. Retrieved on September 20th, 2021 from https://cocodataset.org/#overview.
[4]
Xiyang Dai, Yinpeng Chen, Bin Xiao, Dongdong Chen, Mengchen Liu, Lu Yuan, and Lei Zhang. 2021. Dynamic Head: Unifying Object Detection Heads with Attentions. CoRR abs/2106.08322 (2021). arXiv:2106.08322 https://arxiv.org/abs/2106.08322
[5]
Joshua Hrisko. 2020. High Resolution Thermal Camera with Raspberry Pi and MLX90640. Retrieved on September 20th, 2021 from https://makersportal.com/blog/2020/6/8/high-resolution-thermal-camera-with-raspberry-pi-and-mlx90640.
[6]
TzuTa Lin. 2015. LabelImg. Free Software: MIT License. https://github.com/tzutalin/labelImg
[7]
Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollar. 2017. Focal Loss for Dense Object Detection. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).
[8]
Wenhan Luo, Junliang Xing, Anton Milan, Xiaoqin Zhang, Wei Liu, and Tae-Kyun Kim. 2021. Multiple object tracking: A literature review. Artificial Intelligence 293 (2021), 103448. https://doi.org/10.1016/j.artint.2020.103448
[9]
Aly Metwaly, Jorge Peña Queralta, Victor Kathan Sarker, Tuan Nguyen Gia, Omar Nasir, and Tomi Westerlund. 2019. Edge Computing with Embedded AI: Thermal Image Analysis for Occupancy Estimation in Intelligent Buildings. In Proceedings of the INTelligent Embedded Systems Architectures and Applications Workshop 2019 (New York, NY, USA) (INTESA2019). Association for Computing Machinery, New York, NY, USA, 1--6. https://doi.org/10.1145/3372394.3372397
[10]
Raspberry Pi Foundation. 2021. Raspberry Pi OS. Retrieved on September 20th, 2021 from https://www.raspberrypi.org/software/.
[11]
Kattni Rembor. 2020. Adafruit MLX90640 IR Thermal Camera. Retrieved on September 20th, 2021 from https://learn.adafruit.com/adafruit-mlx90640-ir-thermal-camera/python-circuitpython.
[12]
Fabián Riquelme, Cristina Espinoza, Tomás Rodenas, Jean-Gabriel Minonzio, and Carla Taramasco. 2019. eHomeSeniors Dataset: An Infrared Thermal Sensor Dataset for Automatic Fall Detection Research. Sensors 19, 20 (2019). https://doi.org/10.3390/s19204565
[13]
Zhong-Qiu Zhao, Peng Zheng, Shou-Tao Xu, and Xindong Wu. 2019. Object Detection With Deep Learning: A Review. IEEE Transactions on Neural Networks and Learning Systems 30, 11 (2019), 3212--3232. https://doi.org/10.1109/TNNLS.2018.2876865

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SenSys '21: Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems
November 2021
686 pages
ISBN:9781450390972
DOI:10.1145/3485730
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 November 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. computer vision
  2. infrared thermal dataset
  3. low-resolution thermal images
  4. privacy-preserving applications

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

Acceptance Rates

SenSys '21 Paper Acceptance Rate 25 of 139 submissions, 18%;
Overall Acceptance Rate 174 of 867 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 260
    Total Downloads
  • Downloads (Last 12 months)51
  • Downloads (Last 6 weeks)8
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media