research-article

How real is real enough? optimal reality sampling for fast recognition of mobile imagery

Authors:

Antti Oulasvirta,

Antti Nurminen,

Tiia SuomalainenAuthors Info & Claims

ACM Transactions on Applied Perception (TAP), Volume 9, Issue 4

Article No.: 21, Pages 1 - 18

https://doi.org/10.1145/2355598.2355604

Published: 22 October 2012 Publication History

Abstract

We present the first study to discover optimal reality sampling for mobile imagery. In particular, we identify the minimum information required for fast recognition of images of directly perceivable real-world buildings displayed on a mobile device. Resolution, image size, and JPEG compression of images of façades were manipulated in a same--different recognition task carried out in the field. Best-effort performance is shown to be reachable with significantly lower detail granularity than previously thought. For best user performance, we recommend presenting images as large as possible on the screen and decreasing resolution accordingly.

References

[1]

Bruce, V., Green, P. R., and M. A. G. 2003. Visual Perception: Physiology, Psychology, & Ecology. Psychology Press.

[2]

Cater, K., Chalmers, A., and Ward, G. 2003. Detail to attention: Exploiting visual tasks for selective rendering. In Proceedings of the 14th Eurographics Workshop on Rendering (EGRW'03). Eurographics Association, 270--280.

Digital Library

[3]

Cohen, J., Olano, M., and Manocha, D. 1998. Appearance-preserving simplification. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'98). ACM, New York, 115--122.

Digital Library

[4]

Daly, S. 1993. The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity in Digital Images and Human Vision. A. B. Watson, Ed., MIT Press, Cambridge, MA, 179--206.

Digital Library

[5]

Frohlich, P., Oulasvirta, A., Baldauf, M., and Nurminen, A. 2011. On the move, wirelessly connected to the world. Comm. ACM 54, 1, 132--138.

Digital Library

[6]

Greenberg, D. P. 1999. A framework for realistic image synthesis. Comm. ACM 42, 8, 44--53.

Digital Library

[7]

Gulliver, S. R. and Ghinea, G. 2006. Defining user perception of distributed multimedia quality. ACM Trans. Multimedia Comput. Commun. Appl. 2, 4, 241--257.

Digital Library

[8]

Guo, C. and Zhang, L. 2010. A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans. Image Process. 19, 1, 185--198.

Digital Library

[9]

Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 11, 1254--1259.

Digital Library

[10]

Jayant, N., Johnston, J., and Safranek, R. 1993. Signal compression based on models of human perception. Proc. IEEE 81, 10, 1385--1422.

[11]

Jolicoeur, P. 1987. A sizecongruency effect in memory for visual shape. Memory Cognition 15, 6, 531--543.

[12]

Levine, M. 1982. You-are-here maps: Psychological considerations. Environ. Behav. 14, 2, 221--237.

[13]

Lobben, A. K. 2004. Tasks, strategies, and cognitive processes associated with navigational map reading: A review perspective. Professional Geographer 56, 2, 270--281.

[14]

Mack, A. and Rock, I. 1998. Inattentional Blindness. MIT Press, Cambridge, MA.

[15]

Nadenau, M. J., Alleysson, D., and Kunt, M. 2000. Human vision models for perceptually optimized image processing -- A review. Proc. IEEE.

[16]

Navon, D. 1977. Forest before trees: The of global features in visual perception. Cognitive Psychol. 9, 3, 353--383.

[17]

Nurminen, A. 2008. Mobile 3d city maps. IEEE Comput. Graph. Appl. 28, 4, 20--31.

Digital Library

[18]

Nusseck, M., Cunningham, D. W., Wallraven, C., and Bülthoff, H. H. 2005. Perceptual validation of facial animation: The role of prior experience. In Proceedings of the European Conference on Visual Perception (ECVP'05). Abstracts, 186.

[19]

O'Sullivan, C., Howlett, S., Morvan, Y., McDonnell, R., and O'Conor, K. 2004. Perceptually adaptive graphics. In Eurographics 2004, State of the Art Reports, Wiley-Blackwell, 141--164.

[20]

Oulasvirta, A., Estlander, S., and Nurminen, A. 2008. Embodied interaction with a 3D versus 2D mobile map. Personal Ubiquitous Comput. 13, 4, 303--320.

Digital Library

[21]

Oulasvirta, A., Roto, V., Tamminen, S., and Kuorelahti, J. 2005. Interaction in 4-second bursts: The fragmented nature of attention in mobile HCI. In Proceedings of the CHI'05 Conference. ACM, New York, 919--928.

Digital Library

[22]

Partala, T., Nurminen, A., Vainio, T., Laaksonen, J., Laine, M., and Väänänen, J. 2010. Salience of visual cues in 3d city maps. In Proceedings of the 24th BCS Interaction Specialist Group Conference (BCS'10). British Computer Society, 428--432.

Digital Library

[23]

Pasman, W. and Jansen, F. W. 2003. Comparing simplification and image-based techniques for 3d client-server rendering systems. IEEE Trans.Visualization Comput. Graph. 9, 2, 226--240.

Digital Library

[24]

Ramanarayanan, G., Ferwerda, J., Walter, B., and Bala, K. 2007. Visual equivalence: Towards a new standard for image fidelity. In Proceedings of SIGGRAPH'07. New York, 76.

Digital Library

[25]

Rhyne, T.-M., Johnson, D., Brutzman, D., Kim, R., Jones, M., and Leberl, F. 2008. As the world turns: Debating and examining online digital earth technologies. Panel at the SIGGRAPH 2008 Conference.

[26]

Riva, O. and Kangasharju, J. 2008. Challenges and lessons in developing middleware on smart phones. Computer 41, 10, 23--30.

Digital Library

[27]

Snavely, N., Seitz, S. M., and Szeliski, R. 2008. Modeling the world from Internet photo collections. Int. J. Comput. Vision 80, 2, 189--210.

Digital Library

[28]

Soulodre, G. A., Grusec, T., Lavoie, M., and Thibault, L. 1998. Subjective evaluation of state-of-the-art two-channel audio codecs. J. Audio Eng. Soc. 46, 3, 164--177.

[29]

Torralba, A. 2009. How many pixels make an image&quest; Visual Neurosci. 26, 1, 123--131.

[30]

Torralba, A., Fergus, R., and Freeman, W. T. 2007. Tiny images. CSAIL Tech. rep. 024, MIT.

Cited By

Nurminen ASirvio K(2021)Bus Stop Spotting: a Field Experiment Comparing 2D Maps, Augmented Reality and 3D MapsProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472051(1-14)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472051
Nurminen AHolmquist L(2012)Mobile mixed reality interface developmentsSIGGRAPH Asia 2012 Symposium on Apps10.1145/2407696.2407700(1-1)Online publication date: 28-Nov-2012
https://dl.acm.org/doi/10.1145/2407696.2407700

Index Terms

How real is real enough? optimal reality sampling for fast recognition of mobile imagery
1. Applied computing
  1. Document management and text processing
    1. Document capture
      1. Document scanning
      2. Graphics recognition and interpretation
  2. Law, social and behavioral sciences
    1. Psychology
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Object recognition
      2. Computer vision representations
  2. Computer graphics
    1. Image manipulation

Recommendations

Open-set face recognition across look-alike faces in real-world scenarios

The open-set problem is among the problems that have significantly changed the performance of face recognition algorithms in real-world scenarios. Open-set operates under the supposition that not all the probes have a pair in the gallery. Most face ...
Real-time N-finder processing algorithms for hyperspectral imagery

N-finder algorithm (N-FINDR) is probably one of most popular and widely used algorithms for endmember extraction in hyperspectral imagery. When it comes to practical implementation, four major obstacles need to be overcome. One is the number of ...
Mobile collaborative augmented reality with real-time AR/VR switching
SIGGRAPH '15: ACM SIGGRAPH 2015 Posters

The recent boom in computing capabilities of mobile devices has led to the introduction of Virtual Reality into the mobile ecosystem. We demonstrate a framework for the Samsung Gear VR headset that allows developers to create a totally immersive AR & VR ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Applied Perception

ACM Transactions on Applied Perception Volume 9, Issue 4

October 2012

109 pages

ISSN:1544-3558

EISSN:1544-3965

DOI:10.1145/2355598

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 October 2012

Accepted: 01 July 2012

Revised: 01 June 2012

Received: 01 October 2011

Published in TAP Volume 9, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
252
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nurminen ASirvio K(2021)Bus Stop Spotting: a Field Experiment Comparing 2D Maps, Augmented Reality and 3D MapsProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472051(1-14)Online publication date: 27-Sep-2021
https://dl.acm.org/doi/10.1145/3447526.3472051
Nurminen AHolmquist L(2012)Mobile mixed reality interface developmentsSIGGRAPH Asia 2012 Symposium on Apps10.1145/2407696.2407700(1-1)Online publication date: 28-Nov-2012
https://dl.acm.org/doi/10.1145/2407696.2407700

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents