short-paper

Perceptual quality assessment based on visual attention analysis

Authors:

Junyong You,

Andrew Perkis,

Miska M. Hannuksela,

Moncef GabboujAuthors Info & Claims

MM '09: Proceedings of the 17th ACM international conference on Multimedia

Pages 561 - 564

https://doi.org/10.1145/1631272.1631356

Published: 19 October 2009 Publication History

Get Access

Abstract

Most existing quality metrics do not take the human attention analysis into account. Attention to particular objects or regions is an important attribute of human vision and perception system in measuring perceived image and video qualities. This paper presents an approach for extracting visual attention regions based on a combination of a bottom-up saliency model and semantic image analysis. The use of PSNR (Peak Signal-to-Noise Ratio) and SSIM (Structural SIMilarity) in extracted attention regions is analyzed for image/video quality assessment, and a novel quality metric is proposed which can exploit the attributes of visual attention information adequately. The experimental results with respect to the subjective measurement demonstrate that the proposed metric outperforms the current methods.

References

[1]

Winkler, S. 2005. Digital video quality: vision models and metrics, John Wiley&Sons Press.

Google Scholar

[2]

Pinson, M. and Wolf S. 2004. A new standardized method for objectively measuring video quality. IEEE Trans. Broadcasting, 50 (Sep. 2004), 312--322.

Crossref

Google Scholar

[3]

Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. 2004. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Processing, 13 (Apr. 2004), 600--612.

Digital Library

Google Scholar

[4]

Itti L. and Koch C. 2001. Computational modeling of visual attention, Nat. Rev. Neurosci., 2 (Mar. 2001), 194--203.

Crossref

Google Scholar

[5]

Lu Z., Lin W., Yang X., et al. 2005. Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation. IEEE Trans. Image Processing, 14 (Nov. 2005), 1928--1942.

Digital Library

Google Scholar

[6]

Feng X., Liu T., Yang D., and Wang Y. 2008. Saliency based objective quality assessment of decoded video affected by packet losses. In Proceedings of IEEE Int. Conf. Image Processing (California, USA, Oct. 12--15, 2008), 2560--2563.

Google Scholar

[7]

SaliencyToolbox 2.1, http://www.saliencytoolbox.net.

Google Scholar

[8]

Sheikh H. R., Wang, Z., Cormack L., and Bovik A. C. LIVE Image Quality Assessment Database. http://live.ece.utexas.edu/research/quality.

Google Scholar

[9]

VQEG Sequence, ftp://ftp.crc.ca/crc/vqeg/TestSequences/.

Google Scholar

[10]

Pinson, M. and Wolf, S. 2003. An Objective Method for Combining Multiple Subjective Data Sets. In Proc. SPIE Video Communication and Image Processing Conf. (Lugano, Switzerland, Jul. 2003), 583--592.

Google Scholar

Cited By

View all

Zhang KZhu DMin XGao ZZhai G(2024)Synergetic Assessment of Quality and Aesthetic: Approach and Comprehensive Benchmark DatasetIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.3303933(1-1)Online publication date: 2024
https://doi.org/10.1109/TCSVT.2023.3303933
Wu X(2022)Interpretable Aesthetic Analysis Model for Intelligent Photography Guidance SystemsProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511155(661-671)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511155
Hewage CAhmad AMallikarachchi TBarman NMartini M(2022)Measuring, Modeling and Integrating Time-Varying Video Quality in End-to-End Multimedia Service Delivery: A Review and Open ChallengesIEEE Access10.1109/ACCESS.2022.318049110(60267-60293)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3180491
Show More Cited By

Index Terms

Perceptual quality assessment based on visual attention analysis
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision representations
        Image representations

Recommendations

Stereoscopic Images Quality Assessment with Visual Attention
ISCID '13: Proceedings of the 2013 Sixth International Symposium on Computational Intelligence and Design - Volume 01

Stereoscopic images have been widely studied in recent years from a technical point of view, but the related quality assessment does not follow this enthusiasm. An objective quality assessment with visual attention for stereoscopic images is proposed, ...
Stereoscopic Images Quality Assessment with Visual Attention
ICEICE '12: Proceedings of the 2012 Second International Conference on Electric Information and Control Engineering - Volume 01

Stereoscopic images have been widely studied in recent years from a technical point of view, but the related quality assessment does not follow this enthusiasm. An objective quality assessment with visual attention for stereoscopic images is proposed, ...
Image quality assessment metrics combining structural similarity and image fidelity with visual attention

Image quality assessment has a great importance in several image processing applications. Recently, various objective image quality metrics have been proposed in order to predict human visual perception. In this paper, novel image quality metrics, S-...

Comments

Information & Contributors

Information

Published In

MM '09: Proceedings of the 17th ACM international conference on Multimedia

October 2009

1202 pages

ISBN:9781605586083

DOI:10.1145/1631272

General Chairs:
Wen Gao
Peking University, China
,
Yong Rui
Microsoft, China
,
Alan Hanjalic
Delft University of Technology, The Netherlands
,
Program Chairs:
Changsheng Xu
Institute of Automation, Chinese Academy of Sciences, China
,
Eckehard Steinbach
Technical University of Munich, Germany
,
Abdulmotaleb El Saddik
University of Ottawa, Canada
,
Michelle Zhou
IBM T. J. Watson Research Center, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM09

Sponsor:

SIGMM

MM09: ACM Multimedia Conference

October 19 - 24, 2009

Beijing, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
633
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)3

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhang KZhu DMin XGao ZZhai G(2024)Synergetic Assessment of Quality and Aesthetic: Approach and Comprehensive Benchmark DatasetIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.3303933(1-1)Online publication date: 2024
https://doi.org/10.1109/TCSVT.2023.3303933
Wu X(2022)Interpretable Aesthetic Analysis Model for Intelligent Photography Guidance SystemsProceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490099.3511155(661-671)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490099.3511155
Hewage CAhmad AMallikarachchi TBarman NMartini M(2022)Measuring, Modeling and Integrating Time-Varying Video Quality in End-to-End Multimedia Service Delivery: A Review and Open ChallengesIEEE Access10.1109/ACCESS.2022.318049110(60267-60293)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3180491
Zhang ZHu Z(2021)Video Quality Assessment by Sparse Representation and Dynamic Atom Classification2021 IEEE 13th International Conference on Computer Research and Development (ICCRD)10.1109/ICCRD51685.2021.9386597(41-45)Online publication date: 5-Jan-2021
https://doi.org/10.1109/ICCRD51685.2021.9386597
Bodini M(2019)Will the Machine Like Your Image? Automatic Assessment of Beauty in Images with Machine Learning TechniquesInventions10.3390/inventions40300344:3(34)Online publication date: 28-Jun-2019
https://doi.org/10.3390/inventions4030034
Garcia Freitas PDa Eira LSantos SFarias M(2018)On the Application LBP Texture Descriptors and Its Variants for No-Reference Image Quality AssessmentJournal of Imaging10.3390/jimaging41001144:10(114)Online publication date: 4-Oct-2018
https://doi.org/10.3390/jimaging4100114
Bo YYu JZhang K(2018)Computational aesthetics and applicationsVisual Computing for Industry, Biomedicine, and Art10.1186/s42492-018-0006-11:1Online publication date: 5-Sep-2018
https://doi.org/10.1186/s42492-018-0006-1
Garcia Freitas PAkamine WFarias M(2018)Referenceless image quality assessment by saliency, color-texture energy, and gradient boosting machinesJournal of the Brazilian Computer Society10.1186/s13173-018-0073-324:1Online publication date: 6-Aug-2018
https://doi.org/10.1186/s13173-018-0073-3
Freitas PAlamgeer SAkamine WFarias MCesar PZink MMurray N(2018)Blind image quality assessment based on multiscale salient local binary patternsProceedings of the 9th ACM Multimedia Systems Conference10.1145/3204949.3204960(52-63)Online publication date: 12-Jun-2018
https://dl.acm.org/doi/10.1145/3204949.3204960
Deng YLoy CTang X(2017)Image Aesthetic Assessment: An experimental surveyIEEE Signal Processing Magazine10.1109/MSP.2017.269657634:4(80-106)Online publication date: Jul-2017
https://doi.org/10.1109/MSP.2017.2696576
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Stereoscopic Images Quality Assessment with Visual Attention

Stereoscopic Images Quality Assessment with Visual Attention

Image quality assessment metrics combining structural similarity and image fidelity with visual attention