skip to main content
research-article

No-reference Quality Assessment for Contrast-distorted Images Based on Gray and Color-gray-difference Space

Published: 06 February 2023 Publication History

Abstract

No-reference image quality assessment is a basic and challenging problem in the field of image processing. Among them, contrast distortion has a great impact on the perception of image quality. However, there are relatively few studies on no-reference quality assessment of contrast-distorted images. This article proposes a no-reference quality assessment algorithm for contrast-distorted images based on gray and color-gray-difference (CGD) space. In terms of gray space, we consider the local and global aspects, and use the distribution characteristics of the grayscale histogram to represent global features, while local features are described by the fusion of Local Binary Pattern (LBP) operator and gradient. In terms of CGD space, we first randomly extract patches from the entire image and then extract appropriate quality perception features in the patch’s CGD histogram. Finally, the AdaBoosting back propagation (BP) neural network is used to train the prediction model to predict the quality of the contrast-distorted image. Extensive analysis and cross-validation are carried out on five contrast-related image databases, and the experimental results have proved the superiority of this method compared with recent related algorithms.

References

[1]
Stephen R. Gulliver and Gheorghita Ghinea. 2006. Defining user perception of distributed multimedia quality. ACM Transactions on Multimedia Computing Communications and Applications 2, 4 (2006), 241–257.
[2]
X. Cheng, M. An, Y. Ruan, and Q. Chen. 2013. A novel image definition assessment index for image restoration. Acta Automatica Sinica 39, 4 (2013), 418–423.
[3]
F. Zhou, R. Yao, B. Liu, and G. Qiu. 2019. Visual quality assessment for super-resolved images: Database and method. IEEE Transactions on Image Processing 28, 7 (2019), 35280–3541.
[4]
Saeed Mahmoudpour and Peter Schelkens. 2019. A multi-attribute blind quality evaluator for tone-mapped images. IEEE Transactions on Multimedia PP, 99 (2019), 1–1.
[5]
Yi Zhu, Sharath Chandra Guntuku, Weisi Lin, Gheorghita Ghinea, and Judith A. Redi. 2018. Measuring individual video QoE: A survey, and proposal for future directions using social media. ACM Transactions on Multimedia Computing, Communications and Applications 14, 2s (2018), 1–24.
[6]
Z. Wang, E. Simoncelli, and A. Bovik. 2002. Multi-scale structural similarity for image quality assessment. In ASILOMAR Conference on Signals Systems and Computers.
[7]
L. Zhang, L. Zhang, X. Mou, and D. Zhang. 2011. FSIM: A feature similarity index for image quality assessment. IEEE Transactions on Image Processing 20, 8 (2011), 2378–2386. DOI:
[8]
A. Liu, W. Lin, and M. Narwaria. 2012. Image quality assessment based on gradient similarity. IEEE Transactions on Image Processing 21, 4 (2012), 1500–1512. DOI:
[9]
H. R. Sheikh and A. C. Bovik. 2006. Image information and visual quality. IEEE Transactions on Image Processing 15, 2 (2006), 430–444. DOI:
[10]
Rajiv Soundararajan and Alan C. Bovik. 2011. RRED indices: Reduced reference entropic differencing framework for image quality assessment. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’11). 1149–1152. DOI:
[11]
K. Gu, G. Zhai, X. Yang, and W. Zhang. 2013. A new reduced-reference image quality assessment using structural degradation model. In 2013 IEEE International Symposium on Circuits and Systems (ISCAS’13). 1095–1098. DOI:
[12]
G. Simone, M. Pedersen, and J. Y. Hardeberg. 2012. Measuring perceptual contrast in digital images. Journal of Visual Communication and Image Representation 23, 3 (2012), 491–506.
[13]
L. Zhang, L. Zhang, and A. Bovik. 2015. A feature-enriched completely blind image quality evaluator. IEEE Transactions on Image Processing 24, 8 (2015), 2579–2591. DOI:
[14]
K. Gu, G. Zhai, X. Yang, and W. Zhang. 2015. Using free energy principle for blind image quality assessment. IEEE Transactions on Multimedia 17, 1 (2015), 50–63. DOI:
[15]
Y. Liu, K. Gu, X. Li, and Y. Zhang. 2020. Blind image quality assessment by natural scene statistics and perceptual characteristics. ACM Transactions on Multimedia Computing Communications and Applications 16, 3 (2020), 1–91.
[16]
S. Wang, K. Ma, H. Yeganeh, Z. Wang, and W. Lin. 2015. A patch-structure representation method for quality assessment of contrast changed images. IEEE Signal Processing Letters 22, 12 (2015), 2387–2390. DOI:
[17]
G. Gvozden, S. Grgic, and M. Grgic. 2018. Blind image sharpness assessment based on local contrast map statistics. Journal of Visual Communication and Image Representation 30 (2018), 145–158.
[18]
H. Cai, M. Wang, W. Mao, and M. Gong. 2020. No-reference image sharpness assessment based on discrepancy measures of structural degradation. Journal of Visual Communication and Image Representation 71 (2020), 102861. DOI:
[19]
L. Li, Y. Zhou, J. Wu, W. Lin, and H. Li. 2015. GridSAR: Grid strength and regularity for robust evaluation of blocking artifacts in JPEG images. Journal of Visual Communication and Image Representation 30 (2015), 153–163.
[20]
S. Alireza Golestaneh and Damon M. Chandler. 2014. No-reference quality assessment of JPEG images via a quality relevance map. IEEE Signal Processing Letters 21, 2 (2014), 155–158.
[21]
C. Deng, S. Wang, A. Bovik, G. Huang, and B. Zhao. 2020. Blind noisy image quality assessment using sub-band Kurtosis. IEEE Transactions on Cybernetics 50, 3 (2020), 1146–1156. DOI:
[22]
M. Oszust. 2019. No-reference quality assessment of noisy images with local features and visual saliency models. Information Sciences 482 (2019), 334–349.
[23]
K. Gu, G. Zhai, X. Yang, W. Zhang, and C. Chen. 2015. Automatic contrast enhancement technology with saliency preservation. IEEE Transactions on Circuits and Systems for Video Technology 25, 9 (2015), 1480–1494. DOI:
[24]
W. Sun, W. Yang, F. Zhou, and Q. Liao. 2018. Full-reference quality assessment of contrast changed images based on local linear model. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP’18). 1228–1232. DOI:
[25]
A. Shokrollahi, M. N. Maybodi, and A. Mahmoudi-Aznaveh. 2020. Histogram modification based enhancement along with contrast-changed image quality assessment. Multimedia Tools and Applications 79, 27 (2020), 19193–19214.
[26]
K. Gu, G. Zhai, W. Lin, and M. Liu. 2016. The analysis of image contrast: From quality assessment to automatic enhancement. IEEE Transactions on Cybernetics 46, 1 (2016), 284–297. DOI:
[27]
K. Gu, G. Zhai, X. Yang, W. Zhang, and M. Liu. 2013. Subjective and objective quality assessment for images with contrast change. In 2013 IEEE International Conference on Image Processing. 383–387. DOI:
[28]
H. Gu, G. Zhai, M. Liu, and K. Gu. 2015. Exploiting global and local information for image quality assessment with contrast change. In 2015 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting. 1–5. DOI:
[29]
M. Liu, K. Gu, G. Zhai, P. L. Callet, and W. Zhang. 2017. Perceptual reduced-reference visual quality assessment for contrast alteration. IEEE Transactions on Broadcasting 63, 1 (2017), 71–81.
[30]
Y. Fang, K. Ma, Z. Wang, W. Lin, Z. Fang, and G. Zhai. 2015. No-reference quality assessment of contrast-distorted images based on natural scene statistics. IEEE Signal Processing Letters 22, 7 (2015), 838–842. DOI:
[31]
Y. Wu, Y. Zhu, Y. Yang, W. Zhang, and N. Yu. 2019. A no-reference quality assessment for contrast-distorted image based on improved learning method. Multimedia Tools and Applications 78, 8 (2019), 10057–10076.
[32]
K. Gu, W. Lin, G. Zhai, X. Yang, W. Zhang, and C. W. Chen. 2017. No-reference quality metric of contrast-distorted images based on information maximization. IEEE Transactions on Cybernetics 47, 12 (2017), 4559–4565. DOI:
[33]
K. Gu, D. Tao, J. Qiao, and W. Lin. 2018. Learning a no-reference quality assessment model of enhanced images with big data. IEEE Transactions on Neural Networks and Learning Systems 29, 4 (2018), 1301–1313. DOI:
[34]
M. H. Khosravi and H. Hassanpour. 2020. Blind quality metric for contrast-distorted images based on eigendecomposition of color histograms. IEEE Transactions on Circuits and Systems for Video Technology 30, 1 (2020), 48–58.
[35]
L. He, X. Gao, W. Lu, X. Li, and D. Tao. 2011. Image quality assessment based on S-CIELAB model. Signal Image Video Processing 5, 3 (2011), 283–290.
[36]
Q. Wu, H. Li, F. Meng, K. N. Ngan, B. Luo, C. Huang, and B. Zeng. 2016. Blind image quality assessment based on multichannel feature fusion and label transfer. IEEE Transactions on Circuits and Systems for Video Technology 26, 3 (2016), 425–440.
[37]
D. Ghadiyaram and A. C. Bovik. 2015. Scene statistics of authentically distorted images in perceptually relevant color spaces for blind image quality assessment. IEEE International Conference on Image Processing (2015), 3851–3855.
[38]
L. Liu, Y. Hua, Q. Zhao, H. Huang, and A. C. Bovik. 2016. Blind image quality assessment by relative gradient statistics and AdaBoosting neural network. Signal Processing Image Communication 40, C (2016), 1–15.
[39]
Q. Li, W. Lin, and Y. Fang. 2016. No-reference quality assessment for multiply-distorted images in gradient domain. IEEE Signal Processing Letters 23, 4 (2016), 541–545.
[40]
Ehud Ahissar, Amos Arieli, Moshe Fried, and Yoram Bonneh. 2016. On the possible roles of microsaccades and drifts in visual perception. Vision Research 118 (2016), 25–30.
[41]
H. Hotelling. and 1933. Analysis of a complex of statistical variables in principal components. Journal of Educational Psychology 24, 7 (1933), 498–520.
[42]
J. Shlens. 2014. A tutorial on principal component analysis. International Journal of Remote Sensing 51, 2 (2014), 1593–1684.
[43]
V. Gomez-Verdejo, J. Arenas-Garcia, and A. R. Figueiras-Vidal. 2008. A dynamically adjusted mixed emphasis method for building boosting ensembles. IEEE Transactions on Neural Networks 19, 1 (2008), 3–17. DOI:
[44]
E. C. Larson and D. M. Chandler. 2010. Most apparent distortion: Full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging 19, 1 (2010), 1–21.
[45]
N. Ponomarenko, V. Lukin, A. Zelensky, K. Egiazarian, M. Carli, and F. Battisti. 2009. TID2008- A database for evaluation of full-reference visual quality assessment metrics. In Advances of Modern Radioelectronics, Vol. 10. 30–45.
[46]
N. Ponomarenko, L. Jin, O. Leremeiev, V. Lukin, and K. Egiazarian. 2015. Image database TID2013: Peculiarities, results and perspectives. Signal Processing: Image Communication 30 (2015), 57–77.
[47]
Video Quality Experts Group. 2003. Final report from the video quality experts group on the validation of objective models of video quality assessment.
[48]
X. Min, K. Ma, K. Gu, G. Zhai, Z. Wang, and W. Lin. 2017. Unified blind quality assessment of compressed natural, graphic, and screen content images. IEEE Transactions on Image Processing 26, 11 (2017), 5462–5474. DOI:
[49]
B. Schölkopf. 2003. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press.
[50]
A. Om, A. Fh, and B. Zas. 2020. AdaBoost neural network and cyclopean view for no-reference stereoscopic image quality assessment. Signal Processing: Image Communication 82, 0923-5965 (2020), 115772.
[51]
J. Yan, J. Li, and X. Fu. 2019. No-reference quality assessment of contrast-distorted images using contrast enhancement. arXiv (2019).
[52]
Y. Zhu, X. Chen, and S. Dai. 2021. No-reference image quality assessment for contrast distorted images. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 12890 LNCS (2021), 241–252.
[53]
Q. Wu, H. Li, F. Meng, and K. Ngan. 2018. A perceptually weighted rank correlation indicator for objective image quality assessment. IEEE Transactions on Image Processing 27, 5 (2018), 2499–2513.

Cited By

View all

Index Terms

  1. No-reference Quality Assessment for Contrast-distorted Images Based on Gray and Color-gray-difference Space

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Multimedia Computing, Communications, and Applications
    ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 19, Issue 2
    March 2023
    540 pages
    ISSN:1551-6857
    EISSN:1551-6865
    DOI:10.1145/3572860
    • Editor:
    • Abdulmotaleb El Saddik
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 06 February 2023
    Online AM: 08 August 2022
    Accepted: 27 June 2022
    Revised: 07 May 2022
    Received: 03 November 2021
    Published in TOMM Volume 19, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Contrast distortion
    2. image quality assessment (IQA)
    3. no-reference

    Qualifiers

    • Research-article
    • Refereed

    Funding Sources

    • Natural Science Foundation of the Anhui Higher Education Institutions of China
    • Natural Science Foundation of China

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)94
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 16 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media