article

Deringing cartoons by image analogies

Authors:

Tien-Tsin Wong,

Pheng-Ann HengAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 25, Issue 4

Pages 1360 - 1379

https://doi.org/10.1145/1183287.1183292

Published: 01 October 2006 Publication History

Abstract

In this article, we propose a novel method to reduce ringing artifacts in BDCT-encoded cartoon images using image analogies. The quantization procedure of BDCT compression (such as JPEG and MPEG) introduces annoying visual artifacts. Our main focus is on the removal of ringing artifacts that is seldom addressed by existing methods. In the proposed method, the contaminated image is modeled as a Markov random field (MRF). We “learn” the behavior of contamination by extracting massive numbers of artifact patterns from a training set, and organizing them using tree-structured vector quantization (TSVQ). Instead of postfiltering the input contaminated image, we synthesize an artifact-reduced image. Our method is noniterative and hence, can remove artifacts within a very short period of time. We show that substantial improvement is achieved using the proposed method in terms of visual quality and statistics.

References

[1]

Arya, S., Mount, D. M., Netanyahu, N. S., Silverman, R., and Wu, A. Y. 1998. An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J. ACM 45, 891--923.]]

[2]

Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., and Werman, M. 2001. Texture mixing and texture movie synthesis using statistical learning. IEEE Trans. Visual. Comput. Graph. 7, 2, 120--135.]]

[3]

Bentley, J. L. 1975. Multidimensional binary search trees used for associative searching. Commun. ACM 18, 9, 509--517.]]

[4]

Chan, Y. H., Hong, S. W., and Siu, W. C. 1998. A practical postprocessing technique for real-time block-based coding system. IEEE Trans. Circuits Syst. Video Technol. 8, 1, 4--8.]]

[5]

Chen, T., Wu, H. R., and Qiu, B. 2001. Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts. IEEE Trans. Circuits Syst. Video Technol. 11, 5, 594--602.]]

[6]

Cohen, M. F., Shade, J., Hiller, S., and Deussen, O. 2003. Wang tiles for image and texture generation. In Proceedings of the SIGGRAPH Conference. 287--294.]]

[7]

Combettes, P. L. 1993. The foundation of set theoretic estimation. Proc. IEEE 81, 2, 182--208.]]

[8]

Efros, A. A. and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of the SIGGRAPH Conference. 341--346.]]

[9]

Efros, A. A. and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In Proceedings of the IEEE International Conference on Computer Vision. Corfu, Greece, 1033--1038.]]

[10]

Freeman, W. T., Jones, T. R., and Pasztor, E. C. 2002. Example-Based super-resolution. IEEE Comput. Graph. Appl. 22, 2, 56--65.]]

[11]

Freeman, W. T., Pasztor, E. C., and Carmichael, O. T. 2000. Learning low-level vision. Int. J. Comput. Vision 40, 1, 25--47.]]

[12]

Gall, D. L. 1991. MPEG: A video compression standard for multimedia applications. Commun. ACM 34, 4, 46--58.]]

[13]

Gersho, A. and Gray, R. M. 1992. Vector Quantization and Signal Compression. Kluwer Academic, Boston.]]

[14]

Gunturk, B. K., Altunbasak, Y., and Mersereau, R. M. 2002. Multiframe blocking-artifact reduction for transform-coded video. IEEE Trans. Circuits Syst. Video Technol. 12, 4, 276--282.]]

[15]

Hertzmann, A., Jacobs, C., Oliver, N., Curless, B., and Salesin, D. 2001. Image analogies. In Proceedings of the SIGGRAPH Conference. 327--340.]]

[16]

Hertzmann, A., Oliver, N., Curless, B., and Seitz, S. M. 2002. Curve analogies. In Proceedings of the 13th Eurographics Workshop on Rendering. Pisa, Italy. 233--245.]]

[17]

Hsu, Y. F. and Chen, Y. C. 1993. A new adaptive separable median filter for removing blocking effects. IEEE Trans. Consumer Electron. 39, 3, 510--513.]]

[18]

Jarske, T., Haavisto, P., and Defee, I. 1994. Post-Filtering methods for reducing blocking effects from coded images. IEEE Trans. Consumer Electron. 40, 3, 521--526.]]

[19]

Jeong, Y., Kim, I., and Kang, H. 2000. A practical projection-based postprocessing of block-coded images with fast convergence rate. IEEE Trans. Circuits Syst. Video Technol. 10, 4, 617--623.]]

[20]

Kong, H.-S., Vetro, A., and Sun, H. 2004. Edge map guided adaptive post-filter for blocking and ringing artifacts removal. In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS), vol. 3. 929--932.]]

[21]

Kuo, C. J. and Hsieh, R. J. 1995. Adaptive postprocessor for block encoded images. IEEE Trans. Circuits Syst. Video Technol. 5, 4, 298--304.]]

[22]

Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. In Proceedings of the SIGGRAPH Conference. 277--286.]]

[23]

Lee, Y. L., Kim, H. C., and Park, H. W. 1998. Blocking effect reduction of JPEG images by signal adaptive filtering. IEEE Trans. Image Processing 7, 2, 229--234.]]

[24]

Lee, Y.-L., Park, H.-W., Park, D.-S., and Kim, Y.-S. 1998. Loop filtering for reducing blocking effects and ringing effects. 5th Meeting, Video Coding Experts Group, ITU---Telecommunications Standardization Sector, ITU Document No. Q15-E-22.]]

[25]

Li, S. Z. 1995. Markov Random Field Modeling in Computer Vision. Springer-Verlag, New York.]]

[26]

Liu, C., Wang, C., and Lin, J. 1998. A new postprocessing method for the block-based DCT coding based on the convex-projection theory. IEEE Trans. Consumer Electron. 44, 3, 1054--1061.]]

[27]

Liu, X., Hu, Y., Zhang, J., Tong, X., Guo, B., and Shum, H.-Y. 2004. Synthesis and rendering of bidirectional texture functions on arbitrary surfaces. IEEE Trans. Visual. Comput. Graphics 10, 3, 278--289.]]

[28]

Luo, J., Chen, C. W., Parker, K. J., and Huang, T. S. 1996. Artifact reduction in low bit rate DCT-based image compression. IEEE Trans. Image Processing 5, 9, 1363--1368.]]

[29]

Mese, M. and Vaidyanathan, P. P. 2001. Look-Up table (LUT) method for inverse halftoning. IEEE Trans. Image Processing 10, 10, 1566--1578.]]

[30]

Minami, S. and Zakhor, A. 1995. An optimization approach for removing blocking effects in transform coding. IEEE Trans. Circuits Syst. Video Technol. 5, 2, 74--82.]]

[31]

Paek, H., Kim, R. C., and Lee, S. U. 1998. On the POCS-based postprocessing technique to reduce the blocking artifacts in transform coded images. IEEE Trans. Circuits Syst. Video Technol. 8, 3, 358--367.]]

[32]

Paek, H., Kim, R. C., and Lee, S. U. 2000. A DCT-based spatially adaptive post-processing technique to reduce the blocking artifacts in transform coded images. IEEE Trans. Circuits Syst. Video Technol. 10, 1, 36--41.]]

[33]

Perona, P. and Malik, J. 1990. Scale-Space and edge detection using anisotropic diffusion. IEEE Trans. Pattern Anal. Mach. Intel. 12, 7, 629--639.]]

[34]

Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In Proceedings of the SIGGRAPH Conference. 465--470.]]

[35]

Qiu, G. 2000. MLP for adaptive postprocessing block-coded images. IEEE Trans. Circuits Syst. Video Technol. 10, 8, 1450--1454.]]

[36]

Ramamurthi, B. and Gersho, A. 1986. Nonlinear space-variant postprocessing of block coded images. IEEE Trans. Acoust., Speech, Signal Processing 34, 5, 1258--1268.]]

[37]

Reeve, H. C. and Lim, J. S. 1984. Reduction of blocking effect in image coding. Opt. Eng. 23, 1, 34--37.]]

[38]

Tomasi, C. and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proceedings of the IEEE International Conference on Computer Vision. Bombay, India, 839--846.]]

[39]

Triantafyllidis, G. A., Tzovaras, D., and Strintzis, M. G. 2002. Blocking artifact detection and reduction in compressed data. IEEE Trans. Circuits Syst. Video Technol. 12, 10, 877--890.]]

[40]

Wallace, G. K. 1991. The JPEG still picture compression standard. Commun. ACM 34, 4, 30--44.]]

[41]

Wang, H. 1965. Games, logic and computers. Sci. Amer., 98--106.]]

[42]

Wang, Z., Bovik, A. C., Sheikh, H. R., and Simoncelli, E. P. 2004. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Processing 13, 1, 600--612.]]

[43]

Weerasinghe, C., Liew, A. W., and Yan, H. 2002. Artifact reduction in compressed images based on region homogeneity constraints using the projection onto convex sets algorithm. IEEE Trans. Circuits Syst. Video Technol. 12, 10, 891--897.]]

[44]

Wei, L. Y. and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of the SIGGRAPH Conference. 479--488.]]

[45]

Welsh, T., Ashikhmin, M., and Mueller, K. 2002. Transferring color to greyscale images. In Proceedings of the SIGGRAPH Conference. 277--280.]]

[46]

Yang, S., Hu, Y. H., Nguyen, T. Q., and Tull, D. L. 2001. Maximum-Likelihood parameter estimation for image ringing-artifact removal. IEEE Trans. Circuits Syst. Video Technol. 11, 8, 963--973.]]

[47]

Yang, Y. and Galatsanos, N. P. 1997. Removal of compression artifacts using projections onto convex sets and line process modeling. IEEE Trans. Image Processing 6, 10, 1345--1357.]]

[48]

Yang, Y., Galatsanos, N. P., and Katsaggelos, A. K. 1995. Projection-Based spatially adaptive reconstruction of block-transform compressed images. IEEE Trans. Image Processing 4, 7, 896--908.]]

[49]

Zakhor, A. 1992. Iterative procedures for reduction of blocking effects in transform image coding. IEEE Trans. Circuits Syst. Video Technol. 2, 1, 91--95.]]

Cited By

Zhu DWang WXue XXie HCheng GWang F(2024)Structure-preserving image smoothing via contrastive learningThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02897-940:8(5139-5153)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00371-023-02897-9
Wang JWang YFeng YGong LYan XXie HWang FWei M(2023)Contrastive Semantic‐Guided Image Smoothing NetworkComputer Graphics Forum10.1111/cgf.1468141:7(335-346)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14681
Su HLiu XNiu JCui JWan JWu XWang N(2023)MARVEL: Raster Gray-Level Manga Vectorization via Primitive-Wise Deep Reinforcement LearningIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.330978634:4(2677-2693)Online publication date: 29-Aug-2023
https://dl.acm.org/doi/10.1109/TCSVT.2023.3309786
Show More Cited By

Index Terms

Deringing cartoons by image analogies
1. Computing methodologies

Recommendations

Joint Matting and Gradient-Domain Deringing for Image Deblurring
ICIG '09: Proceedings of the 2009 Fifth International Conference on Image and Graphics

In this paper, we propose a method for removing motion blur and deringing from images, which can be applied to handle both the camera motion blur and the object motion blur. Fully taking the advantage of abundant information of blurred/noisy image pair, ...
Inpainting with image patches for compression

We propose a patch-based image compression framework inspired by the inpainting techniques. The repeated patterns in one image are exploited for compression in a non-parametric manner, i.e., directly sampling image patches and encoding the similarity ...
Perceptually adaptive joint deringing - deblocking filtering for scalable video coding
MobiMedia '06: Proceedings of the 2nd international conference on Mobile multimedia communications

A new perceptually adaptive joint deringing - deblocking filtering method for wavelet based scalable video coding is proposed. The proposed approach is specially designed to deal with the artifacts inherent to video transmission over very low-bit-rate ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 25, Issue 4

October 2006

243 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1183287

Issue’s Table of Contents

Copyright © 2006 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2006

Published in TOG Volume 25, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
937
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhu DWang WXue XXie HCheng GWang F(2024)Structure-preserving image smoothing via contrastive learningThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-023-02897-940:8(5139-5153)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00371-023-02897-9
Wang JWang YFeng YGong LYan XXie HWang FWei M(2023)Contrastive Semantic‐Guided Image Smoothing NetworkComputer Graphics Forum10.1111/cgf.1468141:7(335-346)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14681
Su HLiu XNiu JCui JWan JWu XWang N(2023)MARVEL: Raster Gray-Level Manga Vectorization via Primitive-Wise Deep Reinforcement LearningIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.330978634:4(2677-2693)Online publication date: 29-Aug-2023
https://dl.acm.org/doi/10.1109/TCSVT.2023.3309786
Liu WZhang PLei YHuang XYang JNg M(2022)A Generalized Framework for Edge-Preserving and Structure-Preserving Image SmoothingIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2021.309789144:10_Part_2(6631-6648)Online publication date: 1-Oct-2022
https://dl.acm.org/doi/10.1109/TPAMI.2021.3097891
Li DGao W(2022)Neural style transfer based on deep feature synthesisThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-022-02664-239:11(5359-5373)Online publication date: 15-Sep-2022
https://dl.acm.org/doi/10.1007/s00371-022-02664-2
Surya Prasath VThanh DHieu LThanh L(2021)Compression artifacts reduction with multiscale tensor regularizationMultidimensional Systems and Signal Processing10.1007/s11045-020-00747-832:2(521-531)Online publication date: 1-Apr-2021
https://dl.acm.org/doi/10.1007/s11045-020-00747-8
Liu WZhang PHuang XYang JShen CReid I(2020)Real-time Image Smoothing via Iterative Least SquaresACM Transactions on Graphics10.1145/338888739:3(1-24)Online publication date: 6-Jun-2020
https://dl.acm.org/doi/10.1145/3388887
Liu WZhang PChen XShen CHuang XYang J(2020)Embedding Bilateral Filter in Least Squares for Efficient Edge-Preserving Image SmoothingIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2018.289020230:1(23-35)Online publication date: Jan-2020
https://doi.org/10.1109/TCSVT.2018.2890202
Chen YXu XJia J(2020)Domain Adaptive Image-to-Image Translation2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR42600.2020.00532(5273-5282)Online publication date: Jun-2020
https://doi.org/10.1109/CVPR42600.2020.00532
Barua HMondal K(2019)A Comprehensive Survey on Cloud Data Mining (CDM) Frameworks and AlgorithmsACM Computing Surveys10.1145/334926552:5(1-62)Online publication date: 13-Sep-2019
https://dl.acm.org/doi/10.1145/3349265
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents