article

Structure-Texture Decomposition of Images with Interval Gradient

Authors:

Seungyong LeeAuthors Info & Claims

Computer Graphics Forum, Volume 36, Issue 6

Pages 262 - 274

https://doi.org/10.1111/cgf.12875

Published: 01 September 2017 Publication History

Abstract

This paper presents a novel filtering-based method for decomposing an image into structures and textures. Unlike previous filtering algorithms, our method adaptively smooths image gradients to filter out textures from images. A new gradient operator, the interval gradient, is proposed for adaptive gradient smoothing. Using interval gradients, textures can be distinguished from structure edges and smoothly varying shadings. We also propose an effective gradient-guided algorithm to produce high-quality image filtering results from filtered gradients. Our method avoids gradient reversal in the filtering results and preserves sharp features better than existing filtering approaches, while retaining simplicity and highly parallel implementation. The proposed method can be utilized for various applications that require accurate structure-texture decomposition of images.

References

[1]

{Aga07}¿ Agarwala A.: Efficient gradient-domain compositing using quadtrees. ACM Transactions on Graphics Volume 26, Issue 3 2007, Article No. 94.

Digital Library

[2]

{AR07}¿ Agrawal A., Raskar R.: Gradient domain manipulation techniques in vision and graphics. In Proceedings of ICCV 2007 Tutorials, Rio de Janeiro, Brazil, 2007.

[3]

{BFGS03}¿ Bolz J., Farmer I., Grinspun E., Schröder P.: Sparse matrix solvers on the GPU: Conjugate gradients and multigrid. ACM Trans. Graphics Proc. SIGGRAPH 2003 Volume 22, Issue 3 2003, pp.917-924.

Digital Library

[4]

{BST*14}¿ Bonneel N., Sunkavalli K., Tompkin J., Sun D., Paris S., Pfister H.: Interactive intrinsic video editing. ACM Transactions on Graphics Proceedings of SIGGRAPH 2014 Volume 33, Issue 6 2014, Article No. 197.

Digital Library

[5]

{BZCC10}¿ Bhat P., Zitnick C. L., Cohen M., Curless B.: Gradientshop: A gradient-domain optimization framework for image and video filtering. ACM Transactions on Graphics Volume 29, Issue 2 2010, Article No. 10.

Digital Library

[6]

{CLKL14}¿ Cho H., Lee H., Kang H., Lee S.: Bilateral texture filtering. ACM Transactions on Graphics Volume 33, Issue 4 2014, Article No. 128.

Digital Library

[7]

{FFLS08}¿ Farbman Z., Fattal R., Lischinski D., Szeliski R.: Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics Volume 27, Issue 3 2008, pp.67:1-67:10.

Digital Library

[8]

{FHL*09}¿ Farbman Z., Hoffer G., Lipman Y., Cohen-Or D., Lischinski D.: Coordinates for instant image cloning. ACM Transactions on Graphics Volume 28, Issue 3 2009, Article No. 67.

Digital Library

[9]

{FLW02}¿ Fattal R., Lischinski D., Werman M.: Gradient domain high dynamic range compression. ACM Transactions on Graphics Volume 21, Issue 3 2002, pp.249-256.

Digital Library

[10]

{GJAF09}¿ Grosse R., Johnson M. K., Adelson E. H., Freeman W. T.: Ground truth dataset and baseline evaluations for intrinsic image algorithms. In Proceedings of ICCV 2009, Kyoto, Japan, 2009, IEEE, pp. pp.2335-2342.

[11]

{GO11}¿ Gastal E. S. L., Oliveira M. M.: Domain transform for edge-aware image and video processing. ACM Transactions on Graphics Volume 30 2011, pp.69:1-69:12.

Digital Library

[12]

{GWL*03}¿ Goodnight N., Woolley C., Lewin G., Luebke D., Humphreys G.: A multigrid solver for boundary value problems using programmable graphics hardware. In Proceedings of Graphics Hardware Aire-la-Ville, Switzerland, Switzerland, 2003, Eurographics Association, pp. pp.102-111.

Digital Library

[13]

{HBZW14}¿ Hua M., Bie X., Zhang M., Wang W.: Edge-aware gradient domain optimization framework for image filtering by local propagation. In Proceedings of CVPR, Columbus, OH. 2014, IEEE, pp. pp.2838-2845.

Digital Library

[14]

{HCP15}¿ Ham B., Cho M., Ponce J.: Robust image filtering using joint static and dynamic guidance. In Proceedings of CVPR, Boston, MA, 2015, IEEE, pp. pp.4823-4831.

[15]

{HST10}¿ He K., Sun J., Tang X.: Guided image filtering. pamiVolume 35, Issue 6 2010, pp.1397-1409.

Digital Library

[16]

{KEE13}¿ Karacan L., Erdem E., Erdem A.: Structure-preserving image smoothing via region covariances. ACM Transactions on Graphics Volume 32, Issue 6 2013, pp.176:1-176:11.

Digital Library

[17]

{KS10}¿ Kass M., Solomon J.: Smoothed local histogram filters. ACM Transactions on Graphics Volume 29, Issue 4 2010, pp.100:1-100:10.

Digital Library

[18]

{LM71}¿ Land E. H., McCann J. J.: Lightness and retinex theory. Journal of the Optical Society of America Volume 61, Issue 1 1971, pp.1-11.

[19]

{MCL*14}¿ Min D., Choi S., Lu J., Ham B., Sohn K., Do M. N.: Fast global image smoothing based on weighted least squares. IEEE Transactions on Image Processing Volume 23, Issue 12 2014, pp.5638-5653.

[20]

{MHW*13}¿ Ma Z., He K., Wei Y., Sun J., Wu E.: Constant time weighted median filtering for stereo matching and beyond. In Proceedings of ICCV 2013, Sydney, NSW, 2013, IEEE, pp. pp.49-56.

Digital Library

[21]

{NBGS08}¿ Nickolls J., Buck I., Garland M., Skadron K.: Scalable parallel programming with cuda. Queue Volume 6, Issue 2 2008, pp.40-53.

Digital Library

[22]

{PGB03}¿ Pérez P., Gangnet M., Blake A.: Poisson image editing. ACM Transactions on Graphics Volume 22, Issue 3 2003, pp.313-318.

Digital Library

[23]

{PHK11}¿ Paris S., Hasinoff S. W., Kautz J.: Local Laplacian filters: Edge-aware image processing with a Laplacian pyramid. ACM Transactions on Graphics Volume 30, Issue 4 2011, pp.68:1-68:12.

Digital Library

[24]

{ROF92}¿ Rudin L. I., Osher S., Fatemi E.: Nonlinear total variation based noise removal algorithms. Physica D Volume 60 1992, pp.259-268.

Digital Library

[25]

{SSD09}¿ Subr K., Soler C., Durand F.: Edge-preserving multiscale image decomposition based on local extrema. ACM Transactions on Graphics Proceedings of SIGGRAPH Asia 2009 Volume 28, Issue 5 2009, Article No. 147.

Digital Library

[26]

{TFA05}¿ Tappen M. F., Freeman W. T., Adelson E. H.: Recovering intrinsic images from a single image. IEEE Transactions on Pattern Analysis Machine Intelligence Volume 27, Issue 9 2005, pp.1459-1472.

Digital Library

[27]

{TM98}¿ Tomasi C., Manduchi R.: Bilateral filtering for gray and color images. In Proceedings of ICCV 1998, Bombay, India, 1998, IEEE, pp. pp.839-846.

Digital Library

[28]

{VPS03}¿ Vanhamel I., Pratikakis I., Sahli H.: Multiscale gradient watersheds of color images. IEEE Transactions on Image Processing Volume 12, Issue 6 2003, pp.617-626.

Digital Library

[29]

{Wei98}¿ Weickert J.: Anisotropic Diffusion in Image Processing, Vol. 1. Teubner-Verlag, Stuttgart, Germany, 1998.

[30]

{Wei06}¿ Weiss B.: Fast median and bilateral filtering. ACM Transactions on Graphics Volume 25, Issue 3 2006, pp.519-526.

Digital Library

[31]

{XLXJ11}¿ Xu L., Lu C., Xu Y., Jia J.: Image smoothing via L0 gradient minimization. ACM Transactions on Graphics Volume 30, Issue 5 2011, pp.174:1-174:12.

Digital Library

[32]

{XYXJ12}¿ Xu L., Yan Q., Xia Y., Jia J.: Structure extraction from texture via relative total variation. ACM Transactions on Graphics Volume 31, Issue 6 2012, pp.139:1-139:10.

Digital Library

[33]

{ZSXJ14}¿ Zhang Q., Shen X., Xu L., Jia J.: Rolling guidance filter. In Proceedings of ECCV, Fleet D., Pajdla T., SchieleB. and Tuytelaars T. Eds., Zurich, Switzerland, Springer International Publishing, Vol. 8691, 2014, pp. pp.815-830.

[34]

{ZXJ14}¿ Zhang Q., Xu L., Jia J.: 100+ times faster weighted median filter. In Proceedings of CVPR 2014, Columbus, OH, 2014, IEEE, pp. pp.2830-2837.

Digital Library

Cited By

Pan HWen YHuang Y(2024)L₀ Gradient-Regularization and Scale Space Representation Model for Cartoon and Texture DecompositionIEEE Transactions on Image Processing10.1109/TIP.2024.340350533(4016-4028)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2024.3403505
He LXie YXie SJiang ZChen Z(2024)Iterative Self-Guided Image FilteringIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.337475834:8(7537-7549)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TCSVT.2024.3374758
He LXie YXie SChen Z(2023)Structure-Preserving Texture Smoothing via Scale-Aware Bilateral Total VariationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2022.321421933:4(1493-1506)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TCSVT.2022.3214219
Show More Cited By

Structure-Texture Decomposition of Images with Interval Gradient
1. Computing methodologies
  1. Artificial intelligence
  2. Computer graphics

Recommendations

Virtual Spherical Gaussian Lights for Real-time Glossy Indirect Illumination

Virtual point lights VPLs are well established for real-time global illumination. However, this method suffers from spiky artifacts and flickering caused by singularities of VPLs, highly glossy materials, high-frequency textures, and discontinuous ...
Realtime Rendering Glossy to Glossy Reflections in Screen Space

Glossy to glossy reflections are lights bounced between glossy surfaces. Such directional light transports are important for humans to perceive glossy materials, but difficult to simulate. This paper proposes a new method for rendering screen-space ...
Pre-convolved Radiance Caching

The incident indirect light over a range of image pixels is often coherent. Two common approaches to exploit this inter-pixel coherence to improve rendering performance are Irradiance Caching and Radiance Caching. Both compute incident indirect light ...

Comments

Information & Contributors

Information

Published In

cover image Computer Graphics Forum

Computer Graphics Forum Volume 36, Issue 6

September 2017

417 pages

ISSN:0167-7055

EISSN:1467-8659

Issue’s Table of Contents

Publisher

The Eurographs Association & John Wiley & Sons, Ltd.

Chichester, United Kingdom

Publication History

Published: 01 September 2017

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Pan HWen YHuang Y(2024)L₀ Gradient-Regularization and Scale Space Representation Model for Cartoon and Texture DecompositionIEEE Transactions on Image Processing10.1109/TIP.2024.340350533(4016-4028)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2024.3403505
He LXie YXie SJiang ZChen Z(2024)Iterative Self-Guided Image FilteringIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2024.337475834:8(7537-7549)Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1109/TCSVT.2024.3374758
He LXie YXie SChen Z(2023)Structure-Preserving Texture Smoothing via Scale-Aware Bilateral Total VariationIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2022.321421933:4(1493-1506)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1109/TCSVT.2022.3214219
Hu TZhou QNan XLin R(2023)A color image decomposition model for image enhancementNeurocomputing10.1016/j.neucom.2023.126772558:COnline publication date: 14-Nov-2023
https://dl.acm.org/doi/10.1016/j.neucom.2023.126772
Kumar PPoornima B. Nagendraswamy HManjunath CRangaswamy B(2021)Image-Abstraction Framework as a Preprocessing Technique for Extraction of Text From Underexposed Complex Background and Graphical Embossing ImagesInternational Journal of Distributed Artificial Intelligence10.4018/IJDAI.202101010113:1(1-35)Online publication date: 1-Jan-2021
https://dl.acm.org/doi/10.4018/IJDAI.2021010101
Kumar MPoornima BNagendraswamy HManjunath C(2021)Structure-preserving NPR framework for image abstraction and stylizationThe Journal of Supercomputing10.1007/s11227-020-03547-w77:8(8445-8513)Online publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1007/s11227-020-03547-w
Al-Nasrawi MDeng GWaheed W(2019)Structure extraction of images using anisotropic diffusion with directional second neighbour derivative operatorMultimedia Tools and Applications10.1007/s11042-018-6377-778:5(6385-6407)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s11042-018-6377-7
Hu ASun ZGuo YLi Q(2018)Hierarchical Image Segmentation Based on Multi-feature Fusion and Graph Cut OptimizationAdvances in Multimedia Information Processing – PCM 201810.1007/978-3-030-00767-6_55(596-606)Online publication date: 21-Sep-2018
https://dl.acm.org/doi/10.1007/978-3-030-00767-6_55
Jiang XYao HLiu S(2017)How many zero crossings? A method for structure-texture image decompositionComputers and Graphics10.1016/j.cag.2017.07.03468:C(129-141)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1016/j.cag.2017.07.034

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents