research-article

Manifold preserving edit propagation

Authors:

Ping TanAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 6

Article No.: 132, Pages 1 - 7

https://doi.org/10.1145/2366145.2366151

Published: 01 November 2012 Publication History

Abstract

We propose a novel edit propagation algorithm for interactive image and video manipulations. Our approach uses the locally linear embedding (LLE) to represent each pixel as a linear combination of its neighbors in a feature space. While previous methods require similar pixels to have similar results, we seek to maintain the manifold structure formed by all pixels in the feature space. Specifically, we require each pixel to be the same linear combination of its neighbors in the result. Compared with previous methods, our proposed algorithm is more robust to color blending in the input data. Furthermore, since every pixel is only related to a few nearest neighbors, our algorithm easily achieves good runtime efficiency. We demonstrate our manifold preserving edit propagation on various applications.

Supplementary Material

ZIP File (132-197-0002.zip)

Supplemental Materials for Manifold preserving edit propagation

Download
18.37 MB

References

[1]

Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., and Süsstrunk, S. 2010. SLIC Superpixels. Tech. Rep. no. 149300, EPFL.

[2]

An, X., and Pellacini, F. 2008. Appprop: all-pairs appearance-space edit propagation. In ACM Trans. Graph. (Proc. of Siggraph), vol. 27.

Digital Library

[3]

Chang, Y., Saito, S., and Nakajima, M. 2003. A framework for transfer colors based on the basic color categories. In Proc. of Computer Graphics International, 176--183.

[4]

Chen, J., Paris, S., and Durand, F. 2007. Real-time edge-aware image processing with the bilateral grid. ACM Trans. Graph. (Proc. of Siggraph) 26, 3.

Digital Library

[5]

Chia, A. Y.-S., Zhuo, S., Gupta, R. K., Tai, Y.-W., Cho, S.-Y., Tan, P., and Lin, S. 2011. Semantic colorization with internet images. ACM Trans. Graph. (Proc. of Siggraph Asia) 30, 6.

Digital Library

[6]

Coifman, R., and Lafon, S. 2006. Diffusion maps. Appl. Comput. Harmon. A. 21, 1, 5--30.

[7]

de Ridder, D., and Duin, R. P. 2002. Locally linear embedding for classification. Tech. Rep. PH-2002-01.

[8]

Farbman, Z., Fattal, R., and Lischinski, D. 2010. Diffusion maps for edge-aware image editing. ACM Trans. Graph. (Proc. of Siggraph Asia) 29, 6.

Digital Library

[9]

Fattal, R. 2009. Edge-avoiding wavelets and their applications. ACM Trans. Graph. 28, 3.

Digital Library

[10]

He, K., Sun, J., and Tang, X. 2010. Guided image filtering. In Proc. of ECCV, 1--14.

Digital Library

[11]

Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Trans. Graph. (Proc. of Siggraph) 23, 3.

Digital Library

[12]

Levin, A., Rav-Acha, A., and Lischinski, D. 2008. Spectral matting. IEEE Trans. Pattern Anal. Mach. Intell. 30, 10, 1699--1712.

Digital Library

[13]

Li, Y., Adelson, E. H., and Agarwala, A. 2008. Scribble-boost: Adding classification to edge-aware interpolation of local image and video adjustments. Comput. Graph. Forum 27, 2, 1255--1264.

Digital Library

[14]

Li, Y., Ju, T., and Hu, S.-M. 2010. Instant propagation of sparse edits on images and videos. Comput. Graph. Forum 29, 7, 2049--2054.

[15]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Trans. Graph. (Proc. of Siggraph) 25, 3.

Digital Library

[16]

Liu, C., Freeman, W. T., Adelson, E. H., and Weiss, Y. 2008. Human-assisted motion annotation. In Proc. of CVPR.

[17]

Ma, L.-Q., and Xu, K. 2011. Antialiasing recovery for edit propagation. In Proc. of Virtual Reality Continuum and Its Applications in Industry (VRCAI), 125--130.

Digital Library

[18]

Ou, L., Luo, M., Woodcock, A., and Wright, A. 2004. A study of colour emotion and colour preference. part i: Colour emotions for single colours. In Proc. of Color Res. Appl., 232--240.

[19]

Paris, S., and Durand, F. 2009. A fast approximation of the bilateral filter using a signal processing approach. Int. J. Comput. Vision 81, 1, 24--52.

Digital Library

[20]

Pellacini, F., and Lawrence, J. 2007. Appwand: editing measured materials using appearance-driven optimization. ACM Trans. Graph. (Proc. of Siggraph) 26, 3.

Digital Library

[21]

Rhemann, C., Rother, C., Wang, J., Gelautz, M., Kohli, P., and Rott, P. 2009. A perceptually motivated online benchmark for image matting. In Proc. of CVPR, 1826--1833.

[22]

Roweis, S., and Saul, L. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323--2326.

[23]

Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. In Proc. of ICCV, 839.

Digital Library

[24]

Wang, B., Yu, Y., Wong, T.-T., Chen, C., and Xu, Y.-Q. 2010. Data-driven image color theme enhancement. ACM Trans. Graph. (Proc. Siggraph Asia) 29, 6 (December), 146:1--146:10.

Digital Library

[25]

Xu, K., Li, Y., Ju, T., Hu, S.-M., and Liu, T.-Q. 2009. Efficient affinity-based edit propagation using k-d tree. ACM Trans. Graph. (Proc. of Siggraph) 28, 5.

Digital Library

[26]

Yang, L., Sander, P. V., Lawrence, J., and Hoppe, H. 2011. Antialiasing recovery. ACM Trans. Graph. 30, 3.

Digital Library

Cited By

Zhao WWang LDong MCai Y(2025)CSPDAE: Colorization via SuperPixel Downsampler Denoising AutoEncoder towards enhanced color structural clarityNeurocomputing10.1016/j.neucom.2024.129028618(129028)Online publication date: Mar-2025
https://doi.org/10.1016/j.neucom.2024.129028
Jia HSu X(2024)End-to-end reference image-based coloringInternational Conference on Image Processing and Artificial Intelligence (ICIPAl 2024)10.1117/12.3035550(165)Online publication date: 19-Jul-2024
https://doi.org/10.1117/12.3035550
Yang YPan JPeng ZDu XTao ZTang J(2024)BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-Based Video ColorizationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.337092046:8(5612-5624)Online publication date: Aug-2024
https://doi.org/10.1109/TPAMI.2024.3370920
Show More Cited By

Index Terms

Manifold preserving edit propagation
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks

Recommendations

Efficient manifold-preserving edit propagation using quad-tree data structures

In this paper, we propose an edit propagation algorithm using quad-tree data structures for image manipulation. First, we use a quad-tree to adaptively group all pixels into clusters. Then, we build a manifold-preserving propagation function based on ...
Manifold-preserving image colorization with nonlocal estimation

In this paper, we propose a novel scribble-based colorization method which embeds colors using reconstruction weights from nonlocal nearest texture-similar neighbors in image lightness channel. Our main idea is to exploit image textural features to ...
Locality preserving projections for grassmann manifold
IJCAI'17: Proceedings of the 26th International Joint Conference on Artificial Intelligence

Learning on Grassmann manifold has become popular in many computer vision tasks, with the strong capability to extract discriminative information for imagesets and videos. However, such learning algorithms particularly on high-dimensional Grassmann ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 6

November 2012

794 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2366145

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2012

Published in TOG Volume 31, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

116
Total Citations
View Citations
1,468
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhao WWang LDong MCai Y(2025)CSPDAE: Colorization via SuperPixel Downsampler Denoising AutoEncoder towards enhanced color structural clarityNeurocomputing10.1016/j.neucom.2024.129028618(129028)Online publication date: Mar-2025
https://doi.org/10.1016/j.neucom.2024.129028
Jia HSu X(2024)End-to-end reference image-based coloringInternational Conference on Image Processing and Artificial Intelligence (ICIPAl 2024)10.1117/12.3035550(165)Online publication date: 19-Jul-2024
https://doi.org/10.1117/12.3035550
Yang YPan JPeng ZDu XTao ZTang J(2024)BiSTNet: Semantic Image Prior Guided Bidirectional Temporal Feature Fusion for Deep Exemplar-Based Video ColorizationIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.337092046:8(5612-5624)Online publication date: Aug-2024
https://doi.org/10.1109/TPAMI.2024.3370920
Mazzucchelli AGarcia-Garcia AGarces ERivas-Manzaneque FMoreno-Noguer FPenate-Sanchez A(2024)IReNe: Instant Recoloring of Neural Radiance Fields2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00567(5937-5946)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00567
Zhu PPu YYang QLi SZhao ZWu HXu D(2024)PSANet: Automatic colourisation using position‐spatial attention for natural imagesIET Computer Vision10.1049/cvi2.12291Online publication date: 16-Jun-2024
https://doi.org/10.1049/cvi2.12291
Liu YZhao HChan KWang XLoy CQiao YDong C(2024)Temporally consistent video colorization with deep feature propagation and self-regularization learningComputational Visual Media10.1007/s41095-023-0342-810:2(375-395)Online publication date: 3-Jan-2024
https://doi.org/10.1007/s41095-023-0342-8
Lv CZhang DGeng SWu ZHuang H(2023)Color Transfer for Images: A SurveyACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3635152Online publication date: 30-Nov-2023
https://doi.org/10.1145/3635152
Gong BWang YHan XDou QEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D ScenesProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3611957(8004-8015)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3611957
Zhao YPo LLiu KWang XYu WXian PZhang YLiu M(2023)SVCNet: Scribble-Based Video Colorization Network With Temporal AggregationIEEE Transactions on Image Processing10.1109/TIP.2023.329853732(4443-4458)Online publication date: 2023
https://doi.org/10.1109/TIP.2023.3298537
Zhou ZJin RDai LDu X(2023)EasyColor: Interactive Colorization by User's Edge-Masks and Strokes2023 IEEE 6th International Conference on Multimedia Information Processing and Retrieval (MIPR)10.1109/MIPR59079.2023.00039(1-4)Online publication date: Aug-2023
https://doi.org/10.1109/MIPR59079.2023.00039
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents