research-article

Real-time gradient-domain painting

Authors:

Nancy S. PollardAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 27, Issue 3

Pages 1 - 7

https://doi.org/10.1145/1360612.1360692

Published: 01 August 2008 Publication History

Abstract

We present an image editing program which allows artists to paint in the gradient domain with real-time feedback on megapixel-sized images. Along with a pedestrian, though powerful, gradient-painting brush and gradient-clone tool, we introduce an edge brush designed for edge selection and replay. These brushes, coupled with special blending modes, allow users to accomplish global lighting and contrast adjustments using only local image manipulations --- e.g. strengthening a given edge or removing a shadow boundary. Such operations would be tedious in a conventional intensity-based paint program and hard for users to get right in the gradient domain without real-time feedback. The core of our paint program is a simple-to-implement GPU multigrid method which allows integration of megapixel-sized full-color gradient fields at over 20 frames per second on modest hardware. By way of evaluation, we present example images produced with our program and characterize the iteration time and convergence rate of our integration method.

Supplementary Material

MOV File (a93-mccann.mov)

Download
34.89 MB

References

[1]

Agarwala, A. 2007. Efficient gradient-domain compositing using quadtrees. ACM Transactions on Graphics 26, 3.

Digital Library

[2]

Agrawal, A., and Raskar, R., 2007. Gradient domain manipulation techniques in vision and graphics. ICCV 2007 Course.

[3]

Bolz, J., Farmer, I., Grinspun, E., and Schröoder, P. 2003. Sparse matrix solvers on the GPU: conjugate gradients and multigrid. ACM Transactions on Graphics 22, 3, 917--924.

Digital Library

[4]

Burt, P. J., and Adelson, E. H. 1983. A multiresolution spline with application to image mosaics. ACM Transactions on Graphics 2, 4, 217--236.

Digital Library

[5]

Elder, J. H., and Goldberg, R. M. 2001. Image editing in the contour domain. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 3, 291--296.

Digital Library

[6]

Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3, 249--256.

Digital Library

[7]

Finlayson, G., Hordley, S., and Drew, M. 2002. Removing shadows from images. In ECCV 2002.

Digital Library

[8]

Goodnight, N., Woolley, C., Lewin, G., Luebke, D., and Humphreys, G. 2003. A multigrid solver for boundary value problems using programmable graphics hardware. In HWWS '03, 102--111.

Digital Library

[9]

Kazhdan, M., and Hoppe, H. 2008. Streaming multigrid for gradient-domain operations on large images. ACM Transactions on Graphics 27, 3.

Digital Library

[10]

Land, E. H., and McCann, J. J. 1971. Lightness and retinex theory. Journal of the Optical Society of America (1917-1983) 61 (Jan.), 1--11.

[11]

Levin, A., Zomet, A., Peleg, S., and Weiss, Y., 2003. Seamless image stitching in the gradient domain. Hebrew University Tech Report 2003-82.

[12]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3, 646--653.

Digital Library

[13]

Orzan, A., Bousseau, A., Winnemoeller, H., Barla, P., Joëlle, and Salesin, D. 2008. Diffusion curves: A vector representation for smooth shaded images. ACM Transactions on Graphics 27, 3.

Digital Library

[14]

Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3, 313--318.

Digital Library

[15]

Press, W. H., Teukolsky, S. A., Vetterling, W. T., and Flannery, B. P. 1992. Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press, New York, NY, USA, ch. 19.6, 871--888.

Digital Library

[16]

Roberts, A. J. 2001. Simple and fast multigrid solution of Poisson's equation using diagonally oriented grids. ANZIAM J. 43, E (July), E1--E36.

[17]

Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proceedings of ACM SIGGRAPH 2000, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 489--498.

Digital Library

[18]

Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Transactions on Graphics 25, 3, 1135--1143.

Digital Library

[19]

Tumblin, J., Agrawal, A., and Raskar, R. 2005. Why I want a gradient camera. In Proceedings of IEEE CVPR 2005, vol. 1, 103--110.

Digital Library

[20]

Werner, H. 1935. Studies on contour: I. qualitative analyses. The American Journal of Psychology 47, 1 (Jan.), 40--64.

Cited By

Adeyemi TWei CSharma JChen Y(2024)Comparison of Gas Signature and Void Fraction in Water- and Oil-Based Muds Using Fiber-Optic Distributed Acoustic Sensor, Distributed Temperature Sensor, and Distributed Strain SensorSPE Journal10.2118/219753-PA29:07(3531-3552)Online publication date: 18-Apr-2024
https://doi.org/10.2118/219753-PA
Petruzza SSumma BGooch ALaney CGoulden TSchreiner JCallahan SPascucci V(2023)Interactive Visualization and Portable Image Blending of Massive Aerial Image Mosaics2023 IEEE International Conference on Big Data (BigData)10.1109/BigData59044.2023.10386428(3365-3370)Online publication date: 15-Dec-2023
https://doi.org/10.1109/BigData59044.2023.10386428
Xu KHao XLin J(2022)Automated fibre placement path generation for complex surfaces via digital image deconvolution algorithmComposites Part A: Applied Science and Manufacturing10.1016/j.compositesa.2022.107246163(107246)Online publication date: Dec-2022
https://doi.org/10.1016/j.compositesa.2022.107246
Show More Cited By

Index Terms

Real-time gradient-domain painting
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces

Recommendations

Real-Time Painting with an Expressive Virtual Chinese Brush

A physically based 3D virtual brush with bristles that bend and spread realistically like real brushes is used in Asian painting and calligraphy. Such an expressive brush lets artists create digital brushwork with spontaneity and spirit. Plasticity of ...
RFID Painting Demonstration
ICEC '09: Proceedings of the 8th International Conference on Entertainment Computing

This demonstration challenges the conventional art experience. It brings together the fields of art, science, and software integration. The goal was to create a new kind of painting based on embedded technology, experimenting with a new media: paintings ...
Painting with Polygons: A Procedural Watercolor Engine

Existing natural media painting simulations have produced high-quality results, but have required powerful compute hardware and have been limited to screen resolutions. Digital artists would like to be able to use watercolor-like painting tools, but at ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 27, Issue 3

August 2008

844 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1360612

Issue’s Table of Contents

Copyright © 2008 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2008

Published in TOG Volume 27, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

108
Total Citations
View Citations
1,843
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Adeyemi TWei CSharma JChen Y(2024)Comparison of Gas Signature and Void Fraction in Water- and Oil-Based Muds Using Fiber-Optic Distributed Acoustic Sensor, Distributed Temperature Sensor, and Distributed Strain SensorSPE Journal10.2118/219753-PA29:07(3531-3552)Online publication date: 18-Apr-2024
https://doi.org/10.2118/219753-PA
Petruzza SSumma BGooch ALaney CGoulden TSchreiner JCallahan SPascucci V(2023)Interactive Visualization and Portable Image Blending of Massive Aerial Image Mosaics2023 IEEE International Conference on Big Data (BigData)10.1109/BigData59044.2023.10386428(3365-3370)Online publication date: 15-Dec-2023
https://doi.org/10.1109/BigData59044.2023.10386428
Xu KHao XLin J(2022)Automated fibre placement path generation for complex surfaces via digital image deconvolution algorithmComposites Part A: Applied Science and Manufacturing10.1016/j.compositesa.2022.107246163(107246)Online publication date: Dec-2022
https://doi.org/10.1016/j.compositesa.2022.107246
Shi XLiu WHe LJin HLi MChen Y(2020)Optimizing the SSD Burst Buffer by Traffic DetectionACM Transactions on Architecture and Code Optimization10.1145/337770517:1(1-26)Online publication date: 4-Mar-2020
https://dl.acm.org/doi/10.1145/3377705
Song YLin B(2020)Improving Memory Efficiency in Heterogeneous MPSoCs through Row-Buffer Locality-aware ForwardingACM Transactions on Architecture and Code Optimization10.1145/337714917:1(1-26)Online publication date: 4-Mar-2020
https://dl.acm.org/doi/10.1145/3377149
Wu HLiu WLin HWang C(2020)A Model-Based Software Solution for Simultaneous Multiple Kernels on GPUsACM Transactions on Architecture and Code Optimization10.1145/337713817:1(1-26)Online publication date: 4-Mar-2020
https://dl.acm.org/doi/10.1145/3377138
Hou FSun QFang ZLiu YHu SQin HHao AHe Y(2020)Poisson Vector Graphics (PVG)IEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.286747826:2(1361-1371)Online publication date: 1-Feb-2020
https://doi.org/10.1109/TVCG.2018.2867478
Sevcenco IAgathoklis P(2020)Light field editing in the gradient domainIET Image Processing10.1049/ipr2.1208615:5(1072-1082)Online publication date: 29-Dec-2020
https://doi.org/10.1049/ipr2.12086
Chen MZhao XXu D(2020)FSIS: Fast and Seamless Image Stitching of High-Resolution Dunhuang MuralsAdvances in 3D Image and Graphics Representation, Analysis, Computing and Information Technology10.1007/978-981-15-3867-4_37(317-327)Online publication date: 21-Apr-2020
https://doi.org/10.1007/978-981-15-3867-4_37
Holynski AKopf J(2018)Fast depth densification for occlusion-aware augmented realityACM Transactions on Graphics10.1145/3272127.327508337:6(1-11)Online publication date: 4-Dec-2018
https://dl.acm.org/doi/10.1145/3272127.3275083
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents