research-article

LayerPaint: a multi-layer interactive 3D painting interface

Authors:

Ying HeAuthors Info & Claims

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 811 - 820

https://doi.org/10.1145/1753326.1753445

Published: 10 April 2010 Publication History

Abstract

Painting on 3D surfaces is an important operation in computer graphics, virtual reality, and computer aided design. The painting styles in existing WYSIWYG systems can be awkward, due to the difficulty in rotating or aligning an object for proper viewing during the painting. This paper proposes a multi-layer approach to building a practical, robust, and novel WYSIWYG interface for efficient painting on 3D models. The paintable area is not limited to the front-most visible surface on the screen as in conventional WYSIWYG interfaces. We can efficiently and interactively draw long strokes across different depth layers, and unveil occluded regions that one would like to see or paint on. In addition, since the painting is now depth-sensitive, we can avoid various potential painting artifacts and limitations in the conventional painting interfaces. This multi-layer approach brings in several novel painting operations that contribute to a more compelling WYSIWYG 3D painting interface; this is particular useful when dealing with complicated objects with occluded parts and objects that cannot be easily parameterized. We evaluated our system with 23 users, including both artists and novice painters, and obtained positive experimental results and feedback from them. The user study results demonstrate the efficacy of our novel interface over conventional painting interfaces.

Supplementary Material

JPG File (p811.jpg)

Download
8.89 KB

AVI File (p811.avi)

Download
44.13 MB

References

[1]

M. Agrawala, A. C. Beers, and M. Levoy. 3D painting on scanned surfaces. In Symp. on Interactive 3D Graphics '95, pages 145--150, 1995.

Digital Library

[2]

S.-H. Bae, R. Balakrishnan, and K. Singh. ILoveSketch: as-natural-as-possible sketching system for creating 3D curve models. In ACM symp. on User interface software and tech., pages 151--160, 2008.

Digital Library

[3]

R. Balakrishnan and G. Kurtenbach. Exploring bimanual camera control and object manipulation in 3D graphics interfaces. In CHI '99, pages 56--62, 1999.

Digital Library

[4]

L. Bavoil and K. Myers. Order independent transparency with dual depth peeling, 2008. White paper, NVidia.

[5]

D. A. Bowman, E. Kruijff, J. J. LaViola, and I. Poupyrev. 3D User Interfaces: Theory and Practice. Addison-Wesley Professional, 2004.

Digital Library

[6]

M. Burns and A. Finkelstein. Adaptive cutaways for comprehensible rendering of polygonal scenes. ACM Tran. on Graphics (SIGGRAPH Asia), 27(5), 2008. Article No. 154.

Digital Library

[7]

D. DeBry, J. Gibbs, D. D. Petty, and N. Robins. Painting and rendering textures on unparameterized models. In SIGGRAPH '02, pages 763--768, 2002.

Digital Library

[8]

E. Eisemann, S. Paris, and F. Durand. A visibility algorithm for converting 3D meshes into editable 2D vector graphics. ACM Trans. on Graphics (SIGGRAPH 2009), 28(3), 2009. Article No. 83.

Digital Library

[9]

C. Everitt. Interactive order-independent transparency, 2001. White paper, NVidia.

[10]

A. Gregory, S. Ehmann, and M. Lin. inTouch: interactive multiresolution modeling and 3D painting with a haptic interface. In IEEE Virtual Reality, 2000.

Digital Library

[11]

C. Grimm and M. A. Kowalski. Painting lighting and viewing effects. In Intl. Conf. on Comp. Graphics Theory and App., pages 204--211, 2007.

[12]

P. Hanrahan and P. Haeberli. Direct WYSIWYG painting and texturing on 3D shapes. In SIGGRAPH 90', pages 215--223, 1990.

Digital Library

[13]

A. Khan, B. Komalo, J. Stam, G. Fitzmaurice, and G. Kurtenbach. HoverCam: interactive 3D navigation for proximal object inspection. In Symp. on Interactive 3D graphics and games, pages 73--80, 2005.

Digital Library

[14]

W. Li, M. Agrawala, B. Curless, and D. Salesin. Automated generation of interactive 3D exploded view diagrams. ACM Tran. on Graphics (SIGGRAPH 2008), 27(3), 2008. Article No. 101.

Digital Library

[15]

W. Li, L. Ritter, M. Agrawala, B. Curless, and D. Salesin. Interactive cutaway illustrations of complex 3D models. ACM Tran. on Graphics (SIGGRAPH 2007), 26(3), 2007. Article No. 31.

Digital Library

[16]

F. Liu, M.-C. Huang, X.-H. Liu, and E.-H. Wu. Single pass depth peeling via CUDA rasterizer. In SIGGRAPH Asia 2009 Sketch, 2009.

Digital Library

[17]

J. McCrae, I. Mordatch, M. Glueck, and A. Khan. Multiscale 3D navigation. In Symp. on Interactive 3D graphics and games, pages 7--14, 2009.

Digital Library

[18]

K. Ryokai, S. Marti, and H. Ishii. I/O brush: drawing with everyday objects as ink. In CHI '04, pages 303--310, 2004.

Digital Library

[19]

K. Ryokai, S. Marti, and H. Ishii. Designing the world as your palette. In CHI Extended Abs., pages 1037--1049, 2005.

Digital Library

[20]

S. Schkolne, M. Pruett, and P. Schröder. Surface drawing: creating organic 3D shapes with the hand and tangible tools. In CHI '01, pages 261--268, 2001.

Digital Library

[21]

Y. Shon and S. McMains. Evaluation of drawing on 3D surfaces with haptics. IEEE Comput. Graph. Appl., 24(6):40--50, 2004.

Digital Library

[22]

P. Vandoren, T. Van Laerhoven, L. Claesen, J. Taelman, F. Di Fiore, F. Van Reeth, and E. Flerackers. Dip - it: digital infrared painting on an interactive table. In CHI Extended Abs., pages 2901--2906, 2008.

Digital Library

[23]

C. Ware and J. Rose. Rotating virtual objects with real handles. ACM Trans. Comp.-Human Interaction, 6(2):162--180, 1999.

Digital Library

Cited By

Kawabe WHashimoto TMatulic FIgarashi THiguchi K(2023)Interactive Material Annotation on 3D Scanned Models leveraging Color-Material CorrelationSIGGRAPH Asia 2023 Technical Communications10.1145/3610543.3626170(1-4)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3610543.3626170
Guo SShi YXiao PFu YLin JZeng WLee T(2023)Creative and Progressive Interior Color Design with Eye-tracked User PreferenceACM Transactions on Computer-Human Interaction10.1145/354292230:1(1-31)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3542922
Shimizu EFisher MParis SFatahalian KTagliasacchi ATeather R(2019)Finding Layers Using Hover VisualizationsProceedings of the 45th Graphics Interface Conference10.20380/GI2019.16(1-9)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.20380/GI2019.16
Show More Cited By

Index Terms

LayerPaint: a multi-layer interactive 3D painting interface
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

OverCoat: an implicit canvas for 3D painting
SIGGRAPH '11: ACM SIGGRAPH 2011 papers

We present a technique to generalize the 2D painting metaphor to 3D that allows the artist to treat the full 3D space as a canvas. Strokes painted in the 2D viewport window must be embedded in 3D space in a way that gives creative freedom to the artist ...
3D painting on scanned surfaces
I3D '95: Proceedings of the 1995 symposium on Interactive 3D graphics

We present an intuitive interface for painting on unparameterized three-dimensional polygon meshes using a 6D Polhemus space tracker as an input device. Given a physical object we first acquire its surface geometry using a Cyberware scanner. We then ...
OverCoat: an implicit canvas for 3D painting

We present a technique to generalize the 2D painting metaphor to 3D that allows the artist to treat the full 3D space as a canvas. Strokes painted in the 2D viewport window must be embedded in 3D space in a way that gives creative freedom to the artist ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2010

2690 pages

ISBN:9781605589299

DOI:10.1145/1753326

General Chair:
Elizabeth Mynatt
Georgia Institute of Technology
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Scott Hudson
Carnegie Mellon University
,
Keith Edwards
Georgia Tech
,
Tom Rodden
University of Nottingham

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 April 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '10

Sponsor:

SIGCHI

CHI '10: CHI Conference on Human Factors in Computing Systems

April 10 - 15, 2010

Georgia, Atlanta, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
1,504
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kawabe WHashimoto TMatulic FIgarashi THiguchi K(2023)Interactive Material Annotation on 3D Scanned Models leveraging Color-Material CorrelationSIGGRAPH Asia 2023 Technical Communications10.1145/3610543.3626170(1-4)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3610543.3626170
Guo SShi YXiao PFu YLin JZeng WLee T(2023)Creative and Progressive Interior Color Design with Eye-tracked User PreferenceACM Transactions on Computer-Human Interaction10.1145/354292230:1(1-31)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3542922
Shimizu EFisher MParis SFatahalian KTagliasacchi ATeather R(2019)Finding Layers Using Hover VisualizationsProceedings of the 45th Graphics Interface Conference10.20380/GI2019.16(1-9)Online publication date: 1-Jun-2019
https://dl.acm.org/doi/10.20380/GI2019.16
Takahashi YFukusato TIgarashi T(2019)PaintersView: Automatic Suggestion of Optimal Viewpoints for 3D Texture PaintingSIGGRAPH Asia 2019 Technical Briefs10.1145/3355088.3365159(99-102)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3355088.3365159
Guo CHou ZShi YXu JYu D(2018)A virtual 3D interactive painting method for Chinese calligraphy and painting based on real-time force feedback technologyFrontiers of Information Technology & Electronic Engineering10.1631/FITEE.160128318:11(1843-1853)Online publication date: 18-Jan-2018
https://doi.org/10.1631/FITEE.1601283
Peng MXing JWei L(2018)Autocomplete 3D sculptingACM Transactions on Graphics10.1145/3197517.320129737:4(1-15)Online publication date: 30-Jul-2018
https://dl.acm.org/doi/10.1145/3197517.3201297
Radwan MOhrhallinger SEisemann EWimmer MEisemann EBateman S(2017)Cut and Paint: Occlusion-Aware Subset Selection for Surface ProcessingProceedings of the 43rd Graphics Interface Conference10.5555/3141475.3141494(82-89)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.5555/3141475.3141494
Krs VYumer ECarr NBenes BMěch R(2017)SkippyACM Transactions on Graphics10.1145/3072959.307360336:4(1-12)Online publication date: 20-Jul-2017
https://dl.acm.org/doi/10.1145/3072959.3073603
Lu SMok PJin X(2017)A new design conceptComputer-Aided Design10.1016/j.cad.2017.03.00289:C(35-49)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.1016/j.cad.2017.03.002
Takahashi HMiyashita H(2016)A New Printing Method for Fused Deposition Modeling 3D Printers using the Over-extrusionオーバーエクストルージョンを用いた熱溶解積層方式3Dプリンタのための造形手法The Journal of the Society for Art and Science10.3756/artsci.15.19415:5(194-207)Online publication date: 31-Dec-2016
https://doi.org/10.3756/artsci.15.194
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents