research-article

An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographs

Authors:

Yoshinori Dobashi,

Wataru Iwasaki,

Tsuyoshi Yamamoto,

Tomoyuki NishitaAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 6

Article No.: 145, Pages 1 - 10

https://doi.org/10.1145/2366145.2366164

Published: 01 November 2012 Publication History

Abstract

Clouds play an important role in creating realistic images of outdoor scenes. Many methods have therefore been proposed for displaying realistic clouds. However, the realism of the resulting images depends on many parameters used to render them and it is often difficult to adjust those parameters manually. This paper proposes a method for addressing this problem by solving an inverse rendering problem: given a non-uniform synthetic cloud density distribution, the parameters for rendering the synthetic clouds are estimated using photographs of real clouds. The objective function is defined as the difference between the color histograms of the photograph and the synthetic image. Our method searches for the optimal parameters using genetic algorithms. During the search process, we take into account the multiple scattering of light inside the clouds. The search process is accelerated by precomputing a set of intermediate images. After ten to twenty minutes of precomputation, our method estimates the optimal parameters within a minute.

Supplementary Material

ZIP File (145-140-0338.zip)

Supplemental Materials for An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographs

Download
56.01 MB

References

[1]

Bonneel, N., Paris, S., Panne, M. V. D., Durand, F., and Drettakis, G. 2009. Single photo estimation of hair appearance. Computer Graphics Forum 28, 4, 1171--1180.

Digital Library

[2]

Bouthors, A., Neyret, F., Max, N., Bruneton, E., and Crassin, C. 2008. Interactive multiple anisotropic scattering in clouds. In Proceedings of ACM Symposium on Interactive 3D Graphics and Games, 173--182.

Digital Library

[3]

Cerezo, E., Perez, F., Pueyo, X., Seron, F. J., and Sillion, F. X. 2005. A survey on participating media rendering techniques. The Visual Computer 21, 5, 303--328.

Digital Library

[4]

Davis, A. B., and Marshak, A. 2010. Solar radiation transport in cloudy atmosphere: a 3D perspective on observations and climate impacts. Reports on Progress in Physics 73, 2.

[5]

Dobashi, Y., Kusumoto, K., Nishita, T., and Yamamoto, T. 2008. Feedback control of cumuliform cloud formation based on computational fluid dynamics. ACM Transactions on Graphics 27, 3, Article 94.

Digital Library

[6]

Dobashi, Y., Shinzo, Y., and Yamamoto, T. 2010. Modeling of clouds from a single photograph. Computer Graphics Forum 29, 7, 2083--2090.

[7]

Ebert, D. S., Musgrave, F. K., Peachey, D., and Perlin, K. 2009. Texturing and Modeling: A Procedural Approach Third Edition. Morgan Kaufmann.

Digital Library

[8]

Fattal, R. 2008. Single image dehazing. ACM Transactions on Graphics 27, 3, Article 72.

Digital Library

[9]

Goldberg, D. E. 1989. Genetic Algorithms in Search, Optimization and Machine Lerning. Addison-Wesley Professional.

Digital Library

[10]

Harris, M. J., and Lastra, A. 2001. Real-time cloud rendering. Computer Graphics Forum 20, 3, 76--84.

[11]

Hubball, D., Chen, M., and Grant, P. 2008. Image-based aging using evolutionary computing. Computer Graphics Forum 27, 2, 607--616.

[12]

Jensen, H. W., and Christensen, P. H. 1998. Efficient simulation of light transport in scenes with participating media using photon maps. In Proceedings of ACM SIGGRAPH 1998, 311--320.

Digital Library

[13]

Katz, A., and Thrift, P. 1994. Generating image filters for target recognition by genetic learning. PAMI 16, 9, 906--910.

Digital Library

[14]

Kawai, J. K., Painter, J. S., and Cohen, M. F. 1993. Radioptimization -- goal based rendering. In Proc. ACM SIGGRAPH 1993, 147--154.

Digital Library

[15]

Kienle, A., Lilge, L., Patterson, M. S., Hibst, R., Steiner, R., and Wilson, B. C. 1996. Spatially resolved absolute diffuse reflectance measurements for noninvasive determination of the optical scattering and absorption coefficients of biological tissue. Applied Optics 35, 13.

[16]

Lalonde, J.-F., Efros, A. A., and Narasimhan, S. G. 2012. Estimating natural illumination from a single outdoor image. International Journal on Computer Vision 98, 2, 123--145.

Digital Library

[17]

Li, H., and Yang, C. Y. 1997. A genetic algorithm for inverse radiation problems. International Journal of Heat and Mass Transfer 40, 7, 1545--1549.

[18]

Marks, J., Andalman, B., Beardsley, P. A., Freeman, W., Gibson, S., Hodgins, J., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J., and Shieber, S. 1997. Design galleries: A general approach to setting parametes for computer graphics and animation. In Proc. ACM SIGGRAPH 1997, 380--400.

Digital Library

[19]

Miyazaki, R., Dobashi, Y., and Nishita, T. 2002. Simulation of cumuliform clouds based on computational fluid dynamics. In Proceedings of EUROGRAPHICS 2002 Short Presentations, 405--410.

[20]

Munoz, A., Masia, B., Tolosa, A., and Gutierrez, D. 2009. Single-image appearance acquisition using genetic algorithms. In Proceedings of Computer Graphics, Visualization, Computer Vision and Image Processing 2009, 24--32.

[21]

Munoz, A., Echevarria, J. I., Lopez-Moreno, J., Seron, F., Glencross, M., and Gutierrez, D. 2011. BSSRDF estimation from single images. Computer Graphics Forum 30, 2, 455--464.

[22]

Nishita, T., Dobashi, Y., and Nakamae, E. 1996. Display of clouds taking into account multiple anisotropic scattering and sky light. In Proceedings of ACM SIGGRAPH 1996, 379--386.

Digital Library

[23]

Otsu, N. 1979. A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man and Cybemetics 9, 1, 62--66.

[24]

Pellacini, F., Battaglia, F., Morley, R. K., and Finkelstein, A. 2007. Lighting with paint. ACM Transactions on Graphics 26, 2, Article 9.

Digital Library

[25]

Perez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3, 313--318.

Digital Library

[26]

Premoze, S., Ashikhmin, M., Tessendorf, J., Ramamoorthi, R., and Nayar, S. 2004. Practical rendering of multiple scattering effects in participating media. In Proc. Eurographics Symposium on Rendering, 52--63.

Digital Library

[27]

Reinhard, E., Ashikhimin, M., Gooch, B., and Shirley, P. 2001. Color transfer between images. IEEE Computer Graphics and Applications 21, 5, 34--41.

Digital Library

[28]

Schoeneman, C., Dorsey, J., Smits, B., Arvo, J., and Greenberg, D. 1993. Painting with light. In Proc. ACM SIGGRAPH 1993, 143--146.

Digital Library

[29]

Schpok, J., Simons, J., Ebert, D. S., and Hansen, C. 2003. A real-time cloud modeling, rendering, and animation system. In Proceedings of Symposium on Computer Animation 2005, 160--166.

Digital Library

[30]

Sims, K. 1991. Artificial evolution for computer graphics. In Proc. ACM SIGGRAPH 1991, 319--328.

Digital Library

[31]

Sitthi-Amorn, P., Modly, N., Weimer, W., and Lawrence, J. 2011. Genetic programming for shader simplification. ACM Transactions on Graphics 30, 6, Article 152.

Digital Library

[32]

Snyman, J. 2005. Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms (Applied Optimization). Springer.

[33]

Stam, J. 1995. Multiple scattering as a diffusion process. In Proc. Eurographics Workshop on Rendering, 41--50.

[34]

Tao, L., Yuan, L., and Sun, J. 2009. Skyfinder: Attribute-based sky image search. ACM Transactions on Graphics 28, 3, Article 68.

Digital Library

[35]

Wang, J., Zhao, S., Tong, X., Lin, S., Lin, Z., Dong, Y., Guo, B., and Shum, H.-Y. 2008. Modeling and rendering of heterogeneous translucent materials using the diffusion equation. ACM Transactions on Graphics 27, 1, Article 9.

Digital Library

[36]

Yue, Y., Iwasaki, K., Chen, B.-Y., Dobashi, Y., and Nishita, T. 2010. Unbiased, adaptive stochastic sampling for rendering inhomogeneous participating media. ACM Transactions on Graphics 29, 6, Article 177.

Digital Library

[37]

Zhang, R., Verkruysse, W., Choi, B., Viator, J., Jung, B., Svaasand, L., Aguilar, G., and Nelson, J. 2005. Determination of human skin optical properties from spectrophotometric measurements based on optimization by genetic algorithms. Journal of Biomedical Optics 10, 2.

[38]

Zhou, K., Ren, Z., Lin, S., Bao, H., Guo, B., and Shum, H.-Y. 2008. Real-time smoke rendering using compensated ray marching. ACM Transactions on Graphics 27, 3, Article 36.

Digital Library

Cited By

Suzuki RDobashi Y(2024)Efficient visualization of appearance space of translucent objects using differential renderingSIGGRAPH Asia 2024 Posters10.1145/3681756.3697925(1-2)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3681756.3697925
Suzuki RDobashi Y(2023)Efficient Visualization of Parameter Space for Rendering Translucent Objects2023 Nicograph International (NicoInt)10.1109/NICOINT59725.2023.00014(22-29)Online publication date: Jun-2023
https://doi.org/10.1109/NICOINT59725.2023.00014
Zamri MSunar M(2022)Atmospheric cloud modeling methods in computer graphics: A review, trends, taxonomy, and future directionsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2020.11.03034:6(3468-3488)Online publication date: Jun-2022
https://doi.org/10.1016/j.jksuci.2020.11.030
Show More Cited By

Index Terms

An inverse problem approach for automatically adjusting the parameters for rendering clouds using photographs
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics

Recommendations

A fast rendering method for clouds illuminated by lightning taking into account multiple scattering

Methods for rendering natural scenes are used in many applications such as virtual reality, computer games, and flight simulators. In this paper, we focus on the rendering of outdoor scenes that include clouds and lightning. In such scenes, the ...
Modeling and Rendering Methods of Clouds
PG '99: Proceedings of the 7th Pacific Conference on Computer Graphics and Applications

Recently, simulation of natural phenomena, such as water, smokes, fire, clouds, have been attempted in computer graphics. Clouds play an important role when generating images of outdoor scenes, the earth viewed from outer space and the visualization of ...
Efficient rendering of dynamic clouds
VRCAI '04: Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry

In this paper, an efficient rendering framework for cloud is proposed. With a simplified lighting model, features such as self-shadowing and light scattering are stored in the Shadow Relation Table (SRT) and Metaball Lighting Texture Database (MLTDB) in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 6

November 2012

794 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2366145

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2012

Published in TOG Volume 31, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
659
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Suzuki RDobashi Y(2024)Efficient visualization of appearance space of translucent objects using differential renderingSIGGRAPH Asia 2024 Posters10.1145/3681756.3697925(1-2)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3681756.3697925
Suzuki RDobashi Y(2023)Efficient Visualization of Parameter Space for Rendering Translucent Objects2023 Nicograph International (NicoInt)10.1109/NICOINT59725.2023.00014(22-29)Online publication date: Jun-2023
https://doi.org/10.1109/NICOINT59725.2023.00014
Zamri MSunar M(2022)Atmospheric cloud modeling methods in computer graphics: A review, trends, taxonomy, and future directionsJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2020.11.03034:6(3468-3488)Online publication date: Jun-2022
https://doi.org/10.1016/j.jksuci.2020.11.030
Guo JLi MZong ZLiu YHe JGuo YYan L(2021)Volumetric appearance stylization with stylizing kernel prediction networkACM Transactions on Graphics10.1145/3450626.345979940:4(1-15)Online publication date: 19-Jul-2021
https://dl.acm.org/doi/10.1145/3450626.3459799
Muniz Cdos Santos W(2021)Generative Design applied to Cloud Modeling2021 20th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)10.1109/SBGames54170.2021.00019(79-86)Online publication date: Oct-2021
https://doi.org/10.1109/SBGames54170.2021.00019
Ma SShen QHou QRen ZZhou K(2021)Neural compositing for real-time augmented reality rendering in low-frequency lighting environmentsScience China Information Sciences10.1007/s11432-020-3024-564:2Online publication date: 5-Jan-2021
https://doi.org/10.1007/s11432-020-3024-5
Zhang ZMa YLi YLi FShum HYang BGuo JLiang X(2020)Cumuliform cloud formation control using parameter-predicting convolutional neural networkGraphical Models10.1016/j.gmod.2020.101083(101083)Online publication date: Aug-2020
https://doi.org/10.1016/j.gmod.2020.101083
Goswami P(2020)A survey of modeling, rendering and animation of clouds in computer graphicsThe Visual Computer10.1007/s00371-020-01953-yOnline publication date: 14-Aug-2020
https://doi.org/10.1007/s00371-020-01953-y
Chen JCen YLiang X(2018)Sketch-based Cloud Model Retrieval for Cumulus Cloud Scene ConstructionProceedings of the 2nd International Conference on Digital Signal Processing10.1145/3193025.3193043(166-170)Online publication date: 25-Feb-2018
https://dl.acm.org/doi/10.1145/3193025.3193043
Iwasaki KDobashi YOkabe MMao XThalmann DGavrilova M(2017)Example-based synthesis of three-dimensional clouds from photographsProceedings of the Computer Graphics International Conference10.1145/3095140.3095168(1-6)Online publication date: 27-Jun-2017
https://dl.acm.org/doi/10.1145/3095140.3095168
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents