A 3D Feature-based Approach for Mapping Scaling Effects on Stone Monuments
Article No.: 33, Pages 1 - 19
Abstract
Weathering effects caused by physical, chemical, or biological processes result in visible damage that alters the appearance of stones’ surfaces. Consequently, weathered stone monuments can offer a distorted perception of the artworks to the point of making their interpretation misleading. Being able to detect and monitor decay is crucial for restorers and curators to perform important tasks, such as identifying missing parts, assessing the preservation state, or evaluating curating strategies. Decay mapping, the process of identifying weathered zones of artworks, is essential for preservation and research projects. This is usually carried out by marking the affected parts of the monument on a two-dimensional (2D) drawing or picture of it. One of the main problems of this methodology is that it is manual work based only on experts’ observations. This makes the process slow and often results in disparities between the mappings of the same monument made by different experts. In this article, we focus on the weathering effect known as “scaling,” following the International Council on Monuments and Sites, International Scientific Committee for Stone (ICOMOS ISCS) definition. We present a novel technique for detecting, segmenting, and classifying these effects on stone monuments. Our method is user-friendly, requiring minimal user input. By analyzing 3D reconstructed data considering geometry and appearance, the method identifies scaling features and segments weathered regions, classifying them by scaling subtype. It shows improvements over previous approaches and is well received by experts, representing a significant step toward objective stone decay mapping.
References
[1]
E. Adamopoulos, F. Rinaudo, and D. Adamopoulou. 2021. Automatizing degradation mapping of ancient stelae by dual-band imaging and machine learning-based classification. In ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences VIII-M-1-2021 (2021), 9–16. DOI:
[2]
Kiraz Goze Akoğlu, Eleni Kotoula, and Stefan Simon. 2020. Combined use of ultrasonic pulse velocity (UPV) testing and digital technologies: A model for long-term condition monitoring memorials in historic Grove Street Cemetery, New Haven. J. Cult. Herit. 41 (2020), 84–95. DOI:
[3]
Mohsen Azimi, Armin Dadras Eslamlou, and Gokhan Pekcan. 2020. Data-driven structural health monitoring and damage detection through deep learning: State-of-the-art review. Sensors 20, 10 (2020). DOI:
[4]
Daniel Barath and Jiří Matas. 2018. Graph-cut RANSAC. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6733–6741.
[5]
Gustavo H. Beckman, Dimos Polyzois, and Young-Jin Cha. 2019. Deep learning-based automatic volumetric damage quantification using depth camera. Autom. Construct. 99, March (2019), 114–124.
[6]
José Delgado-Rodrigues. 2015. Defining, mapping and assessing deterioration patterns in stone conservation projects. J. Cult. Herit. 16, 3 (2015), 267–275. DOI:
[7]
Pedro F. Felzenszwalb and Daniel P. Huttenlocher. 2004. Efficient graph-based image segmentation. Int. J. Comput. Vis. 59, 2 (2004), 167–181.
[8]
Marco Fiorucci, Marina Khoroshiltseva, Massimiliano Pontil, Arianna Traviglia, Alessio Del Bue, and Stuart James. 2020. Machine learning for cultural heritage: A survey. Pattern Recogn. Lett. 13, May (2020), 102–108. DOI:
[9]
Bernd Fitzner and Kurt Heinrichs. 2002. Damage index for stone monuments. In Protection and Conservation of the Cultural Heritage of the Mediterranean Cities, E. Galan and F. Zezza (Eds.). Swets & Zeitlinger, Lisse, The Netherlands, 315–326.
[10]
B. Fitzner, K. Heinrichs, and R. Kownatzki. 1997. Weathering forms at natural stone monuments: Classification, mapping and evaluation/Verwitterungsformen an Natursteinbauwerken: Klassifizierung, Kartierung und Auswertung. Restor. Build. Monuments 3, 2 (1997), 105–124. DOI:
[11]
Eleonora Grilli and Fabio Remondino. 2019. Classification of 3D digital heritage. Remote. Sens. 11, 7 (2019), 847.
[12]
Mehmet Ergün Hatır. 2020. Determining the weathering classification of stone cultural heritage via the analytic hierarchy process and fuzzy inference system. J. Cult. Herit. 44, July-August, (2020), 120–134. DOI:
[13]
Mehmet Ergün Hatır, Mücahit Barstüğan, and İsmail İnce. 2020. Deep learning-based weathering type recognition in historical stone monuments. J. Cult. Herit. 45, September-October (2020), 193–203. DOI:
[14]
M. Ergün Hatır, İsmail İnce, and Mustafa Korkanç. 2021. Intelligent detection of deterioration in cultural stone heritage. J. Build. Eng. 44, 12 (2021), 102690.
[15]
ICOMOS. 2008. Monuments and Sites XV—Illustrated Glossary on Deterioration patterns. ICOMOS International Scientific Committee for Stone.
[16]
S. Kyriakaki-Grammatikaki, E. K. Stathopoulou, E. Grilli, F. Remondino, and A. Georgopoulos. 2022. Geometric primitive extraction from semantically enriched point clouds. Int. Arch. Photogram. Remote Sens. Spat. Inf. Sci. 46, 2/W1 (2022), 291–298.
[17]
Jiajun Li, Qian Wang, Jun Ma, and Jingjing Guo. 2022. Multi-defect segmentation from façade images using balanced copy–paste method. Comput.-Aid. Civil Infrastruct. Eng. 37, 11 (2022), 1434–1449.
[18]
Shengyuan Li and Xuefeng Zhao. 2022. A performance improvement strategy for concrete damage detection using stacking ensemble learning of multiple semantic segmentation networks. Sensors 22, 9 (2022), 3341.
[19]
Safia Meklati, Kenza Boussora, Mohamed El Hafedh Abdi, and Sid-Ahmed Berrani. 2023. Surface damage identification for heritage site protection: A mobile crowd-sensing solution based on deep learning. J. Comput. Cult. Herit. 16, 2 (2023), 25:1–25:24. DOI:
[20]
Tommy Messaoudi, Philippe Véron, Gilles Halin, and Livio De Luca. 2018. An ontological model for the reality-based 3D annotation of heritage building conservation state. J. Cult. Herit. 29, January-February (2018), 100–112. DOI:
[21]
Mayank Mishra. 2021. Machine learning techniques for structural health monitoring of heritage buildings: A state-of-the-art review and case studies. J. Cult. Herit. 47, January-February (2021), 227–245. DOI:
[22]
Imanol Muñoz-Pandiella, Kiraz Akoglu, Carles Bosch, and Holly E. Rushmeier. 2017. Towards semi-automatic scaling detection on flat stones. In Eurographics Workshop on Graphics and Cultural Heritage. 49–58.
[23]
Y. Ohtake, A. Belyaev, and H. Seidel. 2002. Mesh smoothing by adaptive and anisotropic Gaussian filter applied to mesh normals. In Vision, Modeling, and Visualization. IOS Press Amsterdam, The Netherlands, 203–210.
[24]
Gaia Pavoni, Francesca Giuliani, Anna De Falco, Massimiliano Corsini, Federico Ponchio, Marco Callieri, and Paolo Cignoni. 2020. Another brick in the wall: Improving the assisted semantic segmentation of masonry walls. In Eurographics Workshop on Graphics and Cultural Heritage. The Eurographics Association.
[25]
Ruwen Schnabel, Roland Wahl, and Reinhard Klein. 2007. Efficient RANSAC for point-cloud shape detection. In Computer Graphics Forum, 26, May. Wiley Online Library, 214–226.
[26]
Chiara Stefani, Xavier Brunetaud, Sarah Janvier-Badosa, Kévin Beck, Livio De Luca, and Muzahim Al-Mukhtar. 2014. Developing a toolkit for mapping and displaying stone alteration on a web-based documentation platform. J. Cult. Herit. 15, 1 (2014), 1–9. DOI:
[27]
Xianfang Sun, Paul L. Rosin, Ralph Martin, and Frank Langbein. 2007. Fast and effective feature-preserving mesh denoising. IEEE Trans. Vis. Comput.r Graph. 13, 5 (2007), 925–938.
[28]
Andrea Vedaldi and Stefano Soatto. 2008. Quick shift and kernel methods for mode seeking. In Proceedings of the 10th European Conference on Computer Vision (ECCV ’08) Part IV 10. Springer, 705–718.
[29]
Niannian Wang, Qingan Zhao, Shengyuan Li, Xuefeng Zhao, and Peng Zhao. 2018. Damage classification for masonry historic structures using convolutional neural networks based on still images. Comput.-Aid. Civil Infrastruct. Eng. 33, 12 (2018), 1073–1089.
[30]
Niannian Wang, Xuefeng Zhao, Peng Zhao, Yang Zhang, Zheng Zou, and Jinping Ou. 2019. Automatic damage detection of historic masonry buildings based on mobile deep learning. Autom. Construct. 103, July (2019), 53–66.
[31]
Niannian Wang, Xuefeng Zhao, Zheng Zou, Peng Zhao, and Fei Qi. 2020. Autonomous damage segmentation and measurement of glazed tiles in historic buildings via deep learning. Comput.-Aid. Civil Infrastruct. Eng. 35, 3 (2020), 277–291.
[32]
Patricia Warke, J. M. Curran, Alice Turkington, and B. J. Smith. 2003. Condition assessment for building stone conservation: A staging system approach. Build. Environ. 38, 9–10 (2003), 1113–1123. DOI:
Index Terms
- A 3D Feature-based Approach for Mapping Scaling Effects on Stone Monuments
Recommendations
Inscription Segmentation Using Synthetic Inscription Images for Text Detection at Stone Monuments
Document Analysis and Recognition – ICDAR 2021 WorkshopsAbstractStone monuments have historical value, and the inscriptions engraved on them can tell us about the events and people at the time of their installation. Photography is an easy way to record inscriptions; however, the light falling on the monument, ...
The Elephant Stone - Tracing a New Path for the Digital Approach to Unsurveyable Monuments
VSMM '09: Proceedings of the 2009 15th International Conference on Virtual Systems and MultimediaAbstract— The stone of the elephant is a well known monument in the northern part of Sardinia, one of the main island in the Mediterranean sea. It is a large volcanic stone with a particular shape which recall the shape of an elephant. The natural ...
Mapping MPEG-7 to CIDOC/CRM
TPDL'11: Proceedings of the 15th international conference on Theory and practice of digital libraries: research and advanced technology for digital librariesThe MPEG-7 is the dominant standard for multimedia content description; thus, the audiovisual Digital Library contents should be described in terms of MPEG-7. Since there exists a huge amount of audiovisual content in the cultural heritage domain, it is ...
Comments
Information & Contributors
Information
Published In
June 2024
355 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 April 2024
Online AM: 13 March 2024
Accepted: 08 February 2024
Received: 01 August 2023
Published in JOCCH Volume 17, Issue 2
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Grup de Recerca Consolidat ViRVIG
- Departament of Research and Universities of the Generalitat de Catalunya
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 157Total Downloads
- Downloads (Last 12 months)157
- Downloads (Last 6 weeks)3
Reflects downloads up to 04 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in