A Robust Gray-code Pattern Decoding Method for 3D Scanning with Structured Light
Article No.: 9, Pages 1 - 5
Abstract
Structured light 3D imaging based on Gray code requires accurate pixel light and dark judgment for high-quality reconstruction. This paper proposes a pixel point classification method for fringe images based on the U-Net network to achieve robust and efficient pixel binary classification. To make the network more effective in learning and utilizing the structural information of the fringes projected by the projector, a multi-channel network input is designed. To address the challenge of obtaining a large number of fringe images for network training in real scenes, this paper utilizes computer graphics to construct a virtual 3D structured light imaging system and produce usable datasets. The proposed method achieved a pixel classification error rate of 0.44% and a mean square error of 285.019 on the test data, outperforming the traditional method's 1.10% and 713.578, respectively. The proposed method can accurately recognize and classify pixel values of highly reflective regions in an image. And it can generate high dynamic range images with wider dynamic range and richer image details.
References
[1]
Geng, J. (2011). Structured-light 3D surface imaging: a tutorial. Advances in Optics and Photonics, 3(2), 128-160.
[2]
Doran, R. W. (2007). The gray code. Department of Computer Science, The University of Auckland, New Zealand.
[3]
O'Toole, M., Mather, J., & Kutulakos, K. N. (2014). 3D shape and indirect appearance by structured light transport. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3246-3253).
[4]
Trobina, M. (1995). Error model of a coded-light range sensor. Technique Report, Communication Technology Laboratory, ETH Zentrum, Zurich.
[5]
Scharstein, D., & Szeliski, R. (2003, June). High-accuracy stereo depth maps using structured light. In 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings. (Vol. 1, pp. I-I). IEEE.
[6]
Song, Z., Chung, R., & Zhang, X. T. (2012). An accurate and robust strip-edge-based structured light means for shiny surface micromeasurement in 3-D. IEEE Transactions on Industrial Electronics, 60(3), 1023-1032.
[7]
Wu, H. B., Chen, Y., Wu, M. Y., Guan, C. R., & Yu, X. Y. (2006, October). 3d measurement technology by structured light using stripe-edge-based gray code. In Journal of Physics: Conference Series (Vol. 48, No. 1, p. 537). IOP Publishing.
[8]
Seitz, S. M., Matsushita, Y., & Kutulakos, K. N. (2005, October). A theory of inverse light transport. In Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 (Vol. 2, pp. 1440-1447). IEEE.
[9]
Nayar, S. K., Krishnan, G., Grossberg, M. D., & Raskar, R. (2006). Fast separation of direct and global components of a scene using high frequency illumination. In ACM SIGGRAPH 2006 Papers (pp. 935-944).
[10]
Xu, Y., & Aliaga, D. G. (2007, May). Robust pixel classification for 3D modeling with structured light. In Proceedings of Graphics Interface 2007 (pp. 233-240).
[11]
Skocaj, D., & Leonardis, A. (2000, September). Range image acquisition of objects with non-uniform albedo using structured light range sensor. In Proceedings 15th International Conference on Pattern Recognition. ICPR-2000 (Vol. 1, pp. 778-781). IEEE.
[12]
Debevec, P. E., & Malik, J. (2008). Recovering high dynamic range radiance maps from photographs. In ACM SIGGRAPH 2008 classes (pp. 1-10).
[13]
Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18 (pp. 234-241). Springer International Publishing.
[14]
Qian, J., Feng, S., Tao, T., Hu, Y., Li, Y., Chen, Q., & Zuo, C. (2020). Deep-learning-enabled geometric constraints and phase unwrapping for single-shot absolute 3D shape measurement. Apl Photonics, 5(4).
[15]
Nguyen, H., Wang, Y., & Wang, Z. (2020). Single-shot 3D shape reconstruction using structured light and deep convolutional neural networks. Sensors, 20(13), 3718.
[16]
Wang, F., Wang, C., & Guan, Q. (2021). Single-shot fringe projection profilometry based on deep learning and computer graphics. Optics Express, 29(6), 8024-8040.
[17]
Liu, Z., Luo, P., Wang, X., & Tang, X. (2018). Large-scale celebfaces attributes (celeba) dataset. Retrieved August, 15(2018), 11.
[18]
Chen, R., Xu, J., Ye, Z., Li, J., Guan, Y., & Chen, K. (2016). Easy-to-operate calibration method for structured light systems. Applied Optics, 55(30), 8478-8485.
Index Terms
- A Robust Gray-code Pattern Decoding Method for 3D Scanning with Structured Light
Index terms have been assigned to the content through auto-classification.
Recommendations
Development of an optical 3D scanner based on structured light
AIKED'10: Proceedings of the 9th WSEAS international conference on Artificial intelligence, knowledge engineering and data basesA 3D laser scanner based on a linear laser was constructed to obtain 3D virtual images of the objects. The scanner was adaptively organized for 3D point cloud extraction. Design and the theory of the scanner were presented together with the real life ...
3D Object Scanning System by Coded Structured Light
ISECS '10: Proceedings of the 2010 Third International Symposium on Electronic Commerce and SecurityThis paper proposes an approach to scanning a real 3D object by a digital camera and DLP projector and calculating its 3D coordinates by coded structured light. Because the coded pattern is composed of color groups which came from color stripes, we can ...
An Efficient and Robust Stripe Extraction Method for Structured Light Measurement System
ICAIP '17: Proceedings of the International Conference on Advances in Image ProcessingStripe extraction methods are a fundamental step for the structured light three-dimensional measurement systems. This work proposes an efficient and robust stripe extraction method for structured light measurement system. In this paper, a novel method ...
Comments
Information & Contributors
Information
Published In
August 2023
378 pages
ISBN:9798400708701
DOI:10.1145/3627341
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 December 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICCVIT 2023
ICCVIT 2023: International Conference on Computer, Vision and Intelligent Technology
August 25 - 28, 2023
Chenzhou, China
Acceptance Rates
ICCVIT '23 Paper Acceptance Rate 54 of 142 submissions, 38%;
Overall Acceptance Rate 54 of 142 submissions, 38%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 37Total Downloads
- Downloads (Last 12 months)35
- Downloads (Last 6 weeks)1
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format