Parallel and distributed processing for high resolution agricultural tomography based on big data
Pages 10115 - 10146
Abstract
In the field of high-resolution tomography, there is currently a notable increase in the volume of tomographic projections and data produced. Such a context has been demanding new computational approaches to the process of reconstruction and processing of the resulting digital images. This paper presents a new approach to meet such a demand, such as optimizing the set of tomographic projections for the reconstruction process, parallelizing algorithm reconstruction, and processing the data in a distributed manner. In this context, a customized method for the high-resolution tomographic reconstruction of agricultural samples has been validated. Hence, tomographic projections with greater amounts of information based on measurements of the spectral density of the projections can be prioritized, and the reconstructive process parallelization using the known filtered back-projection can be considered (i.e., distributed data flow and the use of the Apache Spark environment). For the operation, such an approach based on the big data environment has been organized, that is considering a cluster installed on the Amazon Web Services platform, whose configuration has been defined after the evaluation of the speedup and efficiency metrics. The developed method proved to be useful for carrying out high-resolution tomography analyses of large quantities of agricultural samples, based on the paradigms of precision agriculture for gains in sustainability and competitiveness of the production process.
References
[1]
Ahmed MR, Yasmin J, Wakholi C, Mukasa P, Cho B-K (2020) Classification of pepper seed quality based on internal structure using x-ray CT imaging 179:105839.
[2]
Ahmed MR, Yasmin J, Collins W, and Cho B-K X-ray ct image analysis for morphology of muskmelon seed in relation to germination Biosyst Eng 2018 175 183-193
[3]
Alves GM, Cruvinel PE (2018) Big data infrastructure for agricultural tomographic images reconstruction. 2018 IEEE 12th International Conference on Semantic Computing (ICSC).
[4]
Balogun F and Cruvinel P Compton scattering tomography in soil compaction study Nucl Inst Methods Phys Res A: Accelerators, Spectrometers, Detectors and Associated Equipment 2003 505 1–2 502-507
[5]
Beutler FJ and Leneman OA Random sampling of random processes: Stationary point processes Inf Control 1966 9 4 325-346
[6]
Bronson K, Knezevic I (2016) Big data in food and agriculture. Big Data and Society 3(1).
[7]
Cruvinel P, Cesareo R, Crestana S, and Mascarenhas S X- and gamma-rays computerized minitomograph scanner for soil science IEEE Trans Instrum Meas 1990 39 5 745-750
[8]
Cruvinel P, Pereira M, Saito J, and Costah LDF Performance improvement of tomographic image reconstruction based on DSP processors IEEE Trans. Instrum. Meas. 2009 58 9 3295-3304
[9]
Ding C, Wang W, He H, Yang W (2020) Research on tomographic image reconstruction algorithms based on fixed-point rotation x-CT system 79(35–36):25463–25496.
[10]
Diniz PSR, Silva EAB, and Netto SL Digital Signal Processing 2010 Cambridge University Press
[11]
Ditter A, Fey D, Schon T, Oeckl S (2014) On the way to big data applications in industrial computed tomography 792–793.
[12]
Hajjaji Y, Boulila W, Farah IR, Romdhani I, and Hussain A Big data and IoT-based applications in smart environments: A systematic review 2021 39 100318
[13]
Heeraman D, Hopmans J, and Clausnitzer V Three dimensional imaging of plant roots in situ with x-ray computed tomography Plant Soil 1997 189 2 167-179
[14]
Hsieh J Computed Tomography: Principles, Design, Artifacts, and Recent Advances 2009 John Wiley & Sons Inc
[15]
Janßen R A note on superlinear speedup 1987 4 2 211-213
[16]
Kak AC and Slaney M Principles of Computerized Tomographic Imaging 1989 IEEE Press
[17]
Kamilaris A, Kartakoullis A, and Prenafeta-Boldu FX A review on the practice of big data analysis in agriculture Comput Electron Agric 2017 143 23-37
[18]
Kontoghiorghes EJ (2005) Handbook of Parallel Computing and Statistics. Chapman and Hall/CRC
[19]
Liakos K, Busato P, Moshou D, Pearson S, and Bochtis D Machine learning in agriculture: A review Sensors 2018 18 8 2674
[20]
Naime JM (1994) Projeto e construção de um Tomógrafo portátil para estudos de ciência do solo e plantas, em campo. Master’s thesis, USP
[21]
Oppenheim AV and Schafer RW Digital Signal Processing 1975 Prentice Hall
[22]
Pereira M and Cruvinel P A model for soil computed tomography based on volumetric reconstruction, wiener filtering and parallel processing Comput Electron Agric 2015 111 151-163
[23]
Pires LF and Bacchi OOS Mudanças na estrutura do solo avaliada com uso de tomografia computadorizada Pesq Agrop Brasileira 2010 45 4 391-400
[24]
Pires LF, Borges JA, Bacchi OO, and Reichardt K Twenty-five years of computed tomography in soil physics: A literature review of thebrazilian contribution Soil Tillage Res 2010 110 2 197-210
[25]
Rangayyani RM Biomedical Image Analysis (Biomedical Engineering) 2004 CRC Press
[26]
Ribarics P Big data and its impact on agriculture Ecocycles 2016 2 1 33-34
[27]
Scannavino FA (2013) Tomógrafo de espalhamento Compton para estudos da física de solos agrícolas em ambiente de campo. Ph.D. thesis, USP
[28]
Serrano E, Garcia-Blas J, Carretero J, Desco M, and Abella M Accelerated iterative image reconstruction for cone-beam computed tomography through big data frameworks 2020 106 534-544
[29]
Shannon CE A mathematical theory of communication Bell System Technical Journal 1948 27 3 379-423
[30]
Shannon C Communication in the presence of noise Proc IRE 1949 37 1 10-21
[31]
Silva AM (1997) Construção e uso de um tomógrafo com resolução micrométrica para aplicações em ciências do solo e ambi. Ph.D. thesis,USP
[32]
Ullah R and Arslan T PySpark-based optimization of microwave image reconstruction algorithm for head imaging big data on high-performance computing and google cloud platform 2020 10 10 3382
[33]
Verdu S Fifty years of shannon theory IEEE Trans Inf Theory 1998 44 6 2057-2078
[34]
Wang G A perspective on deep imaging IEEE Access 2016 4 8914-8924
[35]
Zhang H et al (2016) Image Prediction for Limited-angle Tomography via Deep Learning with Convolutional Neural Network. ArXiv e-prints. arXiv:1607.08707 [physics.med-ph]
[36]
Zhao J, Fu Y, Tan Y, Cao F (2013) A reduction algorithm for the big data in 3D surface reconstruction.
Index Terms
- Parallel and distributed processing for high resolution agricultural tomography based on big data
Index terms have been assigned to the content through auto-classification.
Recommendations
A Spark-Based Big Data Platform for Massive Remote Sensing Data Processing
ICDS 2015: Proceedings of the Second International Conference on Data Science - Volume 9208With the fast development of remote sensing techniques, the volume of acquired data grows exponentially. This brings a big challenge to process massive remote sensing data. In the paper, an in-memory computing framework is proposed to address this ...
Disease Surveillance System for Big Climate Data Processing and Dengue Transmission
Ambient intelligence is an emerging platform that provides advances in sensors and sensor networks, pervasive computing, and artificial intelligence to capture the real time climate data. This result continuously generates several exabytes of ...
Multilevel Data Processing Using Parallel Algorithms for Analyzing Big Data in High-Performance Computing
The growing gap between users and the Big Data analytics requires innovative tools that address the challenges faced by big data volume, variety, and velocity. Therefore, it becomes computationally inefficient to analyze such massive volume of data. ...
Comments
Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 20 June 2023
Accepted: 23 April 2023
Revision received: 16 July 2022
Received: 01 November 2021
Author Tags
Qualifiers
- Research-article
Funding Sources
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025