Extracting RoIs for Robust Far-infrared Pedestrian Detection on Board
Pages 131 - 136
Abstract
Far-infrared pedestrian detection onboard is more challenging compared to pedestrian detection of visible light. Existing works proved that the output of RoIs extraction, named as the proposal, is significantly related to recall rate and computational cost for pedestrian detection. However, it is non-trivial for RoIs extraction due to low resolution, blurred details, and pedestrian morphological features in far-infrared scenes. The paper proposes a novel RoIs extraction framework for far-infrared pedestrian detection on Board, named FIR-RoIEF, by using edge to obtain pedestrian contour feature and cascade filtering to gain valuable RoIs. Given pedestrian morphological features, we further present a vertical edge strategy to enhance pedestrian vertical features. A T-shaped template and RoIs reordering are used in the bounding box evaluation process to output pure and high-quality RoIs. Under basic and standard metrics, we perform experiments on public datasets, SCUT and KAIST, which both contain large far-infrared pedestrian objects. As for the result, given 100, 400, 1000 proposals, we both achieve the best recall in 1000 proposals, 94%, and 87% respectively. By the way, it can be proved that our method keeps a good balance between computational cost and good real-time.
References
[1]
Borhade, S.; Shah, M.; Jadhav, P.; Rajurkar, D.; Bhor, A. Advanced driver assistance system. In Proceedings of the 2012 Sixth International Conference on Sensing Technology (ICST), 2012; pp. 718-722.
[2]
Liu, Q.; Zhuang, J.; Ma, J. Robust and fast pedestrian detection method for far-infrared automotive driving assistance systems. Infrared Physics & Technology 2013, 60, 288-299.
[3]
Geronimo, D.; Lopez, A.M.; Sappa, A.D.; Graf, T. Survey of pedestrian detection for advanced driver assistance systems. IEEE transactions on pattern analysis and machine intelligence 2009, 32, 1239-1258.
[4]
Gerónimo, D.; López, A.M. Vision-based pedestrian protection systems for intelligent vehicles; Springer: 2014.
[5]
Dai, J.; Li, Y.; He, K.; Sun, J. R-fcn: Object detection via region-based fully convolutional networks. In Proceedings of the Advances in neural information processing systems, 2016; pp. 379-387.
[6]
Girshick, R. Fast r-CNN. In Proceedings of the Proceedings of the IEEE international conference on computer vision, 2015; pp. 1440-1448.
[7]
Redmon, J.; Farhadi, A. YOLO9000: better, faster, stronger. In Proceedings of the Proceedings of the IEEE conference on computer vision and pattern recognition, 2017; pp. 7263-7271.
[8]
Dollar, P.; Wojek, C.; Schiele, B.; Perona, P. Pedestrian detection: An evaluation of the state of the art. IEEE transactions on pattern analysis and machine intelligence 2011, 34, 743-761.
[9]
Miron, A.; Rogozan, A.; Ainouz, S.; Bensrhair, A.; Broggi, A. An evaluation of the pedestrian classification in a multi-domain multi-modality setup. Sensors 2015, 15, 13851-13873.
[10]
Dalal, N.; Triggs, B. Histograms of oriented gradients for human detection. In Proceedings of the 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05), 2005; pp. 886-893.
[11]
Ge, J.; Luo, Y.; Tei, G. Real-time pedestrian detection and tracking at nighttime for driver-assistance systems. IEEE Transactions on Intelligent Transportation Systems 2009, 10, 283-298.
[12]
Shi, X.-B.; Liu, X.-N.; Liu, F. Dual-threshold Segmentation Method for Infrared Pedestrian [J]. Computer Engineering 2012, 12.
[13]
Wang, G.-H. Research on key techniques of far-infrared pedestrian detection based on the onboard monocular camera. South China University of Technology, Guangzhou, 2016.
[14]
Zitnick, C.L.; Dollár, P. Edge boxes: Locating object proposals from edges. In Proceedings of the European conference on computer vision, 2014; pp. 391-405.
[15]
Ren, S.; He, K.; Girshick, R.; Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems 2015, 28, 91-99.
[16]
South China University of Technology Computer Vision Lab. SCUT FIR Pedestrian Dataset. 2018.
[17]
Hwang, S.; Park, J.; Kim, N.; Choi, Y.; So Kweon, I. Multispectral pedestrian detection: Benchmark dataset and baseline. In Proceedings of the Proceedings of the IEEE conference on computer vision and pattern recognition, 2015; pp. 1037-1045.
[18]
Gerónimo, D.; Sappa, A.D.; López, A.; Ponsa, D. Adaptive image sampling and windows classification for on-board pedestrian detection. In Proceedings of the International Conference on Computer Vision Systems: Proceedings (2007), 2007.
[19]
Mittal, A.; Paragios, N. Motion-based background subtraction using adaptive kernel density estimation. In Proceedings of the Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., 2004; pp. II-II.
[20]
Liu, X.; Fujimura, K. Pedestrian detection using stereo night vision. IEEE Transactions on Vehicular Technology 2004, 53, 1657-1665.
[21]
Xu, F.; Liu, X.; Fujimura, K. Pedestrian detection and tracking with night vision. IEEE Transactions on Intelligent Transportation Systems 2005, 6, 63-71.
[22]
Jiang, Y.; Tan Z.; Yu, Z.; Research on Infrared Image Threshold Segmentation Algorithm. Infrared Image 2008, 29, 33-35.
[23]
Tian, Q.; Sun, H.; Luo, Y.; Hu, D. Nighttime pedestrian detection with a normal camera using SVM classifier. In Proceedings of the International Symposium on Neural Networks, 2005; pp. 189-194.
[24]
Sezgin, M.; Sankur, B. Survey over image thresholding techniques and quantitative performance evaluation. Journal of Electronic imaging 2004, 13, 146-165.
[25]
Gerónimo, D.; López, A.M. Vision-based pedestrian protection systems for intelligent vehicles; Springer: 2014.
[26]
Uijlings, J.R.; Van De Sande, K.E.; Gevers, T.; Smeulders, A.W. Selective search for object recognition. International journal of computer vision 2013, 104, 154-171.
[27]
Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the Proceedings of the IEEE conference on computer vision and pattern recognition, 2014; pp. 580-587.
[28]
Sun, H.; Wang, C.; Wang, B.; El-Sheimy, N. Pyramid binary pattern features for real-time pedestrian detection from infrared videos. Neurocomputing 2011, 74, 797-804.
[29]
Bertozzi, M.; Broggi, A.; Fascioli, A.; Tibaldi, A.; Chapuis, R.; Chausse, F. Pedestrian localization and tracking system with Kalman filtering. In Proceedings of the IEEE Intelligent Vehicles Symposium, 2004, 2004; pp. 584-589.
[30]
Cheng, M.-M.; Zhang, Z.; Lin, W.-Y.; Torr, P. BING: Binarized normed gradients for objectness estimation at 300fps. In Proceedings of the Proceedings of the IEEE conference on computer vision and pattern recognition, 2014; pp. 3286-3293.
[31]
Eitz, M.; Hays, J.; Alexa, M. How do humans sketch objects? ACM Transactions on graphics (TOG) 2012, 31, 1-10.
[32]
Zhang, L.; Lin, L.; Liang, X.; He, K. Is faster R-CNN doing well for pedestrian detection? In Proceedings of the European conference on computer vision, 2016; pp. 443-457.
[33]
He, K.; Gkioxari, G.; Dollár, P.; Girshick, R. Mask r-cnn. In Proceedings of the Proceedings of the IEEE international conference on computer vision, 2017; pp. 2961-2969.
[34]
Dollár, P.; Zitnick, C.L. Structured forests for fast edge detection. In Proceedings of the Proceedings of the IEEE international conference on computer vision, 2013; pp. 1841-1848.
[35]
Dollár, P.; Zitnick, C.L. Fast edge detection using structured forests. IEEE transactions on pattern analysis and machine intelligence 2014, 37, 1558-1570.
Recommendations
Real-time pedestrian detection via hierarchical convolutional feature
With the development of pedestrian detection technologies, existing methods can not simultaneously satisfy high quality detection and fast calculation for practical applications. Therefore, the goal of our research is to balance of pedestrian detection ...
G2P: a new descriptor for pedestrian detection
AbstractPedestrian detection plays an important role in many applications. Since its birth 13 years ago, Histogram Of Gradient (HOG) descriptor has become a popular descriptor for pedestrian detection. Besides its original instantiation, the HOG also ...
Robust pedestrian detection in thermal infrared imagery using a shape distribution histogram feature and modified sparse representation classification
In this paper, a robust approach using a shape distribution histogram (SDH) feature and modified sparse representation classification (MSRC) for pedestrian detection in thermal infrared imagery is proposed. In this framework, the candidate regions that ...
Comments
Information & Contributors
Information
Published In
March 2022
240 pages
ISBN:9781450395502
DOI:10.1145/3529466
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 04 June 2022
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICIAI 2022
ICIAI 2022: 2022 the 6th International Conference on Innovation in Artificial Intelligence
March 4 - 6, 2022
Guangzhou, China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 24Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format