skip to main content
research-article

Urban sound classification using neural networks on embedded FPGAs

Published: 01 March 2024 Publication History

Abstract

Sound classification using neural networks has recently produced very accurate results. A large number of different applications use this type of sound classifiers such as controlling and monitoring the type of activity in a city or identifying different types of animals in natural environments. While traditional acoustic processing applications have been developed on high-performance computing platforms equipped with expensive multi-channel audio interfaces, the Internet of Things (IoT) paradigm requires the use of more flexible and energy-efficient systems. Although software-based platforms exist for implementing general-purpose neural networks, they are not optimized for sound classification, wasting energy and computational resources. In this work, we have used FPGAs to develop an ad hoc system where only the hardware needed for our application is synthesized, resulting in faster and more energy-efficient circuits. The results show that our developments are accelerated by a factor of 35 compared to a software-based implementation on a Raspberry Pi.

References

[1]
Sultana F, Sufian A, Dutta P (2018) Advancements in image classification using convolutional neural network. In: 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), pp 122–129.
[2]
Rawat W and Wang Z Deep convolutional neural networks for image classification: a comprehensive review Neural Comput 2017 29 9 2352-2449
[3]
Sharma N, Jain V, and Mishra A An analysis of convolutional neural networks for image classification Procedia Comput Sci 2018 132 377-384
[4]
Richardson F, Reynolds D, and Dehak N Deep neural network approaches to speaker and language recognition IEEE Signal Process Lett 2015 22 1-1
[5]
Ali H, Tran S, Benetos E, and Garcez A Speaker recognition with hybrid features from a deep belief network Neural Comput Appl 2018
[6]
Dieleman S, Brakel P, Schrauwen B (2011) Audio-based music classification with a pretrained convolutional network, pp 669–674
[7]
Ghosal D, Kolekar M (2018) Music genre recognition using deep neural networks and transfer learning, pp 2087–2091.
[8]
Piczak KJ (2015) Environmental sound classification with convolutional neural networks. In: 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP), pp 1–6.
[9]
Su Y, Zhang K, Wang J, and Madani K Environment sound classification using a two-stream CNN based on decision-level fusion Sensors 2019 19 1733
[10]
Vandendriessche J, Wouters N, da Silva B, Lamrini M, Chkouri MY, and Touhafi A Environmental sound recognition on embedded systems: from fpgas to tpus Electronics 2021 10 21 2622
[11]
Ultra96-V2 Single Board Computer Hardware User’s Guide. https://www.96boards.org/documentation/consumer/ultra96/ultra96-v2/hardware-docs/. Accessed 25 Oct 2022
[13]
PYNQ - Python productivity for Zynq. http://www.pynq.io/. Accessed 25 Oct 2022
[15]
DPUCZDX8G for Zynq UltraScale+MPSoCs Product Guide (PG338). https://docs.xilinx.com/r/en-US/pg338-dpu. Accessed 25 Oct 2022
[16]
Nagel M. Baalen MV, Blankevoort T, Welling M (2019) Data-free quantization through weight equalization and bias correction. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)
[17]
Salamon J, Jacoby C, Bello JP (2014) A dataset and taxonomy for urban sound research. In: 22nd ACM International Conference on Multimedia (ACM-MM’14), Orlando, FL, USA, pp 1041–1044

Recommendations

Comments

Information & Contributors

Information

Published In

cover image The Journal of Supercomputing
The Journal of Supercomputing  Volume 80, Issue 9
Jun 2024
1653 pages

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 March 2024
Accepted: 28 January 2024

Author Tags

  1. FPGA
  2. Sound classification
  3. Hardware acceleration
  4. Convolutional neural networks
  5. Deep learning

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 29 Jan 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media