skip to main content
10.1145/3638550.3641129acmconferencesArticle/Chapter ViewAbstractPublication PageshotmobileConference Proceedingsconference-collections
research-article
Open access

SSS: Towards Autonomous Drone Delivery to Your Door Over House-Aware Semantics

Published: 28 February 2024 Publication History

Abstract

In this work, we present our attempt to tackle the last-hundred-feet problem for autonomous drone delivery. We take a computer-vision-based approach to progressively landing towards a convenient and safe drop-off point at all times (here, at the front/garage door). Specifically, we develop structural semantic segmentation (SSS), a new technique that leverages a single-family house structure to streamline and enhance semantic segmentation in the drop-to-door problem context. We implement SSS into an Android app; Our preliminary evaluation in a residential zone shows SSS is promising to make autonomous drop-to-door in real-time, with no need to wait for slow visual processing. Video demo is available at Youtube [5]. App is released at Github [6].

References

[1]
2020. 2020 Indiana Residential Code (675 IAC 14-4.4). https://www.in.gov/dhs/files/675-IAC-14-4.4-Indiana-Residential-Code-Proposed-Draft-Rule-LSA-Formatted.pdf. (2020).
[2]
2022. Multiclass Semantic Segmentation of Drone Images Using DL. https://github.com/ayushdabra/drone-images-semantic-segmentation. (2022).
[3]
2022. Semantic Drone Dataset. http://dronedataset.icg.tugraz.at/. (2022).
[4]
2022. U.S. single family homes - statistics & facts. https://www.statista.com/topics/5144/single-family-homes-in-the-us/#topicOverview/. (2022).
[5]
2024. Demo for Autonomous Drone Delivery to Your Door. https://www.youtube.com/playlist?list=PLLzN69of2f9bD5ZfPYhDpkAv-Pz2zI7Ac. (2024).
[6]
2024. Release for DroneDelivery (HotMobile'24). https://github.com/mssn/dd-demo. (2024).
[7]
Fabio Borghetti, Claudia Caballini, Angela Carboni, Gaia Grossato, Roberto Maja, and Benedetto Barabino. 2022. The Use of Drones for Last-Mile Delivery: A Numerical Case Study in Milan, Italy. Sustainability 14, 3 (2022).
[8]
Nils Boysen, Dirk Briskorn, Stefan Fedtke, and Stefan Schwerdfeger. 2018. Drone Delivery from Trucks: Drone Scheduling for Given Truck Routes. Networks 72, 4 (2018), 506--527.
[9]
Gino Brunner, Bence Szebedy, Simon Tanner, and Roger Wattenhofer. 2019. The urban last mile problem: Autonomous drone delivery to your balcony. In 2019 international conference on unmanned aircraft systems (icuas). IEEE, 1005--1012.
[10]
McKinsey & Company. 2023. Global drone logistics market in 2023. https://www.globalialogisticsnetwork.com/blog/2023/05/03/global-drone-logistics-market-in-2023/. (May 2023).
[11]
Harsimret Singh Dhami, Dmitry Ignatyev, and Antonios Tsourdos. 2022. Semantic Segmentation based Mapping systems for the Safe and Precise Landing of Flying Vehicles. IFAC-PapersOnLine 55, 22 (2022), 310--315.
[12]
Lijun Ding and Ardeshir Goshtasby. 2001. On the Canny edge detector. Pattern recognition 34, 3 (2001), 721--725.
[13]
DJI. 2022. Mobile SDK. https://developer.dji.com/mobile-sdk/. (2022).
[14]
Eitan Frachtenberg. 2019. Practical drone delivery. Computer 52, 12 (2019), 53--57.
[15]
Google. 2022. Google Colaboratory. https://colab.google/. (2022).
[16]
Junpeng Guo and Chunyi Peng. 2021. Towards live video analytics with on-drone deeper-yet-compatible compression. arXiv preprint arXiv:2111.06263 (2021).
[17]
John Illingworth and Josef Kittler. 1988. A survey of the Hough transform. Computer vision, graphics, and image processing 44, 1 (1988), 87--116.
[18]
Efstratios Kakaletsis, Charalampos Symeonidis, Maria Tzelepi, Ioannis Mademlis, Anastasios Tefas, Nikos Nikolaidis, and Ioannis Pitas. 2021. Computer Vision for Autonomous UAV Flight Safety: An Overview and a Vision-based Safe Landing Pipeline Example. ACM Computing Surveys (CSUR) 54, 9 (2021), 1--37.
[19]
Shyam Sundar Kannan and Byung-Cheol Min. 2022. Autonomous Drone Delivery to Your Door and Yard. In 2022 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE, 452--461.
[20]
Joe Kinahan and Alan F Smeaton. 2021. Image Segmentation to Identify Safe Landing Zones for Unmanned Aerial Vehicles. arXiv:2111.14557 (2021).
[21]
Jonathan Long, Evan Shelhamer, and Trevor Darrell. 2015. Fully Convolutional Networks for Semantic Segmentation. In CVPR.
[22]
Victor RF Miranda and et al. 2022. Autonomous navigation system for a delivery drone. J. Control. Autom. Electr. Syst 33, 1 (2022), 141--155.
[23]
Ecommerce Next. 2023. Top 10 Drone Delivery Companies. https://www.ecommercenext.org/top-10-commercial-drone-delivery-companies/. (Jan 2023).
[24]
Market Research. 2022. Drone Package Delivery Market: Global Forecast to 2030. https://www.marketsandmarkets.com/Market-Reports/drone-package-delivery-market-10580366.html. (July 2022).
[25]
Market Research. 2023. Drone Package Delivery Global Market Report 2023. https://www.researchandmarkets.com/reports/5769463/drone-package-delivery-global-market-report. (April 2023).
[26]
Erich Schubert, Jörg Sander, Martin Ester, Hans Peter Kriegel, and Xiaowei Xu. 2017. DBSCAN revisited, revisited: why and how you should (still) use DBSCAN. ACM Transactions on Database Systems (TODS) 42, 3 (2017), 1--21.
[27]
Judy Scott and Carlton Scott. 2017. Drone delivery models for healthcare. In Proceedings of the 50th Hawaii International Conference on System Sciences.
[28]
Richard Szeliski. 2022. Computer vision: algorithms and applications. Springer Nature.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HOTMOBILE '24: Proceedings of the 25th International Workshop on Mobile Computing Systems and Applications
February 2024
167 pages
ISBN:9798400704970
DOI:10.1145/3638550
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 February 2024

Check for updates

Author Tags

  1. drone delivery
  2. semantic segmentation
  3. structural semantic segmentation (SSS)

Qualifiers

  • Research-article

Funding Sources

  • National Sanitation Foundation

Conference

HOTMOBILE '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 96 of 345 submissions, 28%

Upcoming Conference

HOTMOBILE '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 275
    Total Downloads
  • Downloads (Last 12 months)275
  • Downloads (Last 6 weeks)33
Reflects downloads up to 27 Dec 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media