abstract

Dynamic gesture vocabulary design for intuitive human-robot dialog

Authors:

Saša Bodiroža,

Helman I. Stern,

Yael EdanAuthors Info & Claims

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

Pages 111 - 112

https://doi.org/10.1145/2157689.2157710

Published: 05 March 2012 Publication History

Get Access

Abstract

This paper presents a generalized method for the design of a gesture vocabulary (GV) for intuitive and natural two-way human-robot dialog. Two GV design methodologies are proposed; one for a robot GV (RGV) and a second for a human GV (HGV). The design is based on motion gestures exerted from a cohort of subjects in response to a set of tasks needed to execute several robot waiter (RW)-customer dialogs. Using a RW setting as a case study, preliminary experimental results indicate the unique nature of the HGV obtained.

References

[1]

V. V. Hafner, M. Lohse, J. Meyer, Y. Nagai, and B. Wrede, eds., Proc. HRI Workshop on Expectations in Intuitive Human-Robot Interaction. 2011.

Digital Library

Google Scholar

[2]

I. Poggi, "From a typology of gestures to a procedure for gesture production," in Gesture and Sign Language in Human-Comput. Interaction (I. Wachsmuth and T. Sowa, eds.), vol. 2298 of Lecture Notes in Comput. Sci., pp. 158--168, 2002.

Digital Library

Google Scholar

[3]

H. Narahara and T. Maeno, "Factors of gestures of robots for smooth communication with humans," in Proc of Int. Conf. on Robot Communication and Coordination, pp. 44:1--44:4, 2007.

Digital Library

Google Scholar

[4]

M. Bennewitz, F. Faber, D. Joho, and S. Behnke, "Intuitive multimodal interaction with communication robot Fritz," in Humanoid Robots, Human-like Machines (M. Hackel, ed.), pp. 613--624, I-Tech Education and Publishing, Jun. 2007.

Google Scholar

[5]

H. Stern, J. Wachs, and Y. Edan, "Human factors for design of hand gesture human - machine interaction," in IEEE Int. Conf. on Syst., Man and Cybern., vol. 5, pp. 4052--4056, Oct. 2006.

Google Scholar

Cited By

View all

Garcia-Haro JOña EHernandez-Vicen JMartinez SBalaguer C(2020)Service Robots in Catering Applications: A Review and Future ChallengesElectronics10.3390/electronics1001004710:1(47)Online publication date: 30-Dec-2020
https://doi.org/10.3390/electronics10010047
Makris SMakris S(2020)Allocation of Manufacturing Tasks to Humans and RobotsCooperating Robots for Flexible Manufacturing10.1007/978-3-030-51591-1_20(373-380)Online publication date: 1-Oct-2020
https://doi.org/10.1007/978-3-030-51591-1_20
Makris SMakris S(2020)Virtual Reality for Programming Cooperating Robots Based on Human Motion MimickingCooperating Robots for Flexible Manufacturing10.1007/978-3-030-51591-1_18(339-353)Online publication date: 1-Oct-2020
https://doi.org/10.1007/978-3-030-51591-1_18
Show More Cited By

Index Terms

Dynamic gesture vocabulary design for intuitive human-robot dialog
1. Applied computing
  1. Operations research
    1. Industry and manufacturing
      1. Command and control

Recommendations

Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

In this paper, we describe a project that explores a novel experimental setup towards building a spoken, multi-modally rich, and human-like multiparty tutoring robot. A human-robot interaction setup is designed, and a human-human dialogue corpus is ...
Human-Robot Interaction Through Gesture-Free Spoken Dialogue

We present an approach to human-robot interaction through gesture-free spoken dialogue. Our approach is based on passive knowledge rarefication through goal disambiguation, a technique that allows a human operator to collaborate with a mobile robot on ...
Miscommunication Detection and Recovery in Situated Human–Robot Dialogue

Even without speech recognition errors, robots may face difficulties interpreting natural-language instructions. We present a method for robustly handling miscommunication between people and robots in task-oriented spoken dialogue. This capability is ...

Comments

Information & Contributors

Information

Published In

HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction

March 2012

518 pages

ISBN:9781450310635

DOI:10.1145/2157689

General Chairs:
Holly Yanco
University of Massachusetts Lowell, USA
,
Aaron Steinfeld
Carnegie Mellon University, USA
,
Program Chairs:
Vanessa Evers
University of Amsterdam, The Netherlands
,
Odest Chadwicke Jenkins
Brown University, USA

In-Cooperation

IEEE-RAS: Robotics and Automation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Abstract

Conference

HRI'12

Sponsor:

HRI'12: International Conference on Human-Robot Interaction

March 5 - 8, 2012

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
315
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Garcia-Haro JOña EHernandez-Vicen JMartinez SBalaguer C(2020)Service Robots in Catering Applications: A Review and Future ChallengesElectronics10.3390/electronics1001004710:1(47)Online publication date: 30-Dec-2020
https://doi.org/10.3390/electronics10010047
Makris SMakris S(2020)Allocation of Manufacturing Tasks to Humans and RobotsCooperating Robots for Flexible Manufacturing10.1007/978-3-030-51591-1_20(373-380)Online publication date: 1-Oct-2020
https://doi.org/10.1007/978-3-030-51591-1_20
Makris SMakris S(2020)Virtual Reality for Programming Cooperating Robots Based on Human Motion MimickingCooperating Robots for Flexible Manufacturing10.1007/978-3-030-51591-1_18(339-353)Online publication date: 1-Oct-2020
https://doi.org/10.1007/978-3-030-51591-1_18
Makris SMakris S(2020)Gesture-Based Interaction of Humans with Dual Arm RobotCooperating Robots for Flexible Manufacturing10.1007/978-3-030-51591-1_16(309-319)Online publication date: 1-Oct-2020
https://doi.org/10.1007/978-3-030-51591-1_16
Melidis CMarocco D(2019)Effective Behavioural Dynamic Coupling through Echo State NetworksApplied Sciences10.3390/app90713009:7(1300)Online publication date: 28-Mar-2019
https://doi.org/10.3390/app9071300
Haratiannejadi KFard NSelmic R(2019)Smart Glove and Hand Gesture-based Control Interface For Multi-rotor Aerial Vehicles2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)10.1109/SMC.2019.8914464(1956-1962)Online publication date: Oct-2019
https://doi.org/10.1109/SMC.2019.8914464
Tsarouchi PMakris SChryssolouris G(2018)Human–robot interaction review and challenges on task planning and programmingInternational Journal of Computer Integrated Manufacturing10.1080/0951192X.2015.113025129:8(916-931)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1080/0951192X.2015.1130251
Melidis CIizuka HMarocco D(2017)Intuitive control of mobile robots: an architecture for autonomous adaptive dynamic behaviour integrationCognitive Processing10.1007/s10339-017-0818-519:2(245-264)Online publication date: 5-Jun-2017
https://doi.org/10.1007/s10339-017-0818-5
Obaid MKistler FHäring MBühling RAndré E(2014)A Framework for User-Defined Body Gestures to Control a Humanoid RobotInternational Journal of Social Robotics10.1007/s12369-014-0233-36:3(383-396)Online publication date: 4-Apr-2014
https://doi.org/10.1007/s12369-014-0233-3
Bodiroža SDoisy GHafner VKuzuoka HEvers VImai MForlizzi J(2013)Position-invariant, real-time gesture recognition based on dynamic time warpingProceedings of the 8th ACM/IEEE international conference on Human-robot interaction10.5555/2447556.2447580(87-88)Online publication date: 3-Mar-2013
https://dl.acm.org/doi/10.5555/2447556.2447580
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Human-robot collaborative tutoring using multiparty multimodal spoken dialogue

Human-Robot Interaction Through Gesture-Free Spoken Dialogue

Miscommunication Detection and Recovery in Situated Human–Robot Dialogue