United States

We present a speaker-aware robotic system which recognizes users by voice in realistic, noisy conditions, highlighting the potential of speaker identification to enrich industrial and social HRI. We approach this as a CNN-based audio classification task, with the particular aim of producing fast, reliable, and explainable predictions. Our method is evaluated on a challenging 6-speaker dataset collected &quot;in the wild&quot; and showcased in a manufacturing scenario, where a collaborative robot personalizes its responses and prevents non-authorized users from executing commands.

IEEE RO-MAN 2021

Why Talk to People When You Can Talk to Robots? Far-Field Speaker Identification in the Wild

robots

audio classification

speaker recognition

machine learning

dialogue system

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications

* To connect machine learning researchers with experts in military requirements

* To build and strengthen collaborations within the defense research community

**Watch this video to hear about the AFCEA purpose.**

<iframe width=1280 height=706 frameborder="0" scrolling="no" src="https://screencast-o-matic.com/player/creleVVcvRh?v=6&ff=1&title=0&controls=1" allowfullscreen="true"></iframe>

NAML 2021

We present a speaker-aware robotic system which recognizes users by voice in realistic, noisy conditions, highlighting the potential of speaker identification to enrich industrial and social HRI. We approach this as a CNN-based audio classification task, with the particular aim of producing fast, reliable, and explainable predictions. Our method is evaluated on a challenging 6-speaker dataset collected "in the wild" and showcased in a manufacturing scenario, where a collaborative robot personalizes its responses and prevents non-authorized users from executing commands.

panel

RO-MAN 2021's theme is trustworthiness and cooperation. We chose this term well before the pandemic put the world on edge and added a new reason for us to question our own personal safety when in the company of others. But what about in the company of social robots? What would cause us to trust, or not trust, them? How do we as researchers create that feeling, that critical component of any relationship? With social robots, it is of course largely in our power to design the physical form, the control code and the interface software to maximize trustworthiness, facilitate cooperation and enhance the quality of human-robot interaction. This theme also touches upon people's expectations and perceptions of robots, as well as other social, cognitive and cultural factors that will influence human-robot interactions. We will have a special session/track on this topic, invite targeted submissions and include plenary speakers who are specialist in this area. We sincerely hope that this focus will help enlighten the design-thinking of all of us as we fabricate and program our own various systems.

To access RO-MAN Virtual 2021, [please register here.](https://ro-man2021.org/registration/)

RO-MAN 2021's theme is trustworthiness and cooperation. We chose this term well before the pandemic put the world on edge and added a new reason for us to question our own personal safety when in the company of others. But what about in the company of social robots? What would cause us to trust, or not trust, them? How do we as researchers create that feeling, that critical component of any relationship? With social robots, it is of course largely in our power to design the physical form, the control code and the interface software to maximize trustworthiness, facilitate cooperation and enhance the quality of human-robot interaction. 

This paper presents a haptic shared control paradigm that modulates the level of robotic guidance, based on predictions of human motion intentions. The proposed method incorporates robot trajectories learned from human demonstrations and dynamically adjusts the level of robotic assistance based on how closely the detected intentions match these trajectories. An experimental study is conducted to demonstrate the paradigm on a teleoperated pick-and-place task using a Franka Emika Panda robot arm, controlled via a 3D Systems Touch X haptic interface. In the experiment, the human operator teleoperates a remote robot arm while observing the environment on a 2D screen. While the human teleoperates the robot arm, the objects are tracked, and the human’s motion intentions (e.g., which object will be picked or which bin will be approached) are predicted using a Deep Q-Network (DQN). The predictions are made considering the current robot state and baseline robot trajectories that are learned from human demonstrations using Probabilistic Movement Primitives (ProMPs). The detected intentions are then used to condition the ProMP trajectories to modulate the movement and accommodate changing object configurations. Consequently, the system generates adaptive force guidance as weighted virtual fixtures that are rendered on the haptic device. The outcomes of the user study, conducted with 12 participants, indicate that the proposed paradigm can successfully guide users to robust grasping configurations and brings better performance by reducing the number of grasp attempts and improving trajectory smoothness and length.

Explainable Temperament Estimation of Toddlers by a Childcare Robot

A novel interaction concept and according to inverse kinematic solvers based on a local elliptic approximation are proposed, which allows commanding a WAM holding grasp with one click on a point cloud. It is shown how the local elliptic model is used for formulating a very fast analytic multi-contact inverse kinematic solver. Experiments show the efﬁciency of the analytic method and the robustness of the local elliptic model relative to perceptual perturbations.

Commanding a Whole-Arm Manipulation Grasp Configuration with One Click: Interaction Concept and Analytic IK Method

Currently, there is a lack of study on culture with respect to non-humanoid, multi-robot interactions. In this paper, we explore how cultural differences may impact users’ preferences and perceived usefulness of a multi-robot organizer system by using an interactive online survey. Evaluated across 191 young adults, we find significant differences between participants from India and China or the USA, but not between China and the USA. Our findings reinforce the importance of considering cultural differences in designing domestic multi-robotic assistants.

Towards Infant Kick Quality Detection to Support Physical Therapy and Early Detection of Cerebral Palsy: A Pilot Study

Guaranteeing people's engagement during an interaction is very important to elicit positive and effective emotions in public service scenarios. A robot should be able to detect its interlocutor's level and mode of engagement to accordingly modulate its behaviours. 
However, there is not a generally accepted model to annotate and classify engagement during an interaction. In this work, we consider engagement as a multidimensional construct with three relevant dimensions: affective, cognitive and behavioural. To be automatically evaluated by a robot, such a complex construct requires the selection of the proper interaction features among a large set of possibilities. Moreover, manually collecting and annotating large datasets of real interactions are extremely time-consuming and costly. In this study, we collected the recordings of human-robot interactions in a bartending scenario, and we compared different feature selection and regression models to find the features that characterise a user's engagement in the interaction, and the model that can efficiently detect them. Results showed that the characterisation of each dimension separately in terms of features and regression obtains better results with respect to a model that directly combines the three dimensions.

Affective, Cognitive and Behavioural Engagement Detection for Human-Robot Interaction in a Bartending Scenario

This study used an experimental design to investigate the relationship between human-based leadership styles and robotic leadership. It is anticipated that social robots can have the capability to serve as leaders for human teams and to collaborate with humans in order to improve the organizational requirements of the workplace environment. We report an experiment conducted in order to determine which human leadership styles would be associated with better results in the organizational phenomena.

Deployment of a Social Robot into a Classroom of Remote Teaching by Elderly People to School Children: a Case Report

Exploration of user interface widgets for use in collaborative robotics, drawing motivation from robot attention demand. The work focuses on developing an understanding of robot attention demand in the cobot manufacturing space. The work evaluates the developed interface widgets with a formative user study.

Affective Touch Robots with Changing Textures and Movements

Due to the increased isolation during the pandemic, we investigated how the use of social companion robots has been affected in care homes for older adults during this time. The results show that there has been little time to use robots and that the monotonous lifestyle has decreased the need of companion robots.

Pandemic Effects on Social Companion Robot Use in Care Homes

We describe a method of teaching a robot its empathic behavioural response from its interaction with people. Firsst, we bootstrap the training through a pre-learning mechanism in which training is conducted by users who know the robotic system. Then we developed an online learning scheme for naive users to personalize their robot further. Our interface enables natural human-robot interaction via the suite of sensors that allows the users to provide evaluative feedback during the interaction with the robot.

Robot player adaptation to human opponents in physical, competitive robogames

Socially assistive robots (SARs) are currently 
being developed to assist in the delivery of Applied Behavior 
Analysis (ABA) therapies to individuals diagnosed with Autism 
Spectrum Disorder (ASD). Although SARs have demonstrated 
positive outcomes, minimal research has focused on
investigating needs of the therapists that deliver treatments. 
Therapist perspectives are important as they will likely be the 
primary end-users of SARs. In this study, we investigated the 
perceptions and design requirements of ABA therapists towards 
SARs and the interfaces used to operate them. Therapists were 
interviewed after they independently designed, developed, and 
implemented their own robot-mediated interventions. Overall, 
therapists’ general perceptions towards integrating a SAR 
within their existing workflow was positive and they expected 
that children would benefit from ABA therapies delivered by a 
SAR. The therapists also provided insights on design 
requirements for utilizing SARs and their interfaces as well as 
potential clinical and future use cases for this technology

Designing Proactive Objects with Artificial Eyes Based on Perceptual Crossing Paradigm

This work presents insights on deploying an affordable Socially Assistive Robots (SARs) at actual elder care facilites for symptoms and exposure screening of COVID-19. The study considered not only the older adults, but also caregivers and clinicians, and their preferences towards the robot and the interaction. A survey evaluated participants' preference on the screening agent, positive and negative aspecs of the interaction and their reactions by an observer.

Premium content

Why Talk to People When You Can Talk to Robots? Far-Field Speaker Identification in the Wild

Downloads

Next from IEEE RO-MAN 2021

Explainable Temperament Estimation of Toddlers by a Childcare Robot

Similar lecture

Machine Learning Provides SeaVision with Maritime Behavior Recognition