New Zealand

Igor Goncharenko, Mikhail Svinin, Shigeyuki Hosoe and Sven Forstmann (April 1st 2010). On the Influence of Hand Dynamics on Motion Planning of Reaching Movements in Haptic Environments, Advances in Haptics, Mehrdad Hosseini Zadeh, IntechOpen, DOI: 10.5772/8693. 

Petar Curkovic, Bojan Jerbic and Tomislav Stipancic (March 1st 2010). Comparison of Swarm Optimization and Genetic Algorithm for Mobile Robot Navigation, Swarm Robotics from Biology to Robotics, Ester Martinez Martin, IntechOpen, DOI: 10.5772/8601.

Seungyeol Lee and Jeon-Il Moon (September 13th 2017). Management of a Single-User Multi-Robot Teleoperated System for Maintenance in Offshore Plants, Multi-agent Systems, Jorge Rocha, IntechOpen, DOI: 10.5772/intechopen.69351.

Takanori Komatsu (February 1st 2010). Comparison an On-screen Agent with a Robotic Agent in an Everyday Interaction Style: How to Make Users React Toward an On-screen Agent as if They are Reacting Toward a Robotic Agent, Human-Robot Interaction, Daisuke Chugo, IntechOpen, DOI: 10.5772/8133. 

To transition from control theory to real applications, it is important to study missions such as Swarm Search and Service (SSS) where vehicles are not only required to search an area, but also service all jobs that they find. In SSS missions each type of job requires a group of vehicles to break-off from the swarm for a given amount of time to successfully service it. The required number of vehicles and the service rate are unique to each job type. Once a job has been completed the vehicles are able to return to the swarm for use elsewhere. If not enough vehicles are present in the swarm at the time that the job is identified, that job is dropped without being serviced. In SSS missions that occur in open environments, the arrival rate of jobs varies dynamically as vehicles move in and out of the swarm to service jobs. Human operators as tasked with effectively planning and managing these complex missions. This paper presents a user study that seeks to test the efficacy and ease-of-use of a prediction model known as the Hybrid Model as an aid in planning and monitoring tasks. Results show that the novel computational model aid allows operators to more effectively choose the necessary swarm size to handle expected mission workload, as well as, maintain sufficient situation awareness to evaluate the performance of the swarm during missions.


AAMAS 2020

Human-in-the-loop Planning and Monitoring of Swarm Search and Service Missions

multi-robot/agent interaction

human-robot/agent interaction

monitoring

swarm

planning

AAMAS is the leading scientific conference for research in autonomous agents and multi-agent systems. The AAMAS conference series was initiated in 2002 as the merging of three respected scientific meetings: the International Conference on Multi-Agent Systems (ICMAS), the International Workshop on Agent Theories, Architectures, and Languages (ATAL), and the International Conference on Autonomous Agents (AA). The aim of the joint conference is to provide a single, high-profile, internationally-respected archival forum for scientific research in the theory and practice of autonomous agents and multi-agent systems.

Browse keynotes, discussions, panels and over 300 presentations.


AAMAS is the leading scientific conference for research in autonomous agents and multi-agent systems. The AAMAS conference series was initiated in 2002 as the merging of three respected scientific meetings: the International Conference on Multi-Agent Systems (ICMAS), the International Workshop on Agent Theories, Architectures, and Languages (ATAL), and the International Conference on Autonomous Agents (AA). 

technical paper

Representing unknown and missing knowledge about the environment is fundamental to leverage robot behavior and improve its performance in completing a task. However, reconstructing spatial knowledge beyond the sensory horizon of the robot is an extremely
challenging task. Existing approaches assume that the environment static and features repetitive patterns (e.g. rectangular rooms) or that it can be all generalized with pre-trained models. Our goal is to remove such assumptions and to introduce a novel methodology that allows the robot to represent unknown spatial knowledge in dynamic and unstructured environments. To this end, we exploit generative learning to (1) learn a distribution of spatial landmarks observed during the robot mission and to (2) generate missing in- formation in real-time. The proposed approach aims at supporting planning and decision-making processes needed for robot behaviors. In this paper, we describe architecture modeling the proposed approach and a first validation on a mobile platform.

GUESs: Generative Modeling of Unknown Environments and Spatial Abstraction for robots

In participatory budgeting, citizens can take part in the decision on which projects a city should spend money. Formally, the input is a set of items, each having a certain cost, while agents can express their preferences. The task is to choose a set of items respecting a given bound. Recently Talmon and Faliszewski introduced a framework for budgeting based on approval votes. This paper revisits the introduced methods axiomatically from an irresolute point of view, especially showing that two of the proposed methods coincide. The study is complemented by approximation results.


Irresolute Approval-based Budgeting

When an AI system interacts with multiple users, it frequently needs to make allocation decisions. For instance, a virtual agent decides whom to pay attention to in a group setting, or a factory robot selects a worker to deliver a part. Demonstrating fairness in decision making is essential for such systems to be broadly accepted. We introduce a Multi-Armed Bandit algorithm with fairness constraints, where fairness is defined as a minimum rate that a task or a resource is assigned to a user. The proposed algorithm uses contextual information about the users and the task and makes no assumptions on how the losses capturing the performance of different users are generated. We provide theoretical guarantees of performance and an online user study. We view this as an exciting step towards including fairness constraints in resource allocation decisions.


The Fair Contextual Multi-Armed Bandit

Reinforcement learning under partial observability poses two types of conceptually orthogonal learning challenges; learning a useful representation
of the observable past, and selecting actions based on that representation. While the latter is common to both fully and partially observable control
problems, the former is idiomatic to the partially observable case. Traditional reinforcement learning relies exclusively on the reward signal to train the
representation model, but rewards constitute a weak learning signal in partially observable settings. To help train richer representations, we discuss
and propose an auxiliary self-supervised learning task designed to help the primary reinforcement learning task. We further propose two training schemes
for training with auxiliary tasks, one inspired by the idea of promoting complementary representations. Empirical evaluations show that agents which
exploit auxiliary tasks and complementary representations learn better policies, and converge faster, compared to agents which use common reactive and
recurrent representations trained on the rewards alone.

Learning Complementary Representations of the Past using Auxiliary Tasks in Partially Observable Reinforcement Learning

We consider solving a cooperative multi-robot object manipulation task using reinforcement learning (RL). We propose two distributed multi-agent RL approaches: distributed approximate RL (DA-RL), where each agent applies Q-learning with individual reward functions; and game-theoretic RL (GT-RL), where the agents update their Q-values based on the Nash equilibrium of a bimatrix Q-value game. We validate the proposed approaches in the setting of cooperative object manipulation with two simulated robot arms. Although we focus on a small system of two agents in this paper, both DA-RL and GT-RL apply to general multi-agent systems, and are expected to scale well to large systems.

Distributed Reinforcement Learning for Cooperative Multi-Robot Object Manipulation

Auction mechanism generally requires a trusted-third party as the market mediator to coordinate bidding and resource allocation via collecting private data from the agents, which may arouse severe privacy concerns and high computation overheads. To address such issues, we propose a novel privacy-aware double auction framework (namely PANDA) by designing an efficient cryptographic protocol to privately execute double auction for divisible resources among all the agents. To ensure privacy and truthfulness, PANDA delicately co-designs VCG auction and cryptographic protocol, which is equivalent to a mediator for sealed-bid auction of divisible resources. 


PANDA: Privacy-Aware Double Auction for Divisible Resources without a Mediator

Autonomous driving promises to transform road transport. Multi-vehicle and multi-lane scenarios, however, present unique challenges due to constrained navigation and unpredictable vehicle interactions. Learning-based methods—such as deep reinforcement learning—are emerging as a promising approach to automatically design intelligent driving policies that can cope with these challenges. Yet, the process of safely learning multi-vehicle driving behaviours is hard: while collisions—and their near-avoidance—are essential to the learning process, directly executing immature policies on autonomous vehicles raises considerable safety concerns. In this article, we present a safe and efficient framework that enables the learning of driving policies for autonomous vehicles operating in a shared workspace, where the absence of collisions cannot be guaranteed. Key to our learning procedure is a sim2real approach that uses real-world online policy adaptation in a mixed reality setup, where other vehicles and static obstacles exist in the virtual domain. This allows us to perform safe learning by simulating (and learning from) collisions between the learning agent(s) and other objects in virtual reality. Our results demonstrate that, after only a few runs in mixed reality, collisions are significantly reduced.


Mixed Reality Reinforcement Learning For Autonomous Multi-Lane Driving

An Agent-Based Model for Trajectory Modelling in Shared Spaces: A Combination of Expert Based and Deep Learning Approaches

Online social networks lack support for the collaborative management of access control. This is crucial for content that may involve multiple users such as photos, as this lack of support causes conflicts that lead to privacy violations. Previous research proposed collaborative mechanisms to support users in these cases, but most of these attempts fail to satisfy some desirable requirements, such as explainability, role-agnosticism, adaptability, and being utility- and value-driven at the same time. In this paper, we outline an agent architecture that has been designed to meet all these requirements.


Towards a Value-driven Explainable Agent for Collective Privacy

The booming sharing economy has a common challenge in motivating agents, by truthful actions, to follow the economic design of the market maker. For the well known BitTorrent network, there has been an array of theoretical research in the study of the truthfulness of the proportional response protocol formulated to model its tit-for-tat strategy. Some works confirm the truthfulness for deviations against the false name attack, weight cheating, and edge deleting. Others reveal it not truthful against Sybil attack where an agent may split its resource among its different copies. Though truthfulness cannot be guaranteed, the incentives are shown to generate a limited gain for agents pursuing such an attack in several special networks, such as trees, cliques, and cycles. In this work, we establish the first such results for general networks, proving a \theta(1) incentive ratio for any agent playing such an attack.


Downloads

Next from AAMAS 2020

GUESs: Generative Modeling of Unknown Environments and Spatial Abstraction for robots

Similar lecture

Optimal Swarm Strategy for Dynamic Target Search and Tracking

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAMAS 2020

GUESs: Generative Modeling of Unknown Environments and Spatial Abstraction for robots

Similar lecture

Optimal Swarm Strategy for Dynamic Target Search and Tracking

Downloads