Adel Al-Jumaily and Mohamed Al-Jaafreh (December 1st 2006). Multi-Agent System Concepts Theory and Application Phases, Mobile Robotics, Moving Intelligence, Jonas Buchli, IntechOpen, DOI: 10.5772/4730. 

Miklos Nagy and Maria Vargas-Vera (January 1st 2010). Towards an Automatic Semantic Data Integration: Multi-agent Framework Approach, Semantic Web, Gang Wu, IntechOpen, DOI: 10.5772/7310. 

Kunikazu Kobayashi, Koji Nakano, Takashi Kuremoto and Masanao Obayashi (February 1st 2010). Objective-based Reinforcement Learning System for Cooperative Behavior Acquisition, Application of Machine Learning, Yagang Zhang, IntechOpen, DOI: 10.5772/8615. 

New Zealand

The challenge of developing powerful and general Reinforcement Learning (RL) agents has received increasing attention in recent years. Much of this effort has focused on the single-agent setting, in which an agent maximizes a predefined extrinsic reward function. However, a long-term question inevitably arises: how will such independent agents cooperate when they are continually learning and acting in a shared multi-agent environment? Observing that humans often provide incentives to influence others&#39; behavior, we propose to equip each RL agent in a multi-agent environment with the ability to give rewards directly to other agents, via a learned incentive function. Each agent learns the incentive function by considering how the given incentives affect its own extrinsic objective, through the learning of agents who receive incentives. We demonstrate in experiments that such agents significantly outperform policy gradient agents and opponent-shaping agents in a small yet challenging general-sum Markov game. Our work points toward a more general research program of endowing agents with expanded capabilities for incentivizing others to ensure the common good in a multi-agent future.

AAMAS 2020

Learning to Incentivize Other Learning Agents

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-23 is the Thirty-Seventh AAAI Conference on Artificial Intelligence. The theme of this conference is to create collaborative bridges within and beyond AI. Like previous AAAI conferences, AAAI-23 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and two new activities: a Bridge Program and a Lab Program. Many of these activities are tailored to the theme of bridges and all are selected according to the highest standards, with additional programs for students and young researchers. 
AAAI is providing you with a conference planner, which you can use to help organize your itinerary of activities. This includes talks to attend in person, talks to attend remotely, breaks with colleagues and your site seeing activities. To access this conference planner, please go to [https://aaai-2023.takemobi.io](https://aaai-2023.takemobi.io).

In order to access this site, you need to register. If you haven't already, please register [here](https://aaai.org/Conferences/AAAI-23/registration/).


AAAI 2023

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines.

The challenge of developing powerful and general Reinforcement Learning (RL) agents has received increasing attention in recent years. Much of this effort has focused on the single-agent setting, in which an agent maximizes a predefined extrinsic reward function. However, a long-term question inevitably arises: how will such independent agents cooperate when they are continually learning and acting in a shared multi-agent environment? Observing that humans often provide incentives to influence others' behavior, we propose to equip each RL agent in a multi-agent environment with the ability to give rewards directly to other agents, via a learned incentive function. Each agent learns the incentive function by considering how the given incentives affect its own extrinsic objective, through the learning of agents who receive incentives. We demonstrate in experiments that such agents significantly outperform policy gradient agents and opponent-shaping agents in a small yet challenging general-sum Markov game. Our work points toward a more general research program of endowing agents with expanded capabilities for incentivizing others to ensure the common good in a multi-agent future.

technical paper

AAMAS is the leading scientific conference for research in autonomous agents and multi-agent systems. The AAMAS conference series was initiated in 2002 as the merging of three respected scientific meetings: the International Conference on Multi-Agent Systems (ICMAS), the International Workshop on Agent Theories, Architectures, and Languages (ATAL), and the International Conference on Autonomous Agents (AA). The aim of the joint conference is to provide a single, high-profile, internationally-respected archival forum for scientific research in the theory and practice of autonomous agents and multi-agent systems.

Browse keynotes, discussions, panels and over 300 presentations.


AAMAS is the leading scientific conference for research in autonomous agents and multi-agent systems. The AAMAS conference series was initiated in 2002 as the merging of three respected scientific meetings: the International Conference on Multi-Agent Systems (ICMAS), the International Workshop on Agent Theories, Architectures, and Languages (ATAL), and the International Conference on Autonomous Agents (AA). 

This paper proposes an approach that aims to automatically visualize large-scale text-based online discussions. The ultimate goal is to develop an automatic visualization tool which helps to understand the content of large-scale text-based online discussions. To support this au- tomatic visualization tool, an effective discussion visualization approach is needed. Toward this end, we propose a discussion visualization method using D3.js which is a JavaScript libraly. The proposed method employs issue-based information system (IBIS), as a suitable format for struc- turing online discussions. By visualizing based on the IBIS discussion structure, it becomes possible to enhance the intuitive understanding of the contents of discussions and to find the active threads intuitively. In particular, this paper aims to support the understanding of specific topics that users are interested in. In order to evaluate the proposed approach, a set of experiments has been conducted on the data collected from the discussions in the online discussion support system called D-Agree. The experimental results demonstrate that the proposed approach is effective for supporting the understanding of discussion contents.

An Automated Tool for Visualizing Large-Scale Online Discussions

Exploiting Simulation For Mass Programming and Engineering - The JaCaMo-SIM Platform

Learning Correlation Functions on Mixed Data Sequences for Computer Architecture Applications

Personal Agents (PAs) have longly been explored as assistants to support users in their daily activities. Surprisingly, few works refer to the adoption of PAs in the healthcare domain, where they can assist physicians’ activities reducing medical errors. Although literature proposes different approaches for modelling and engineering PAs, none of them discusses how they can be integrated with cognitive services in order to empower their reasoning capabilities. In this paper we present an integration model, specifically devised for healthcare applications, that enhances Belief-Desire-Intention agents rea- soning with advanced cognitive capabilities. As a case study, we adopt this integrated model in the critical care path of trauma resuscitation, stepping forward to the vision of Smart Hospitals.

Complementing Agents with Cognitive Services: a case study in Healthcare

The collection of large-scale people opinions through discussion support system is an emerging approach for SDGs cooperation that aims to solve wicked problems in the 21st century by facilitating the discussion and making collective decision. Previous research centered on gathering large-scale people opinions considering a stable society like Japan. Here, we focus on usage and application of crowd discussion support system into fragile and conflict-affected city like Kabul, Afghanistan. Our paper is especially focused on the international experiment transfer of “D-Agree” usage and application for town meeting and city issues in five selected district of Kabul city, being presented with an opportunity of experimental transfer by Industry-Academia-Government collaboration. Our action research is based on the soft system methodology utilizing online crowd discussion system in which people can discuss their municipal district issues online. The content includes the background, process and formalization of the collaboration and reports on the outline of the societal experiment of D-Agree with public citizens officials at KM and private citizen in selected 5 districts of Kabul city. The final objective of our study is to evaluate facilitation of citizens discussion to district issues and evaluate AI-based facilitation of our system.

Usage & application of AI-based facilitation discussion support system for city issues and town meeting: Kabul experimental view

One of the fundamental challenges of governance is deciding when and how to intervene in multi-agent systems in order to impact group-wide metrics of success. This is particularly challenging when proposed interventions are novel and expensive. For example, one may wish to modify a building’s layout to improve the efficiency of its escape route. Evaluating such interventions would generally require access to an elaborate simulator, which must be constructed ad-hoc for each environment, and can be prohibitively costly or inaccurate. Here we examine a simple alternative: Optimize By Observational Extrapolation (OBOE). The idea is to use observed behavioural trajectories, without any interventions, to learn predictive models mapping environment states to individual agent outcomes, and then use these to evaluate and select changes. We evaluate OBOE in socially complex gridworld environments and consider novel physical interventions that our models were not trained on. We show that neural network models trained to predict agent returns on baseline environments are effective at selecting among the interventions. Thus, OBOE can provide guidance for challenging questions like: “which wall should I tear down in order to minimize the Gini index of this group?”

Should I tear down this wall? Optimizing social metrics by evaluating novel actions

Automatic Classification of Freely-Offered Opinions

Explain how to extract discussion structure which is not abstract

Extracting Discussion Structures for Automated Facilitation Agents

Researchers have long been interested in the role that norms can play in governing agent actions in multi-agent systems. Much work has been done on formalising normative concepts from human society and adapting them for the government of open software systems, and on the simulation of normative processes in human and artificial societies. However, there has been comparatively little work on applying normative MAS mechanisms to understanding the norms in human society. This work investigates this issue in the context of international politics. Using the GDELT dataset, containing machine-encoded records of international events extracted from news reports, we extracted bilateral sequences of inter-country events and applied a Bayesian norm mining mechanism to identify norms that best explained the observed behaviour. A statistical evaluation showed that the normative model fitted the data significantly better than a probabilistic discrete event model.

Mining International Political Norms from the GDELT Database

This paper proposes an approach that aims to extract online discussions structure and to reduce the extraction model size simultaneously. The ultimate goal is the development of an automated facilitation agent that automatically facilitates online discussions. In large-scale online discussions, it becomes necessary to have a facilitator. However, facilitates large-scale online discussions with hundreds or thousands of participants is an intricate problem, and in dynamic discussions, it be- comes impossible for human facilitators to keep an eye on the flow of discussions. As a result, we propose the development of an automated facilitator agent that automatically facilitates online discussions. In order for the automated facilitation agent to function properly, it needs to dynamically extract the structure of online discussions. Towards this end, we use Bidirectional Encoder Representative from Transformers(BERT) and deep neural networks for extracting the structure of online discus- sions. In order to evaluate the proposed approach, we use a dataset based on extracting different posts from a large-scale online discussion system called D-Agree. The experimental results show that the proposed approach is efficient for extracting the structure of online discussions where the link extraction model size is much smaller than the existing methods.

Learning to Incentivize Other Learning Agents

Downloads

Next from AAMAS 2020

An Automated Tool for Visualizing Large-Scale Online Discussions

Similar lecture

A Tale of Two Latent Flows: Learning Latent Space Normalizing Flow with Short-run Langevin Flow for Approximate Inference

Learning to Incentivize Other Learning Agents

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AAMAS 2020

An Automated Tool for Visualizing Large-Scale Online Discussions

Similar lecture

A Tale of Two Latent Flows: Learning Latent Space Normalizing Flow with Short-run Langevin Flow for Approximate Inference

Downloads