Netherlands

User engagement plays a central role in companies and organisations that aimed to personalise their online services. A main challenge is to leverage knowledge about the online interaction of users to understand what engages them. A common way that engagement is measured and understood is through the definition and development of metrics of user satisfaction, which can act as a proxy of user engagement. This talk will present various works and personal thoughts on how to measure user engagement. It will discuss the definition and development of metrics of user satisfaction that can be used as a proxy of user engagement. An important message is that, for personalisation to work both in the short and the long-term, it is important to consider the heterogeneity of both user and content to formalise the notion of engagement, and in turn design the appropriate metrics to capture these and optimize for. One way to achieve this is to follow these four steps: 1) Understanding intents; 2) Optimizing for the right metric; 3) Acting on segmentation; and 4) Thinking about diversity. The talk will illustrate these steps with some of the research at Spotify.

HCOMP 2020

Engagement, Metrics and personalisation at Scale

The 8th AAAI Conference on Human Computation and Crowdsourcing (HCOMP 2020) will be held October 26–28th virtually at The Netherlands Institute for Sound and Vision in Hilversum, The Netherlands.

While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers, but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice.

This year, we especially invite works that will generate new insights into the quality (or qualities) of human-annotated datasets, including elements such as reliability and replicability of human computation and crowdsourcing experiments, novel metrics for aggregation of results, and holistic approaches to deal with bias, fairness and interpretability.

HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. 


keynote

Workshop 1: Data Excellence (DEW 2020)

Is this significant?

Amplified Intelligence: Uniting Human and Machine Intelligence in Cultural Heritage Workflows

Visipedia: Combining People, Data and Machines to distill and share Knowledge

Socio-Technical Aspects 

Human Computation Applications

Methods and Platforms

Blue Sky Session

technical paper

https://d3smihljt9218e.cloudfront.net/transcript/4277/subtitle/dd018b3d986037505e79250b1b8168e6.vtt

English (automatic)

Downloads

Next from HCOMP 2020

Workshop 1: Data Excellence (DEW 2020)

Similar lecture

Assessing Political Bias using Crowdsourced Pairwise Comparisons

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from HCOMP 2020

Workshop 1: Data Excellence (DEW 2020)

Similar lecture

Assessing Political Bias using Crowdsourced Pairwise Comparisons

Downloads