Portugal

&quot;We present a system for real-time lyrical improvisation between a human and a robot in the style of hip hop. Our system takes vocal input from a human rapper, analyzes the semantic meaning, and generates a response that is rapped back by a robot over a musical groove. Previous work with real-time interactive music systems has largely focused on instrumental output, and vocal interactions with robots have been explored, but not in a musical context. Our generative system includes custom methods for censorship, voice, rhythm, rhyming and a novel deep learning pipeline based on phoneme embeddings. The rap performances are accompanied by synchronized robotic gestures and mouth movements. Key technical challenges that were overcome in the system are developing rhymes, performing with low-latency and dataset censorship.
We evaluated several aspects of the system through a survey of videos and sample text output. Analysis of comments showed that the overall perception of the system was positive. The model trained on our hip hop dataset was rated significantly higher than our metal dataset in coherence, rhyme quality, and enjoyment. Participants preferred outputs generated by a given input phrase over outputs generated from unknown keywords, indicating that the system successfully relates its output to its input. &quot;

ICCC&#39;20

Shimon the Rapper: A Real-Time System for Human-Robot Interactive Rap Battles

hiphop

music

robotics

artificial intelligence

deep learning

Dear Delegates, 

On behalf of the organizing committee at UCF Rosen College of Hospitality Management and Elsevier, I have the greatest pleasure to welcome you to the **6th World Research Summit for Tourism and Hospitality: Resilience, Adaptability, and Innovation.** 

Though we cannot host you this year owing to Covid-19 at our beautiful resort-like campus in Orlando, Florida, we believe this virtual and live-streamed conference will provide an interactive, dynamic, and shared international platform for global academics and practitioners to discuss how to enhance research applications and knowledge management through resilience, adaptability, digital intelligence, innovation, and smart knowledge in bringing our industry and research back to normal. This summit particularly offers unique opportunities to unfold and embrace various repercussions of COVID-19 pandemic with various stakeholders, including academic researchers, industry professionals, and government officials, through dialogues on how to better utilize research outputs for the benefits of the industry, in a resilient, intelligent and innovative way. 

I hope you will agree that we have put together a wonderful program including keynote speeches, panel discussions, concurrent presentations, poster sessions, and best paper recognition and award ceremony. We hope you will take advantage of these activities and engage yourself with great learning and sharing opportunities during the two days of the Summit. Thank you for joining us and we look forward to our discussions! 

Sincerely, 
Dr. Youcheng Wang 
Dean and Preeminent Chair Professor

Please register with Elsevier to be able to enter the conference on Underline.io. If you have already registered, please login to Underline.io to be able to see full conference content. In case you do not have an Underline account, please create one. Thank you

Please login to your Underline account

TOUR 2021

This conference provides an interactive, dynamic, and shared international platform for global academics and practitioners to discuss how to enhance research applications and knowledge management through resilience, adaptability, digital intelligence, innovation, and smart knowledge in bringing our industry and research back to normal. This summit particularly offers unique opportunities to unfold and embrace various repercussions of COVID-19 pandemic with various stakeholders, including academic researchers, industry professionals, and government officials, through dialogues on how to better utilize research outputs for the benefits of the industry, in a resilient, intelligent and innovative way.

"We present a system for real-time lyrical improvisation between a human and a robot in the style of hip hop. Our system takes vocal input from a human rapper, analyzes the semantic meaning, and generates a response that is rapped back by a robot over a musical groove. Previous work with real-time interactive music systems has largely focused on instrumental output, and vocal interactions with robots have been explored, but not in a musical context. Our generative system includes custom methods for censorship, voice, rhythm, rhyming and a novel deep learning pipeline based on phoneme embeddings. The rap performances are accompanied by synchronized robotic gestures and mouth movements. Key technical challenges that were overcome in the system are developing rhymes, performing with low-latency and dataset censorship.
We evaluated several aspects of the system through a survey of videos and sample text output. Analysis of comments showed that the overall perception of the system was positive. The model trained on our hip hop dataset was rated significantly higher than our metal dataset in coherence, rhyme quality, and enjoyment. Participants preferred outputs generated by a given input phrase over outputs generated from unknown keywords, indicating that the system successfully relates its output to its input. "

technical paper

Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviours that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalising what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, the arts, literature, gaming and elsewhere.

The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.


ICCC'20

The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.
Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviors that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalizing what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, the arts, literature, gaming and elsewhere.



The field of bisociative literature-based discovery aims at exploring scientific literature to reveal new discoveries based on yet uncovered relations between knowledge from different, relatively isolated fields of specialization. This paper outlines selected outlier-based literature mining approaches, which focus on finding outlier documents as means for finding unexpected links crossing different contexts. Selected approaches to bridging term detection through outlier document exploration are briefly outlined, together with the lessons learned from recent applications in medical and biological literature-based knowledge discovery. Finally, the paper addresses new prospects in bisociative literature-based discovery, emphasizing the use of advanced embeddings technology for cross-domain literature mining.

Bisociative Literature-based Discovery: Lessons Learned and New Prospects

This papers revisits the receptive theory in context of computational creativity. It presents a case study of a Paranoid Transformer — a fully autonomous text generation engine with raw output that could be read as the narrative of a mad digital persona without any additional human post-filtering. We describe technical details of the generative system, provide examples of output and discuss the impact of receptive theory, chance discovery and simulation of fringe mental state on the understanding of computational creativity.

Paranoid Transformer: Reading Narrative of Madnessas Computational Approach to Creativity

The ability to extract features from objects or concepts and to connect them in a meaningful way is believed to be crucial to creativity. This paper proposes a novel computational model for creative behaviour, by learning extractions and connections separately. Such separation enables adaptive feature and object connections, which means one object can be connected to different other objects within different contexts. This paper applies recent cognitive theories of computational creativity to two specific tasks: an image-to-image mapping and music- to-video mapping. In both cases deep neural networks are used to automate these two creative cognition tasks.

Being Creative: A Domain Mapping Network

We present Lemotif, an integrated natural language processing and image generation system that uses machine learning to (1) parse a text-based input journal entry describing the user's day for salient themes and emotions and (2) visualize the detected themes and emotions in creative and appealing image motifs. Synthesizing approaches from artificial intelligence and psychology, Lemotif acts as an affective visual journal, encouraging users to regularly write and reflect on their daily experiences through visual reinforcement. By making patterns in emotions and their sources more apparent, Lemotif aims to help users better understand their emotional lives, identify opportunities for action, and track the effectiveness of behavioral changes over time. We verify via human studies that prospective users prefer motifs generated by Lemotif over corresponding baselines, find the motifs representative of their journal entries, and think they would be more likely to journal regularly using a Lemotif-based app.

Lemotif: An Affective Visual Journal Using Deep Neural Networks

"This work is on the transformation of text relying mostly on a common analogy vector operation, computed in a distributional model, i.e., static word embeddings.
Given a theme, original song lyrics have their words replaced by new ones, related to the new theme as the original words are to the original theme.
As this is not enough for producing good lyrics, towards more coherent and singable text, constraints are gradually applied to the replacements.
Human opinions confirmed that more balanced lyrics are obtained when there is a one-to-one mapping between original words and their replacement; only content words are replaced; and the replacement has the same part-of-speech and rhythm as the original word."

WeirdAnalogyAutomatic: Experimenting with Analogy for Lyrics Transformation

Generation and transformation of images and videos using artificial intelligence have flourished over the past few years. Yet, there are only a few works aiming to produce creative 3D shapes, such as sculptures. Here we show a novel 3D-to-3D topology transformation method using Generative Adversarial Networks (GAN). We use a modified pix2pix GAN, which we call Vox2Vox, to transform the volumetric style of a 3D object while retaining the original object shape. In particular, we show how to transform 3D models into two new volumetric topologies - the 3D Network and the Ghirigoro. We describe how to use our approach to construct customized 3D representations. We believe that the generated 3D shapes are novel and inspirational. Finally, we compare the results between our approach and a baseline algorithm that directly convert the 3D shapes, without using our GAN.

3D Topology Transformation with Generative Adversarial Networks

"Self-expression is essential to processing our thoughts and feelings and is central to successful mental health therapy. Art therapy provides a wider range of expressive mechanisms than offered through traditional approaches, allowing individuals to process their emotions when traditional therapies prove unsuccessful. Yet, effective expression through art therapy may call on a level of artistic experience that is not available to all.  As such, a lack of expertise or comfort with artistic expression may hinder one's ability to receive needed mental health support. 
 
Creative machines can offer novel therapeutic approaches by offloading the need for creative expertise and opening up creative self-expression to those who lack the corresponding experience. In this paper, we focus on bereavement, and explore a co-creative songwriting system, ALYSIA, as a new form of therapy for those who had recently suffered the loss of a loved one. We evaluate the utility of this creative system in aiding bereaved individuals through several case studies. In addition, we discuss the utility of co-creative systems to the therapeutic context with potential application to  a broad range of therapies."

Co-Creative Songwriting for Bereavement Support

We consider the advent of computational creativity systems that are potentially far superior to human creators, at least in some domains. To do so, we revisit the concepts of P- and H-creativity and propose a social refinement called group-relative creativity (G-creativity). Using this reconceptualization, we explore several critical questions regarding computational creativity’s effect on human creators.

What Happens When a Computer Joins the Group?

"The presentation describes an exploratory study involving humans and computational musical agents. In the study, the system's co-creative behavior
was varied by manipulating a single experimental parameter to engender different co-creative experiences in rhythm duets. In one experimental condition, the system induced a sense of producing divergent material, influencing creative outcomes, and negotiating musical outcomes, three aspects that were consistent with group music creativity. These preliminary findings provide supportive evidence that the system’s parameter can be varied to systematically engender co-creative experiences distinct from creative support."

Engendering co-creative experiences through parametric variation

“Hello” is an interactive cinematic generative artwork that gained traction within the Cultural Adventures research project, an international endeavor between Portugal and Thailand. The encompassing rationale assumed the need of a link connecting both countries, and thus “Hello” was born from the similarities that can be found in commuters that flock to and from both capital cities by train, often more engaged with their mobile phones than with their immediate surroundings – people, train or traversed landscapes –, which constitute more of a shapeless blurred audiovisual background than a sharp attention-grabbing focus. The artwork is also used as a demonstrator of the potential of generative art in producing complex cinematic narrative figurative artworks, yet permeated with interference, chaos and randomness, and how the audience perceives and makes sense of them through the ability to identify and create patterns, to conceptualize, to deal with information overload, and to imagine and build a narrative through abductive reasoning from incomplete yet suggestive information.

Shimon the Rapper: A Real-Time System for Human-Robot Interactive Rap Battles

Downloads

Next from ICCC'20

Bisociative Literature-based Discovery: Lessons Learned and New Prospects

Similar lecture

A critical review of artificial intelligence research in hospitality and tourism

Shimon the Rapper: A Real-Time System for Human-Robot Interactive Rap Battles

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from ICCC'20

Bisociative Literature-based Discovery: Lessons Learned and New Prospects

Similar lecture

A critical review of artificial intelligence research in hospitality and tourism

Downloads