Mexico

SOVIA, an interactive system that endows Claude Monet’s art with responsive auditory experiences. SOVIA uses computer vision trained on Monet’s artwork to take the user ``into the painting.&#39;&#39; When the user interacts with a digital version of Monet&#39;s landscapes, their mouse positions are mapped to sounds that artistically represent the objects that the user is currently exploring in the art. These interactive musical journeys have the potential to make classical art more captivating for modern audiences.

ICCC&#39;21

SOVIA: Sonification of Visual Interactive Art

**WELCOME TO THE 2021 CAP VIRTUAL CONGRESS UNDERLINE PLATFORM**

The CAP staff and our organizing and program committees are pleased to welcome you to our 2021 Congress filled with plenary talks, technical sessions/talks, student presentations and competition sessions, workshops, and several symposia offered by the CAP divisions and its partners.  

You will also have opportunities to network with other delegates through the Gathertown platform accessed by selecting the lounge or posters button on the left.

Registered delegates should use the schedule button to call up the details of the session/event they wish to attend.  Each sessions includes a link to access the online platform where the event is taking place, either within Underline or through other Congress-related Zoom meetings.  

Invited speaker talks are identified with an (I), and student competitors include a (G*) or (U*) to identify graduate or undergraduate presenters.

Please take the time to check out the information about our sponsors and exhibitors, request further information, or leave a note of thanks for their support.

General information about the Congress can be found on the CAP website Congress pages at https://www.cap.ca/congress/2021.

Looking for a specific talk?   A full searchable list is available on our Indico Congress site at https://indico.cern.ch/event/985448/contributions/

We look forward to sharing this exciting week with you!


CAP Virtual Congress 2021

SOVIA, an interactive system that endows Claude Monet’s art with responsive auditory experiences. SOVIA uses computer vision trained on Monet’s artwork to take the user ``into the painting.'' When the user interacts with a digital version of Monet's landscapes, their mouse positions are mapped to sounds that artistically represent the objects that the user is currently exploring in the art. These interactive musical journeys have the potential to make classical art more captivating for modern audiences.

demo

### **Welcome to the Twelfth International Conference on Computational Creativity, ICCC’21!**

<iframe width=1280 height=720 style="border:0;" scrolling="no" src="https://screencast-o-matic.com/player/crQbitV66dw?width=1280&height=720&ff=1&title=0" allowfullscreen="true"></iframe>

Computational creativity is an interdisciplinary endeavor that is located at the intersection of the fields of artificial intelligence, cognitive psychology, philosophy, social sciences and the arts. The goal of computational creativity is to model, simulate or replicate creativity using a computer, to achieve one of several ends:

* to construct a program or computer capable of showing some level of creativity
* to better understand human creativity and to formulate an algorithmic perspective on creative behavior in humans
* to design programs that can enhance human creativity without necessarily being creative themselves

<br>The ICCC conference series organized by the [**Association for Computational Creativity**](https://computationalcreativity.net/) since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.



To access the Twelfth International Conference on Computational Creativity, ICCC’21, you need to register for the conference.  Instructions on how to access the event will be provided directly to attendees and included on the Twelfth International Conference on Computational Creativity, ICCC’21 conference website. 

[Register now](https://computationalcreativity.net/iccc21/registration/)

Register now

ICCC'21

Welcome to the Twelfth International Conference on Computational Creativity, ICCC’21!

We describe recent work on the Aris system that creates and verifies new formal specifications for pre-existing source code. We describe Aris in terms of the abductive reasoning system that suggest possible specifications and then uses an existing deductive verifier to evaluate these creations. This paper focuses on the abduction system that creates new formal specifications by leveraging a small set of inspiring artefacts to augment a subset of candidate problems. This employs knowledge graphs to represent the raw data (i.e., source code), discovering latent similarities between graphs using a graph-matching process. Results are presented for the C# programming language with novel creations and its sister language called Code Contracts. We outline ampliative creativity, whereby newly created artefacts drive subsequent creative episodes beyond the initially perceived limitations. We also outline some recent work towards transferring specifications between the C# and Java programming languages.

Creating new Program Proofs by Combining Abductive and Deductive Reasoning

In this short paper, we reflect on the long quest for intelligence and creativity of computing machinery as well as the suitability for prevailing machine learning techniques to be used in creative tasks. We believe that modularization and multi-layered structures are among essential ingredients constituting creative minds and may greatly benefit machines on handling creative tasks. For proof of concept, we select musical composition, particularly, Species Counterpoint, as the task, adopt a recently proposed computational framework designed for investigating creativity and the creative process, and present an implementation capable of producing the outcomes that exhibit the desired effect.

In the Name of Creativity: En Route to Inspiring Machines

In this technical demonstration paper we document the use of a Generative Adversarial Network (GAN) based casual creator game for systematic assessment of human creativity. We discuss some of the challenges in designing GAN-based casual creators, specifically focusing on how to identify and select appropriate parts of the latent vector space - images, in our case.

CREA.blender: a casual creator for creativity assessment

We present a proof-of-concept prototype aimed at providing a subjectivity touch to the production of creative artifacts. The underlying idea is to have a system in which the development of the artifact occurs concurrently with the dynamic formation of a personal identity, thus enriching the overall perception of creativity.

Dynamic Creation of Points of View

This work presents CoPE, a dance education framework for AI systems with three key components: Composition, Performance, and Evaluation. By analyzing nowadays dance education, we suggest how to incorporate principles from the dance community into AI-based dance generation systems by aiming for more realistic pieces of art.

Composition, Performance and Evaluation: A Dance Education Framework for AI Systems

In recent years computer simulations have proven to be useful in the study of the origin and evolution of com- munication. In this paper, we present a system that is able to evolve image-based communication protocols to transmit information. We trained an encoder and a de- coder in an architecture similar to a model of commu- nication where the generator transforms a message into an image and the decoder tries to reconstruct the origi- nal message. This way the two networks are stimulated to work together to establish some type of communica- tion. We used the GloVe word to vector dataset to generate images for concepts and took advantage of its linear properties to generate new concepts. We analyse the results by comparing images of similar concepts and demonstrated that our system is capable of creating sim- ilar images for related concepts, distancing itself from different concepts.

Towards a Visual Language Using Neural Networks

We present a Computational Creativity system based on Conceptual Blending theory. To obtain diverse output -- in the form of blend spaces -- it allows a trade-off in the optimisation process according to multiple criteria. It is handled by a high performance Multiple Objective Evolutionary Algorithm supporting a large Knowledge Base, large input spaces, a high number of mappings as well of frames, all in the range of millions of elements in their structures. Some of CB's Optimality Principles were adapted into objectives as well as new ideas we decided to investigate. Initial experiments allows us to conclude that the system exhibits a form of creativity and its output is capable of depict a simple drawing or a short story.

A Heavy Duty Computational Model of Conceptual Blending Using Multiple Objective Optimisation

Wölfflin Affective Generative Analysis (WAGA) as an approach to understand and analyze the progress of machine-generated artworks in contrast to real art and their connection to our human artistic heritage, and how they extend the shape of art history. Specifically, we studied the machine-generated art after integrating creativity losses in the state-of-the-art generative models e.g., StyleGAN v1 and v2. We denote these models as Style Creative Adversarial Networks v1 and v2; in short, StyleCAN v1 and v2. We contrasted the learned representation between real and generated artworks through correlation analysis between constructed emotion (collected through Amazon MTurk) and Heinrich Wölfflin (1846-1945)'s principles of art history. Analogous to the recent ArtEmis dataset, we collected constructed emotions and explanations on generated art instead of real art to study the contrast. To enable Wölfflin Affective Generative Analysis, we collected 45,000 annotations on 1800 artworks; 1000 real and 800 generated. Our analysis shows a correlation exists between the Wölfflin principles and the emotions.

Wölfflin's Affective Generative Analysis of Artworks

MuSyFI is a system that tries to model an inspirational computational creative process. It uses images as source of inspiration and begins by implementing a possible translation between visual and musical features. Three different musical artifacts are generated: an automatic version, a co-created version, and a genetic version. The automatic version maps features from the image into musical features nondeterministically; the co-created version adds harmony lines manually composed by us to the automatic version; finally, the genetic version applies a genetic algorithm to a mixed population of automatic and co-created artifacts. In this Demo, we present the three different versions for four of the six evaluated images in our surveys

SOVIA: Sonification of Visual Interactive Art

Downloads

Next from ICCC'21

SOVIA: Sonification of Visual Interactive Art

Similar lecture

Development and Implementation of a Machine Learning Algorithm for Pulse Shape Discrimination

SOVIA: Sonification of Visual Interactive Art

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from ICCC'21

SOVIA: Sonification of Visual Interactive Art

Similar lecture

Development and Implementation of a Machine Learning Algorithm for Pulse Shape Discrimination

Downloads