CHORUS workshop on Affect, Appeal, and Sentiment as Factors Influencing Interaction with Multimedia Information

2009, May 28, Brussels

Av Beaulieu 33, Room 0/54

hosted by the European Commission,
organised by the CHORUS Coordination action

 
 
 

This workshop will address style, sentiment, and emotional impact of data content in access and use of above all moving image data. The intention is to provide an overview for a field which has yet to take its first steps, draw up an bibliography of relevant literature, and to provide a meeting point for those interested in the formation of a new avenue of research. A potential goal for the workshop is to jointly contribute to a published paper to establish the starting points and to draw up a gap analysis for future experiments, research tasks, and development projects.

Some types of data are inherently more topical than others. For factual narrative and topical argumentative texts and text-like materials, the field of information retrieval provides a framework for organisation, systematic categorisation, search, and retrieval of items or sets of items. There are established use cases, success metrics, and evaluation benchmarks of various kinds, which all hinge on the target notion of relevance.

The framework does not carry over well to the study of non-topical information access. Extending information retrieval to other media for topical retrieval is conceptually, if not always practically, straight-forward, but moving retrieval to cater for other facets of usefulness, pertinence or acceptability is not as obvious as it first might seem.

Topics for discussion at the workshop

Challenges to address are

  • Practice and practical tools.
  • Use cases and scenarios of application.
  • Representation - features and models of affect, appeal and emotion in humans and in analysis of multi-media objects and in user-contributed annotation.
  • The intended generation and provocation of affectual responses in the viewer, in art and commercial practice.
  • Social and legal issues including business models and issues related to integrity and privacy of users.

Since there is relatively little done in this area, this workshop is not intended to become a project parade, but rather to start a discussion on what challenges there lie before us to set the scene for future efforts and to make an inventory of what tools, technologies, and theories there are in the field; to formulate a research plan for the field, and to invite practicioners from the consumer media industries to interact with researchers in the information retrieval field.

Goals

The workshop goal is to provide a first sketch of a paper with a bibliography to establish starting points for the field.

We will bring together a small group of researchers, practicioners, and artists to make an inventory of the current state of the art and to project likely paths of development in the near future with respect to understanding the role, the representation, and potential application of affect, appeal and sentiment in systems for information access and information provision. This is intended to not only include digital libraries and prototypical data repositories, but also artwork and installations, entertainment systems and personal data management.

 

Participants

Loretta Anania, European Commission, Brussels
Robert Bre?evi?, Interactive Institute, Stockholm
Marc Cavazza, Teesside University, Middlesborough
Lynda Hardman, Centrum Wiskunde & Informatica (CWI), Amsterdam
Steffi Heidecker, Folkwang Academy, Essen
Gareth Jones, Dublin City University
Joemon Jose, University of Glasgow
Noriko Kando, National Institute of Informatics (NII), Tokyo
Jussi Karlgren, Swedish Institute of Computer Science (SICS), Stockholm
Joep Kierkels, University of Geneva
Paul King, Informatics and Telematics Institute, Thessaloniki
Jarmo Laaksolahti, Swedish Institute of Computer Science (SICS), Stockholm
Martha Larson, Delft University of Technology (TU Delft)
Stefanie Nowak, Fraunhofer Institute for Digital Media Technology, Ilmenau
Roeland Ordelman, Netherlands Institute for Sound & Vision and University of Twente
Thierry Pun, University of Geneva
Nicu Sebe, University of Trento

Presentations

Jussi Karlgren: Models for application in computation, Starting points

Gareth Jones: Affect-based indexing and retrieval for multimedia data
Thierry Pun and Joep Kierkels: Affective computing for multimodal interaction
Noriko Kando: Towards describing and capturing the sentiment in and about media
Martha Larson and Roeland Ordelman: Appeal and the archive
Stephanie Nowak: Which photo is appealing? Classifying aesthetics and emotions in media items
Marc Cavazza: Affective interfaces for interactive media

Robert Bre?evi?: Viewer affect in interactive art