Svetlana Kordumova receives ACM Multimedia Retrieval best paper award

13 June 2016

Svetlana Kordumova from the Informatics Institute (IvI) received the Best Paper Award at the 2016 edition of the ACM International Conference on Multimedia Retrieval. The prize is received for the paper entitled 'Pooling Objects for Recognizing Scenes without Examples' (co-authored by Thomas Mensink and Cees Snoek).

Recognizing a scene by its objects

Digital images are everywhere. Hence, making sense of image data offers a wealth of opportunities for science, for professionals, and for businesses. The scientific challenge is to understand what happens in image content automatically. Different from the common approach in the image retrieval literature, which learns to recognize what happens in an image from large amounts of carefully labeled image examples, the paper by Kordumova et al. propose to recognize where an image is situated, its scene, without the need for any example to learn from. The key innovation is to represent an image in terms of classification scores for objects, such as ‘ball’, ‘basket’, and ‘bed’, to a maximum of 15,000. Then a mapping is learned between the name of a scene (such as ‘beach’, ‘supermarket’ or ‘youth hostel’) and all object categories from an online corpus of text snippets. Four strategies are proposed to automatically select objects for recognizing scenes, leading to a new image search engine that can also answer complex text queries like ‘finding beaches with a human on the left’ or a ‘harbor with a flag on the right’.

ACM Multimedia Retrieval

The ACM International Conference on Multimedia Retrieval is the premier scientific conference for multimedia retrieval worldwide. Its mission is to illuminate the state of the art in multimedia retrieval by bringing together researchers and practitioners in the field of multimedia retrieval. The conference includes sessions for presenting high-quality research papers and for sharing practitioner experience. The 2016 edition received 230 submissions. After peer-review 66 were selected for the conference program and 4 were nominated for the best paper award. Svetlana Kordumova delivered the winning presentation during the conference in New York City and received a plaque and a prize worth 1,000 US Dollar. 

Published by  IVI