Svetlana Kordumova received ACM Multimedia Retrieval best paper award

13 June 2016

Svetlana Kordumova, PhD from the Informatics Institute (IvI), received the Best Paper Award at the ACM International Conference on Multimedia Retrieval 2016. The prize is received for the paper entitled ‘Pooling Objects for Recognizing Scenes without Examples. Co-authors are Thomas Mensink and Cees Snoek.

Digital images are everywhere. Hence, making sense of image data offers a wealth of opportunities for science, for professionals, and for businesses. The scientific challenge is to understand what happens in image content automatically. Different from the common approach in the image retrieval literature, which learns to recognize what happens in an image from large amounts of carefully labeled image examples, the paper by Kordumova proposes to recognise where an image is situated, its scene, without the need for any example to learn from.

Representation

The key innovation is to represent an image in terms of classification scores for objects, such as ‘ball’, ‘basket’, and ‘bed’, to a maximum of 15,000 objects. Then a mapping is learned between the name of a scene, such as ‘beach’, ‘supermarket’ or ‘youth hostel’, and all object categories from an online corpus of text snippets. Four strategies are proposed to automatically select objects for recognising scenes, leading to a new image search engine that can also answer complex text queries like ‘finding beaches with a human on the left’ or a ‘harbor with a flag on the right’.

ACM Multimedia Retrieval

The ACM International Conference on Multimedia Retrieval is the premier scientific conference for multimedia retrieval worldwide. Its mission is to illuminate the state of the art in multimedia retrieval by bringing together researchers and practitioners in the field of multimedia retrieval. The conference includes sessions for presenting high-quality research papers and for sharing practitioner experience.

Best paper

The 2016 edition received 230 submissions. After peer-review 66 were selected for the conference programme and four were nominated for the best paper award. Svetlana Kordumova delivered the winning presentation during the conference in New York City and received a plaque and a prize worth 1,000 Dollar.

Scenes-from-objects-Svetalana-Kordumova

Scenes from objects.

Published by  Faculty of Science