Publications related to Multimedia information retrieval

From scattered sources to comprehensive technology landscape : A recommendation-based retrieval approach

Mapping the technology landscape is crucial for market actors to take informed investment decisions. However, given the large amount of data on the Web and its subsequent information overload, manually retrieving information is a seemingly ineffective and ...

ELSEVIER2023

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Karl Aberer, Rémi Philippe Lebret, Negar Foroutan Eghlidi

Vision-Language Pre-training (VLP) has advanced the performance of many visionlanguage tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in English. Previous w ...

Assoc Computational Linguistics-Acl2023

Knowledge-Aware Cross-Modal Text-Image Retrieval for Remote Sensing Images

Devis Tuia, Christel Marie Tartini-Chappuis, Li Mi, Siran Li

Image-based retrieval in large Earth observation archives is difficult, because one needs to navigate across thousands of candidate matches only with the proposition image as a guide. By using text as a query language, the retrieval system gains in usabili ...

2022

Graph Embedding for Retrieval

Chi Thang Duong

Information retrieval (IR) systems such as search engines are important for people to find what they need among the tremendous amount of data available in their organization or on the Internet. These IR systems enable users to search in a large data collec ...

EPFL2022

Semantics-Aware Spatial-Temporal Binaries for Cross-Modal Video Retrieval

Jie Luo, Mengshi Qi, Yiyu Wang

With the current exponential growth of video-based social networks, video retrieval using natural language is receiving ever-increasing attention. Most existing approaches tackle this task by extracting individual frame-level spatial features to represent ...

2021

QAIR: Practical Query-efficient Black-Box Attacks for Image Retrieval

Shaokai Ye, Yuan He, Hang Su, Jinfeng Li

We study the query-based attack against image retrieval to evaluate its robustness against adversarial examples under the black-box setting, where the adversary only has query access to the top-1 ranked unlabeled images from the database. Compared with que ...

IEEE COMPUTER SOC2021

Deep Feature Factorization For Content-Based Image Retrieval And Localization

Sabine Süsstrunk, Edo Collins

State of the art content-based image retrieval algorithms owe their excellent performance to the rich semantics encoded in the deep activations of a convolutional neural network. The difference between these algorithms lies mostly in how activations are co ...

IEEE2019

Creating a neuroprosthesis for active tactile exploration of textures

Solaiman Shokur, Miguel Nicolelis

Intracortical microstimulation (ICMS) of the primary somatosensory cortex (S1) can produce percepts that mimic somatic sensation and, thus, has potential as an approach to sensorize prosthetic limbs. However, it is not known whether ICMS could recreate act ...

National Academy of Sciences2019

Texture-driven parametric snakes for semi-automatic image segmentation

Michaël Unser, Adrien Raphaël Depeursinge, Anaïs Laure Marie-Thérèse Badoual

We present a texture-driven parametric snake for semi-automatic segmentation of a single and closed structure in an image. We propose a new energy functional that combines intensity and texture information. The two types of image information are balanced u ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2019

SUBDIVIDE AND CONQUER Active Contours and Surfaces for Biomedical Image Segmentation

Anaïs Laure Marie-Thérèse Badoual

Ongoing advances in imaging techniques create new demands regarding the analysis of images in medicine and biology. Image segmentation is a key step of many image analysis pipelines and its proper execution is a particularly challenging task. This thesis i ...

EPFL2019

A Versatile Method for Ice Particle Habit Classification Using Airborne Imaging Probe Data

Alexis Berne, Christophe Praz

A versatile method to automatically classify ice particle habit from various airborne optical array probes is presented. The classification is achieved using a multinomial logistic regression model. For each airborne probe, the model determines the particl ...

AMER GEOPHYSICAL UNION2018

Point cloud subjective evaluation methodology based on reconstructed surfaces

Touradj Ebrahimi, Evangelos Alexiou

Point clouds have been gaining importance as a solution to the problem of efficient representation of 3D geometric and visual information. They are commonly represented by large amounts of data, and compression schemes are important for their manipulation ...

SPIE-INT SOC OPTICAL ENGINEERING2018

Fast iterative retrieval algorithm for ultrashort pulse characterization using dispersion scans

João Miguel Augusto Penedones Fernandes

We present an iterative retrieval algorithm based on data constraint for ultrashort pulse characterization using dispersion scan (d-scan). The proposed algorithm is much faster and leads to a drastic reduction of retrieval times, but, compared to the stand ...

Optical Society of America2017

Adaptive relevance feedback for large-scale image retrieval

François Fleuret, Nicolae Suditu

Content-based image retrieval aims at substituting traditional indexing based on manual annotation by using automatically-extracted visual indexing features. Novel techniques are needed however to efficiently deal with the semantic gap (i.e. the partial ma ...

2016

Semi-supervised and unsupervised kernel-based novelty detection with application to remote sensing images

Frank Grégoire Jean de Morsier

The main challenge of new information technologies is to retrieve intelligible information from the large volume of digital data gathered every day. Among the variety of existing data sources, the satellites continuously observing the surface of the Earth ...

EPFL2014

Iterative EEG-based Natural Image Search under RSVP

José del Rocio Millán Ruiz, Ricardo Andres Chavarriaga Lozano, Marija Uscumlic

This work extends previous studies on using EEG decoding for automatic image retrieval. We propose an iterative way to integrate the information obtained from the EEG decoding and image processing methods. In the light of real-world BCI applications, we de ...

Graz University of Technology Publishing House2013

Low Complexity Image Recognition Algorithms for Handheld devices

Pradyumna Ayyalasomayajula

Content Based Image Retrieval (CBIR) has gained a lot of interest over the last two decades. The need to search and retrieve images from databases, based on information (“features”) extracted from the image itself, is becoming increasingly important. CBIR ...

EPFL2013

Retrieval of occluded images using DCT phase and region merging

Pierre-André Farine, Sara Grassi Pauletti, Pradyumna Ayyalasomayajula

In this paper we present an efficient method for Content Based Image Retrieval (CBIR) of occluded images using DCT-phase. The proposed method utilizes a novel correlation metric for ternary-valued DCT-phase, as well as a region merging method to reconstruc ...

IEEE2012

LDAHash: Improved Matching with Smaller Descriptors

Pascal Fua, Christoph Strecha

SIFT-like local feature descriptors are ubiquitously employed in computer vision applications such as content-based retrieval, video analysis, copy detection, object recognition, photo tourism, and 3D reconstruction. Feature descriptors can be designed to ...

Institute of Electrical and Electronics Engineers2012

Assessing Sparse Coding Methods for Contextual Shape Indexing of Maya Hieroglyphs

Daniel Gatica-Perez, Jean-Marc Odobez, Edgar Roman Rangel

Bag-of-visual-words or bag-of-visterms (bov) is a common technique used to index Multimedia information with the purposes of retrieval and classification. In this work we address the problem of constructing efficient bov representations of complex shapes a ...

2012