Publications associées à Knowledge-Aware Cross-Modal Text-Image Retrieval for Remote Sensing Images

From scattered sources to comprehensive technology landscape : A recommendation-based retrieval approach

Mapping the technology landscape is crucial for market actors to take informed investment decisions. However, given the large amount of data on the Web and its subsequent information overload, manually retrieving information is a seemingly ineffective and ...

ELSEVIER2023

The role of the visual field size in artificial vision

Diego Ghezzi

Objective. Artificial vision has been and still is the subject of intense research. The ultimate goal is to help blind people in their daily life. Approaches to artificial vision, including visual prostheses and optogenetics, have strongly focused on resto ...

IOP Publishing Ltd2023

Graph Embedding for Retrieval

Chi Thang Duong

Information retrieval (IR) systems such as search engines are important for people to find what they need among the tremendous amount of data available in their organization or on the Internet. These IR systems enable users to search in a large data collec ...

EPFL2022

Visual Scene Understanding for Transportation: From Detecting Objects To Relationships

George Adaimi

Transportation, which deals with moving people and goods around, has a clear impact on the economic development of our society and our well-being. Traditionally, transportation was studied and analyzed using expensive sensors, such as induction loops, that ...

EPFL2022

Efficient and Effective Multi-Modal Queries Through Heterogeneous Network Embedding

Karl Aberer, Quoc Viet Hung Nguyen, Thành Tâm Nguyên, Chi Thang Duong, Thanh Trung Huynh

The heterogeneity of today's Web sources requires information retrieval (IR) systems to handle multi-modal queries. Such queries define a user's information needs by different data modalities, such as keywords, hashtags, user profiles, and other media. Rec ...

IEEE COMPUTER SOC2022

QAIR: Practical Query-efficient Black-Box Attacks for Image Retrieval

Hang Su, Jinfeng Li, Shaokai Ye, Yuan He

We study the query-based attack against image retrieval to evaluate its robustness against adversarial examples under the black-box setting, where the adversary only has query access to the top-1 ranked unlabeled images from the database. Compared with que ...

IEEE COMPUTER SOC2021

Semantics-Aware Spatial-Temporal Binaries for Cross-Modal Video Retrieval

Jie Luo, Yiyu Wang, Mengshi Qi

With the current exponential growth of video-based social networks, video retrieval using natural language is receiving ever-increasing attention. Most existing approaches tackle this task by extracting individual frame-level spatial features to represent ...

2021

Orchestration of oscillatory activity to improve visual motion discrimination

Roberto Felipe Salamanca Giron

This thesis describes advances in the use of novel configurations of non-invasive brain stimulation over the visual system allowing to modulate of modifying electro-physiological activity, interregional interactions and by it, visual behavior such as motio ...

EPFL2021

Lifelong Machine Learning with Data Efficiency and Knowledge Retention

Fei Mi

Artificial intelligence (AI) and machine learning (ML) have become de facto tools in many real-life applications to offer a wide range of benefits for individuals and our society. A classic ML model is typically trained with a large-scale static dataset in ...

EPFL2021

Graph Embeddings for One-pass Processing of Heterogeneous Queries

Karl Aberer, Quoc Viet Hung Nguyen, Chi Thang Duong

Effective information retrieval (IR) relies on the ability to comprehensively capture a user's information needs. Traditional IR systems are limited to homogeneous queries that define the information to retrieve by a single modality. Support for heterogene ...

IEEE COMPUTER SOC2020

Learning a Unified Blind Image Quality Metric via On-Line and Off-Line Big Training Instances

Daniel Thalmann, Xingyu Xu

In this work, we resolve a big challenge that most current image quality metrics (IQMs) are unavailable across different image contents, especially simultaneously coping with natural scene (NS) images or screen content (SC) images. By comparison with exist ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Language Resources for Historical Newspapers: the Impresso Collection

Raphaël Barman, Maud Ehrmann, Matteo Romanello

Following decades of massive digitization, an unprecedented amount of historical document facsimiles can now be retrieved and accessed via cultural heritage online portals. If this represents a huge step forward in terms of preservation and accessibility, ...

European Language Resources Association2020

Multi-scale sequential network for semantic text segmentation and localization

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

We present a novel method for semantic text document analysis which in addition to localizing text it labels the text in user-defined semantic categories. More precisely, it consists of a fully-convolutional and sequential network that we apply to the part ...

2020

The organisation of science: topics, incentives and funding

Omar Ballester Gonzalez

Ever since the links between the development of new technologies and economic growth became evident, researchers have attempted to study how the creation of knowledge fosters progress. If pushing the frontier of knowledge has an impact on progress and well ...

EPFL2020

Deep Feature Factorization For Content-Based Image Retrieval And Localization

Sabine Süsstrunk, Edo Collins

State of the art content-based image retrieval algorithms owe their excellent performance to the rich semantics encoded in the deep activations of a convolutional neural network. The difference between these algorithms lies mostly in how activations are co ...

IEEE2019

Multimodal person recognition in audio-visual streams

Do Hoang Nam Le

Multimedia databases are growing rapidly in size in the digital age. To increase the value of these data and to enhance the user experience, there is a need to make these videos searchable through automatic indexing. Because people appearing and talking in ...

EPFL2019

Running Large-Scale Simulations on the Neurorobotics Platform to Understand Vision - The Case of Visual Crowding

Michael Herzog, Gregory Francis, Alban Bornet, Egidio Falotico, Alessandro Ambrosano

Traditionally, human vision research has focused on specific paradigms and proposed models to explain very specific properties of visual perception. However, the complexity and scope of modern psychophysical paradigms undermine the success of this approach ...

2019

Learning Vision-based Flight in Drone Swarms by Imitation

Dario Floreano, Julien Jean Denis Nicolas Lecoeur, Fabian Maximilian Schilling, Fabrizio Schiano

Decentralized drone swarms deployed today either rely on sharing of positions among agents or detecting swarm members with the help of visual markers. This work proposes an entirely visual approach to coordinate markerless drone swarms based on imitation l ...

2019

Mapping Affinities in Academic Organizations

Boris Beaude, Frédéric Kaplan, Dario Rodighiero

Scholarly affinities are one of the most fundamental hidden dynamics that drive scientific development. Some affinities are actual, and consequently can be measured through classical academic metrics such as co-authoring. Other affinities are potential, an ...

2018

Quantifying Collaboration in Synchronous Document Editing

Adrian Pierre Sergio Pace, Louis Antoine Baligand, Stian Haklev, Jennifer Kaitlyn Olsen

Collaborative synchronous writing tools like Google Docs and Etherpad let multiple users edit the same document and see each others edits in near real-time to simplify collaboration and avoid merge-conflicts. These tools are used extensively across many do ...

2018