Publications by Javiera Francisca Castillo Navarro

Learning transferable land cover semantics for open vocabulary interactions with remote sensing images

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro

Why should we confine land cover classes to rigid and arbitrary definitions? Land cover mapping is a central task in remote sensing image processing, but the rigorous class definitions can sometimes restrict the transferability of annotations between datas ...

2025

Land Cover Mapping From Multiple Complementary Experts Under Heavy Class Imbalance

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro, Xiaolong Lu

Deep learning has emerged as a promising avenue for automatic mapping, demonstrating high efficacy in land cover categorization through various semantic segmentation models. Nonetheless, the practical deployment of these models encounters important challen ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Knowledge-Aware Text–Image Retrieval for Remote Sensing Images

Devis Tuia, Li Mi, Javiera Francisca Castillo Navarro

Image-based retrieval in large Earth observation archives is challenging because one needs to navigate across thousands of candidate matches only with the query image as a guide. By using text as information supporting the visual query, the retrieval syste ...

Institute of Electrical and Electronics Engineers (IEEE)2024

ConGeo: Robust Cross-View Geo-Localization Across Ground View Variations

Devis Tuia, Antoine Bosselut, Li Mi, Javiera Francisca Castillo Navarro, Syrielle Mathilde Marie Montariol

Cross-view geo-localization aims at localizing a ground-level query image by matching it to its corresponding geo-referenced aerial view. In real-world scenarios, the task requires accommodating diverse ground images captured by users with varying orientat ...

Springer Cham2024

ConVQG: Contrastive Visual Question Generation with Multimodal Guidance

Devis Tuia, Antoine Bosselut, Li Mi, Javiera Francisca Castillo Navarro, Syrielle Mathilde Marie Montariol

Asking questions about visual environments is a crucial way for intelligent agents to understand rich multi-faceted scenes, raising the importance of Visual Question Generation (VQG) systems. Apart from being grounded to the image, existing VQG systems can ...

Association for the Advancement of Artificial Intelligence (AAAI)2024

Training Visual Language Models with Object Detection: Grounded Change Descriptions in Satellite Images

Devis Tuia, Antoine Bosselut, Javiera Francisca Castillo Navarro, Syrielle Mathilde Marie Montariol

Recently, generalist Vision Language Models (VLMs) have shown exceptional progress in tasks previously dominated by specialized computer vision models. This becomes more prevalent when visual grounding capabilities, such as the ability to reason over input ...

Institute of Electrical and Electronics Engineers Inc.2024

Knowledge-Aware Visual Question Generation for Remote Sensing Images

Devis Tuia, Li Mi, Javiera Francisca Castillo Navarro

With the rapid development of remote sensing image archives, asking questions about images has become an effective way of gathering specific information or performing image retrieval. However, automatically generated image-based questions tend to be simpli ...

IEEE2024

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Multi-task prompt-RSVQA to explicitly count objects on aerial images

Devis Tuia, Christel Marie Tartini-Chappuis, Nicola Antonio Santacroce, Sylvain Lobry, Javiera Francisca Castillo Navarro

Introduced to enable a wider use of Earth Observation images using natural language, Remote Sensing Visual Question Answering (RSVQA) remains a challenging task, in particular for questions related to counting. To address this specific challenge, we propos ...

2023