Publications associées à Datasets and Models for Historical Newspaper Article Segmentation

Land Cover Mapping From Multiple Complementary Experts Under Heavy Class Imbalance

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro, Xiaolong Lu

Deep learning has emerged as a promising avenue for automatic mapping, demonstrating high efficacy in land cover categorization through various semantic segmentation models. Nonetheless, the practical deployment of these models encounters important challen ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

An end-to-end pipeline for historical censuses processing

Marion Kramer, Rémi Guillaume Petitpierre, Lucas Arnaud André Rappo

Censuses are structured documents of great value for social and demographic history, which became widespread from the nineteenth century on. However, the plurality of formats and the natural variability of historical data make their extraction arduous and ...

2023

A Stepwise Domain Adaptive Segmentation Network With Covariate Shift Alleviation for Remote Sensing Imagery

Yunpeng Li, Yinlin Hu, Rui Song, Jingyu Li

Semantic segmentation for remote sensing images (RSI) is critical for the Earth monitoring system. However, the covariate shift between RSI datasets under different capture conditions cannot be alleviated by directly using the unsupervised domain adaptatio ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

MultiMAE: Multi-modal Multi-task Masked Autoencoders

Amir Roshan Zamir, Roman Christian Bachmann, David Mizrahi, Andrei Atanov

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Determining crack kinematics from imaged crack patterns

Katrin Beyer, Amir Rezaie, Bryan German Pantoja Rosero, Ketson Roberto Maximiano Dos Santos

Determining the relationship between the cause of damage and the subsequent structural behavior of infrastructure systems requires an accurate characterization of the propagation of cracks, which represents the evolution of the damage state. When no inform ...

2022

The Vulnerability of Semantic Segmentation Networks to Adversarial Attacks in Autonomous Driving: Enhancing Extensive Environment Sensing

Peter Clemens Schlicht

Enabling autonomous driving (AD) can be considered one of the biggest challenges in today?s technology. AD is a complex task accomplished by several functionalities, with environment perception being one of its core functions. Environment perception is usu ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Combining Visual and Textual Features for Semantic Segmentation of Historical Newspapers

Frédéric Kaplan, Sofia Ares Oliveira, Raphaël Barman, Maud Ehrmann

The massive amounts of digitized historical documents acquired over the last decades naturally lend themselves to automatic processing and exploration. Research work seeking to automatically process facsimiles and extract information thereby are multiplyin ...

2021

Deep Learning‐based Semantic Segmentation in Remote Sensing

Devis Tuia

Semantic segmentation consists of the generation of a categorical map, given an image in which each pixel of the image is automatically assigned a class. Deep learning allows the influence of the pixel's context to be learned by capturing the non-linear re ...

Wiley2021

A Shared Representation for Photorealistic Driving Simulators

Alexandre Massoud Alahi, Saeed Saadatnejad, Siyuan Li, Taylor Ferdinand Mordan

A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Networks (cGANs), providing high-fidel ...

IEEE Institute of Electrical and Electronics Engineers2021

STC-GAN: Spatio-Temporally Coupled Generative Adversarial Networks for Predictive Scene Parsing

Jie Luo, Yiyu Wang, Mengshi Qi

Predictive scene parsing is a task of assigning pixel-level semantic labels to a future frame of a video. It has many applications in vision-based artificial intelligent systems, e.g., autonomous driving and robot navigation. Although previous work has sho ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Using A Priori Knowledge to Improve Scene Understanding

Alexandre Massoud Alahi

Semantic segmentation algorithms that can robustly segment objects across multiple camera viewpoints are crucial for assuring navigation and safety in emerging applications such as autonomous driving. Existing algorithms treat each image in isolation, but ...

IEEE2019

Learning to Reduce Annotation Load

Ksenia Konyushkova

Modern machine learning methods and their applications in computer vision are known to crave for large amounts of training data to reach their full potential. Because training data is mostly obtained through humans who manually label samples, it induces a ...

EPFL2019

Apartment Structure Estimation Using Fully Convolutional Networks and Graph Model

Jing Zhang

Apartment searching has been a hot demand all over the world. Understanding the apartment structure will significantly contribute to simplifying the searching process. In this project, the fully convolutional networks are applied to generate semantic segme ...

ASSOC COMPUTING MACHINERY2018

Variational Methods for Human Modeling

Timur Bagautdinov

A large part of computer vision research is devoted to building models and algorithms aimed at understanding human appearance and behaviour from images and videos. Ultimately, we want to build automated systems that are at least as capable as people when i ...

EPFL2018

Long-term path prediction in urban scenarios using circular distributions

Alexandre Massoud Alahi

Human ability to foresee the near future plays a key role in everyone's life to prevent potentially dangerous situations. To be able to make predictions is crucial when people have to interact with the surrounding environment. Modeling such capability can ...

2018

Keyword-based Image Color Re-rendering with Semantic Segmentation

Sabine Süsstrunk, Bin Jin, Fayez Lahoud

Keyword-based image color re-rendering is a convenient way to enhance the color of images. Most methods only focus on the color characteristics of the image while ignoring the semantic meaning of different regions. We propose to incorporate semantic inform ...

2017

Learning Aerial Image Segmentation from Online Maps

Thomas Hofmann, Aurélien Lucchi, Martin Jaggi, Jan Dirk Wegner

This study deals with semantic segmentation of high-resolution (aerial) images where a semantic class label is assigned to each pixel via supervised classification as a basis for automatic map generation. Recently, deep convolutional neural networks (CNNs) ...

Institute of Electrical and Electronics Engineers2017

Efficient Transductive Semantic Segmentation

Mathieu Salzmann

Semantically describing the contents of images is one of the classical problems of computer vision. With huge numbers of images being made available daily, there is increasing interest in methods for semantic pixel labelling that exploit large image sets. ...

Ieee2016