Publications associées à Text segmentation

Land Cover Mapping From Multiple Complementary Experts Under Heavy Class Imbalance

Devis Tuia, Valérie Zermatten, Javiera Francisca Castillo Navarro, Xiaolong Lu

Deep learning has emerged as a promising avenue for automatic mapping, demonstrating high efficacy in land cover categorization through various semantic segmentation models. Nonetheless, the practical deployment of these models encounters important challen ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

An end-to-end pipeline for historical censuses processing

Lucas Arnaud André Rappo, Rémi Guillaume Petitpierre, Marion Kramer

Censuses are structured documents of great value for social and demographic history, which became widespread from the nineteenth century on. However, the plurality of formats and the natural variability of historical data make their extraction arduous and ...

2023

MultiMAE: Multi-modal Multi-task Masked Autoencoders

Amir Roshan Zamir, Roman Christian Bachmann, Andrei Atanov, David Mizrahi

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input besides the RGB ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

A Stepwise Domain Adaptive Segmentation Network With Covariate Shift Alleviation for Remote Sensing Imagery

Yinlin Hu, Yunpeng Li, Jingyu Li, Rui Song

Semantic segmentation for remote sensing images (RSI) is critical for the Earth monitoring system. However, the covariate shift between RSI datasets under different capture conditions cannot be alleviated by directly using the unsupervised domain adaptatio ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Determining crack kinematics from imaged crack patterns

Katrin Beyer, Bryan German Pantoja Rosero, Amir Rezaie, Ketson Roberto Maximiano Dos Santos

Determining the relationship between the cause of damage and the subsequent structural behavior of infrastructure systems requires an accurate characterization of the propagation of cracks, which represents the evolution of the damage state. When no inform ...

2022

Datasets and Models for Historical Newspaper Article Segmentation

Maud Ehrmann, Sofia Ares Oliveira, Raphaël Barman

Dataset and models used and produced in the work described in the paper "Combining Visual and Textual Features for Semantic Segmentation of Historical Newspapers": https://infoscience.epfl.ch/record/282863?ln=en ...

2021

The Vulnerability of Semantic Segmentation Networks to Adversarial Attacks in Autonomous Driving: Enhancing Extensive Environment Sensing

Peter Clemens Schlicht

Enabling autonomous driving (AD) can be considered one of the biggest challenges in today?s technology. AD is a complex task accomplished by several functionalities, with environment perception being one of its core functions. Environment perception is usu ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Deep Learning‐based Semantic Segmentation in Remote Sensing

Devis Tuia

Semantic segmentation consists of the generation of a categorical map, given an image in which each pixel of the image is automatically assigned a class. Deep learning allows the influence of the pixel's context to be learned by capturing the non-linear re ...

Wiley2021

Combining Visual and Textual Features for Semantic Segmentation of Historical Newspapers

Frédéric Kaplan, Maud Ehrmann, Sofia Ares Oliveira, Raphaël Barman

The massive amounts of digitized historical documents acquired over the last decades naturally lend themselves to automatic processing and exploration. Research work seeking to automatically process facsimiles and extract information thereby are multiplyin ...

2021

Historical City Maps Semantic Segmentation Dataset

Rémi Guillaume Petitpierre

This dataset includes a total of 635 annotated image patches from historical city maps. It is designed for the semantic segmentation of the maps into 5 semantic classes (building blocks, non-built, water, road network, background frame). 330 patches are ta ...

Zenodo2021

Uncertainty and Surprisal Jointly Deliver the Punchline: Exploiting Incongruity-Based Features for Humor Recognition

Pearl Pu Faltings, Yubo Xie, Junze Li

Humor recognition has been widely studied as a text classification problem using data-driven approaches. However, most existing work does not examine the actual joke mechanism to understand humor. We break down any joke into two distinct components: the se ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2021

A Shared Representation for Photorealistic Driving Simulators

Alexandre Massoud Alahi, Saeed Saadatnejad, Taylor Ferdinand Mordan, Siyuan Li

A powerful simulator highly decreases the need for real-world tests when training and evaluating autonomous vehicles. Data-driven simulators flourished with the recent advancement of conditional Generative Adversarial Networks (cGANs), providing high-fidel ...

IEEE Institute of Electrical and Electronics Engineers2021

Multi-scale sequential network for semantic text segmentation and localization

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

We present a novel method for semantic text document analysis which in addition to localizing text it labels the text in user-defined semantic categories. More precisely, it consists of a fully-convolutional and sequential network that we apply to the part ...

2020

STC-GAN: Spatio-Temporally Coupled Generative Adversarial Networks for Predictive Scene Parsing

Jie Luo, Mengshi Qi, Yiyu Wang

Predictive scene parsing is a task of assigning pixel-level semantic labels to a future frame of a video. It has many applications in vision-based artificial intelligent systems, e.g., autonomous driving and robot navigation. Although previous work has sho ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Using A Priori Knowledge to Improve Scene Understanding

Alexandre Massoud Alahi

Semantic segmentation algorithms that can robustly segment objects across multiple camera viewpoints are crucial for assuring navigation and safety in emerging applications such as autonomous driving. Existing algorithms treat each image in isolation, but ...

IEEE2019

Learning to Reduce Annotation Load

Ksenia Konyushkova

Modern machine learning methods and their applications in computer vision are known to crave for large amounts of training data to reach their full potential. Because training data is mostly obtained through humans who manually label samples, it induces a ...

EPFL2019

Variational Methods for Human Modeling

Timur Bagautdinov

A large part of computer vision research is devoted to building models and algorithms aimed at understanding human appearance and behaviour from images and videos. Ultimately, we want to build automated systems that are at least as capable as people when i ...

EPFL2018

Simple Unsupervised Keyphrase Extraction using Sentence Embeddings

Martin Jaggi, Claudiu-Cristian Musat, Kamil Bennani-Smires

Keyphrase extraction is the task of automatically selecting a small set of phrases that best describe a given free text document. Keyphrases can be used for indexing, searching, aggregating and summarizing text documents, serving many automatic as well as ...

2018