Publications related to Comic Digitization through the Extraction of Semantic Content and Style Analysis

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Dense Multitask Learning to Reconfigure Comics

Mathieu Salzmann, Sabine Süsstrunk, Deblina Bhattacharjee

In this paper, we develop a MultiTask Learning (MTL) model to achieve dense predictions for comic panels to, in turn, facilitate the transfer of comics from one publication channel to another by assisting authors in the task of reconfiguring their narrativ ...

IEEE2023

Explanation of Face Recognition via Saliency Maps

Touradj Ebrahimi, Yuhang Lu

Despite the significant progress in recent years, deep face recognition is often treated as a "black box" and has been criticized for lacking explainability. It becomes increasingly important to understand the characteristics and decisions of deep face rec ...

2023

CLIP the Gap: A Single Domain Generalization Approach for Object Detection

Mathieu Salzmann, Martin Pierre Engilberge, Vidit Vidit

Single Domain Generalization (SDG) tackles the problem of training a model on a single source domain so that it generalizes to any unseen target domain. While this has been well studied for image classification, the literature on SDG object detection remai ...

Ieee Computer Soc2023

Complex Daily Activities, Country-Level Diversity, and Smartphone Sensing: A Study in Denmark, Italy, Mongolia, Paraguay, and UK

Daniel Gatica-Perez, Karim Assi, Lakmal Buddika Meegahapola

Smartphones enable understanding human behavior with activity recognition to support peoples daily lives. Prior studies focused on using inertial sensors to detect simple activities (sitting, walking, running, etc.) and were mostly conducted in homogeneous ...

Assoc Computing Machinery2023

Recognizing distant faces

Marin Vogelsang, Lukas Vogelsang

As an 'early alerting' sense, one of the primary tasks for the human visual system is to recognize distant objects. In the specific context of facial identification, this ecologically important task has received surprisingly little attention. Most studies ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Rigidity-Aware Detection for 6D Object Pose Estimation

Mathieu Salzmann, Yinlin Hu, Rui Song, Jingyu Li

Most recent 6D object pose estimation methods first use object detection to obtain 2D bounding boxes before actually regressing the pose. However, the general object detection methods they use are ill-suited to handle cluttered scenes, thus producing poor ...

Ieee Computer Soc2023

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

Improving Object Detection under Domain Shifts

Vidit Vidit

Object detection plays a critical role in various computer vision applications, encompassing domains like autonomous vehicles, object tracking, and scene understanding. These applica- tions rely on detectors that generate bounding boxes around known object ...

EPFL2023

How to Boost Face Recognition with StyleGAN?

Nikita Durasov

State-of-the-art face recognition systems require vast amounts of labeled training data. Given the priority of privacy in face recognition applications, the data is limited to celebrity web crawls, which have issues such as limited numbers of identities. O ...

Ieee Computer Soc2023

Personalized Productive Engagement Recognition in Robot-Mediated Collaborative Learning

Jauwairia Nasir, Barbara Bruno

In this paper, we propose and compare personalized models for Productive Engagement (PE) recognition. PE is defined as the level of engagement that maximizes learning. Previously, in the context of robot-mediated collaborative learning, a framework of prod ...

2022

Improving the Training of Compact Neural Networks for Visual Recognition

Shuxuan Guo

During the Artificial Intelligence (AI) revolution of the past decades, deep neural networks have been widely used and have achieved tremendous success in visual recognition. Unfortunately, deploying deep models is challenging because of their huge model s ...

EPFL2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

GALET: A deep learning image segmentation model for drone-based grain size analysis of gravel bars

Giovanni De Cesare, Christian Mörtl

In this study, we present the deep learning image segmentation model for drone-based grain size analysis of gravel bars called GALET. The objectives are to quantify the performance of the code and to test its applicability in river research and management. ...

International Association for Hydro-Environment Engineering and Research (IAHR)2022

Comic Based Learning for Students with Visual Impairments

Kalpani Anuradha Welivita

Visual impairment can affect a student's ability to learn since their concept development when interacting with educational material is being limited. Learning activities based on images and visually rich content are mainstream learning methods, where faci ...

2023

Poly-NL: Linear Complexity Non-local Layers With 3rd Order Polynomials

Filippos Kokkinos, Grigorios Chrysos

Spatial self-attention layers, in the form of Non-Local blocks, introduce long-range dependencies in Convolutional Neural Networks by computing pairwise similarities among all possible positions. Such pairwise functions underpin the effectiveness of non-lo ...

IEEE2021

On the Recognition Performance of BioHashing on state-of-the-art Face Recognition models

Sébastien Marcel, Hatef Otroshi Shahreza

Face recognition has become a popular authentication tool in recent years. Modern state-of-the-art (SOTA) face recognition methods rely on deep neural networks, which extract discriminative features from face images. Although these methods have high recogn ...

IEEE2021

Using footstep-induced vibrations for occupant detection and recognition in buildings

Ian Smith, Yves Sylvain Gilles Reuland, Sai Ganesh Sarvotham Pai, Slah Drira

Occupant detection and recognition support functional goals such as security, healthcare, and energy management in buildings. Typical sensing approaches, such as smartphones and cameras, undermine the privacy of building occupants and inherently affect the ...

2021

Differentiable Patch Selection for Image Recognition

Aravindh Mahendran, Jean-Baptiste Francis Marie Juliette Cordonnier

Neural Networks require large amounts of memory and compute to process high resolution images, even when only a small part of the image is actually informative for the task at hand. We propose a method based on a differentiable Top-K operator to select the ...

IEEE COMPUTER SOC2021

TTT++: When Does Self-Supervised Test-Time Training Fail or Thrive?

Alexandre Massoud Alahi, Yuejiang Liu, Parth Ashit Kothari, Taylor Ferdinand Mordan, Bastien Germain C. Van Delft

Test-time training (TTT) through self-supervised learning (SSL) is an emerging paradigm to tackle distributional shifts. Despite encouraging results, it remains unclear when this approach thrives or fails. In this work, we first provide an in-depth look at ...

2021