Publications associées à Two-handed gestures for human-computer interaction

Enabling Uncertainty Estimation in Iterative Neural Networks

Pascal Fua, Doruk Oner, Nikita Durasov, Minh Hieu Lê

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...

Curran Associates2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition

Elisa Donati, Pasquale Davide Schiavone

Hand gestures are one of the most natural and expressive way for humans to convey information, and thus hand gesture recognition has become a research hotspot in the human-machine interface (HMI) field. In particular, biological signals such as surface ele ...

SPRINGER INTERNATIONAL PUBLISHING AG2023

Improving Object Detection under Domain Shifts

Vidit Vidit

Object detection plays a critical role in various computer vision applications, encompassing domains like autonomous vehicles, object tracking, and scene understanding. These applica- tions rely on detectors that generate bounding boxes around known object ...

EPFL2023

Encoding and Decoding Narratives: Datafication and Alternative Access Models for Audiovisual Archives

Yuchen Yang

Situated in the intersection of audiovisual archives, computational methods, and immersive interactions, this work probes the increasingly important accessibility issues from a two-fold approach. Firstly, the work proposes an ontological data model to hand ...

ACM2023

State of the Art in Dense Monocular Non-Rigid 3D Reconstruction

Pascal Fua

3D reconstruction of deformable (or non-rigid) scenes from a set of monocular 2D image observations is a long-standing and actively researched area of computer vision and graphics. It is an ill-posed inverse problem, since-without additional prior assumpti ...

WILEY2023

Towards Novel Evaluation Methods for Social Dialog Systems

Ekaterina Svikhnushina

Language has shaped human evolution and led to the desire to endow machines with language abilities. Recent advancements in natural language processing enable us to achieve this breakthrough in human-machine interaction. However, introducing conversational ...

EPFL2023

Towards Visual Saliency Explanations of Face Verification

Touradj Ebrahimi, Yuhang Lu, Zewei Xu

In the past years, deep convolutional neural networks have been pushing the frontier of face recognition (FR) techniques in both verification and identification scenarios. Despite the high accuracy, they are often criticized for lacking explainability. The ...

2024

Discriminative Deep Feature Visualization for Explainable Face Recognition

Touradj Ebrahimi, Yuhang Lu, Zewei Xu

Despite the huge success of deep convolutional neural networks in face recognition (FR) tasks, current methods lack explainability for their predictions because of their ``black-box'' nature. In recent years, studies have been carried out to give an interp ...

2023

The role of the visual field size in artificial vision

Diego Ghezzi

Objective. Artificial vision has been and still is the subject of intense research. The ultimate goal is to help blind people in their daily life. Approaches to artificial vision, including visual prostheses and optogenetics, have strongly focused on resto ...

IOP Publishing Ltd2023

Region Extraction in Mesh Intersection

Annalisa Buffa, Pablo Antolin Sanchez, Emiliano Cirillo

Region extraction is a very common task in both Computer Science and Engineering with several applications in object recognition and motion analysis, among others. Most of the literature focuses on regions delimited by straight lines, often in the special ...

2023

Text as a Richer Source of Supervision in Semantic Segmentation Tasks

Devis Tuia, Valérie Zermatten, Lloyd Haydn Hughes, Javiera Francisca Castillo Navarro

This paper introduces TACOSS a text-image alignment approach that allows explainable land cover semantic segmentation by directly integrating semantic concepts encoded from texts. TACOSS combines convolutional neural networks for visual feature extraction ...

The Institute of Electrical and Electronics Engineers, Inc2023

Human Interactive Robotic Surfaces for Physical Immersion

Fabio Zuliani

Computers have long been augmenting human capabilities and communication, and with emerging technologies, physical immersion in virtual worlds is now attainable. These advancements push the boundaries of human potential, allowing designers, architects, eng ...

EPFL2023

Novel Methods For Detection And Analysis Of Atypical Aspects In Speech

Julian David Fritsch

Atypical aspects in speech concern speech that deviates from what is commonly considered normal or healthy. In this thesis, we propose novel methods for detection and analysis of these aspects, e.g. to monitor the temporary state of a speaker, diseases tha ...

EPFL2023

Learning Disentangled Behaviour Patterns for Wearable-based Human Activity Recognition

Tao Lin

In wearable-based human activity recognition (HAR) research, one of the major challenges is the large intra-class variability problem. The collected activity signal is often, if not always, coupled with noises or bias caused by personal, environmental, or ...

ASSOC COMPUTING MACHINERY2022

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Josephine Anna Eleanor Hughes

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

Institute of Electrical and Electronics Engineers Inc.2022

Interactive Digital Engagement With Visual Artworks and Cultural Artefacts Enhances User Aesthetic Experiences in the Laboratory and Museum

Martin Vetterli, Loïc Arnaud Baboulaz, Christine Mohr, Pierre Gabioud

Digital technologies reshape the way we interact with our environment, including with artworks. Advanced computational imaging solutions allow having extremely high-resolution digital reproductions of artworks outside museums, presumably increasing artwork ...

TAYLOR & FRANCIS INC2022

Learning to Represent and Reconstruct 3D Deformable Objects

Jan Bednarík

Representing and reconstructing 3D deformable shapes are two tightly linked problems that have long been studied within the computer vision field. Deformable shapes are truly ubiquitous in the real world, whether be it specific object classes such as human ...

EPFL2022

Focus on People: Five Qestions from Human-Centered Computing

Daniel Gatica-Perez

A substantial body of research in multimodal interaction has studied how people naturally interact -face-to-face and through machinesand developed technology to analyze, support, and extend such forms of interaction. The talk will share personal experience ...

Assoc Computing Machinery2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022