Publications associées à Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Quantifying the biomimicry gap in biohybrid robot-fish pairs

Francesco Mondada, Vaios Papaspyros

Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulatio ...

2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024

3D diffractive optics for linear interconnects and nonlinear processing

Niyazi Ulas Dinç

The optical domain presents potential avenues for enhancing both computing and communication due to its inherent properties of bandwidth, parallelism, and energy efficiency. This research focuses on harnessing 3-Dimensional (3D) diffractive optics for nove ...

EPFL2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Biohybrid Superorganisms—On the Design of a Robotic System for Thermal Interactions With Honeybee Colonies

Francesco Mondada, Robert Matthew Mills, Rafael Botner Barmak, Raphael Cherfan

Social insects, such as ants, termites, and honeybees, have evolved sophisticated societies where collaboration and division of labor enhance survival of the whole colony, and are thus considered “superorganisms”. Historically, studying behaviors involving ...

2024

On the Theory and Practice of Modern Secure Messaging

Daniel Patrick Collins

Billions of people now have conversations daily over the Internet. A large portion of this communication takes place via secure messaging protocols that offer "end-to-end encryption'" guarantees and resilience to compromise like the widely-used Double Ratc ...

EPFL2024

Enabling Uncertainty Estimation in Iterative Neural Networks

Pascal Fua, Doruk Oner, Nikita Durasov, Minh Hieu Lê

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...

Curran Associates2024

Distributed Predictive Formation Control of Autonomous Rotary-Wing Micro Aerial Vehicles

Izzet Kagan Erünsal

This doctoral thesis navigates the complex landscape of motion coordination and formation control within teams of rotary-wing Micro Aerial Vehicles (MAVs). Prompted by the intricate demands of real-world applications such as search and rescue or surveillan ...

EPFL2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Elena Beanato, Esra Neufeld, Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Traian Popa, Pierre Theopistos Vassiliadis, Julie Duqué, Fabienne Windel

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Digital Twins of Stone Masonry Buildings for Damage Assessment

Radhakrishna Achanta, Katrin Beyer, Bryan German Pantoja Rosero

Digital twins are virtual models of physical objects or systems that enable real-time monitoring and analysis. In the ﬁeld of stone masonry buildings, digital twins can be used to assess damage, predict maintenance needs, and opti- mize building performanc ...

Springer2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, José del Rocio Millán Ruiz, Olaf Blanke, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Memento Mori: Reliable robustness in self-reconfigurable modular robots

Kevin Andrew Holdcroft

Modular robotics link the reliability of a centralised system with the adaptivity of a decentralised system. It is difficult for a robot with a fixed shape to be able to perform many different types of tasks. As the task space grows, the number of functi ...

EPFL2024

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

A Biohybrid Superorganism - Investigating honeybees' collective behaviors via interactive robotics

Rafael Botner Barmak

Social insects, such as ants, termites, and honeybees, have evolved sophisticated societies where the collaborative efforts of "simple" individuals can lead to the emergence of complex dynamics. The reliance of each organism on the collective is so great t ...

EPFL2024

Uncovering interactions between Descending Neurons as a functional principle of behavioural control

Jonas Friedrich Braun

Animals, including humans, exhibit a remarkable variety of complex behaviours. How the nervous system controls all these behaviours ranging from simple, stereotyped movements to flexible, adaptive actions is a central questions of neuroscience. One of the ...

EPFL2024

Immersive VR for upper-extremity rehabilitation in patients with neurological disorders: a scoping review

Silvestro Micera, Elena Losanno

Background Neurological disorders, such as stroke and chronic pain syndromes, profoundly impact independence and quality of life, especially when affecting upper extremity (UE) function. While conventional physical therapy has shown effectiveness in provid ...

BioMed Central2024

SORI: A softness-rendering interface to unravel the nature of softness perception

Jamie Paik, Mustafa Mete, Hwayeong Jeong

Tactile perception of softness serves a critical role in the survival, well-being, and social interaction among various species, including humans. This perception informs activities from food selection in animals to medical palpation for disease detection ...

National Academy of Sciences2024

An immersive virtual reality tool for assessing left and right unilateral spatial neglect

Olaf Blanke, Andrea Serino, Roberta Ronchi

The reported rate of the occurrence of unilateral spatial neglect (USN) is highly variable likely due to the lack of validity and low sensitivity of classical tools used to assess it. Virtual reality (VR) assessments try to overcome these limitations by pr ...

Wiley2024