Publications associées à Modeling and Inferring Attention between Humans or for Human-Robot Interactions

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024

A Biohybrid Superorganism - Investigating honeybees' collective behaviors via interactive robotics

Rafael Botner Barmak

Social insects, such as ants, termites, and honeybees, have evolved sophisticated societies where the collaborative efforts of "simple" individuals can lead to the emergence of complex dynamics. The reliance of each organism on the collective is so great t ...

EPFL2024

Biohybrid Superorganisms—On the Design of a Robotic System for Thermal Interactions With Honeybee Colonies

Francesco Mondada, Robert Matthew Mills, Rafael Botner Barmak, Raphael Cherfan

Social insects, such as ants, termites, and honeybees, have evolved sophisticated societies where collaboration and division of labor enhance survival of the whole colony, and are thus considered “superorganisms”. Historically, studying behaviors involving ...

2024

Probing and modulating inter-areal coupling in the cortical visual motion processing pathway with non-invasive brain stimulation

Michele Bevilacqua

In the last few years, stroke ranked as the second most common cause of death and is the third most significant condition affecting disability-adjusted life years (DALYs) worldwide. Being the most prevalent and quality of life impacting post-stroke symptom ...

EPFL2024

Predicting Visual Stimuli From Cortical Response Recorded With Wide-Field Imaging in a Mouse

Silvestro Micera, Daniela De Luca

Neural decoding of the visual system is a subject of research interest, both to understand how the visual system works and to be able to use this knowledge in areas, such as computer vision or brain-computer interfaces. Spike-based decoding is often used, ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Memento Mori: Reliable robustness in self-reconfigurable modular robots

Kevin Andrew Holdcroft

Modular robotics link the reliability of a centralised system with the adaptivity of a decentralised system. It is difficult for a robot with a fixed shape to be able to perform many different types of tasks. As the task space grows, the number of functi ...

EPFL2024

Quantifying the biomimicry gap in biohybrid robot-fish pairs

Francesco Mondada, Vaios Papaspyros

Biohybrid systems in which robotic lures interact with animals have become compelling tools for probing and identifying the mechanisms underlying collective animal behavior. One key challenge lies in the transfer of social interaction models from simulatio ...

2024

Robot Learning using Tensor Networks

Suhan Narayana Shetty

In various robotics applications, the selection of function approximation methods greatly influences the feasibility and computational efficiency of algorithms. Tensor Networks (TNs), also referred to as tensor decomposition techniques, present a versatile ...

EPFL2024

Neurobiological and metabolic basis of motivation and effort-based decision-making - A human 1H-MRS, fMRI and machine learning study

Arthur Barakat

Motivation is a multifaceted phenomenon that we explore within the framework of decision-making. Through this cognitive process, actions are directed towards specific goals by performing a trade-off between the cost and benefit of an action. The dorsomedia ...

EPFL2024

Weak correlations between visual abilities in healthy older adults, despite long-term performance stability

Michael Herzog, Simona Adele Garobbio

Using batteries of visual tests, most studies have found that there are only weak correlations between the performance levels of the tests. Factor analysis has confirmed these results. This means that a participant excelling in one test may rank low in ano ...

2024

Soft Robotics: A Route to Equality, Diversity, and Inclusivity in Robotics

Josephine Anna Eleanor Hughes

Robotics is entering our daily lives. The discipline is increasingly crucial in fields such as agriculture, medicine, and rescue operations, impacting our food, health, and planet. At the same time, it is becoming evident that robotic research must embrace ...

Mary Ann Liebert, Inc2024

SIMPLE HIERARCHICAL PLANNING WITH DIFFUSION

Chang Chen, Caglar Gulcehre

Diffusion-based generative methods have proven effective in modeling trajectories with offline datasets. However, they often face computational challenges and can falter in generalization, especially in capturing temporal abstractions for long- horizon tas ...

2024

High-order geometric integrators for the variational Gaussian wavepacket dynamics and application to vibronic spectra at finite temperature

Roya Moghaddasi Fereidani

Molecular quantum dynamics simulations are essential for understanding many fundamental phenomena in physics and chemistry. They often require solving the time-dependent Schrödinger equation for molecular nuclei, which is challenging even for medium-sized ...

EPFL2024

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Empathetic Conversational Agents for Distress Support

Kalpani Anuradha Welivita

Due to the increasing demands of today's fast-paced world, mental health concerns are on the rise, which necessitates innovative approaches to provide support to those in need. Open-domain conversational agents known as chatbots, offer a unique opportunit ...

EPFL2023

Computational Models of Mutual Understanding for Human-Robot Collaborative Learning

Utku Norman

There is a growing trend towards designing learning activities featuring robots as collaborative exercises where children work together to achieve the activity objectives, generating interactions that can trigger learning processes. Witnessing such activit ...

EPFL2023

Human Interactive Robotic Surfaces for Physical Immersion

Fabio Zuliani

Computers have long been augmenting human capabilities and communication, and with emerging technologies, physical immersion in virtual worlds is now attainable. These advancements push the boundaries of human potential, allowing designers, architects, eng ...

EPFL2023

A biohybrid interaction framework for the integration of robots in animal societies

Francesco Mondada, Daniel Burnier, Vaios Papaspyros, Raphael Cherfan

The collective behavior of animals has been traditionally studied through observation, quantitative models of behavior, and devices of low intelligence. Nowadays, the advancements in the field of robotics allow for closed-loop experiments that occur in rea ...

2023

Training Efficient Controllers via Analytic Policy Gradient

Dario Floreano, Davide Scaramuzza, Valentin Wüest

Control design for robotic systems is complex and often requires solving an optimization to follow a trajectory accurately. Online optimization approaches like Model Predictive Control (MPC) have been shown to achieve great tracking performance, but requir ...

New York2023