Publications associées à From Sentence to Emotion: a real-time 3D graphics metaphor of emotions extracted from text

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, José del Rocio Millán Ruiz, Olaf Blanke, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Updates on moleculARweb, the Swiss Portal for Chemistry and Structural Biology Education Using Augmented and now also Virtual Reality

Luciano Andres Abriata, Fabio Jose Cortes Rodriguez

We present a new activity on the moleculARweb plat-form on molecular symmetry elements, two more languages, a new marker-less augmented reality mode, and a new virtual reality tool for VR headsets. ...

SWISS CHEMICAL SOC2023

Affordance segmentation of hand-occluded containers from exocentric images

Andrea Cavallaro

Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this ...

Ieee Computer Soc2023

Empathetic Conversational Agents for Distress Support

Kalpani Anuradha Welivita

Due to the increasing demands of today's fast-paced world, mental health concerns are on the rise, which necessitates innovative approaches to provide support to those in need. Open-domain conversational agents known as chatbots, offer a unique opportunit ...

EPFL2023

Compassion and Engineering Students’ Moral Reasoning: The Emotional Experience of Engineering Ethics Cases

Roland John Tormey, Nihat Kotluk

Background: There has been an increase in interest in emotion in engineering and science ethics education. There is also evidence that emotional content in case studies may improve students’ learning and enhance awareness, understanding, and motivation con ...

American Society for Engineering Education2023

'connEcted caesarean section': creating a virtual link between MOthers and their infanTs to ImprOve maternal childbirth experieNce - study protocol for a PILOT trial (e-motion-pilot)

Sandra Maria Marcadent, Karine Lepigeon, Fiona Corbaz, David Desseauve

IntroductionOne-third of mothers rate their childbirth as traumatic. The prevalence of childbirth-related post-traumatic stress disorder (CB-PTSD) is 4.7%. Skin-to-skin contact is a protective factor against CB-PTSD. However, during a caesarean section (CS ...

BMJ PUBLISHING GROUP2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Sahand Jamal Rahi, Kseniia Korchagina

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Portfolio2023

Academic boredom(s): a person-centered investigation

Alexandra Corina Niculescu

Should we refer to boredom or boredoms? Research on the emotion of boredom sets itself apart from studies on other emotions by posing the question: is boredom a singular concept or does it have multiple facets? In this manuscript presenting empirical resea ...

2023

Projector-based augmented stacking framework for irregularly shaped objects

Yves Weinand, Katrin Beyer, Julien Gamerro, Andrea Settimi, Qianqing Wang, Edward Carlo Giorgio Andò

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

ms3: A parser for MuseScore files, serving as data factory for annotated music corpora

Martin Alois Rohrmeier, Johannes Hentschel

The Python library ms3 makes scores (symbolic representations of music) operational for computational approaches by representing their contents as sets of tabular files. Music scores represent relations between sounding events by graphical means. The Free ...

2023

A Wearable Smart Glove and Its Application of Pose and Gesture Detection to Sign Language Classification

Josephine Anna Eleanor Hughes

Advances in soft sensors coupled with machine learning are enabling increasingly capable wearable systems. Since hand motion in particular can convey useful information for developing intuitive interfaces, glove-based systems can have a significant impact ...

Institute of Electrical and Electronics Engineers Inc.2022

Towards Empathetic Open-Domain Chatbots

Yubo Xie

The research community of dialog generation has been interested in incorporating emotional information into the design of open-domain dialog systems ever since neural networks (sequence-to-sequence models in particular) were adopted for modeling dialogs. T ...

EPFL2022

Cockroach: an open-source tool for point cloud processing in cad

Yves Weinand, Julien Gamerro, Andrea Settimi, Petras Vestartas

In the architecture, engineering and construction (AEC) sector, the use of point cloud data is not a novelty. Usually employed to retrieve data for inspecting construction sites or retrofitting pre-existing buildings, sensors like LiDAR cameras have been k ...

Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)2022

Serab: A Multi-Lingual Benchmark For Speech Emotion Recognition

Pierre Anton Beckmann, Milos Cernak

Recent developments in speech emotion recognition (SER) often leverage deep neural networks (DNNs). Comparing and benchmarking different DNN models can often be tedious due to the use of different datasets and evaluation protocols. To facilitate the proces ...

IEEE2022

Reaching articular limits can negatively impact embodiment in virtual reality

Ronan Boulic, Bruno Herbelin, Olaf Blanke, Thibault Serge Mario Porssut

Providing Virtual Reality(VR) users with a 3D representation of their body complements the experience of immersion and presence in the virtual world with the experience of being physically located and more personally involved. A full-body avatar representa ...

2022

Efficient and Accurate Physically-Based Differentiable Rendering

Delio Aleardo Vicini

Physically-based rendering algorithms generate photorealistic images of virtual scenes. By simulating light paths in a scene, complex physical effects such as shadows, reflections and volumetric scattering can be reproduced. Over the last decade, physicall ...

EPFL2022

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Edoardo Remelli

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

EPFL2022

Differentiable Physically Based Rendering: Algorithms, Systems and Applications

Merlin Eléazar Nimier-David

Physically based rendering methods can create photorealistic images by simulating the propagation and interaction of light in a virtual scene. Given a scene description including the shape of objects, participating media, material properties, etc., the sim ...

EPFL2022