Publications related to Modality (human–computer interaction)

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Keep Sensors in Check: Disentangling Country-Level Generalization Issues in Mobile Sensor-Based Models with Diversity Scores

Daniel Gatica-Perez, Lakmal Buddika Meegahapola

Machine learning models trained with passive sensor data from mobile devices can be used to perform various inferences pertaining to activity recognition, context awareness, and health and well-being. Prior work has improved inference performance through t ...

Assoc Computing Machinery2023

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

Dynamic pulse scheduling in ASDEX Upgrade: Disruption avoidance and investigation of the H-Mode density limit

Federico Alberto Alfredo Felici, Alessandro Pau, Bernhard Sieglin

Operation of a tokamak device requires the coordinated operation of a multitude of systems. The sequence of operations during a discharge is both too complex and fast for human interaction. A common way of operation is a predefined sequence of operations w ...

2023

Focus on People: Five Qestions from Human-Centered Computing

Daniel Gatica-Perez

A substantial body of research in multimodal interaction has studied how people naturally interact -face-to-face and through machinesand developed technology to analyze, support, and extend such forms of interaction. The talk will share personal experience ...

Assoc Computing Machinery2022

Introducing Alternative Value Proposition Canvases for Collaborative and Blended Design Thinking Activities in Science and Engineering Education

Denis Gillet, Isabelle Barbara Marie-Hélène Cardia

The value proposition canvas introduced in 2015 by Pigneur et al. is broadly used by entrepreneurs and intrapreneurs to create new services and products. We decided to apply it for collaborative and blended design thinking activities in a specialization in ...

IEEE2022

Do Children Adapt Their Perspective to a Robot When They Fail to Complete a Task?

Pierre Dillenbourg, Elmira Yadollahi, Ana Paiva

Spatial understanding and communication are essential skills in human interaction. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, both perceptually and cognitively. In this paper, we take the first st ...

Assoc Computing Machinery2022

Conversational Multi-Hop Reasoning with Neural Commonsense Knowledge and Symbolic Logic Rules

Antoine Bosselut, Forough Arabshahi

One of the challenges faced by conversational agents is their inability to identify unstated presumptions of their users' commands, a task trivial for humans due to their common sense. In this paper, we propose a zeroshot commonsense reasoning system for c ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2021

Electronic Skins for Healthcare Monitoring and Smart Prostheses

Stéphanie Lacour, Laurent Mirko Dejace, Haotian Chen

The human skin is a unique organ that embeds multiple functions that no artificial systems can currently replicate. Advances in materials science and engineering are driving the design of electronic skins-large-area sensor arrays that mimic some sensory mo ...

ANNUAL REVIEWS2021

Exploring Spatial Perspective Taking in Human-Robot Interaction

Elmira Yadollahi

Humans often rely on their perspective taking skills to thrive within the world's complex relations and connections. An adequate understanding of others' spatial perspectives can increase the quality of the interaction, not only perceptually but also cogni ...

EPFL2021

Being Part of the Swarm: Experiencing Human-Swarm Interaction with VR and Tangible Robots

Pierre Dillenbourg, Barbara Bruno, Arzu Güneysu Özgür, Kevin Gonyop Kim, Hala Khodr

A swarm is the coherent behavior that emerges ubiquitously fromsimple interaction rules between self-organized agents. Understand-ing swarms is of utmost importance in many disciplines and jobs,but hard to teach due to the elusive nature of the phenomenon, ...

2020

Privacy-Aware Digital Mediation Tools for Improving Adolescent Mental Well-being: Application to School Bullying

Denis Gillet, Isabelle Barbara Marie-Hélène Cardia, Maria Gaci

In human-computer interaction, self-disclosure of sensitive information regarding distressing experiences requires the establishment of a trust channel between the user and the digital tool. As privacy and security have been identified as factors that cont ...

2020

Retention of E. coli and water on the skin after liquid contact

Tamar Kohn, Timothy R. Julian

The frequent contact people have with liquids containing pathogenic microorganisms provides opportunities for disease transmission. In this work, we quantified the transfer of bacteria—using E. coli as a model- from liquid to skin, estimated liquid retenti ...

2020

Engagement in Human-Agent Interaction: An Overview

Jauwairia Nasir, Catharine Regina Monika Maria Oertel Genannt Bierbach

Engagement is a concept of the utmost importance in human-computer interaction, not only for informing the design and implementation of interfaces, but also for enabling more sophisticated interfaces capable of adapting to users. While the notion of engage ...

2020

FuzzGen: Automatic Fuzzer Generation

Mathias Josef Payer

Fuzzing is a testing technique to discover unknown vulnerabilities in software. When applying fuzzing to libraries, the core idea of supplying random input remains unchanged, yet it is non-trivial to achieve good code coverage. Libraries cannot run as stan ...

USENIX ASSOC2020

Linear Impact Generator for Automated Dataset Acquisition of Elastic Waves in Haptic Surfaces

Yves Perriard, Paolo Germano, Adrien Jean-Michel Thabuis, Camilo Hernandez Mejia

Tactile surfaces are commonly found on a big number of devices nowadays. Generally, this kind of interfaces lacks haptic feedback, which lowers the efficiency and perceived quality of human interaction. Time reversal of elastic waves has been studied and i ...

IEEE2019

Reverse-Engineering Satire, or "Paper on Computational Humor Accepted despite Making Serious Advances"

Robert West

Humor is an essential human trait. Efforts to understand humor have called out links between humor and the foundations of cognition, as well as the importance of humor in social engagement. As such, it is a promising and important subject of study, with re ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2019

Hough Forest With Optimized Leaves for Global Hand Pose Estimation With Arbitrary Postures

Daniel Thalmann, Hui Liang, Jun Lee

Vision-based hand pose estimation is important in human-computer interaction. While many recent works focus on full degree-of-freedom hand pose estimation, robust estimation of global hand pose remains a challenging problem. This paper presents a novel alg ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Responsive Joint Attention in Human-Robot Interaction

Catharine Regina Monika Maria Oertel Genannt Bierbach

Joint attention has been shown to be not only crucial for human-human interaction but also human-robot interaction. Joint attention can help to make cooperation more efficient, support disambiguation in instances of uncertainty and make interactions appear ...

IEEE2019

Lean synthesis and application to lower-limb exoskeletons

Tristan Hubert Vouga

Mobility impairments are the most prevalent of all disabilities, affecting the life of nearly one in 20 individuals in developed countries. In the most severe cases, they can have dramatic consequences for the social, mental and physical well-being of thos ...

EPFL2019