Publications related to Microsoft HoloLens

Effects of Head-Tracking Artefacts on Externalization and Localization in Azimuth With Binaural Wearable Devices

Hervé Lissek, Gilles André Courtois, Vincent Pierre Olivier Grimaldi

Head tracking combined with head movements have been shown to improve auditory externalization of a virtual sound source and contribute to the performance in localization. With certain technically constrained head-tracking algorithms, as can be found in we ...

Audio Engineering Soc2023

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Maxim Pavliv, Fabrizio Schiano, Giuseppe Loianno

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

Towards BCI-Based Interfaces for Augmented Reality: Feasibility, Design and Evaluation

Nicolas Julien Roussel, Camille Marie Jeunet

Brain-Computer Interfaces (BCIs) enable users to interact with computers without any dedicated movement, bringing new hands-free interaction paradigms. In this paper we study the combination of BCI and Augmented Reality (AR). We first tested the feasibilit ...

2020

Real-time 360 Body Scanning System for Virtual Reality Research Applications

Olaf Blanke, Bruno Herbelin, Florian Lance, Louis Philippe Albert

We present a low-cost solution to perform the online and realistic representation of users using an array of depth cameras. The system is composed of a cluster of 10 Microsoft Kinect 2 cameras, each one associated to a compact NUC PC to stream live depth & ...

2019

A Gaze Visualizer Tool Implementation Of Gaze Data Into Lighting Rendering Tools Using Radiance And Honeybee For Grasshopper3D

Marilyne Andersen, Jan Wienold, Mandana Sarey Khanie

The Gaze Visualizer tool is an implementation of eyetracking (gaze) data and a preliminary gaze responsive light driven (GRL) model, which enables to visualize gaze behavior in a 3D space, in Grasshopper3D. The workflow from obtaining the relevant photomet ...

AMER SOC HEATING, REFRIGERATING AND AIR-CONDITIONING ENGS2018

AR in VR: Simulating Infrared Augmented Vision

Sabine Süsstrunk, Fayez Lahoud

Developing an augmented reality (AR) system involves multiple algorithms such as image fusion, camera synchronization and calibration, and brightness control, each of them having diverse variants. This abundance of features, while beneficial in nature, is ...

2018

Visual Augmentation of Deictic Gestures in MOOC Videos

Pierre Dillenbourg, Kshitij Sharma

We present an eye-tracking study to compare different modalities for visual augmentations of the teacher’s explicit deictic gestures on a video lecture. We compared three visualizations: 1) hand gestures with a pointer, 2) gaze overlay, and 3) no-augmentat ...

2016

Kinect=IMU? Learning MIMO Signal Mappings to Automatically Translate Activity Recognition Systems Across Sensor Modalities

José del Rocio Millán Ruiz, Ricardo Andres Chavarriaga Lozano, Hesam Sagha, Daniel Roggen

We propose a method to automatically translate a pre-existing activity recognition system, devised for a source sensor domain S, so that it can operate on a newly discovered target sensor domain T , possibly of different modality. First, we use MIMO system ...

2012

A Wearable Gaze Tracking System for Children in Unconstrained Environments

Aude Billard, Basilio Noris, Jean-Baptiste Keller

We present here a head-mounted gaze tracking system for the study of visual behavior in unconstrained environments. The system is designed both for adults and for infants as young as 1 year of age. The system uses two CCD cameras to record a very wide fiel ...

2011

Gaze quality assisted automatic recognition of social contexts in collaborative Tetris

Patrick Jermann, Weifeng Li, Marc-Antoine Nüssli

The use of dual eye-tracking is investigated in a collabora- tive game setting. Social context influences individual gaze and action during a collaborative Tetris game: results show that experts as well as novices adapt their playing style when interacting ...

2010

6th Sense - Toward a Generic Framework for End-to-End Adaptive Wearable Augmented Reality

Denis Gillet, Christophe Salzmann, Damien Perritaz

Augmented Reality enhances the user perception by overlaying real world information with virtual computer-generated information. The aims of the 6 th Sense pro ject are to maximize the user experience in mobile Augmented Reality and to improve the context- ...

2009