Publications related to Kinect

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

Test-time adaptation for 6D pose tracking

Andrea Cavallaro

We propose a test -time adaptation for 6D object pose tracking that learns to adapt a pre -trained model to track the 6D pose of novel objects. We consider the problem of 6D object pose tracking as a 3D keypoint detection and matching task and present a mo ...

Elsevier Sci Ltd2024

An Authoring Model For Interactive 360 Videos

Roberto Gerson De Albuquerque Azevedo

The recent availability of consumer-level head-mounted displays and omnidirectional cameras has been driving an explosion of 360 video content. Transforming the original recorded 360 video content in meaningful interactive multimedia presentations that sup ...

IEEE2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Real-time 360 Body Scanning System for Virtual Reality Research Applications

Olaf Blanke, Bruno Herbelin, Florian Lance, Louis Philippe Albert

We present a low-cost solution to perform the online and realistic representation of users using an array of depth cameras. The system is composed of a cluster of 10 Microsoft Kinect 2 cameras, each one associated to a compact NUC PC to stream live depth & ...

2019

Sphere-Meshes for Real-Time Hand Modeling and Tracking

Mark Pauly, Anastasia Tkach, Andrea Tagliasacchi

Modern systems for real-time hand tracking rely on a combination of discriminative and generative approaches to robustly recover hand poses. Generative approaches require the specification of a geometric model. In this paper, we propose a the use of sphere ...

Assoc Computing Machinery2016

Natural user interface for lighting control: Case study on desktop lighting using modular robots

Auke Ijspeert, Mehmet Hasan Mutlu, Massimo Vespignani, Simon Lukas Hauser, Stéphane Bonardi, Alexandre Bernardino

Roombots (RB) are self-reconfigurable modular robots designed to explore physical structure change by robotic reconfiguration and adaptive locomotion on structured grid environment or unstructured environment. The primary goal of RB is to create adaptive f ...

Ieee2016

Active crosstalk reduction system for multiview autostereoscopic displays

Touradj Ebrahimi, Philippe Hanhart, Carmelo Di Nolfo

Multiview autostereoscopic displays are considered as the future of 3DTV. However, these displays suffer from a high level of crosstalk, which negatively impacts quality of experience (QoE). In this paper, we propose a system to improve 3D QoE on multiview ...

2015

Let Your Body Speak: Communicative Cue Extraction on Natural Interaction Using RGBD Data

Daniel Gatica-Perez

Employment interviews are relevant scenarios for the study of social interaction. In this setting, social skills play an important role, even though the interactions between potential employers and candidates are often limited. One fundamental aspect of so ...

Ieee-Inst Electrical Electronics Engineers Inc2015

Realtime Face Tracking and Animation

Sofien Bouaziz

Capturing and processing human geometry, appearance, and motion is at the core of computer graphics, computer vision, and human-computer interaction. The high complexity of human geometry and motion dynamics, and the high sensitivity of the human visual sy ...

EPFL2015

Optimization Based Control for Target Estimation and Tracking via Highly Observable Trajectories An Application to Motion Control of Autonomous Robotic Vehicles

Colin Neil Jones, Andrea Alessandretti, António Pedro Rodrigues de Aguiar

This paper proposes a Model Predictive Control (MPC) scheme to solve the target estimation and tracking problem. The objective is to derive a feedback law that drives an autonomous robotic vehicle to follow a target vehicle using an on-line estimate of the ...

Springer-Verlag Berlin2015

Dynamic 2D/3D Registration

Mark Pauly, Sofien Bouaziz, Andrea Tagliasacchi

Image and geometry registration algorithms are an essential component of many computer graphics and computer vision systems. With recent technological advances in RGB-D sensors, such as the Microsoft Kinect or Asus Xtion Live, robust algorithms that combin ...

The Eurographics Association2014

Leveraging Colour Segmentation for Upper-Body Detection

Jean-Marc Odobez

This paper presents an upper-body detection algorithm that extends classical shape-based detectors through the use of additional semantic colour segmentation cues. More precisely, candidate upper-body image patches produced by a base detector are soft-segm ...

2014

Hardware and Algorithms for Ultrasonic Depth Imaging

Ivan Dokmanic

Depth imaging is commonly based on light. For example, LIDAR and Kinect use infrared light, while stereo cameras use visible light. These systems require hardware operating at high sampling frequencies, precise calibration, and they dissipate significant p ...

Ieee2014

Natural User Interface for Roombots

Auke Ijspeert, Massimo Vespignani, Rico Möckel, Ayberk Özgür, Stéphane Bonardi

Roombots (RB) are self-reconfigurable modular robots designed to study robotic reconfiguration on a structured grid and adaptive locomotion off grid. One of the main goals of this platform is to create adaptive furniture inside living spaces such as homes ...

IEEE2014

Optimization based control for target estimation and tracking via highly observable trajectories

Colin Neil Jones, Andrea Alessandretti, António Pedro Rodrigues de Aguiar

This paper presents a Model Predictive Control (MPC) scheme to solve the target estimation and tracking problem. The objective is to derive a feedback law that drives a follower vehicle to a target vehicle using on-line estimation of the target position an ...

2014

Dynamic 2D/3D registration for the Kinect

Mark Pauly, Sofien Bouaziz

Image and geometry registration algorithms are essential components of many computer graphics and computer vision systems. With recent technological advances in RGB-D sensors, robust algorithms that combine 2D image and 3D geometry registration have become ...

ACM2013

Wordless Sounds: Robust Speaker Diarization using Privacy-Preserving Audio Representations

Hervé Bourlard, Daniel Gatica-Perez, Sree Hari Krishnan Parthasarathi

This paper investigates robust privacy-sensitive audio features for speaker diarization in multiparty conversations: ie., a set of audio features having low linguistic information for speaker diarization in a single and multiple distant microphone scenario ...

2013

Kinect=IMU? Learning MIMO Signal Mappings to Automatically Translate Activity Recognition Systems Across Sensor Modalities

José del Rocio Millán Ruiz, Ricardo Andres Chavarriaga Lozano, Hesam Sagha, Daniel Roggen

We propose a method to automatically translate a pre-existing activity recognition system, devised for a source sensor domain S, so that it can operate on a newly discovered target sensor domain T , possibly of different modality. First, we use MIMO system ...

2012

Unsupervised Extraction of Audio-Visual Objects

Pierre Vandergheynst, Anna Llagostera Casanovas

We propose a novel method to automatically detect and extract the video modality of the sound sources that are present in a scene. For this purpose, we first assess the synchrony between the moving objects captured with a video camera and the sounds record ...

Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa2011