Publications associées à Audiovisual Diarization Of People In Video Content

Understanding and Enhancing Digital Wellbeing Dimensions: Empirical Studies on Smartphone Usage Patterns and Recommendations of Micro-Informative Content

Digital technology has become an integral part of our lives, offering various benefits from communication and entertainment to education and productivity. However, its pervasive use has also raised concerns about its potential negative impact on users' wel ...

EPFL2024

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Claudio Bruschini, Edoardo Charbon, Andrei Ardelean, Mohit Gupta

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

Referencing in YouTube Knowledge Communication Videos

Daniel Gatica-Perez, Haeeun Kim

In recent years, there has been widespread concern about misinformation and hateful content on social media that are damaging societies. Being one of the most influential social media that practically serves as a newsearch engine, YouTube has accepted crit ...

Assoc Computing Machinery2023

AI-based telepresence for broadcast applications

Touradj Ebrahimi, Rayan Daod Nathoo, Laurent Deillon, Henrique Piñeiro Monteagudo

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

SPIE2022

Asynchrony Increases Efficiency: Time Encoding of Videos and Low-Rank Signals

Martin Vetterli, Adam James Scholefield, Karen Adam

In event-based sensing, many sensors independently and asynchronously emit events when there is a change in their input. Event-based sensing can present significant improvements in power efficiency when compared to traditional sampling, because (1) the out ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

A novel assessment framework for learning-based deepfake detectors in realistic conditions

Touradj Ebrahimi, Yuhang Lu

Detecting manipulations in facial images and video has become an increasingly popular topic in media forensics community. At the same time, deep convolutional neural networks have achieved exceptional results on deepfake detection tasks. Despite the remark ...

2022

How Asynchronous Events Encode Video

Martin Vetterli, Adam James Scholefield, Karen Adam

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology’s potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events when their inputs change, thus encodin ...

IEEE2021

Multisensory haptic system and method

Olaf Blanke, Simon Gallo, Giulio Rognini

A computer-implemented method for operating a haptic device, the haptic device comprising a plurality of tactile displays configured to provide haptic stimuli to a user, the method including the steps of (a) processing an audio signal derived from an audio ...

2020

ASAP: a Dataset of Aligned Scores and Performances for Piano Transcription

Andrew Philip McLeod

In this paper we present Aligned Scores and Performances (ASAP): a new dataset of 222 digital musical scores aligned with 1068 performances (more than 92 hours) of Western classical piano music.The scores are provided as paired MusicXML files and quantized ...

2020

Sparse and Parametric Modeling with Applications to Acoustics and Audio

Helena Peic Tukuljac

Recent advances in signal processing, machine learning and deep learning with sparse intrinsic structure of data have paved the path for solving inverse problems in acoustics and audio. The main task of this thesis was to bridge the gap between the powerfu ...

EPFL2020

Predictive Validity of Thin-Slice Nonverbal Behavior from Social Interactions

Laurent Son Nguyen, Denise Frauendorfer

We present five studies investigating the predictive validity of thin slices of nonverbal behavior (NVB). Predictive validity of thin slices refers to how well behavior slices excerpted from longer video predict other measured variables. Using six NVBs, we ...

SAGE PUBLICATIONS INC2019

Synthetic electronic video containing a hidden image

Roger Hersch, Sabine Süsstrunk, Mahmut Sami Arpa

We present a method for hiding images in synthetic videos and reveal them by temporal averaging. We developed a visual masking method that hides the input image both spatially and temporally. Our masking approach consists of temporal and spatial pixel by p ...

2019

Dynamic Adaptive Streaming for Multi-Viewpoint Omnidirectional Videos

Pascal Frossard, Francesca De Simone, Xavier Corbillon

Full immersion inside a Virtual Reality (VR) scene requires six Degrees of Freedom (6DoF) applications where the user is allowed to perform translational and rotational movements within the virtual space. The implementation of 6DoF applications is however ...

ASSOC COMPUTING MACHINERY2018

Vlogging Over Time: Longitudinal Impressions and Behavior in YouTube

Daniel Gatica-Perez, Dinesh Babu Jayagopi, Dairazalia Sanchez Cortes

YouTube vlogging, as a popular genre of ubiquitous social video, engages people in entertainment, civic, and social activities. Although several aspects of vlogging have been studied in media studies and multimedia analysis, the longitudinal angle of vlogg ...

ASSOC COMPUTING MACHINERY2018

Machine Learning-Based Quality-Aware Power and Thermal Management of Multistream HEVC Encoding on Multicore Servers

David Atienza Alonso, Marina Zapater Sancho, Arman Iranfar

The emergence of video streaming applications, together with the users’ demand for high-resolution contents, has led to the development of new video coding standards, such as High Efficiency Video Coding (HEVC). HEVC provides high efficiency at the cost of ...

2018

Optimal Lagrange Multipliers for Dependent Rate Allocation in Video Coding

Pascal Frossard, Ana Karina De Abreu Goes

In a typical video rate allocation problem, the objective is to optimally distribute a source rate budget among a set of (in)dependently coded data units to minimize the total distortion. Conventional Lagrangian approaches convert the lone rate constraint ...

Elsevier2018

Inpainting of Long Audio Segments With Similarity Graphs

Nathanaël Perraudin

We present a novel method for the compensation of long duration data loss in audio signals, in particular music. The concealment of such signal defects is based on a graph that encodes signal structure in terms of time-persistent spectral similarity. A sui ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2018

Digital transformation and open innovation ecosystems in the tilm industry: the case of the Movieday platform

Christopher Tucci, Gianluigi Viscusi

Digital technologies are transforming the film industry. Up until roughly a decade ago, the business model for film exhibition was based on theatrical release in combination with television sales and home cinema releases (video and DVD). Recently, many que ...

2017

Adaptive-Rate Reconstruction of Time-Varying Signals with Application in Compressive Foreground Extraction

Volkan Cevher

We propose and analyze an online algorithm for reconstructing a sequence of signals from a limited number of linear measurements. The signals are assumed sparse, with unknown support, and evolve over time according to a generic nonlinear dynamical model. O ...

Institute of Electrical and Electronics Engineers2016

Adaptive-Rate Sparse Signal Reconstruction With Application in Compressive Foreground Subtraction

Volkan Cevher

We propose and analyze an online algorithm for reconstructing a sequence of signals from a limited number of linear measurements. The signals are assumed sparse, with unknown support, and evolve over time according to a generic nonlinear dynamical model. O ...

Institute of Electrical and Electronics Engineers2016