Publications related to Audio deepfake

Assessment framework for deepfake detection in real-world situations

Detecting digital face manipulation in images and video has attracted extensive attention due to the potential risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have been employed and ...

2024

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Sabine Süsstrunk, Yufan Ren, Peter Arpad Grönquist, Alessio Verardo, Qingyi He

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

2024

Improving Deepfake Detectors against Real-world Perturbations with Amplitude-Phase Switch Augmentation

Touradj Ebrahimi, Yuhang Lu, Ruizhi Luo

In recent years, the remarkable progress in facial manipulation techniques has raised social concerns due to their potential malicious usage and has received considerable attention from both industry and academia. While current deep learning-based face for ...

2023

Impact of Video Processing Operations in Deepfake Detection

Touradj Ebrahimi, Yuhang Lu

The detection of digital face manipulation in video has attracted extensive attention due to the increased risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have been developed and ha ...

2023

Improving Object Detection under Domain Shifts

Vidit Vidit

Object detection plays a critical role in various computer vision applications, encompassing domains like autonomous vehicles, object tracking, and scene understanding. These applica- tions rely on detectors that generate bounding boxes around known object ...

EPFL2023

A multimodal measurement of the impact of deepfakes on the ethical reasoning and affective reactions of students

Touradj Ebrahimi, Patrick Jermann, Roland John Tormey, Cécile Hardebolle, Nihat Kotluk, Vivek Ramachandran

Deepfakes - synthetic videos generated by machine learning models - are becoming increasingly sophisticated. While they have several positive use cases, their potential for harm is also high. Deepfake production involves input from multiple engineers, maki ...

2023

Leveraging Unlabeled Data to Track Memorization

Patrick Thiran, Mahsa Forouzesh, Hanie Sedghi

Deep neural networks may easily memorize noisy labels present in real-world data, which degrades their ability to generalize. It is therefore important to track and evaluate the robustness of models against noisy label memorization. We propose a metric, ca ...

2023

Towards more Practical Threat Models in Artificial Intelligence Security

Alexandre Massoud Alahi, Kathrin Grosse

Recent works have identified a gap between research and practice in artificial intelligence security: threats studied in academia do not always reflect the practical use and security risks of AI. For example, while models are often studied in isolation, th ...

Usenix Association2024

A novel assessment framework for learning-based deepfake detectors in realistic conditions

Touradj Ebrahimi, Yuhang Lu

Detecting manipulations in facial images and video has become an increasingly popular topic in media forensics community. At the same time, deep convolutional neural networks have achieved exceptional results on deepfake detection tasks. Despite the remark ...

2022

Self-supervised Segmentation via Background Inpainting

Pascal Fua, Mathieu Salzmann, Isinsu Katircioglu, Helge Jochen Rhodin, Victor Constantin

While supervised object detection and segmentation methods achieve impressive accuracy, they generalize poorly to images whose appearance significantly differs from the data they have been trained on. To address this when annotating data is prohibitively e ...

2022

Synthetic Disinformation Attacks on Automated Fact Verification Systems

Antoine Bosselut

Automated fact-checking is a needed technology to curtail the spread of online misinformation. One current framework for such solutions proposes to verify claims by retrieving supporting or refuting evidence from related textual sources. However, the reali ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2022

Risk governance and the rise of deepfakes

Touradj Ebrahimi

Deepfakes first came to prominence less than five years ago. Since then, they have surged in quantity and quality, becoming both a source of viral entertainment and of concern about the dark side of digital life. In this article, we provide a risk governan ...

International Risk Governance Center2021

Utterance Verification-Based Dysarthric Speech Intelligibility Assessment Using Phonetic Posterior Features

Mathew Magimai Doss, Julian David Fritsch

In the literature, the task of dysarthric speech intelligibility assessment has been approached through development of different low-level feature representations, subspace modeling, phone confidence estimation or measurement of automatic speech recognitio ...

IEEE Institute of Electrical and Electronics Engineers2021

CryoGAN: A New Reconstruction Paradigm for Single-Particle Cryo-EM Via Deep Adversarial Learning

Michaël Unser, Laurène Donati, Harshit Gupta, Michael Thompson McCann

We present CryoGAN, a new paradigm for single-particle cryo-electron microscopy (cryo-EM) reconstruction based on unsupervised deep adversarial learning. In single-particle cryo-EM, the structure of a biomolecule needs to be reconstructed from a large set ...

2021

Trainable Preprocessing for Reduced Precision Neural Networks

Gabor Andras Csordas

Applications of neural networks are emerging in many fields and are frequently implemented in embedded environment, introducing power, throughput and latency constraints next to accuracy. Although practical computer vision solutions always involve some kin ...

EUROPEAN ASSOC SIGNAL SPEECH & IMAGE PROCESSING-EURASIP2021

Learning One Class Representations for Face Presentation Attack Detection using Multi-channel Convolutional Neural Networks

Sébastien Marcel

Face recognition has evolved as a widely used biometric modality. However, its vulnerability against presentation attacks poses a significant security threat. Though presentation attack detection (PAD) methods try to address this issue, they often fail in ...

IEEE2020

Neural Network Based End-to-End Query by Example Spoken Term Detection

Hervé Bourlard, Dhananjay Ram

This article focuses on the problem of query by example spoken term detection (QbE-STD) in zero-resource scenario. State-of-the-art approaches primarily rely on dynamic time warping (DTW) based template matching techniques using phone posterior or bottlene ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Editing in Style: Uncovering the Local Semantics of GANs

Sabine Süsstrunk, Edo Collins

While the quality of GAN image synthesis has improved tremendously in recent years, our ability to control and condition the output is still limited. Focusing on StyleGAN, we introduce a simple and effective method for making local, semantically-aware edit ...

IEEE2020

Multilingual and Unsupervised Subword Modeling for Zero-Resource Languages

Enno Hermann

Subword modeling for zero-resource languages aims to learn low-level representations of speech audio without using transcriptions or other resources from the target language (such as text corpora or pronunciation dictionaries). A good representation should ...

2021

WatchNet plus plus : efficient and accurate depth-based network for detecting people attacks and intrusion

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

We present an efficient and accurate people detection approach based on deep learning to detect people attacks and intrusion in video surveillance scenarios Unlike other approaches using background segmentation and pre-processing techniques, which are not ...

2020