Publications related to Synthetic media

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Sabine Süsstrunk, Yufan Ren, Peter Arpad Grönquist, Alessio Verardo, Qingyi He

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

2024

GELEX: Generative AI-Hybrid System for Example-Based Learning

Paola Mejia Domenzain, Aybars Yazici, Tanja Christina Käser Jacober, Jibril Albachir Frej

Traditional example-based learning methods are often limited by static, expert-created content. Hence, they face challenges in scalability, engagement, and effectiveness, as some learners might struggle to relate to the examples or find them relevant. To a ...

Association for Computing Machinery2024

On Speed and Advantage : Results in Information Velocity and Monitoring Problems

Reka Inovan

Information theory has allowed us to determine the fundamental limit of various communication and algorithmic problems, e.g., the channel coding problem, the compression problem, and the hypothesis testing problem. In this work, we revisit the assumptions ...

EPFL2024

A multimodal measurement of the impact of deepfakes on the ethical reasoning and affective reactions of students

Touradj Ebrahimi, Patrick Jermann, Roland John Tormey, Cécile Hardebolle, Nihat Kotluk, Vivek Ramachandran

Deepfakes - synthetic videos generated by machine learning models - are becoming increasingly sophisticated. While they have several positive use cases, their potential for harm is also high. Deepfake production involves input from multiple engineers, maki ...

2023

Deep Generative Models for Autonomous Driving: from Motion Forecasting to Realistic Image Synthesis

Saeed Saadatnejad

Forecasting is a capability inherent in humans when navigating. Humans routinely plan their paths, considering the potential future movements of those around them. Similarly, to achieve comparable sophistication and safety, autonomous systems must embrace ...

EPFL2023

Fast Adversarial Training With Adaptive Step Size

Mathieu Salzmann, Sabine Süsstrunk, Chen Liu, Zhuoyi Huang, Yong Zhang, Jue Wang

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of recent works to ...

Ieee-Inst Electrical Electronics Engineers Inc2023

Smart filter aided domain adversarial neural network for fault diagnosis in noisy industrial scenarios

Olga Fink, Gaëtan Michel Frusque, Tianfu Li, Qi Li, Baorui Dai

The application of unsupervised domain adaptation (UDA)-based fault diagnosis methods has shown significant efficacy in industrial settings, facilitating the transfer of operational experience and fault signatures between different operating conditions, di ...

2023

DyNCA: Real-time Dynamic Texture Synthesis Using Neural Cellular Automata

Sabine Süsstrunk, Ehsan Pajouheshgar, Yitao Xu, Tong Zhang

Current Dynamic Texture Synthesis (DyTS) models can synthesize realistic videos. However, they require a slow iterative optimization process to synthesize a single fixed-size short video, and they do not offer any post-training control over the synthesis p ...

Ieee Computer Soc2023

Learnable Wavelet Transform and Domain Adversarial Learning for Enhanced Bearing Fault Diagnosis

Olga Fink, Gaëtan Michel Frusque, Qi Li, Baorui Dai

The application of unsupervised domain adaptation (UDA)-based fault diagnosis methods has shown significant efficacy in industrial settings, facilitating the transfer of operational experience and fault signatures between different operating conditions, di ...

Research Publishing2023

Towards more Practical Threat Models in Artificial Intelligence Security

Alexandre Massoud Alahi, Kathrin Grosse

Recent works have identified a gap between research and practice in artificial intelligence security: threats studied in academia do not always reflect the practical use and security risks of AI. For example, while models are often studied in isolation, th ...

Usenix Association2024

Validating functional redundancy with mixed generative adversarial networks

Thanh Trung Huynh, Quoc Viet Hung Nguyen, Thành Tâm Nguyên, Trung-Dung Hoang

Data redundancy has been one of the most important problems in data-intensive applications such as data mining and machine learning. Removing data redundancy brings many benefits in efficient data updating, effective data storage, and error-free query proc ...

ELSEVIER2023

VETIM: Expanding the Vocabulary of Text-to-Image Models only with Text

Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

Text-to-image models, such as Stable Diffusion, can generate high-quality images from simple textual prompts. With methods such as Textual Inversion, it is possible to expand the vocabulary of these models with additional concepts, by learning the vocabula ...

BMVA2023

Synthetic Disinformation Attacks on Automated Fact Verification Systems

Antoine Bosselut

Automated fact-checking is a needed technology to curtail the spread of online misinformation. One current framework for such solutions proposes to verify claims by retrieving supporting or refuting evidence from related textual sources. However, the reali ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2022

Vehicle trajectory prediction works, but not everywhere

Alexandre Massoud Alahi, Seyed Mohsen Moosavi Dezfooli, Saeed Saadatnejad, Ahmad Rahimi, Mohammadhossein Bahari

Vehicle trajectory prediction is nowadays a fundamental pillar of self-driving cars. Both the industry and research communities have acknowledged the need for such a pillar by providing public benchmarks. While state-of-the-art methods are impressive, i.e. ...

IEEE2022

Safety-Compliant Generative Adversarial Networks for Human Trajectory Forecasting

Alexandre Massoud Alahi, Parth Ashit Kothari

Human trajectory forecasting in crowds presents the challenges of modelling social interactions and outputting collision-free multimodal distribution. Following the success of Social Generative Adversarial Networks (SGAN), recent works propose various GAN- ...

IEEE Institute of Electrical and Electronics Engineers2023

Neural System Level Synthesis: Learning over All Stabilizing Policies for Nonlinear Systems

Giancarlo Ferrari Trecate, Luca Furieri, Clara Lucía Galimberti

We address the problem of designing stabilizing control policies for nonlinear systems in discrete-time, while minimizing an arbitrary cost function. When the system is linear and the cost is convex, the System Level Synthesis (SLS) approach offers an effe ...

IEEE2022

Adversarial training with informed data selection

Pascal Frossard, Javier Alejandro Maroto Morales, Marcele Oliveira Kuhfuss de Mendonça

With the increasing amount of available data and advances in computing capabilities, deep neural networks (DNNs) have been successfully employed to solve challenging tasks in various areas, including healthcare, climate, and finance. Nevertheless, state-of ...

IEEE2022

Adversarial Robustness by Design Through Analog Computing And Synthetic Gradients

Florent Gérard Krzakala, Julien Marcel Daniel Emmanuel Launay, Ruben Elie Ohana

We propose a new defense mechanism against adversarial at-tacks inspired by an optical co-processor, providing robustness without compromising natural accuracy in both white-box and black-box settings. This hardware co-processor performs a nonlinear fixed ...

IEEE2022

Towards Verifiable, Generalizable and Efficient Robust Deep Neural Networks

Chen Liu

In the last decade, deep neural networks have achieved tremendous success in many fields of machine learning. However, they are shown vulnerable against adversarial attacks: well-designed, yet imperceptible, perturbations can make the state-of-the-art deep ...

EPFL2022

Risk governance and the rise of deepfakes

Touradj Ebrahimi

Deepfakes first came to prominence less than five years ago. Since then, they have surged in quantity and quality, becoming both a source of viral entertainment and of concern about the dark side of digital life. In this article, we provide a risk governan ...

International Risk Governance Center2021