Publications associées à Stable Diffusion

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

Accelerator-driven Data Arrangement to Minimize Transformers Run-time on Multi-core Architectures

David Atienza Alonso, Giovanni Ansaloni, Alireza Amirshahi

The increasing complexity of transformer models in artificial intelligence expands their computational costs, memory usage, and energy consumption. Hardware acceleration tackles the ensuing challenges by designing processors and accelerators tailored for t ...

2024

Generalization of Scaled Deep ResNets in the Mean-Field Regime

Volkan Cevher, Grigorios Chrysos, Fanghui Liu

Despite the widespread empirical success of ResNet, the generalization properties of deep ResNet are rarely explored beyond the lazy training regime. In this work, we investigate scaled ResNet in the limit of infinitely deep and wide neural networks, of wh ...

2024

Learnable latent embeddings for joint behavioural and neural analysis

Mackenzie Mathis, Steffen Schneider, Jin Hwa Lee

Mapping behavioural actions to neural activity is a fundamental goal of neuroscience. As our ability to record large neural and behavioural data increases, there is growing interest in modelling neural dynamics during adaptive behaviours to probe neural re ...

NATURE PORTFOLIO2023

Toward responsible face datasets: modeling the distribution of a disentangled latent space for sampling face images from demographic groups

Sébastien Marcel, Parsa Rahimi Noshanagh, Christophe René Joseph Ecabert

Recently, it has been exposed that some modern facial recognition systems could discriminate specific demographic groups and may lead to unfair attention with respect to various facial attributes such as gender and origin. The main reason are the biases in ...

IEEE2023

VETIM: Expanding the Vocabulary of Text-to-Image Models only with Text

Sabine Süsstrunk, Radhakrishna Achanta, Mahmut Sami Arpa, Martin Nicolas Everaert

Text-to-image models, such as Stable Diffusion, can generate high-quality images from simple textual prompts. With methods such as Textual Inversion, it is possible to expand the vocabulary of these models with additional concepts, by learning the vocabula ...

BMVA2023

Fashioning the Future: Unlocking the Creative Potential of Deep Generative Models for Design Space Exploration

Pierre Dillenbourg, Richard Lee Davis, Tanja Christina Käser Jacober, Kevin Gonyop Kim, Thiemo Wambsganss, Wei Jiang

This paper investigates the potential impact of deep generative models on the work of creative professionals, specifically focusing on fashion design. We argue that current generative modeling tools lack critical features that would make them useful creati ...

Association for Computing Machinery2023

Text Representation Learning for Low Cost Natural Language Understanding

Jan Frederik Jonas Florian Mai

Natural language processing and other artificial intelligence fields have witnessed impressive progress over the past decade. Although some of this progress is due to algorithmic advances in deep learning, the majority has arguably been enabled by scaling ...

EPFL2023

Stop Pre-Training: Adapt Visual-Language Models to Unseen Languages

Karl Aberer, Rémi Philippe Lebret, Negar Foroutan Eghlidi

Vision-Language Pre-training (VLP) has advanced the performance of many visionlanguage tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in English. Previous w ...

Assoc Computational Linguistics-Acl2023

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina, Tomás Soares De Carvalho Feith

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

Dense Image-based Predictions for Comics Analysis

Deblina Bhattacharjee

Dense image-based prediction methods have advanced tremendously in recent years. Their remarkable development has been possible due to the ample availability of real-world imagery. While these methods work well on photographs, their abilities do not genera ...

EPFL2023

Improving Object Detection under Domain Shifts

Vidit Vidit

Object detection plays a critical role in various computer vision applications, encompassing domains like autonomous vehicles, object tracking, and scene understanding. These applica- tions rely on detectors that generate bounding boxes around known object ...

EPFL2023

Semi-Supervised Deep Learning Representations in Earth Observation Based Forest Management

Devis Tuia, Marc Conrad Russwurm, Lloyd Haydn Hughes, Oleg Antropov, Sudipan Saha

In this study, we examine the potential of several self-supervised deep learning models in predicting forest attributes and detecting forest changes using ESA Sentinel-1 and Sentinel-2 images. The performance of the proposed deep learning models is compare ...

The Institute of Electrical and Electronics Engineers, Inc2023

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Mehmet Fatih Sahin

Non-convex constrained optimization problems have become a powerful framework for modeling a wide range of machine learning problems, with applications in k-means clustering, large- scale semidefinite programs (SDPs), and various other tasks. As the perfor ...

EPFL2023

3DHumanGAN: 3D-Aware Human Image Generation with 3D Pose Mapping

Zhuoqian Yang, Siyuan Li

We present 3DHumanGAN, a 3D-aware generative adversarial network that synthesizes photo-like images of fullbody humans with consistent appearances under different view-angles and body-poses. To tackle the representational and computational challenges in sy ...

Ieee Computer Soc2023

Resolution-robust Large Mask In painting with Fourier Convolutions

Anastasia Remizova

Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that one of the main reasons for that is the lack of an effective receptive field ...

IEEE COMPUTER SOC2022

Generalization of an Encoder-Decoder LSTM model for flood prediction in ungauged catchments

Olga Fink, Yi Zhang, Peter Molnar, Silvan Ragettli

Flood prediction in ungauged catchments is usually conducted by hydrological models that are parameterized based on nearby and similar gauged catchments. As an alternative to this process-based modelling, deep learning (DL) models have demonstrated their a ...

ELSEVIER2022

Latent Space Slicing for Enhanced Entropy Modeling in Learning-Based Point Cloud Geometry Compression

Touradj Ebrahimi, Davi Nachtigall Lazzarotto

The growing adoption of point clouds as an imaging modality has stimulated the search for efficient solutions for compression. Learning-based algorithms have been reporting increasingly better performance and are drawing the attention from the research com ...

IEEE2022

Physics-informed neural networks for diffraction tomography

Demetri Psaltis, Carlo Gigli, Amirhossein Saba Shirvan, Ahmed Ayoub

We propose a physics-informed neural network (PINN) as the forward model for tomographic reconstructions of biological samples. We demonstrate that by training this network with the Helmholtz equation as a physical loss, we can predict the scattered field ...

SPIE-SOC PHOTO-OPTICAL INSTRUMENTATION ENGINEERS2022

Block-Sparse Adversarial Attack To Fool Transformer-Based Text Classifiers

Pascal Frossard, Seyedeh Sahar Sadrizadeh

Recently, it has been shown that, in spite of the significant performance of deep neural networks in different fields, those are vulnerable to adversarial examples. In this paper, we propose a gradient-based adversarial attack against transformer-based tex ...

IEEE2022