Publications associées à Generative grammar

Fashioning Creative Expertise with Generative AI: Graphical Interfaces for GAN-Based Design Space Exploration Better Support Ideation Than Text Prompts for Diffusion Models

Pierre Dillenbourg, Richard Lee Davis, Tanja Christina Käser Jacober, Kevin Gonyop Kim, Wei Jiang, Thiemo Wambsganss

This paper investigates the potential impact of deep generative models on the work of creative professionals. We argue that current generative modeling tools lack critical features that would make them useful creativity support tools, and introduce our own ...

2024

Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling

Robert West, Maxime Jean Julien Peyrard, Marija Sakota

Generative language models (LMs) have become omnipresent across data science. For a wide variety of tasks, inputs can be phrased as natural language prompts for an LM, from whose output the solution can then be extracted. LM performance has consistently be ...

Assoc Computing Machinery2024

Deep Generative Models for Autonomous Driving: from Motion Forecasting to Realistic Image Synthesis

Saeed Saadatnejad

Forecasting is a capability inherent in humans when navigating. Humans routinely plan their paths, considering the potential future movements of those around them. Similarly, to achieve comparable sophistication and safety, autonomous systems must embrace ...

EPFL2023

4M: Massively Multimodal Masked Modeling

Amir Roshan Zamir, Oguzhan Fatih Kar, Roman Christian Bachmann, Shuqing Teresa Yeo, David Mizrahi

Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in co ...

Neural Information Processing Systems (Nips)2023

Deep Learning for Localized-Haptic Feedback in Tactile Surfaces

Camilo Hernandez Mejia

Touchscreens are nowadays the preferred choice for user interfaces in consumer electronics. Significant technological advances have been made in terms of touch sensing and visual quality. However, the haptic feedback offered by commercial products is still ...

EPFL2023

Fashioning the Future: Unlocking the Creative Potential of Deep Generative Models for Design Space Exploration

Pierre Dillenbourg, Richard Lee Davis, Tanja Christina Käser Jacober, Kevin Gonyop Kim, Thiemo Wambsganss, Wei Jiang

This paper investigates the potential impact of deep generative models on the work of creative professionals, specifically focusing on fashion design. We argue that current generative modeling tools lack critical features that would make them useful creati ...

Association for Computing Machinery2023

GANs for All: Supporting Fun and Intuitive Exploration of GAN Latent Spaces

Pierre Dillenbourg, Richard Lee Davis, Kevin Gonyop Kim, Wei Jiang

We have developed a new tool that makes it possible for people with zero programming experience to intentionally and meaningfully explore the latent space of a GAN. We combine a number of methods from the literature into a single system that includes multi ...

PMLR2022

DeepNC: Deep Generative Network Completion

Andreas Oliver Spitz

Most network data are collected from partially observable networks with both missing nodes and missing edges, for example, due to limited resources and privacy settings specified by users on social media. Thus, it stands to reason that inferring the missin ...

IEEE COMPUTER SOC2022

Bayesian Inversion for Nonlinear Imaging Models Using Deep Generative Priors

Michaël Unser, Thanh-An Michel Pham, Pakshal Narendra Bohra, Jonathan Yuelin Dong

Most modern imaging systems incorporate a computational pipeline to infer the image of interest from acquired measurements. The Bayesian approach to solve such ill-posed inverse problems involves the characterization of the posterior distribution of the im ...

2022

Investigating cognitive ability using action-based models of structural brain networks

Enrico Amico

Recent developments in network neuroscience have highlighted the importance of developing techniques for analysing and modelling brain networks. A particularly powerful approach for studying complex neural systems is to formulate generative models that use ...

OXFORD UNIV PRESS2022

Context-Aware Learning for Generative Models

José del Rocio Millán Ruiz, Ricardo Andres Chavarriaga Lozano, Robert Leeb, Serafeim Perdikis

This work studies the class of algorithms for learning with side-information that emerges by extending generative models with embedded context-related variables. Using finite mixture models (FMMs) as the prototypical Bayesian network, we show that maximum- ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

On Linear Interpolation in the Latent Space of Deep Generative Models

Quentin Christian Becker, Mike Yan Michelis

The underlying geometrical structure of the latent space in deep generative models is in most cases not Euclidean, which may lead to biases when comparing interpolation capabilities of two models. Smoothness and plausibility of linear interpolations in lat ...

2021

Grammar-based generation of bar networks in static equilibrium with bounded bar lengths

Corentin Jean Dominique Fivet, Ioannis Mirtsopoulos

This paper presents a generative approach for the conceptual design of structures, which aims at exploring alternative bar networks in static equilibrium by means of a grammar rule. Operating on incomplete networks of bars in interim static equilibrium, th ...

2021

Explainable Phonology-based Approach for Sign Language Recognition and Assessment

Sandrine Tornay

Sign language technology, unlike spoken language technology, is an emerging area of research. Sign language technologies can help in bridging the gap between the Deaf community and the hearing community. One such computer-aided technology is sign language ...

EPFL2021

Further results on latent discourse models and word embeddings

Youssef Allouah

We discuss some properties of generative models for word embeddings. Namely, (Arora et al., 2016) proposed a latent discourse model implying the concentration of the partition function of the word vectors. This concentration phenomenon led to an asymptotic ...

Microtome Publishing2021

Conditional LSTM-GAN for Melody Generation from Lyrics

Simon Canales, Yi Yu

Melody generation from lyrics has been a challenging research issue in the field of artificial intelligence and music, which enables us to learn and discover latent relationships between interesting lyrics and accompanying melodies. Unfortunately, the limi ...

2021

Deep Generative Models and Applications

Tatjana Chavdarova

Over the past few years, there have been fundamental breakthroughs in core problems in machine learning, largely driven by advances in deep neural networks. The amount of annotated data drastically increased and supervised deep discriminative models exceed ...

EPFL2020

Learning How to Smile: Expression Video Generation With Conditional Adversarial Recurrent Nets

Wei Wang

While several research studies have focused on analyzing human behavior and, in particular, emotional signals from visual data, the problem of synthesizing face video sequences with specific attributes (e.g. age, facial expressions) received much less atte ...

2020

Refutation-based synthesis in SMT

Viktor Kuncak, Andrew Joseph Reynolds

We introduce the first program synthesis engine implemented inside an SMT solver. We present an approach that extracts solution functions from unsatisfiability proofs of the negated form of synthesis conjectures. We also discuss novel counterexample-guided ...

SPRINGER2019

Modeling Facial Geometry using Compositional VAEs

Pascal Fua, Timur Bagautdinov, Chenglei Wu

We propose a method for learning non-linear face geometry representations using deep generative models. Our model is a variational autoencoder with multiple levels of hidden variables where lower layers capture global geometry and higher ones encode more l ...

2018