Publications associées à SKILL: Structured Knowledge Infusion for Large Language Models

Infusing structured knowledge priors in neural models for sample-efficient symbolic reasoning

The ability to reason, plan and solve highly abstract problems is a hallmark of human intelligence. Recent advancements in artificial intelligence, propelled by deep neural networks, have revolutionized disciplines like computer vision and natural language ...

EPFL2024

Ontology-based Knowledge Representation for Traditional Martial Arts

Yumeng Hou, Sarah Irene Brutton Kenderdine

Traditional martial arts are treasures of humanity's knowledge and critical carriers of sociocultural memories throughout history. However, such treasured practices have encountered various challenges in knowledge transmission and now feature many entries ...

2024

Augmenting large language models with chemistry tools

Philippe Schwaller, Oliver Tobias Schilter, Andres Camilo Marulanda Bran, Carlo Baldassari

Large language models (LLMs) have shown strong performance in tasks across domains but struggle with chemistry-related problems. These models also lack access to external knowledge sources, limiting their usefulness in scientific applications. We introduce ...

Nature Portfolio2024

Social-Transmotion: Promptable Human Trajectory Prediction

Alexandre Massoud Alahi, Saeed Saadatnejad, Yang Gao, Kaouther Messaoud Ben Amor

Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate when navigating ...

2024

Quasi-operando Transmission Electron Microscopy Diagnostics for Electrocatalytic Processes in Liquids

Vasiliki Tileli

It is of great interest to the energy community to understand how the mechano-physico-chemical phenomena that eventually lead to device degradation are related to the startup, operation, and shutdown phases. For electrocatalytic systems operating in liquid ...

Swiss Chemical Soc2024

Fly-Swat or Cannon? Cost-Effective Language Model Choice via Meta-Modeling

Maxime Jean Julien Peyrard, Robert West, Marija Sakota

Generative language models (LMs) have become omnipresent across data science. For a wide variety of tasks, inputs can be phrased as natural language prompts for an LM, from whose output the solution can then be extracted. LM performance has consistently be ...

Assoc Computing Machinery2024

Beyond fine-tuning: LoRA modules boost near-OOD detection and LLM security

Pierre Vandergheynst, Milos Vasic, Renata Khasanova, Francesco Craighero

Under resource constraints, LLMs are usually fine- tuned with additional knowledge using Parameter Efficient Fine-Tuning (PEFT), using Low-Rank Adaptation (LoRA) modules. In fact, LoRA injects a new set of small trainable matrices to adapt an LLM to a new ...

2024

Beyond fine-tuning: LoRA modules boost near-OOD detection and LLM security

Pierre Vandergheynst, Milos Vasic, Renata Khasanova, Francesco Craighero

Under resource constraints, LLMs are usually fine-tuned with additional knowledge using Parameter Efficient Fine-Tuning (PEFT), using Low-Rank Adaptation (LoRA) modules. In fact, LoRA injects a new set of small trainable matrices to adapt an LLM to a new t ...

2024

Driving and suppressing the human language network using large language models

Martin Schrimpf

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict t ...

Nature Portfolio2024

Echoing Swiss Coloniality. Land, Archive and Visuality between Brazil and Switzerland

Denise Bertschi

Informed by longstanding artistic practice, this doctoral thesis approaches entanglements of Swiss coloniality in Brazil and Switzerland under the lens of land, archive, and visuality. The enduring legacies of imperial capitalism in the former Colonia Leop ...

EPFL2024

Bioengineering functional organoid models across scales

Tania Hübscher

The last two decades have seen the development of organoid models for many different tissues and organs. Organoids are three-dimensional organ-mimetics derived from stem or progenitor cells comprising various specialized cell types, resembling the architec ...

EPFL2024

Quartiers rhodaniens en transition

Sara Sonia Formery Regazzoni

Over the course of history, the relationship between cities and their waters has shown different gradients of interweaving, marked by cycles of bonding and distancing. Following a period of complete neglect of urban watercourses, the versatile, multifacete ...

EPFL2024

Machine Learning for Modeling Stock Returns

Teng Andrea Xu

Throughout history, the pace of knowledge and information sharing has evolved into an unthinkable speed and media. At the end of the XVII century, in Europe, the ideas that would shape the "Age of Enlightenment" were slowly being developed in coffeehouses, ...

EPFL2024

A comprehensive review on geomembrane systems application in hydropower

Giovanni De Cesare, Samuel Luke Vorlet

Geomembrane systems have been used at hydropower plants as rehabilitation and mitigation technology for several decades and are now used worldwide. In the context of planning an energy transition that promotes the sustainable use of water resources for ene ...

2024

The multimodality cell segmentation challenge: toward universal solutions

Xin Yang, Bo Wang, Yixin Wang, Jun Ma, Lin Han, Maxime Emmanuel Scheder, Marco Labagnara, Sahand Jamal Rahi, Vojislav Gligorovski, Yao Zhang

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimen ...

Nature Portfolio2024

Global existence for perturbations of the 2D stochastic Navier-Stokes equations with space-time white noise

Martin Hairer

We prove global in time well-posedness for perturbations of the 2D stochastic Navier-Stokes equations partial derivative( t)u + u center dot del u = Delta u - del p + sigma + xi, u(0, center dot ) = u(0),div (u) = 0, driven by additive space-time white noi ...

Springernature2024

Enhancing Procedural Writing Through Personalized Example Retrieval: A Case Study on Cooking Recipes

Tanja Christina Käser Jacober, Paola Mejia Domenzain, Luca Mouchel, Antoine Bosselut, Thiemo Wambsganss, Seyed Parsa Neshaei, Jibril Albachir Frej, Tatjana Nazaretsky

Writing high-quality procedural texts is a challenging task for many learners. While example-based learning has shown promise as a feedback approach, a limitation arises when all learners receive the same content without considering their individual input ...

2024

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Maria del Carmen Sandi Perez, Elias Georges Gebara, Ana del Rocio Conde Moro

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Springer2024

Text-to-Microstructure Generation Using Generative Deep Learning

Jamie Paik

Designing novel materials is greatly dependent on understanding the design principles, physical mechanisms, and modeling methods of material microstructures, requiring experienced designers with expertise and several rounds of trial and error. Although rec ...

Wiley-V C H Verlag Gmbh2024

Accelerator-driven Data Arrangement to Minimize Transformers Run-time on Multi-core Architectures

David Atienza Alonso, Giovanni Ansaloni, Alireza Amirshahi

The increasing complexity of transformer models in artificial intelligence expands their computational costs, memory usage, and energy consumption. Hardware acceleration tackles the ensuing challenges by designing processors and accelerators tailored for t ...

2024