Publications related to Extreme learning machine

On the number of regions of piecewise linear neural networks

Michaël Unser, Alexis Marie Frederic Goujon

Many feedforward neural networks (NNs) generate continuous and piecewise-linear (CPWL) mappings. Specifically, they partition the input domain into regions on which the mapping is affine. The number of these so-called linear regions offers a natural metric ...

2024

The inductive bias of deep learning: Connecting weights and functions

Guillermo Ortiz Jimenez

Years of a fierce competition have naturally selected the fittest deep learning algorithms. Yet, although these models work well in practice, we still lack a proper characterization of why they do so. This poses serious questions about the robustness, trus ...

EPFL2023

The Societal and Scientific Importance of Inclusivity, Diversity, and Equity in Machine Learning for Chemistry

Daniel Probst

While the introduction of practical deep learning has driven progress across scientific fields, recent research highlighted that the requirement of deep learning for ever-increasing computational resources and data has potential negative impacts on the sci ...

2023

NMDA-driven dendritic modulation enables multitask representation learning in hierarchical sensory processing pathways

Willem Anna Mark Wybo, Bernd Albert Illing, Matthias Chinyen Tsai, Walter Senn

While sensory representations in the brain depend on context, it remains unclear how such modulations are implemented at the biophysical level, and how processing layers further in the hierarchy can extract useful features for each possible contex-tual sta ...

National Academy of Sciences2023

Universal Approximation Property of Hamiltonian Deep Neural Networks

Giancarlo Ferrari Trecate, Muhammad Zakwan

This letter investigates the universal approximation capabilities of Hamiltonian Deep Neural Networks (HDNNs) that arise from the discretization of Hamiltonian Neural Ordinary Differential Equations. Recently, it has been shown that HDNNs enjoy, by design, ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Phase Retrieval: From Computational Imaging to Machine Learning: A tutorial

Michaël Unser, Thanh-An Michel Pham, Jonathan Yuelin Dong

Phase retrieval consists in the recovery of a complex-valued signal from intensity-only measurements. As it pervades a broad variety of applications, many researchers have striven to develop phase-retrieval algorithms. Classical approaches involve techniqu ...

2023

Universal machine learning for the response of atomistic systems to external fields

Yaolong Zhang

Machine learned interatomic interaction potentials have enabled efficient and accurate molecular simulations of closed systems. However, external fields, which can greatly change the chemical structure and/or reactivity, have been seldom included in curren ...

Nature Portfolio2023

A Neural-Network-Based Convex Regularizer for Inverse Problems

Michaël Unser, Pakshal Narendra Bohra, Alexis Marie Frederic Goujon, Sebastian Jonas Neumayer, Stanislas Ducotterd

The emergence of deep-learning-based methods to solve image-reconstruction problems has enabled a significant increase in quality. Unfortunately, these new methods often lack reliability and explainability, and there is a growing interest to address these ...

2023

Towards Robust Monitoring of the Laser Powder Bed Fusion Process based on Acoustic Emission combined with Machine Learning Solutions

Rita Drissi Daoudi

Laser Powder Bed Fusion (LPBF) is an Additive Manufacturing (AM) process consolidating parts layer by layer, from a metallic powder bed. It allows no limitation in terms of geometry and is therefore of particular interest to various industries. Metallic LP ...

EPFL2023

Fairness and Explainability in Clustering Problems

Xinrui Jia

In this thesis we present and analyze approximation algorithms for three different clustering problems. The formulations of these problems are motivated by fairness and explainability considerations, two issues that have recently received attention in the ...

EPFL2023

Machine-Learning-Enhanced Procedural Modeling for 4D Historical Cities Reconstruction

Frédéric Kaplan, Isabella Di Lenardo, Rémi Guillaume Petitpierre, Beatrice Vaienti

The generation of 3D models depicting cities in the past holds great potential for documentation and educational purposes. However, it is often hindered by incomplete historical data and the specialized expertise required. To address these challenges, we p ...

2023

Exploring neural networks and their potential for species distribution modeling

Devis Tuia, Benjamin Alexander Kellenberger, Nina Marion Aurélia Van Tiel, Robin Adrien Zbinden, Lloyd Haydn Hughes

Species distribution models (SDMs) relate species occurrence data with environmental variables and are used to understand and predict species distributions across landscapes. While some machine learning models have been adopted by the SDM community, recent ...

2023

Learnable Wavelet Transform and Domain Adversarial Learning for Enhanced Bearing Fault Diagnosis

Olga Fink, Gaëtan Michel Frusque, Qi Li, Baorui Dai

The application of unsupervised domain adaptation (UDA)-based fault diagnosis methods has shown significant efficacy in industrial settings, facilitating the transfer of operational experience and fault signatures between different operating conditions, di ...

Research Publishing2023

New tools for phase segmentation and denoising of analytical STEM data for enhanced chemical sensitivity, applied to Earth mantle research

Hui Chen

This thesis is dedicated to developing innovative methodologies that improve elemental quantification in scanning transmission electron microscopy (STEM) using energy-dispersive X-ray spectroscopy (EDXS). The primary motivation stems from a geochemistry pr ...

EPFL2023

Evaluating the Explainers: Black-Box Explainable Machine Learning for Student Success Prediction in MOOCs

Vinitra Swamy, Tanja Christina Käser Jacober, Bahar Radmehr, Mirko Marras, Natasa Krco

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in human-centric fields. We im ...

2022

Sparse-RS: A Versatile Framework for Query-Efficient Sparse Black-Box Adversarial Attacks

Nicolas Henri Bernard Flammarion, Maksym Andriushchenko, Francesco Croce

We propose a versatile framework based on random search, Sparse-RS, for score-based sparse targeted and untargeted attacks in the black-box setting. Sparse-RS does not rely on substitute models and achieves state-of-the-art success rate and query efficienc ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2022

Perspectives in machine learning for wildlife conservation

Devis Tuia, Alexander Mathis, Mackenzie Mathis, Benjamin Alexander Kellenberger

Inexpensive and accessible sensors are accelerating data acquisition in animal ecology. These technologies hold great potential for large-scale ecological understanding, but are limited by current processing approaches which inefficiently distill data into ...

Nature Research2022

Practical Byzantine-resilient Stochastic Gradient Descent

Sébastien Louis Alexandre Rouault

Algorithms are everywhere. The recipe for the frangipane cake is an algorithm. If all the listed ingredients are available and the cook is sufficiently deft, after a finite number of small, well-defined steps a delicious dessert will exit the oven. Now, wh ...

EPFL2022

Deep learning-based analysis of multiple sclerosis lesions with high and ultra-high field MRI

Francesco La Rosa

Multiple sclerosis (MS) is the most common demyelinating disease of the central nervous system and affects almost 3 million people worldwide. There is currently no cure for MS, and its symptoms, starting with fatigue and weakness, often progress over time ...

EPFL2022

Efficient Transformer-Based Speech Recognition

Apoorv Vyas

Training deep neural network based Automatic Speech Recognition (ASR) models often requires thousands of hours of transcribed data, limiting their use to only a few languages. Moreover, current state-of-the-art acoustic models are based on the Transformer ...

EPFL2022