Publications related to Hyperparameter optimization

Biophysically accurate and machine learning-based surrogate models to optimize neuroprosthesis design and operation

Electrical stimulation of the nervous system has emerged as a promising assistive technology in case of many injuries and illnesses across various parts of the nervous system. In particular, the invasive neuromodulation of the peripheral nervous system see ...

EPFL2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Text Representation Learning for Low Cost Natural Language Understanding

Jan Frederik Jonas Florian Mai

Natural language processing and other artificial intelligence fields have witnessed impressive progress over the past decade. Although some of this progress is due to algorithmic advances in deep learning, the majority has arguably been enabled by scaling ...

EPFL2023

Confidence Matters: Applications to Semantic Segmentation

Prabhu Teja Sivaprasad

The successes of deep learning for semantic segmentation can in be, in part, attributed to its scale: a notion that encapsulates the largeness of these computational architectures and the labeled datasets they are trained on. These resource requirements hi ...

EPFL2023

Phenomenological theory of variational quantum ground-state preparation

Ivano Tavernelli, Giuseppe Carleo

The variational approach is a cornerstone of computational physics, considering both conventional and quantum computing computational platforms. The variational quantum eigensolver algorithm aims to prepare the ground state of a Hamiltonian exploiting para ...

Amer Physical Soc2023

Bayesian Optimization for Chemical Reactions

Philippe Schwaller, Jeff Guo, Bojana Rankovic

Reaction optimization is challenging and traditionally delegated to domain experts who iteratively pro-pose increasingly optimal experiments. Problematically, the reaction landscape is complex and often requires hundreds of experiments to reach convergence ...

Swiss Chemical Soc2023

Improving Generalization of Pretrained Language Models

Rabeeh Karimi Mahabadi

In this dissertation, we propose multiple methods to improve transfer learning for pretrained language models (PLMs). Broadly, transfer learning is a powerful technique in natural language processing, where a language model is first pre-trained on a data-r ...

EPFL2023

Stochastic-robust planning optimization method based on tracking-economy extreme scenario tradeoff for CCHP multi-energy system

François Maréchal, Yuxuan Li

The load tracking performance of combined cooling, heating, and power multi-energy system (CCHP-MES) greatly depends on the equipment capacity configuration. And the frequent fluctuations in the source-load uncertainty puts higher demands on the load track ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Power Transformer Fault Diagnosis Using Neural Network Optimization Techniques

Dimitrios Kaminaris

Artificial Intelligence (AI) techniques are considered the most advanced approaches for diagnosing faults in power transformers. Dissolved Gas Analysis (DGA) is the conventional approach widely adopted for diagnosing incipient faults in power transformers. ...

MDPI2023

Deep Learning Generalization with Limited and Noisy Labels

Mahsa Forouzesh

Deep neural networks have become ubiquitous in today's technological landscape, finding their way in a vast array of applications. Deep supervised learning, which relies on large labeled datasets, has been particularly successful in areas such as image cla ...

EPFL2023

Online interoperable resources for building hippocampal neuron models via the Hippocampus Hub

Armando Romani, Felix Schürmann, Michele Migliore, Luca Leonardo Bologna

To build biophysically detailed models of brain cells, circuits, and regions, a data-driven approach is increasingly being adopted. This helps to obtain a simulated activity that reproduces the experimentally recorded neural dynamics as faithfully as possi ...

2023

Beyond Spectral Gap: The Role of the Topology in Decentralized Learning

Martin Jaggi, Thijs Vogels, Hadrien Hendrikx

In data-parallel optimization of machine learning models, workers collaborate to improve their estimates of the model: more accurate gradients allow them to use larger learning rates and optimize faster. In the decentralized setting, in which workers commu ...

Microtome Publishing2023

Data-driven optimization tool for the functional, economic, and environmental properties of blended cement concrete using supplementary cementitious materials

Hisham Tarek Mohamed Hafez

The need to produce more sustainable concrete is proving imminent given the rising environmental concerns facing the industry. Blended cement concrete, based on any of the prominent supplementary cementitious materials (SCMs) such as fly ash, ground granul ...

ELSEVIER2023

The statistical complexity of early-stopped mirror descent

Tomas Vaskevicius, Varun Kanade

Recently there has been a surge of interest in understanding implicit regularization properties of iterative gradient-based optimization algorithms. In this paper, we study the statistical guarantees on the excess risk achieved by early-stopped unconstrain ...

Oxford Univ Press2023

Quality-Constrained Encoding Optimization for Omnidirectional Video Streaming

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo, Chaofan He

Omnidirectional video streaming is usually implemented based on the representations of tiles, where the tiles are obtained by splitting the video frame into several rectangular areas and each tile is converted into multiple representations with different r ...

Ieee-Inst Electrical Electronics Engineers Inc2023

Machine-Learning Based Monitoring of Cognitive Workload in Rescue Missions with Drones

David Atienza Alonso, Dario Floreano, Ricardo Andres Chavarriaga Lozano, Adriana Arza Valdes, Fabio Isidoro Tiberio Dell'Agnola, Ping-Keng Jao

In search and rescue missions, drone operations are challenging and cognitively demanding. High levels of cognitive workload can affect rescuers’ performance, leading to failure with catastrophic outcomes. To face this problem, we propose a machine learnin ...

2022

Auto-tuning deep forest for shear stiffness prediction of headed stud connectors

Xianlin Wang, Yuqing Liu

The shear stiffness of headed stud connector is a critical parameter for the calculation of deflection and inter-facial shear force for steel-concrete composite structure. Thus, this study presented a promising data-driven model auto-tuning Deep Forest (AT ...

2022

Auto-tuning ensemble models for estimating shear resistance of headed studs in concrete

Xianlin Wang, Yuqing Liu

The shear resistance of headed studs is of paramount importance for the design of steel-concrete composite structures and an accurate predictive model is highly needed. Ensemble learning is expected to be a powerful solution while it relies on laborious se ...

2022

Robust Binary Models by Pruning Randomly-initialized Networks

Sabine Süsstrunk, Mathieu Salzmann, Chen Liu, Ziqi Zhao

Robustness to adversarial attacks was shown to require a larger model capacity, and thus a larger memory footprint. In this paper, we introduce an approach to obtain robust yet compact models by pruning randomly-initialized binary networks. Unlike adversar ...

2022

Towards Robust Vision Transformer

Shaokai Ye, Yuan He

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard accuracy and com ...

IEEE COMPUTER SOC2022