Publications associées à Accelerating Gradient Boosting Machines

On the Generalization of Stochastic Gradient Descent with Momentum

While momentum-based accelerated variants of stochastic gradient descent (SGD) are widely used when training machine learning models, there is little theoretical understanding on the generalization error of such methods. In this work, we first show that th ...

Microtome Publishing2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Gradient boosting with extreme-value theory for wildfire prediction

Jonathan Koh Boon Han

This paper details the approach of the team Kohrrelation in the 2021 Extreme Value Analysis data challenge, dealing with the prediction of wildfire counts and sizes over the contiguous US. Our approach uses ideas from extreme-value theory in a machine lear ...

2023

Enhancing Epileptic Seizure Detection with EEG Feature Embeddings

Mahsa Shoaran, Bingzhao Zhu, Arman Zarei

Epilepsy is one of the most prevalent brain disorders that disrupts the lives of millions worldwide. For patients with drug-resistant seizures, there exist implantable devices capable of monitoring neural activity, promptly triggering neurostimulation to r ...

ArXiv2023

Improved calorimetric particle identification in NA62 using machine learning techniques

Alessandro Mapelli, Radoslav Marchevski, Alina Kleimenova

Measurement of the ultra-rare K+ -> pi(+)nu(nu) over bar over bar decay at the NA62 experiment at CERN requires high-performance particle identification to distinguish muons from pions. Calorimetric identification currently in use, based on a boosted decis ...

Springer Nature2023

Acceleration of graph pattern mining and applications to financial crime

Jovan Blanusa

Various forms of real-world data, such as social, financial, and biological networks, can be represented using graphs. An efficient method of analysing this type of data is to extract subgraph patterns, such as cliques, cycles, and motifs, from graphs. For ...

EPFL2023

Cross-resolution Face Recognition via Identity-Preserving Network and Knowledge Distillation

Touradj Ebrahimi, Yuhang Lu

Cross-resolution face recognition has become a challenging problem for modern deep face recognition systems. It aims at matching a low-resolution probe image with high-resolution gallery images registered in a database. Existing methods mainly leverage pri ...

2023

Euclid: Identification of asteroid streaks in simulated images using deep learning

Georges Meylan, Frédéric Courbin, Richard Massey, Yi Wang

The material composition of asteroids is an essential piece of knowledge in the quest to understand the formation and evolution of the Solar System. Visual to near-infrared spectra or multiband photometry is required to constrain the material composition o ...

Edp Sciences S A2023

Classification of fall directions via wearable motion sensors

Mustafa Sahin Turan

Effective fall-detection and classification systems are vital in mitigating severe medical and economical consequences of falls to people in the fall risk groups. One class of such systems is based on wearable sensors. While there is a vast amount of acade ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2022

Fast and accurate decoding of finger movements from ECoG through Riemannian features and modern machine learning techniques

Mahsa Shoaran, Bingzhao Zhu

Objective. Accurate decoding of individual finger movements is crucial for advanced prosthetic control. In this work, we introduce the use of Riemannian-space features and temporal dynamics of electrocorticography (ECoG) signal combined with modern machine ...

IOP Publishing Ltd2022

Using Machine Learning to Predict Mortality for COVID-19 Patients on Day 0 in the ICU

Sahand Jamal Rahi, Nahal Mansouri

Rationale: Given the expanding number of COVID-19 cases and the potential for new waves of infection, there is an urgent need for early prediction of the severity of the disease in intensive care unit (ICU) patients to optimize treatment strategies.Objecti ...

FRONTIERS MEDIA SA2022

Machine learning-derived gut microbiome signature predicts fatty liver disease in the presence of insulin resistance

Johan Auwerx, Dongryeol Ryu

A simple predictive biomarker for fatty liver disease is required for individuals with insulin resistance. Here, we developed a supervised machine learning-based classifier for fatty liver disease using fecal 16S rDNA sequencing data. Based on the Kangbuk ...

Nature Portfolio2022

Predicting Superagers by Machine Learning Classification Based on the Functional Brain Connectome Using Resting-State Functional Magnetic Resonance Imaging

Chang-Hyun Park

Superagers are defined as older adults who have youthful memory performance comparable to that of middle-aged adults. Classifying superagers based on the brain connectome using machine learning modeling can provide important insights on the physiology unde ...

OXFORD UNIV PRESS INC2021

Noninvasive estimation of aortic hemodynamics and cardiac contractility using machine learning

Nikolaos Stergiopoulos, Stamatia Zoi Pagoulatou, Vasiliki Bikia, Georgios Rovas

Cardiac and aortic characteristics are crucial for cardiovascular disease detection. However, noninvasive estimation of aortic hemodynamics and cardiac contractility is still challenging. This paper investigated the potential of estimating aortic systolic ...

Nature Research2020

ResOT: Resource-Efficient Oblique Trees for Neural Signal Classification

Mahsa Shoaran, Bingzhao Zhu

Classifiers that can be implemented on chip with minimal computational and memory resources are essential for edge computing in emerging applications such as medical and IoT devices. This paper introduces a machine learning model based on oblique decision ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

A generalised framework for detailed classification of swimming paths inside the Morris Water Maze

Maria del Carmen Sandi Perez, Eleni Vasilaki

The Morris Water Maze is commonly used in behavioural neuroscience for the study of spatial learning with rodents. Over the years, various methods of analysing rodent data collected during this task have been proposed. These methods span from classical per ...

Nature Research2018

ASTErIsM: application of topometric clustering algorithms in automatic galaxy detection and classification

Frédéric Courbin, Jean-Paul Richard Kneib, Danuta Janina Paraficz

We present a study on galaxy detection and shape classification using topometric clustering algorithms. We first use the DBSCAN algorithm to extract, from CCD frames, groups of adjacent pixels with significant fluxes and we then apply the DENCLUE algorithm ...

Oxford Univ Press2016

Vision-Based Unmanned Aerial Vehicle Detection and Tracking for Sense and Avoid Systems

Denis Gillet, Alcherio Martinoli, Pascal Fua, Vincent Lepetit, Steven Adriaan Roelofsen, Artem Rozantsev, Krishna Raj Sapkota

We propose an approach for on-line detection of small Unmanned Aerial Vehicles (UAVs) and estimation of their relative positions and velocities in the 3D environment from a single moving camera in the context of sense and avoid systems. This problem is cha ...

Ieee2016

Adaptive Sampling for Large Scale Boosting

François Fleuret, Charles Dubout

Classical Boosting algorithms, such as AdaBoost, build a strong classifier without concern for the computational cost. Some applications, in particular in computer vision, may involve millions of training examples and very large feature spaces. In such con ...

2014

Alternative search techniques for face detection using location estimation and binary features

Sébastien Marcel, Venkatesh Bala Subburaman

The sliding window approach is the most widely used technique to detect an object from an image. In the past few years, classifiers have been improved in many ways to increase the scanning speed. Apart from the classifier design (such as the cascade), the ...

Academic Press Inc Elsevier Science2013