Publications related to Cognitive architecture

Enabling Uncertainty Estimation in Iterative Neural Networks

Pascal Fua, Nikita Durasov, Doruk Oner, Minh Hieu Lê

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...

Curran Associates2024

Sparse autoregressive neural networks for classical spin systems

Giuseppe Carleo, Dian Wu, Indaco Biazzo

Efficient sampling and approximation of Boltzmann distributions involving large sets of binary variables, or spins, are pivotal in diverse scientific fields even beyond physics. Recent advances in generative neural networks have significantly impacted this ...

Iop Publishing Ltd2024

Deep Learning Theory Through the Lens of Diagonal Linear Networks

Scott William Pesme

In this PhD manuscript, we explore optimisation phenomena which occur in complex neural networks through the lens of

2

-layer diagonal linear networks. This rudimentary architecture, which consists of a two layer feedforward linear network with a diagonal ...

EPFL2024

Towards practical reinforcement learning for tokamak magnetic control

Federico Alberto Alfredo Felici, Cristian Galperti, Jonas Buchli, Brendan Tracey

Reinforcement learning (RL) has shown promising results for real-time control systems, including the domain of plasma magnetic control. However, there are still significant drawbacks compared to traditional feedback control approaches for magnetic confinem ...

Elsevier Science Sa2024

EdgeAI-Aware Design of In-Memory Computing Architectures

Marco Antonio Rios

Driven by the demand for real-time processing and the need to minimize latency in AI algorithms, edge computing has experienced remarkable progress. Decision-making AI applications stand out for their heavy reliance on data-centric operations, predominantl ...

EPFL2024

TeSLA: Test-Time Self-Learning With Automatic Adversarial Augmentation

Jean-Philippe Thiran, Guillaume Marc Georges Vray, Devavrat Tomar, Seyedbehzad Bozorgtabar

Most recent test-time adaptation methods focus on only classification tasks, use specialized network architectures, destroy model calibration or rely on lightweight information from the source domain. To tackle these issues, this paper proposes a novel Tes ...

Los Alamitos2023

Inter-Task Transfer of Prism Adaptation through Motor Imagery

Lisa Aïcha Mireille Julie Fleury

Prism adaptation (PA) is a useful method to investigate short-term sensorimotor plasticity. Following active exposure to prisms, individuals show consistent after-effects, probing that they have adapted to the perturbation. Whether after-effects are transf ...

MDPI2023

Learning From Heterogeneous Data Based on Social Interactions Over Graphs

Ali H. Sayed, Virginia Bordignon, Stefan Vlaski

This work proposes a decentralized architecture, where individual agents aim at solving a classification problem while observing streaming features of different dimensions and arising from possibly different distributions. In the context of social learning ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Classification of Tropical Deforestation Drivers with Machine Learning and Satellite Image Time Series

Devis Tuia, Jan Pisl, Marc Conrad Russwurm, Lloyd Haydn Hughes

Tropical deforestation is a major environmental problem with severe consequences such as carbon emissions or biodiversity loss. While much research focuses on monitoring and mapping deforestation, less attention is paid to understanding the various reasons ...

The Institute of Electrical and Electronics Engineers, Inc.2023

From event-based surprise to lifelong learning. A journey in the timescales of adaptation

Martin Louis Lucien Rémy Barry

Humans and animals constantly adapt to their environment over the course of their life. This thesis seeks to integrate various timescales of adaptation, ranging from the adaptation of synaptic connections between spiking neurons (milliseconds), rapid behav ...

EPFL2023

The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems

Indaco Biazzo

Autoregressive Neural Networks (ARNNs) have shown exceptional results in generation tasks across image, language, and scientific domains. Despite their success, ARNN architectures often operate as black boxes without a clear connection to underlying physic ...

Nature Portfolio2023

Transformer Models for Vision

Jean-Baptiste Francis Marie Juliette Cordonnier

The recent developments of deep learning cover a wide variety of tasks such as image classification, text translation, playing go, and folding proteins. All these successful methods depend on a gradient-based learning algorithm to train a model on massive ...

EPFL2023

Confidence Matters: Applications to Semantic Segmentation

Prabhu Teja Sivaprasad

The successes of deep learning for semantic segmentation can in be, in part, attributed to its scale: a notion that encapsulates the largeness of these computational architectures and the labeled datasets they are trained on. These resource requirements hi ...

EPFL2023

Breaking the Curse of Dimensionality in Deep Neural Networks by Learning Invariant Representations

Leonardo Petrini

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as natural language proc ...

EPFL2023

Dynamic functional hippocampal markers of residual depressive symptoms in euthymic bipolar disorder

Dimitri Nestor Alice Van De Ville, Julian Gaviria

Objectives: Bipolar disorder (BD) is a severe, chronic, affective disorder characterized by recurrent switching between mood states, psychomotor and cognitive symptoms, which can linger in euthymic states as residual symptoms. Hippocampal alterations may p ...

WILEY2023

Investigating the roles of reflexes and central pattern generators in the control and modulation of human locomotion using a physiologically plausible neuromechanical model

Auke Ijspeert, Andrea Di Russo, Dimitar Yuriev Stanev, Anushree Bapusaheb Sabnis, Stéphane Armand

Objective. Studying the neural components regulating movement in human locomotion is obstructed by the inability to perform invasive experimental recording in the human neural circuits. Neuromechanical simulations can provide insights by modeling the locom ...

Iop Publishing Ltd2023

Structured cerebellar connectivity supports resilient pattern separation

Ilaria Ricchi

The cerebellum is thought to help detect and correct errors between intended and executed commands(1,2) and is critical for social behaviours, cognition and emotion 3 Computations for motor control must be performed quicklyto correct errors in real time an ...

NATURE PORTFOLIO2023

Full System Exploration of On-Chip Wireless Communication on Many-Core Architectures

David Atienza Alonso, Marina Zapater Sancho, Giovanni Ansaloni, Rafael Medina Morillas, Yasir Mahmood Qureshi, Joshua Alexander Harrison Klein

In order to develop sustainable and more powerful information technology (IT) infrastructures, the challenges posed by the "memory wall" are critical for the design of high-performance and high-efficiency many-core computing systems. In this context, recen ...

IEEE2022

Bio-inspired Reflex System for Learning Visual Information for Resilient Robotic Manipulation

Josephine Anna Eleanor Hughes, Kai Christian Junge

Humans have an incredible sense of self-preservation that is both instilled, and also learned through experience. One system which contributes to this is the pain and reflex system which both minimizes damage through involuntary reflex ac- tions and also s ...

2022

The EEG multiverse of schizophrenia

Michael Herzog, Maya Roinishvili, Ophélie Gladys Favrod, Janir Nuno Ramos Antunes Da Cruz, Patricia Figueiredo, Wei-Hsiang Lin, Dario Alejandro Gordillo Lopez

Research on schizophrenia typically focuses on one paradigm for which clear-cut differences between patients and controls are established. Great efforts are made to understand the underlying genetical, neurophysiological, and cognitive mechanisms, which ev ...

2023