Publications related to Salience (neuroscience)

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Towards Visual Saliency Explanations of Face Verification

Touradj Ebrahimi, Yuhang Lu, Zewei Xu

In the past years, deep convolutional neural networks have been pushing the frontier of face recognition (FR) techniques in both verification and identification scenarios. Despite the high accuracy, they are often criticized for lacking explainability. The ...

2024

SAGTTA: SALIENCY GUIDED TEST TIME AUGMENTATION FOR MEDICAL IMAGE SEGMENTATION ACROSS VENDOR DOMAIN SHIFT

Devavrat Tomar, Seyedbehzad Bozorgtabar

Test time augmentation has been shown to be an effective approach to combat domain shifts in deep learning. Despite their promising performance levels, the interpretability of the underlying used models is however low. Saliency maps have been widely used i ...

IEEE2023

Towards Robust Monitoring of the Laser Powder Bed Fusion Process based on Acoustic Emission combined with Machine Learning Solutions

Rita Drissi Daoudi

Laser Powder Bed Fusion (LPBF) is an Additive Manufacturing (AM) process consolidating parts layer by layer, from a metallic powder bed. It allows no limitation in terms of geometry and is therefore of particular interest to various industries. Metallic LP ...

EPFL2023

Modeling Object Dissimilarity for Deep Saliency Prediction

Sabine Süsstrunk, Mathieu Salzmann, Tong Zhang, Seungryong Kim, Deblina Bhattacharjee, Bahar Aydemir

Saliency prediction has made great strides over the past two decades, with current techniques modeling low-level information, such as color, intensity and size contrasts, and high-level ones, such as attention and gaze direction for entire objects. Despite ...

2022

Uncertainty-aware Joint Salient Object and Camouflaged Object Detection

Tong Zhang

Visual salient object detection (SOD) aims at finding the salient object(s) that attract human attention, while camouflaged object detection (COD) on the contrary intends to discover the camouflaged object(s) that hidden in the surrounding. In this paper, ...

IEEE COMPUTER SOC2021

Serial dependence under memory load

Michael Herzog, David Pascucci, Ayberk Ozkirli, Gizay Ceylan, Yury Markov, Natalia Tiurina

Perceptual decisions are biased towards previous stimuli, a phenomenon known as serial dependence. However, the mechanisms of this bias are unknown. For example, it is debated whether serial dependence reflects a perceptual bias or interference of prior st ...

SAGE Publishing2021

Eye-tracking and artificial intelligence to enhance motivation and learning

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture user ...

SPRINGER HEIDELBERG2020

Towards Modelling of Visual Saliency in Point Clouds for Immersive Applications

Touradj Ebrahimi, Evangelos Alexiou, Peisen Xu

Modelling human visual attention is of great importance in the field of computer vision and has been widely explored for 3D imaging. Yet, in the absence of ground truth data, it is unclear whether such predictions are in alignment with the actual human vie ...

2019

Stimuli-based Gaze Analytics to Enhance Motivation and Learning in MOOCs

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture lear ...

IEEE2019

Perceptual effects of daylight patterns in architecture

Kynthia Chamilothori

The profound impact of daylight on occupants is broadly recognized in the fields of architecture and lighting. In particular, the façade and its interplay with light is a central design element, while the diversity of daylight in space is widely acknowledg ...

EPFL2019

Using the Neurorobotics platform to explain global processing in visual crowding

Michael Herzog, Gregory Francis, Alban Bornet

The Neurorobotics Platform of the Human Brain Project hosts many different large-scale models that can easily be connected with each other. Here, we linked a deep neural network for saliency computation to a spiking cortical model for visual segmentation ( ...

2018

Is lack of attention necessary for task-irrelevant perceptual learning?

Michael Herzog, Lukasz Grzeczkowski, Jessica Galliussi

Perceptual learning can occur for a feature irrelevant to the training task, when it is sub-threshold and outside of the focus of attention (task-irrelevant perceptual learning, TIPL); however, TIPL does not occur when the task-irrelevant feature is supra- ...

PERGAMON-ELSEVIER SCIENCE LTD2018

Perceptual Dynamics of Daylight in Architecture

Siobhan Francois Rockcastle

In our experience of daylit architecture, our visual perception is greatly impacted by the ephemeral and inherently dynamic conditions of the surrounding environment. Driven by changes in sky type, time-of-day, and time-of-year, these variable conditions c ...

EPFL2017

Contrast measures for predicting perceptual effects of daylight in architectural renderings

Marilyne Andersen, María Lovísa Ámundadóttir, Siobhan Francois Rockcastle

Daylit architecture is perceived as a dynamic luminous composition, yet most existing performance metrics were designed to evaluate natural illumination for its ability to adequately illuminate a two-dimensional task surface and avoid glare-based discomfor ...

SAGE Publications2017

Towards the Use of Social Interaction Conventions as Prior for Gaze Model Adaptation

Jean-Marc Odobez, Rémy Alain Siegfried, Yu Yu

Gaze is an important non-verbal cue involved in many facets of social interactions like communication, attentiveness or attitudes. Nevertheless, extracting gaze directions visually and remotely usually suffers large errors because of low resolution images, ...

ACM2017

Influence of Saliency and Social Impairments on the Development of Intention Recognition

Aude Billard, Laura Bénédicte Marine Cohen

Among the symptoms of schizophrenia, deficits in the recognition of intention is one of the most studied. However, there is no cognitive model of intention recognition that takes into account both innate and environmental/developmental factors. This work p ...

Springer Int Publishing Ag2016

Visual impact assessment of BIPV in building retrofits using saliency models

Ran Xu

Limited fossil energy resources and the potential danger of nuclear power plants led to growing popularity of solar energy. In Switzerland, Building Integrated Photovoltaic (BIPV) is expected to be responsible for up to quarter of the energy production fro ...

EPFL2016

Are All Pixels Equally Important? Towards Multi-Level Salient Object Detection

Gökhan Yildirim

When we look at our environment, we primarily pay attention to visually distinctive objects. We refer to these objects as visually important or salient. Our visual system dedicates most of its processing resources to analyzing these salient objects. An ana ...

EPFL2015