Publications related to Dynamic Visual Attention on the Sphere

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Kynthia Chamilothori, Bahar Aydemir, Caroline Karmann, Seungryong Kim

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

Towards Visual Saliency Explanations of Face Verification

Touradj Ebrahimi, Yuhang Lu, Zewei Xu

In the past years, deep convolutional neural networks have been pushing the frontier of face recognition (FR) techniques in both verification and identification scenarios. Despite the high accuracy, they are often criticized for lacking explainability. The ...

2024

The effects of visual distractors on serial dependence

David Pascucci

Attractive serial dependence occurs when perceptual decisions are attracted toward previous stimuli. This effect is mediated by spatial attention and is most likely to occur when similar stimuli are attended at nearby locations. Attention, however, also in ...

Assoc Research Vision Ophthalmology Inc2023

Generative power of a protein language model trained on multiple sequence alignments

Umberto Lupo, Anne-Florence Raphaëlle Bitbol, Damiano Sgarbossa

Computational models starting from large ensembles of evolutionarily related protein sequences capture a representation of protein families and learn constraints associated to protein structure and function. They thus open the possibility for generating no ...

eLIFE SCIENCES PUBL LTD2023

On the Maximum Power Density of Implanted Antennas within Simplified Body Phantoms

Anja Skrivervik, Mingxiang Gao, Zvonimir Sipus

With the application requirements of wireless technology in implantable bioelectronics, knowledge of the fundamental limits for implanted antennas becomes critical. In this work, we investigated the variation of maximum power density within simplified body ...

IEEE2022

Modeling Object Dissimilarity for Deep Saliency Prediction

Mathieu Salzmann, Sabine Süsstrunk, Bahar Aydemir, Deblina Bhattacharjee, Seungryong Kim, Tong Zhang

Saliency prediction has made great strides over the past two decades, with current techniques modeling low-level information, such as color, intensity and size contrasts, and high-level ones, such as attention and gaze direction for entire objects. Despite ...

2022

Clustering and Informative Path Planning for 3D Gas Distribution Mapping: Algorithms and Performance Evaluation

Alcherio Martinoli, Chiara Ercolani, Ankita Arun Humne, Lixuan Tang

Chemical gas dispersion can represent a severe threat to human and animal lives, as well as to the environment. Constructing a map of the distribution of gas in a fast and reliable manner is critical to ensure accurate monitoring of at-risk facilities and ...

2022

Mapping Active Site Geometry to Activity in Immobilized Frustrated Lewis Pair Catalysts

Anne-Clémence Corminboeuf, Jacob Terence Blaskovits, Shubhajit Das, Rubén Laplaza Solanas

The immobilization of molecular catalysts imposes spatial constraints on their active site. We reveal that in bifunctional catalysis such constraints can also be utilized as an appealing handle to boost intrinsic activity through judicious control of the a ...

Wiley-VCH Verlag GmbH2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

Vision-based Flocking in Aerial Robot Swarms

Fabian Maximilian Schilling

Aerial robot swarms have the potential to perform time-critical and dangerous tasks such as disaster response without compromising human safety. However, their reliance on external infrastructure such as global positioning for localization and wireless net ...

EPFL2022

A Lightweight Goal-Based model for Trajectory Prediction

Kaouther Messaoud Ben Amor

We present a lightweight goal-based model for multimodal, probabilistic trajectory prediction for urban driving. Previous conditioned-on-goal methods have used map information in order to establish a set of potential goals and then complete the correspondi ...

IEEE2022

Mapping forest in the Swiss Alps treeline ecotone with explainable deep learning

Devis Tuia, Thiên-Anh Claris Nguyen, Benjamin Alexander Kellenberger

Forest maps are essential to understand forest dynamics. Due to the increasing availability of remote sensing data and machine learning models like convolutional neural networks, forest maps can these days be created on large scales with high accuracy. Com ...

Elsevier2022

LSSANet: A Long Short Slice-Aware Network for Pulmonary Nodule Detection

Bo Du, Jiancheng Yang, Rui Xu

Convolutional neural networks (CNNs) have been demonstrated to be highly effective in the field of pulmonary nodule detection. However, existing CNN based pulmonary nodule detection methods lack the ability to capture long-range dependencies, which is vita ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022

Uncertainty-aware Joint Salient Object and Camouflaged Object Detection

Tong Zhang

Visual salient object detection (SOD) aims at finding the salient object(s) that attract human attention, while camouflaged object detection (COD) on the contrary intends to discover the camouflaged object(s) that hidden in the surrounding. In this paper, ...

IEEE COMPUTER SOC2021

Spatial and temporal integration of visual features

Oh-Hyeon Choung

Visual processing can be seen as the integration and segmentation of features. Objects are composed of contours, integrated into shapes and segmented from other contours. Information also needs to be integrated to solve the ill-posed problems of vision. Fo ...

EPFL2021

Crowding and the importance of grouping and segmentation processes in human vision

Alban Bornet

Human vision has evolved to make sense of a world in which elements almost never appear in isolation. Surprisingly, the recognition of an element in a visual scene is strongly limited by the presence of other nearby elements, a phenomenon known as visual c ...

EPFL2021

Feed-forward and noise-tolerant detection of feature homogeneity in spiking networks with a latency code

Marc-Oliver Gewaltig

In studies of the visual system as well as in computer vision, the focus is often on contrast edges. However, the primate visual system contains a large number of cells that are insensitive to spatial contrast and, instead, respond to uniform homogeneous i ...

SPRINGER2021

Global and high-level effects in crowding cannot be predicted by either high-dimensional pooling or target cueing

Michael Herzog, Alban Bornet, Adrien Christophe Doerig, Mauro Manassi, Oh-Hyeon Choung

In visual crowding, the perception of a target deteriorates in the presence of nearby flankers. Traditionally, target-flanker interactions have been considered as local, mostly deleterious, low-level, and feature specific, occurring when information is poo ...

2021