Publications related to An all-in-one solution to geometric and photometric calibration

TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality Woodworking

Yves Weinand, Julien Gamerro, Andrea Settimi, Florian Aymanns, Naravich Chutisilp

We present TimberTool (TTool v2.1.1), a software designed for woodworking tasks assisted by augmented reality (AR), emphasizing its essential function of the real-time localization of a tool head’s poses within camera frames. The localization process, a fu ...

2024

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, José del Rocio Millán Ruiz, Olaf Blanke, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

Additively manufactured stretchable zipping electrostatic actuators

Giulio Grasso

The use of soft and stretchable materials allows the development of adaptive robotic systems and human-machine interfaces that are more natural and comfortable to interact with. One of the application fields that benefits the most from these compliant mate ...

EPFL2024

Projector-based augmented stacking framework for irregularly shaped objects

Yves Weinand, Katrin Beyer, Julien Gamerro, Andrea Settimi, Qianqing Wang, Edward Carlo Giorgio Andò

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

A Stand-Alone Augmented Reality Intervention for Chronic Pain using Embodied Systolic Stimulation

Skander Mensi, Sylvain Cardin, Oliver Alan Kannape, Robert Leeb, Fabien Bourban, Alexis Dorier, Andrea Serino

Chronic pain presents a tremendous personal, societal, and financial burden. Treatment options are often limited to managing symptoms as opposed to treating the causes, and the consequences of pharmacological treatments can be immensely harmful as evidence ...

IEEE2023

Affordance segmentation of hand-occluded containers from exocentric images

Andrea Cavallaro

Visual affordance segmentation identifies the surfaces of an object an agent can interact with. Common challenges for the identification of affordances are the variety of the geometry and physical properties of these surfaces as well as occlusions. In this ...

Ieee Computer Soc2023

Out-of-body illusion induced by visual-vestibular stimulation

Bruno Herbelin, Olaf Blanke, Florian Lance, Sophie Jacqueline Andrée Betka, Hsin-Ping Wu, Estelle Nakul

Out-of-body experiences (OBEs) are characterized by the subjective feeling of being located outside one's physical body and perceiving one's own body from an elevated perspective looking downwards. OBEs have been correlated with abnormal integration of bod ...

Cell Press2023

Chaotic microcomb inertia-free parallel ranging

Tobias Kippenberg, Anton Stroganov, Anton Lukashchuk

Ever growing pixel acquisition rates in the fields of augmented reality, autonomous driving and robotics have increased interest in solid state beam scanning without moving parts. Modern photonic integrated laser ranging advances towards passive beam steer ...

AIP Publishing2023

A Full-Wave Reference Simulator for Computing Surface Reflectance

Mengqi Xia

Computing light reflection from rough surfaces is an important topic in computer graphics. Reflection models developed based on geometric optics fail to capture wave effects such as diffraction and interference, while existing models based on physical opti ...

ASSOC COMPUTING MACHINERY2023

Visualization, Interactive Handling and Simulation of Molecules in Commodity Augmented Reality in Web Browsers Using moleculARweb's Virtual Modeling Kits

Matteo Dal Peraro, Luciano Andres Abriata, Lucien Fabrice Krapp, Fabio Jose Cortes Rodriguez

moleculARweb (https://molecularweb.epfl.ch) began as a website for education and outreach in chemistry and structural biology through augmented reality (AR) content that runs in the web browsers of regular devices like smartphones, tablets, and computers. ...

SWISS CHEMICAL SOC2022

A virtual microstructure generator for 3D stone masonry walls

Katrin Beyer, Mahmoud S. M. Shaqfa

Detailed micromodel simulations of stone masonry walls require as input a 3D mesh that represents a realistic arrangement of stones in the masonry wall. In this paper, we constructed the first 3D masonry microstructures to derive 2D and 3D finite or discre ...

ELSEVIER2022

Cockroach: an open-source tool for point cloud processing in cad

Yves Weinand, Julien Gamerro, Andrea Settimi, Petras Vestartas

In the architecture, engineering and construction (AEC) sector, the use of point cloud data is not a novelty. Usually employed to retrieve data for inspecting construction sites or retrofitting pre-existing buildings, sensors like LiDAR cameras have been k ...

Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)2022

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Edoardo Remelli

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

EPFL2022

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

MoleculARweb: A Web Site for Chemistry and Structural Biology Education through Interactive Augmented Reality out of the Box in Commodity Devices

Matteo Dal Peraro, Luciano Andres Abriata, Lucien Fabrice Krapp, Fabio Jose Cortes Rodriguez

Augmented/virtual realities (ARs/VRs) promise to revolutionize STEM education. However, most easy-to-use tools are limited to static visualizations, which limits the approachable content, whereas more interactive and dynamic alternatives require costly har ...

AMER CHEMICAL SOC2021

Texture mapping and IFC material retrievement for virtual reality applications

Laurent Deschamps, Sebastian Duque Mahecha, Sergi Aguacil Moreno, Alexandre Denis Stoll

Most current software support the Industry Foundation Classes (IFC) transfer of Building Information Models (BIMs) to applications enabling Virtual Reality (VR) navigation (BuildingSMART, 2020; Kiviniemi, Tarandi, Karlshøj, Bell, and Karud, 2008; Poljanšek ...

2021

Smart Toys plus plus : Exploiting the Social Connectedness for Playing and Learning

Ayberk Özgür, Arzu Güneysu Özgür

Under the umbrella of smart toys, a myriad of interactive systems have addressed a variety of scenarios considering entertainment, education, sustainability, social and environmental learning through play. Tangibles and small toy robots prevail; but intera ...

ASSOC COMPUTING MACHINERY2021

Light Path Gradients for Forward and Inverse Rendering

Tizian Lucien Zeltner

Physically based rendering is a process for photorealistic digital image synthesis and one of the core problems in computer graphics. It involves simulating the light transport, i.e. the emission, propagation, and scattering of light through a virtual scen ...

EPFL2021

Narrowband Optical Coupler Using Fano Interference in First Order Diffraction

Olivier Martin, Benjamin Gallinet, Fabian Michael Lütolf, Giorgio Quaranta

Light coupling in waveguides has been extensively investigated in a variety of contexts, from photonic integrated circuits to biosensing and near-eye displays for augmented reality. Here, narrowband diffraction is reported using a Fano interference effect ...

AMER CHEMICAL SOC2021