Publications related to Extended reality

TTool: A Supervised Artificial Intelligence-Assisted Visual Pose Detector for Tool Heads in Augmented Reality Woodworking

Yves Weinand, Andrea Settimi, Julien Gamerro, Florian Aymanns, Naravich Chutisilp

We present TimberTool (TTool v2.1.1), a software designed for woodworking tasks assisted by augmented reality (AR), emphasizing its essential function of the real-time localization of a tool head’s poses within camera frames. The localization process, a fu ...

2024

The Metaverse as a Virtual Model of Platform Urbanism: Its Converging AIoT, XReality, Neurotech, and Nanobiotech and Their Applications, Challenges, and Risks

Simon Elias Bibri

With their exponentially rising computational power, digital platforms are heralding a new era of hybrid intelligence. There has recently been much enthusiasm and hype that the Metaverse has the potential to unlock hybrid intelligence. This is premised on ...

MDPI2023

Out-of-body illusion induced by visual-vestibular stimulation

Olaf Blanke, Bruno Herbelin, Hsin-Ping Wu, Sophie Jacqueline Andrée Betka, Florian Lance, Estelle Nakul

Out-of-body experiences (OBEs) are characterized by the subjective feeling of being located outside one's physical body and perceiving one's own body from an elevated perspective looking downwards. OBEs have been correlated with abnormal integration of bod ...

Cell Press2023

Projector-based augmented stacking framework for irregularly shaped objects

Katrin Beyer, Yves Weinand, Julien Gamerro, Andrea Settimi, Qianqing Wang, Edward Carlo Giorgio Andò

Augmented reality in additive fabrication is predominantly applied to the manufacturing of structures from regularly shaped materials. Our work however embraces natural heterogeneity, by focusing on the assembly of irregularly shaped elements such as miner ...

2023

Chaotic microcomb inertia-free parallel ranging

Tobias Kippenberg, Anton Stroganov, Anton Lukashchuk

Ever growing pixel acquisition rates in the fields of augmented reality, autonomous driving and robotics have increased interest in solid state beam scanning without moving parts. Modern photonic integrated laser ranging advances towards passive beam steer ...

AIP Publishing2023

A Stand-Alone Augmented Reality Intervention for Chronic Pain using Embodied Systolic Stimulation

Sylvain Cardin, Andrea Serino, Robert Leeb, Oliver Alan Kannape, Skander Mensi, Fabien Bourban, Alexis Dorier

Chronic pain presents a tremendous personal, societal, and financial burden. Treatment options are often limited to managing symptoms as opposed to treating the causes, and the consequences of pharmacological treatments can be immensely harmful as evidence ...

IEEE2023

Visualization, Interactive Handling and Simulation of Molecules in Commodity Augmented Reality in Web Browsers Using moleculARweb's Virtual Modeling Kits

Matteo Dal Peraro, Luciano Andres Abriata, Fabio Jose Cortes Rodriguez, Lucien Fabrice Krapp

moleculARweb (https://molecularweb.epfl.ch) began as a website for education and outreach in chemistry and structural biology through augmented reality (AR) content that runs in the web browsers of regular devices like smartphones, tablets, and computers. ...

SWISS CHEMICAL SOC2022

Cockroach: an open-source tool for point cloud processing in cad

Yves Weinand, Julien Gamerro, Andrea Settimi, Petras Vestartas

In the architecture, engineering and construction (AEC) sector, the use of point cloud data is not a novelty. Usually employed to retrieve data for inspecting construction sites or retrofitting pre-existing buildings, sensors like LiDAR cameras have been k ...

Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)2022

A comprehensive review of digital twin - part 1: modeling and twinning enabling technologies

Olga Fink, Chao Hu, Sayan Ghosh

As an emerging technology in the era of Industry 4.0, digital twin is gaining unprecedented attention because of its promise to further optimize process design, quality control, health monitoring, decision and policy making, and more, by comprehensively mo ...

SPRINGER2022

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

Smart Toys plus plus : Exploiting the Social Connectedness for Playing and Learning

Ayberk Özgür, Arzu Güneysu Özgür

Under the umbrella of smart toys, a myriad of interactive systems have addressed a variety of scenarios considering entertainment, education, sustainability, social and environmental learning through play. Tangibles and small toy robots prevail; but intera ...

ASSOC COMPUTING MACHINERY2021

MoleculARweb: A Web Site for Chemistry and Structural Biology Education through Interactive Augmented Reality out of the Box in Commodity Devices

Matteo Dal Peraro, Luciano Andres Abriata, Fabio Jose Cortes Rodriguez, Lucien Fabrice Krapp

Augmented/virtual realities (ARs/VRs) promise to revolutionize STEM education. However, most easy-to-use tools are limited to static visualizations, which limits the approachable content, whereas more interactive and dynamic alternatives require costly har ...

AMER CHEMICAL SOC2021

Narrowband Optical Coupler Using Fano Interference in First Order Diffraction

Olivier Martin, Benjamin Gallinet, Giorgio Quaranta, Fabian Michael Lütolf

Light coupling in waveguides has been extensively investigated in a variety of contexts, from photonic integrated circuits to biosensing and near-eye displays for augmented reality. Here, narrowband diffraction is reported using a Fano interference effect ...

AMER CHEMICAL SOC2021

Texture mapping and IFC material retrievement for virtual reality applications

Sergi Aguacil Moreno, Laurent Deschamps, Sebastian Duque Mahecha, Alexandre Denis Stoll

Most current software support the Industry Foundation Classes (IFC) transfer of Building Information Models (BIMs) to applications enabling Virtual Reality (VR) navigation (BuildingSMART, 2020; Kiviniemi, Tarandi, Karlshøj, Bell, and Karud, 2008; Poljanšek ...

2021

Psychometrics of Disembodiment and Its Differential Modulation by Visuomotor and Visuotactile Mismatches

Oliver Alan Kannape, Bigna Lenggenhager

Altered states of embodiment are fundamental to the scientific understanding of bodily self consciousness. The feeling of disembodiment during everyday activities is common to clinical conditions; however, the direct study of disembodiment in experimental ...

2020

Jointly Optimizing Sensing Pipelines for Multimodal Mixed Reality Interaction

Lakmal Buddika Meegahapola

Natural human interactions for Mixed Reality Applications are overwhelmingly multimodal: humans communicate intent and instructions via a combination of visual, aural and gestural cues. However, supporting low-latency and accurate comprehension of such mul ...

IEEE COMPUTER SOC2020

Untethered Feel‐Through Haptics Using 18‐µm Thick Dielectric Elastomer Actuators

Yves Perriard, Herbert Shea, Yoan René Cyrille Civet, Vito Cacucciolo, Xiaobin Ji, Xinchang Liu

Head‐mounted displays for virtual reality (VR) and augmented reality (AR) allow users to see highly realistic virtual worlds. The wearable haptics that enable feeling and touching these virtual objects are typically bulky, tethered, and provide only low fi ...

2020

Building blocks for commodity augmented reality-based molecular visualization and modeling in web browsers

Luciano Andres Abriata

For years, immersive interfaces using virtual and augmented reality (AR) for molecular visualization and modeling have promised a revolution in the way how we teach, learn, communicate and work in chemistry, structural biology and related areas. However, m ...

2020

Towards BCI-Based Interfaces for Augmented Reality: Feasibility, Design and Evaluation

Nicolas Julien Roussel, Camille Marie Jeunet

Brain-Computer Interfaces (BCIs) enable users to interact with computers without any dedicated movement, bringing new hands-free interaction paradigms. In this paper we study the combination of BCI and Augmented Reality (AR). We first tested the feasibilit ...

2020

Concordia: A musical XR instrument for playing the solar system

Petter Harald Ericson

Kepler Concordia, a new scientific and musical instrument enabling players to explore the solar system and other data within immersive extended-reality (XR) platforms, is being designed by a diverse team of musicians, artists, scientists and engineers usin ...

ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD2020