Publications by Juan Pablo Zuluaga Gomez

XLSR-Transducer: Streaming ASR for Self-Supervised Pretrained Models

Self-supervised pretrained models exhibit competitive performance in automatic speech recognition (ASR) on finetuning, even with limited in-domain supervised data. However, popular pretrained models are not suitable for streaming ASR because they are train ...

Institute of Electrical and Electronics Engineers2025

Speech Data Selection for Efficient ASR Fine-Tuning using Domain Classifier and Pseudo-Label Filtering

Juan Pablo Zuluaga Gomez

In real-world speech data processing, the scarcity of annotated data and the abundance of unlabelled speech data present a significant challenge. To address this, we propose an efficient data selection pipeline for fine-tuning ASR models by generating pseu ...

Institute of Electrical and Electronics Engineers Inc.2025

Low-Resource Speech Recognition and Understanding for Challenging Applications

Juan Pablo Zuluaga Gomez

Automatic speech recognition (ASR) and spoken language understanding (SLU) is the core component of current voice-powered AI assistants such as Siri and Alexa. It involves speech transcription with ASR and its comprehension with natural language understand ...

EPFL2024

Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whisper

Juan Pablo Zuluaga Gomez

The training of automatic speech recognition (ASR) with little to no supervised data remains an open question. In this work, we demonstrate that streaming Transformer-Transducer (TT) models can be trained from scratch in consumer and accessible GPUs in the ...

Association for Computational Linguistics (ACL)2024

A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers

Petr Motlicek, Amrutha Prasad, Juan Pablo Zuluaga Gomez

In this paper we propose a novel virtual simulation-pilot engine for speeding up air traffic controller (ATCo) training by integrating different state-of-the-art artificial intelligence (AI)-based tools. The virtual simulation-pilot engine receives spoken ...

MDPI2023

An Automatic Speaker Clustering Pipeline for the Air Traffic Communication Domain

Juan Pablo Zuluaga Gomez

In air traffic management (ATM), voice communications are critical for ensuring the safe and efficient operation of aircraft. The pertinent voice communications-air traffic controller (ATCo) and pilot-are usually transmitted in a single channel, which pose ...

2023

Validating Automatic Speech Recognition and Understanding for Pre-Filling Radar Labels-Increasing Safety While Reducing Air Traffic Controllers' Workload

Juan Pablo Zuluaga Gomez

Automatic speech recognition and understanding (ASRU) for air traffic control (ATC) has been investigated in different ATC environments and applications. The objective of this study was to quantify the effect of ASRU support for air traffic controllers (AT ...

2023

Lessons Learned in Transcribing 5000 h of Air Traffic Control Communications for Robust Automatic Speech Understanding

Juan Pablo Zuluaga Gomez

Voice communication between air traffic controllers (ATCos) and pilots is critical for ensuring safe and efficient air traffic control (ATC). The handling of these voice communications requires high levels of awareness from ATCos and can be tedious and err ...

2023

A Two-Step Approach To Leverage Contextual Data: Speech Recognition In Air-Traffic Communications

Petr Motlicek, Amrutha Prasad, Juan Pablo Zuluaga Gomez

Automatic Speech Recognition (ASR), as the assistance of speech communication between pilots and air-traffic controllers, can significantly reduce the complexity of the task and increase the reliability of transmitted information. ASR application can lead ...

IEEE2022

How Does Pre-Trained Wav2Vec 2.0 Perform On Domain-Shifted Asr? An Extensive Benchmark On Air Traffic Control Communications

Petr Motlicek, Amrutha Prasad, Juan Pablo Zuluaga Gomez

Recent work on self-supervised pre-training focus on leveraging large-scale unlabeled speech data to build robust end-to-end (E2E) acoustic models (AM) that can be later fine-tuned on downstream tasks e.g., automatic speech recognition (ASR). Yet, few work ...

IEEE2022

Bertraffic: Bert-Based Joint Speaker Role And Speaker Change Detection For Air Traffic Control Communications

Petr Motlicek, Amrutha Prasad, Juan Pablo Zuluaga Gomez

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common challenge is speech ...

IEEE2022

Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systems

Petr Motlicek, Amrutha Prasad, Juan Pablo Zuluaga Gomez

Air traffic management and specifically air-traffic control (ATC) rely mostly on voice communications between Air Traffic Controllers (ATCos) and pilots. In most cases, these voice communications follow a well-defined grammar that could be leveraged in Aut ...

ISCA-INT SPEECH COMMUNICATION ASSOC2021

Boosting of contextual information in ASR for air-traffic call-sign recognition

Petr Motlicek, Juan Pablo Zuluaga Gomez

Contextual adaptation of ASR can be very beneficial for multi-accent and often noisy Air-Traffic Control (ATC) speech. Our focus is call-sign recognition, which can be used to track conversations of ATC operators with individual airplanes. We developed a t ...

ISCA-INT SPEECH COMMUNICATION ASSOC2021

Domain-Adversarial Based Model with Phonological Knowledge for Cross-Lingual Speech Recognition

Juan Pablo Zuluaga Gomez

Phonological-based features (articulatory features, AFs) describe the movements of the vocal organ which are shared across languages. This paper investigates a domain-adversarial neural network (DANN) to extract reliable AFs, and different multi-stream tec ...

2021