Publications related to Data cleansing

Extensions of Peer Prediction Incentive Mechanisms

As large, data-driven artificial intelligence models become ubiquitous, guaranteeing high data quality is imperative for constructing models. Crowdsourcing, community sensing, and data filtering have long been the standard approaches to guaranteeing or imp ...

EPFL2024

Continuous corrected particle number concentration data in 10 sec resolution measured in the Swiss aerosol container using a whole air inlet during MOSAiC 2019/2020

Julia Schmale, Ivo Fabio Beck

This dataset contains corrected particle number concentration data measured during the year-long MOSAiC expedition from October 2019 to September 2020. Some periods of the measurements were affected by repeated step changes in the particle number concentra ...

Zenodo2023

Genetic features and genomic targets of human KRAB-zinc finger proteins

Didier Trono, Jacques Fellay, Priscilla Turelli, Christian Axel Wandall Thorball, Sandra Eloise Kjeldsen, Evaristo Jose Planet Letschert, Julien Léonard Duc, Cyril David Son-Tuyên Pulver, Romain Forey, Bara Khubieh, Alexandre Coudray, Michaël Imbeault, Jonas Caspar De Tribolet-Hardy

Krüppel-associated box (KRAB) domain-containing zinc finger proteins (KZFPs) are one of the largest groups of transcription factors encoded by tetrapods, with 378 members in human alone. KZFP genes are often grouped in clusters reflecting amplification by ...

2023

Pollution mask for the continuous corrected particle number concentration data in 1 min time resolution measured in the Swiss aerosol container using a whole air inlet during MOSAiC 2019/2020

Julia Schmale, Andrea Baccarini, Ivo Fabio Beck, Hélène Paule Angot

This dataset contains particle number concentrations and a pollution flag in 1 min time resolution. It is derived by the pollution detection algorithm (PDA, doi:10.5281/zenodo.5761101) based on the corrected particle number concentration data of the CPC377 ...

Zenodo2023

Shared metadata for data-centric materials science

Giovanni Pizzi, Ronald Earle Miller, Gian-Marco Rignanese, Carsten Baldauf, Matthias Scheffler, Tristan Bereau

The expansive production of data in materials science, their widespread sharing and repurposing requires educated support and stewardship. In order to ensure that this need helps rather than hinders scientific work, the implementation of the FAIR-data prin ...

Nature Portfolio2023

Scalable and Privacy-Preserving Federated Principal Component Analysis

Jean-Pierre Hubaux, Juan Ramón Troncoso-Pastoriza, Apostolos Pyrgelis, David Jules Froelicher, Joao André Gomes de Sá e Sousa, Jean-Philippe Léonard Bossuat

Principal component analysis (PCA) is an essential algorithm for dimensionality reduction in many data science domains. We address the problem of performing a federated PCA on private data distributed among multiple data providers while ensuring data confi ...

IEEE COMPUTER SOC2023

E-Scan: Consuming Contextual Data with Model Plugins

Anastasia Ailamaki, Viktor Sanca

Extracting value and insights from increasingly heterogeneous data sources involves multiple systems combining and consuming the data. With multi-modal and context-rich data such as strings, text, videos, or images, the problem of standardizing the data mo ...

2023

Two-level Data Augmentation for Calibrated Multi-view Detection

Pascal Fua, Martin Pierre Engilberge, Zhiye Wang, Haixin Shi

Data augmentation has proven its usefulness to improve model generalization and performance. While it is commonly applied in computer vision application when it comes to multi-view systems, it is rarely used. Indeed geometric data augmentation can break th ...

IEEE COMPUTER SOC2023

incentive Mechanism Design for Responsible Data Governance: A Large-Scale Field Experiment

Boi Faltings, Naman Goel

A crucial building block of responsible artificial intelligence is responsible data governance, including data collection. Its importance is also underlined in the latest EU regulations. The data should be of high quality, foremost correct and representati ...

2023

Dataset for "Elastocapillary menisci mediate interaction of neighboring structures at the surface of a compliant solid"

John Martin Kolinski

This dataset supports the publication 'Elastocapillary menisci mediate interaction of neighboring structures at the surface of a compliant solid' by Lebo Molefe and John M. Kolinski, Physical Review E, (2023). The data are surface profiles of textured surf ...

Zenodo2023

Bulk size-resolved chemical composition and mass concentration of non-refractory submicron aerosols measured in the Swiss container during MOSAiC 2019/2020

Julia Schmale, Benjamin Jérémy Laurent Heutte, Ivo Fabio Beck, Imad El Haddad, Hélène Paule Angot, Lubna Dada

This dataset contains the bulk size-resolved chemical composition and mass concentration of non-refractory submicron aerosols (NR-PM1) measured during the MOSAiC expedition from October 2019 to July 2020. These include the mass concentrations of sulfate (S ...

Zenodo2023

Center-aware Adversarial Augmentation for Single Domain Generalization

Mathieu Salzmann, Zhiye Wang

Domain generalization (DG) aims to learn a model from multiple training (i.e., source) domains that can generalize well to the unseen test (i.e., target) data coming from a different distribution. Single domain generalization (SingleDG) has recently emerge ...

IEEE COMPUTER SOC2023

Determining an optimum quantity of interleaved instruction streams of defined coroutines

Anastasia Ailamaki, Georgios Psaropoulos

A method for optimizing memory access for database operations is provided. The method may include performing a first database operation by at least executing a first instruction stream associated with the first database operation. The first database opera ...

2023

Methodology for selecting measurement points that optimize information gain for model updating

Ian Smith, Numa Joy Bertola

Information collected through sensor measurements has the potential to improve knowledge of complex-system behavior, leading to better decisions related to system management. In this situation, and particularly when using digital twins, the quality of sens ...

2023

A Practical Influence Approximation for Privacy-Preserving Data Filtering in Federated Learning

Boi Faltings, Ljubomir Rokvic, Panayiotis Danassis

Federated Learning by nature is susceptible to low-quality, corrupted, or even malicious data that can severely degrade the quality of the learned model. Traditional techniques for data valuation cannot be applied as the data is never revealed. We present ...

2023

The Impact of Data Persistence Bias on Social Media Studies

Tugrulcan Elmas

Social media studies often collect data retrospectively to analyze public opinion. Social media data may decay over time and such decay may prevent the collection of the complete dataset. As a result, the collected dataset may differ from the complete data ...

Assoc Computing Machinery2023

Continuous corrected particle number concentration data in 10 sec resolution, measured in the Swiss aerosol container during MOSAiC 2019/2020

Julia Schmale, Ivo Fabio Beck

This dataset contains corrected particle number concentration data measured during the year long MOSAiC expedition from October 2019 to September 2020. The measurement was performed in the Swiss aerosol container on the D-deck of Research Vessel Polarstern ...

Zenodo2022

Pollution mask for the continuous corrected particle number concentration data in 1 min resolution, measured in the Swiss aerosol container during MOSAiC 2019/2020

Julia Schmale, Ivo Fabio Beck, Andrea Baccarini, Hélène Paule Angot

This dataset contains a pollution flag in 1 min time resolution. It is derived by the pollution detection algorithm (PDA) based on the corrected particle number concentration data (DOI upcoming) measured during the year long MOSAiC expedition from October ...

Zenodo2022

Putting Temperature into the Equation: Development and Validation of Algorithms to Distinguish Non-Wearing from Inactivity and Sleep in Wearable Sensors

Kamiar Aminian, Anisoara Ionescu, Sara Pagnamenta

Long-term monitoring of real-life physical activity (PA) using wearable devices is increasingly used in clinical and epidemiological studies. The quality of the recorded data is an important issue, as unreliable data may negatively affect the outcome measu ...

MDPI2022

Analytical prediction of the final error due to noise in a ϕ-OTDR system

Luc Thévenaz, Malak Mohamed Hossameldeen Omar Mohamed Galal, Yuting Yang, Li Zhang, Suneetha Sebastian

An analytical expression to estimate the uncertainty on the frequency shift in ϕ-OTDR systems is established and confirmed by actual data. ...

Optica Publishing Group2022