Publications related to Data lake

Oligolithic Cross-task Optimizations across Isolated Workloads

Anastasia Ailamaki, Eleni Zapridou, Panagiotis Sioulas

Enterprises collect data in large volumes and leverage them to drive numerous concurrent decisions and business processes. Their teams deploy multiple applications that often operate concurrently on the same data and infrastructure but have widely differen ...

2024

Lithium tantalate photonic integrated circuits for volume manufacturing

Tobias Kippenberg

Dataset for the manuscript "Lithium tantalate photonic integrated circuits for volume manufacturing". DOI: 10.1038/s41586-024-07369-1 Contains all raw data and code used to produce the Figures and Extended Data Figures in the manuscript. ...

EPFL Infoscience2023

Dataset for the paper High durability and stability of 2D nanofluidic devices for long-term single-molecule sensing

Aleksandra Radenovic, Andras Kis, Martina Lihter, Mukesh Kumar Tripathi, Mukeshchand Thakur, Andrey Chernev, Nianduo Cai, Yunfei Teng, Michal Daniel Macha, Yanfei Zhao, Miao Zhang

Information regarding the Dataset, corresponding to the paper: “Thakur, M., Cai, N., Zhang, M. et al. High durability and stability of 2D nanofluidic devices for long-term single-molecule sensing. npj 2D Mater Appl 7, 11 (2023). https://doi.org/10.1038/s41 ...

Zenodo2023

Physically Consistent Multiple-Step Data-Driven Predictions Using Physics-Based Filters

Colin Neil Jones, Jicheng Shi, Yingzhao Lian

Data-driven control can facilitate the rapid development of controllers, offering an alternative to conventional approaches. In order to maintain consistency between any known underlying physical laws and a data-driven decision-making process, preprocessin ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Genetic features and genomic targets of human KRAB-zinc finger proteins

Didier Trono, Jacques Fellay, Priscilla Turelli, Christian Axel Wandall Thorball, Sandra Eloise Kjeldsen, Evaristo Jose Planet Letschert, Julien Léonard Duc, Cyril David Son-Tuyên Pulver, Romain Forey, Bara Khubieh, Alexandre Coudray, Michaël Imbeault, Jonas Caspar De Tribolet-Hardy

Krüppel-associated box (KRAB) domain-containing zinc finger proteins (KZFPs) are one of the largest groups of transcription factors encoded by tetrapods, with 378 members in human alone. KZFP genes are often grouped in clusters reflecting amplification by ...

2023

Dataset for "Elastocapillary menisci mediate interaction of neighboring structures at the surface of a compliant solid"

John Martin Kolinski

This dataset supports the publication 'Elastocapillary menisci mediate interaction of neighboring structures at the surface of a compliant solid' by Lebo Molefe and John M. Kolinski, Physical Review E, (2023). The data are surface profiles of textured surf ...

Zenodo2023

Data for: "A Neural-Network-Based Convex Regularizer for Inverse Problems"

Michaël Unser, Pakshal Narendra Bohra, Alexis Marie Frederic Goujon, Sebastian Jonas Neumayer, Stanislas Ducotterd

Data for: "A Neural-Network-Based Convex Regularizer for Inverse Problems". The corresponding scripts can be accessed on GitHub (https://github.com/axgoujon/convex_ridge_regularizers). The data is organized as follows: - ct_data_sets.tar.gz: contains prepr ...

Zenodo2023

An Annotated Corpus of Tonal Piano Music from the Long 19th Century

Martin Alois Rohrmeier, Fabian Claude Moss, Johannes Hentschel, Markus Franz Josef Neuwirth

We present a dataset of 264 annotated piano pieces of nine composers, composed in the long 19th century (https://doi.org/10.5281/zenodo.7483349). Annotations adhere to the DCML harmony annotation standard and include Roman numerals, phrase boundaries, and ...

Ohio State Univ, Sch Music2023

Data for "Host starvation and in hospite degradation of algal symbionts shape the heat stress response of the Cassiopea-Symbiodiniaceae symbiosis"

Anders Meibom, Stéphane Laurent Escrig, Cristina Martin Olmos, Nils Rädecker, Claudia Isabella Pogoreutz, Guilhem Maurice Louis Banc-Prandi, Gaëlle Delphine Toullec

Raw data associated with the publication "Host starvation and in hospite degradation of algal symbionts shape the heat stress response of the Cassiopea-Symbiodiniaceae symbiosis". Temperature profile, daily measurements, physiological measurements, element ...

Zenodo2023

Dimensionality reduction of time-series data, and systems and devices that use the resultant embeddings

Mackenzie Mathis, Steffen Schneider

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for dimensionality reduction of time-series using contrastive learning. A method can include receiving multidimensional input time series data that includes ...

2023

Imaging radial distribution functions of complex particles by relayed dynamic nuclear polarization

David Lyndon Emsley, Arthur César Pinon, Pierrick Berruyer

Raw data and Matlab scripts from the publication at https://doi.org/10.1021/jacs.3c01279 All codes are provided free of charge and come with no warranty. Future use (original or modified) is required to cite: Zenedo data deposit at DOI 10.5281/zenodo. ...

Zenodo2023

Data for "Ultrafast deep-ultraviolet study of photoexcited aqueous Ferrioxalate"

Majed Chergui, Christoph Bostedt, Michele Puppin, Malte Oppermann, Hui-Yuan Chen

Data repository for the following publication: A. Duque-Prata*, H.-Y. Chen*, L. Müller, M. Oppermann, M. Puppin, C. Serpa, C. Bostedt and M. Chergui, “Ultrafast deep-ultraviolet study of photoexcited aqueous Ferrioxalate”, submitted to ChemPhotoCh ...

Zenodo2023

Columnar Storage Optimization and Caching for Data Lakes

Haoqiong Bian

As a unified data repository, data lake plays a vital role in enterprise data management and analysis. It composes the raw files into tables that are processed in-situ by various computation engines and applications. Therefore, the read performance of the ...

2022

High-dimensional Data Cubes

Christoph Koch, Sachin Basil John

This paper introduces an approach to supporting high-dimensional data cubes at interactive query speeds and moderate storage cost. The approach is based on binary(-domain) data cubes that are judiciously partially materialized; the missing information can ...

2022

Graph integration of structured, semistructured and unstructured data for data journalism

Angelos Christos Anadiotis, Jingmao You

Digital data is a gold mine for modern journalism. However, datasets which interest journalists are extremely heterogeneous, ranging from highly structured (relational databases), semi-structured (JSON, XML, HTML), graphs (e.g., RDF), and text. Journalists ...

PERGAMON-ELSEVIER SCIENCE LTD2022

Storage Management in Smart Data Lake

Anastasia Ailamaki, Haoqiong Bian, Bikash Chandra, Ioannis Mytilinis

Data lakes are complex ecosystems where heterogeneity prevails. Raw data of diverse formats are stored and processed, while long and expensive ETL processes are avoided. Apart from data heterogeneity, data lakes also entail hardware heterogeneity. Typical ...

2021

Data transformer apparatus

Babak Falsafi, Christoph Koch, Siddharth Gupta, Mario Paulo Drumond Lages De Oliveira, Mark Johnathon Sutherland, Arash Pourhabibi Zarandi, Zilu Tian, Hussein Kassir

Data transformer apparatus comprising at least a dispatcher module (D), a reader module (R), a converter module (C) and a writer module (W). The dispatcher module (D) is configured to: receive a data transformation request (DTR) including: a first informat ...

2021

Optimization methods for collaborative learning

Sai Praneeth Reddy Karimireddy

A traditional machine learning pipeline involves collecting massive amounts of data centrally on a server and training models to fit the data. However, increasing concerns about the privacy and security of user's data, combined with the sheer growth in the ...

EPFL2021

Adaptive partitioning and indexing for in situ query processing

Anastasia Ailamaki, Manolis Karpathiotakis, Ioannis Alagiannis, Manoussos Gavriil Athanassoulis, Matthaios Alexandros Olma

The constant flux of data and queries alike has been pushing the boundaries of data analysis systems. The increasing size of raw data files has made data loading an expensive operation that delays the data-to-insight time. To alleviate the loading cost, in ...

SPRINGER2020

Approaching Ontology Alignment through Representation Learning to Bridge the Semantic Gap in Engineering Applications

Prodromos Kolyvakis

The current information landscape is characterised by a vast amount of relatively semantically homogeneous, when observed in isolation, data silos that are, however, drastically semantically fragmented when considered as a whole. Within each data silo, inf ...

EPFL2020