Delta Lake

An open-source storage layer that brings ACID transactions to Apache Spark™

Pinned

delta Public

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.

Scala 4.6k 1.1k

delta-rs Public
A native Rust library for Delta Lake, with bindings into Python and Ruby.

Rust 486 Apache-2.0 116 92 (25 issues need help) 8 Updated Jun 30, 2022
website Public
Delta Lake Website

JavaScript 6 Apache-2.0 9 5 (1 issue needs help) 11 Updated Jun 30, 2022
delta Public
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs for Scala, Java, Rust, Ruby, and Python.

Scala 4,557 Apache-2.0 1,078 164 (1 issue needs help) 39 Updated Jun 30, 2022
connectors Public
Connectors for Delta Lake

Java 272 Apache-2.0 108 34 (1 issue needs help) 7 Updated Jun 27, 2022
delta-sharing Public
An open protocol for secure data sharing

Scala 399 Apache-2.0 82 21 4 Updated Jun 26, 2022
kafka-delta-ingest Public
A highly efficient daemon for streaming data from Kafka into Delta Lake

Rust 128 Apache-2.0 27 21 (6 issues need help) 1 Updated Jun 17, 2022

delta-lake big-data delta pandas spark