apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
See what the GitHub community is most excited about today.
Apache Spark - A unified analytics engine for large-scale data processing
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
Rocket Chip Generator
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
Chisel: A Modern Hardware Design Language
An open protocol for secure data sharing
Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala
An Agile RISC-V SoC Design Framework with in-order cores, out-of-order cores, accelerators, and more
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
CMAK is a tool for managing Apache Kafka clusters
A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
The Community Maintained High Velocity Web Framework For Java and Scala.
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Modern Load Testing as Code
ZIO — A type-safe, composable library for async and concurrent programming in Scala
Spark: The Definitive Guide's Code Repository
Open-source high-performance RISC-V processor
Source code for Twitter's Recommendation Algorithm
Simple and Distributed Machine Learning
TheHive: a Scalable, Open Source and Free Security Incident Response Platform
State of the Art Natural Language Processing