apache / spark
Apache Spark - A unified analytics engine for large-scale data processing
See what the GitHub community is most excited about this week.
Apache Spark - A unified analytics engine for large-scale data processing
Source code for Twitter's Recommendation Algorithm
ZIO — A type-safe, composable library for async and concurrent programming in Scala
Open-source high-performance RISC-V processor
The Scala 3 compiler, also known as Dotty.
An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
An open protocol for secure data sharing
An Agile RISC-V SoC Design Framework with in-order cores, out-of-order cores, accelerators, and more
Rocket Chip Generator
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Powerful, joyful building blocks for modern cloud-native applications.
Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala
Scala 2 compiler and standard library. Scala 2 bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
Reference applications for funding, operating, and incentivizing the use of a decentralized, public Canton synchronizer. Includes the Amulet reference application for creating native payment utilities for Canton synchronizers and Daml applications.
Removes large or troublesome blobs like git-filter-branch does, but faster. And written in Scala
A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.
Scala language server with rich IDE features 🚀