Top 10 Scala Python Projects

Apache Spark

101 38,320 10.0 Scala

Apache Spark - A unified analytics engine for large-scale data processing

Project mention: "xAI will open source Grok" | news.ycombinator.com | 2024-03-11

mleap

1 1,494 5.2 Scala

MLeap: Deploy ML Pipelines to Production
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Cortex

4 1,249 4.9 Scala

Cortex: a Powerful Observable Analysis and Active Response Engine (by TheHive-Project)
adam

3 967 6.1 Scala

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
sparkMeasure

1 641 7.5 Scala

This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spark jobs. It focuses on easing the collection and examination of Spark metrics, making it a practical choice for both developers and data engineers.
scalapy

2 531 3.5 Scala

Use the world of Python from the comfort of Scala!
Vyxal

2 261 9.9 Scala

A code-golfing language experience that has aspects of traditional programming languages - terse, elegant, readable.

Project mention: Vyxal: A code-golfing language experience | news.ycombinator.com | 2024-02-28

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
spark-extension

1 168 8.3 Scala

A library that provides useful extensions to Apache Spark and PySpark.

Project mention: Data diffs: Algorithms for explaining what changed in a dataset (2022) | news.ycombinator.com | 2023-07-26

We're doing a env migration and I've been using spark diff extension for reconcile data, it's amazing, we've discover bugs in the data logic so quickly,
here is the extension if anyone is interested https://github.com/G-Research/spark-extension/blob/master/DI...

kukulcan

1 114 0.0 Scala

A REPL for Apache Kafka
stasis

1 28 7.2 Scala

Backup and recovery system with emphasis on security and privacy (by sndnv)

Project mention: ⟳ 1 apps added, 3 updated at apt.izzysoft.de | /r/FDroidUpdates | 2023-10-25

stasis: Backup and recovery system with emphasis on security and privacy

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).