flintrock vs spark-snowflake

Our great sponsors

WorkOS - The modern identity platform for B2B SaaS

InfluxDB - Power Real-Time Data Analytics at Scale

SaaSHub - Software Alternatives and Reviews

Our great sponsors

flintrock		spark-snowflake
	Project
1	Mentions	1
630	Stars	196
-	Growth	-0.5%
5.0	Activity	5.6
16 days ago	Latest Commit	2 months ago
Python	Language	Scala
Apache License 2.0	License	Apache License 2.0

The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

flintrock

Posts with mentions or reviews of flintrock. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-02-14.

Why Databricks Is Winning
5 projects | news.ycombinator.com | 14 Feb 2021

> * AWS has a managed Spark offering called EMR
There is also my rinky-dink open source project, Flintrock [0], that will launch open source Spark clusters on AWS for you.
It's probably not the right tool for production use (and you would be right to wonder why Flintrock exists when we have EMR [1]), but I know of several companies that have used Flintrock at one point or other in production at large scale (like, 400+ node clusters).
[0]: https://github.com/nchammas/flintrock
[1]: https://github.com/nchammas/flintrock#why-build-flintrock-wh...

spark-snowflake

Posts with mentions or reviews of spark-snowflake. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-02-14.

Why Databricks Is Winning
5 projects | news.ycombinator.com | 14 Feb 2021

Snowflake and Databricks are different, sometimes complementary technologies. You can store data in Snowflake & query it with Databricks for example: https://github.com/snowflakedb/spark-snowflake
Snowflake predicate pushdown filtering seems quite promising: https://www.snowflake.com/blog/snowflake-spark-part-2-pushin...
Think both these companies can win.

What are some alternatives?

When comparing flintrock and spark-snowflake you can also consider the following projects:

databricks-nutter-repos-demo - Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline

dask-gateway - A multi-tenant server for securely deploying and managing Dask clusters.

Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing

chispa - PySpark test helper methods with beautiful error messages

MLflow - Open source platform for the machine learning lifecycle

delta - An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

quinn - pyspark methods to enhance developer productivity 📣 👯 🎉