Azure-Databricks-NYC-Taxi-Workshop
spark-extension
| Azure-Databricks-NYC-Taxi-Workshop | spark-extension | |
|---|---|---|
| 1 | 1 | |
| 98 | 173 | |
| - | 5.2% | |
| 0.0 | 8.3 | |
| about 1 year ago | 7 days ago | |
| Scala | Scala | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Azure-Databricks-NYC-Taxi-Workshop
-
What the FUCK do people with office jobs do for work?
Depends if you need to do a lot of intermediate processing on your data; like spatial joins, or doing more more interesting modeling of the data.
spark-extension
-
Data diffs: Algorithms for explaining what changed in a dataset (2022)
We're doing a env migration and I've been using spark diff extension for reconcile data, it's amazing, we've discover bugs in the data logic so quickly,
here is the extension if anyone is interested https://github.com/G-Research/spark-extension/blob/master/DI...
What are some alternatives?
mmlspark - Simple and Distributed Machine Learning [Moved to: https://github.com/microsoft/SynapseML]
deep-diff2 - Deep diff Clojure data structures and pretty print the result
spark-nlp - State of the Art Natural Language Processing
handy_sql_queries
SynapseML - Simple and Distributed Machine Learning
pyspark-starter - Starter pyspark code with a working combination of all versions
scala - Scala 2 compiler and standard library. Bugs at https://github.com/scala/bug; Scala 3 at https://github.com/scala/scala3
recidiffist - Diffs for structured data
lila - ♞ lichess.org: the forever free, adless and open source chess server ♞
macrobase-diff - Minimal implementation of Macrobase Diff
ExplainDaV
thanos-remote-read - Adapter to query Thanos StoreAPI with Prometheus remote read support.