pyspark-example-project
dados-censup
| pyspark-example-project | dados-censup | |
|---|---|---|
| 1 | 1 | |
| 1,370 | 6 | |
| - | - | |
| 0.0 | 4.9 | |
| over 1 year ago | 3 months ago | |
| Python | Python | |
| - | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pyspark-example-project
-
Learning Pyspark for a new role
https://github.com/AlexIoannides/pyspark-example-project You can use this as an example to organize your project. I have referred to this in the past.
dados-censup
What are some alternatives?
soda-spark - Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
ticker_selection_BI_dashboard - Data Engineering Project: 4 shares of a stock data extraction, upload on MySql used to be in a BI project
Apache-Spark-Guide - Apache Spark Guide
workshop-introduction-to-machine-learning - Come ready to discover the goals and approaches of machine learning, and how to build effective algorithms and solutions!
patterns-devkit - Data pipelines from re-usable components
pgcli - Postgres CLI with autocompletion and syntax highlighting
hamilton - Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Mage - 🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai
uber-expenses-tracking - The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
TypedPyspark - Type-annotate your spark dataframes and validate them
data-science-notes - Notes of IBM Data Science Professional Certificate Courses on Coursera