datajob
stepview
Our great sponsors
datajob | stepview | |
---|---|---|
4 | 1 | |
107 | 28 | |
- | - | |
0.0 | 1.8 | |
about 1 year ago | almost 2 years ago | |
Python | Python | |
Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datajob
- Build and deploy a serverless data pipeline on AWS with no effort.
-
Datajob: Build and deploy a serverless data pipeline on AWS with no effort.
Thanks! triggering a pipeline run based on a schedule is one of the ideas to implement next: https://github.com/vincentclaes/datajob#ideas
-
Aws Glue Environmentsdlc
I created an open source library called `datajob` to deploy and orchestrate glue jobs. You can find it on github https://github.com/vincentclaes/datajob and on pypi
stepview
What are some alternatives?
tributary - Streaming reactive and dataflow graphs in Python
LocalStack - 💻 A fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline
DataEngineeringProject - Example end to end data engineering project.
data-science-ipython-notebooks - Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.
getting-started - This repository is a getting started guide to Singer.
devops-exercises - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview Questions
Moto - A library that allows you to easily mock out tests based on AWS infrastructure.
gluonts - Probabilistic time series modeling in Python
stepfunctions2processing - Configuration with AWS step functions and lambdas which initiates processing from activity state