Our great sponsors
-
flyte
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
While I was on my recent Hacktoberfest live stream we discovered Flyte. It's an open source project for machine learning and data processing. Flyte is a platform enabling workflows.
One of the cool things about Flyte is they have a tonne of tutorials. These tutorials are here to teach you how to use Flyte and start processing data, training models, or performing batch predictions. The tutorials are affectionately named Flytesnacks. All the code for the tutorials is available on GitHub for easy access.
You can find the detailed contribution guide here.
Home Page 路 Quick Start 路 Documentation 路 Features 路 Community & Resources 路 Changelogs 路 Components
Instead of writing *.yaml files (which are what workflow run on), you can spend your time writing code, and leave the workflows to Flyte. It's built on Kubernetes, and there's lots of SDKs so you can program exactly what you want.
Related posts
- Why bad scientific code beats code following "best practices"
- Building a no-code Helm UI with Windmill - Part 1
- Flyte(v1.5.0) - Self-hosted solution to build production-grade data and ML pipelines; now ships with streaming support, pod templates, partial tasks and more 馃殌 (3.2k stars on GitHub)
- Ask HN: Go vs. Python (Docker SDK)
- Lessons Learned from Running Apache Airflow at Scale