orchest
ExpansionCards
Our great sponsors
orchest | ExpansionCards | |
---|---|---|
44 | 1,136 | |
4,020 | 769 | |
0.2% | 2.7% | |
4.5 | 4.6 | |
11 months ago | 3 months ago | |
TypeScript | OpenSCAD | |
Apache License 2.0 | Creative Commons Attribution 4.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
orchest
-
Decent low code options for orchestration and building data flows?
You can check out our OSS https://github.com/orchest/orchest
- Build ML workflows with Jupyter notebooks
-
Building container images in Kubernetes, how would you approach it?
The code example is part of our ELT/data pipeline tool called Orchest: https://github.com/orchest/orchest/
-
Launch HN: Patterns (YC S21) β A much faster way to build and deploy data apps
First want to say congrats to the Patterns team for creating a gorgeous looking tool. Very minimal and approachable. Massive kudos!
Disclaimer: we're building something very similar and I'm curious about a couple of things.
One of the questions our users have asked us often is how to minimize the dependence on "product specific" components/nodes/steps. For example, if you write CI for GitHub Actions you may use a bunch of GitHub Action references.
Looking at the `graph.yml` in some of the examples you shared you use a similar approach (e.g. patterns/openai-completion@v4). That means that whenever you depend on such components your automation/data pipeline becomes more tied to the specific tool (GitHub Actions/Patterns), effectively locking in users.
How are you helping users feel comfortable with that problem (I don't want to invest in something that's not portable)? It's something we've struggled with ourselves as we're expanding the "out of the box" capabilities you get.
Furthermore, would have loved to see this as an open source project. But I guess the second best thing to open source is some open source contributions and `dcp` and `common-model` look quite interesting!
For those who are curious, I'm one of the authors of https://github.com/orchest/orchest
-
Argo became a graduated CNCF project
Haven't tried it. In its favor, Argo is vendor neutral and is really easy to set up in a local k8s environment like docker for desktop or minikube. If you already use k8s for configuration, service discovery, secret management, etc, it's dead simple to set up and use (avoiding configuration having to learn a whole new workflow configuration language in addition to k8s). The big downside is that it doesn't have a visual DAG editor (although that might be a positive for engineers having to fix workflows written by non-programmers), but the relatively bare-metal nature of Argo means that it's fairly easy to use it as an underlying engine for a more opinionated or lower-code framework (orchest is a notable one out now).
- Ideas for infrastructure and tooling to use for frequent model retraining?
-
Looking for a mentor in MLOps. I am a lead developer.
If youβd like to try something for you data workflows thatβs vendor agnostic (k8s based) and open source you can check out our project: https://github.com/orchest/orchest
-
Is there a good way to trigger data pipelines by event instead of cron?
You can find it here: https://github.com/orchest/orchest Convenience install script: https://github.com/orchest/orchest#installation
-
How do you deal with parallelising parts of an ML pipeline especially on Python?
We automatically provide container level parallelism in Orchest: https://github.com/orchest/orchest
-
Launch HN: Sematic (YC S22) β Open-source framework to build ML pipelines faster
For people in this thread interested in what this tool is an alternative to: Airflow, Luigi, Kubeflow, Kedro, Flyte, Metaflow, Sagemaker Pipelines, GCP Vertex Workbench, Azure Data Factory, Azure ML, Dagster, DVC, ClearML, Prefect, Pachyderm, and Orchest.
Disclaimer: author of Orchest https://github.com/orchest/orchest
ExpansionCards
-
Framework's software and firmware have been a mess, but it's working on them
I think the SD module won't be able to have the card flush, as the modules are only and SD cards are 32mm long, and you need some PCB space for the socket cage and the USB-C on the other side. The retrofit PCB outline they provide is only 26.9mm from front edge to back edge, so an SD card will stick out a little bit.
So perhaps they decided to go for the one that lets users have the card flush for use like an expansion bay as well as for data transfer to/from devices.
https://github.com/FrameworkComputer/ExpansionCards/tree/mai...
-
Microsoft starts testing ads in the Windows 11 Start menu
There are many laptops and desktops that fit the bill.
Frame.work: https://frame.work/
Dell: https://www.dell.com/support/kbdoc/en-us/000138246/linux-on-...
System76: https://system76.com/laptops
Kubuntu Focus: https://kfocus.org/land/business
I am sure there are more, this is only what I have found in less than 5 minutes of searching.
- Which Windows/Linux laptop maker do you like the most?
-
The Gazelle Laptops are the biggest POS
I'll buy a frame.work long before I touch system76. Their prices are too high for the general feedback I keep seeing on the quality control. I'm not spending 3k+ to be out a laptop until support responds. Especially, considering they still don't make these in house..
-
That feeling when you are unboxing a flagship keyboard from a major brand in 2023 and find out it uses micro-USB #smh
No they didn't, companies just mostly gave up on it.
-
ππππ Apple
A Framework Laptop (https://frame.work)
- Is there anything out there that has changed, FOR THE BETTER?
-
1080p 7840U laptop
You could get a Framework 13 which comes with your choice of a 7840U or 7640U and a Radeon 780M iGPU. They do officially support Linux, and you don't have to pay for a Windows license, if you go the DIY option and chose to not get a Windows license.
-
ELI5: What makes a consumer laptop in 2023 better than one in 2018?
Take a look at the Framework laptops. They're 100% modular so if stuff like that goes bad you can simply order the replacement part and do it yourself. I'm using a desktop right now but Ithink my next laptop is gonna be a framework.
-
Conflicting information from Framework on my preorder
a couple of days ago I tried to order a Framework laptop (13 inch AMD). I chose to create an account during the checkout process and provided my email address. After entering my shipping details, I authorized the transfer of the deposit fee via Giropay. The deposit was deducted from my bank account but when I was sent back to the frame.work website I was greeted by an error message. Unfortunately I could neither complete the checkout process nor continue my account registration.
What are some alternatives?
docker-airflow - Docker Apache Airflow
system76-driver - System76 Driver for Pop!_OS
ploomber - The fastest β‘οΈ way to build data pipelines. Develop iteratively, deploy anywhere. βοΈ
pdfarranger - Small python-gtk application, which helps the user to merge or split PDF documents and rotate, crop and rearrange their pages using an interactive and intuitive graphical interface.
hookdeck-cli - Manage your Hookdeck workspaces, connections, transformations, filters, and more with the Hookdeck CLI
coreboot - Mirror of https://review.coreboot.org/coreboot.git. We don't handle Pull Requests.
n8n - Free and source-available fair-code licensed workflow automation tool. Easily automate tasks across different services.
linux-surface - Linux Kernel for Surface Devices
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
Killed by Google - Part guillotine, part graveyard for Google's doomed apps, services, and hardware.
Node RED - Low-code programming for event-driven applications
hardened_malloc - Hardened allocator designed for modern systems. It has integration into Android's Bionic libc and can be used externally with musl and glibc as a dynamic library for use on other Linux-based platforms. It will gain more portability / integration over time.