seldon-core
Gravitational Teleport
seldon-core | Gravitational Teleport | |
---|---|---|
14 | 62 | |
4,220 | 16,578 | |
1.2% | 2.5% | |
7.6 | 10.0 | |
4 days ago | 4 days ago | |
HTML | Go | |
GNU General Public License v3.0 or later | GNU Affero General Public License v3.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
seldon-core
-
seldon-core VS MLDrop - a user suggested alternative
2 projects | 20 Feb 2023
-
[D] Feedback on a worked Continuous Deployment Example (CI/CD/CT)
ZenML is an extensible, open-source MLOps framework to create production-ready machine learning pipelines. Built for data scientists, it has a simple, flexible syntax, is cloud- and tool-agnostic, and has interfaces/abstractions that are catered towards ML workflows. Seldon Core is a production grade open source model serving platform. It packs a wide range of features built around deploying models to REST/GRPC microservices that include monitoring and logging, model explainers, outlier detectors and various continuous deployment strategies such as A/B testing, canary deployments and more.
-
[D] BentoML's Compatibility with Seldon;
I am using BentoML to build the docker container for a BERT model, and then deploy that using Seldon on GKE. The model's REST API endpoint works fine. at terms of compatibility with Seldon, the metrics are being scraped by Prometheus and visualized on Grafana. The only Seldon component that doesn't appear to be working is the request logging, which I have working for other applications that were deployed on Seldon. I am using the elastic stack from here. From my understanding, request logging should still be compatible and the β only lost functionality should be Seldon's model metadata. Any insight on how to get the centralized request logging working? No errors were shown; it's just that the logs aren't being captured and sent to ElasticSearch. Anyone have any success using BentoML with Seldon and not losing any of Seldon's features?
-
Building a Responsible AI Solution - Principles into Practice
While tools in the model experimentation space normally include diagnostic charts on a model's performance, there are also specialised solutions that help ensure that the deployed model continues to perform as they are expected to. This includes the likes of seldon-core, why-labs and fiddler.ai.
-
Ask HN: Who is hiring? (January 2022)
Seldon | Multiple positions | London/Cambridge UK | Onsite/Remote | Full time | seldon.io
At Seldon we are building industry leading solutions for deploying, monitoring, and explaining machine learning models. We are an open-core company with several successful open source projects like:
* https://github.com/SeldonIO/seldon-core
* https://github.com/SeldonIO/mlserver
* https://github.com/SeldonIO/alibi
* https://github.com/SeldonIO/alibi-detect
* https://github.com/SeldonIO/tempo
We are hiring for a range of positions, including software engineers(go, k8s), ml engineers (python, go), frontend engineers (js), UX designer, and product managers. All open positions can be found at https://www.seldon.io/careers/
- Ask HN: Who is hiring? (December 2021)
-
Has anyone implemented Seldon?
Also note our github repo has a link to our slack where you can ask active users: https://github.com/SeldonIO/seldon-core
-
[Discussion] Look for service to upload a model and receive a REST API endpoint, for serving predictions
If you want to serve your model at scale, with a bunch of production features you should have a look at the open-source framework Seldon Core. It does what you're asking for plus a bunch of other cool stuff like routing, logging and monitoring.
- Seldon Core : Open-source platform for rapidly deploying machine learning models on Kubernetes
-
Looking for open-source model serving framework with dashboard for test data quality
Seldon ticks most of those boxes if you already have some experience with kubernetes. You can set up a/b tests, do payload logging to elastic and then do monitoring on top of that, and it has drift detection and model explainer modules too. Idk about great expectations integration, but you could probably do something with a custom transformer module as part of the inference graph.
Gravitational Teleport
-
List of ngrok/Cloudflare Tunnel alternatives and other tunneling software and services. Focus on self-hosting.
Teleport - Comprehensive control plane tool, but also supports accessing apps behind NATs. Written in Go.
-
Apache Guacamole: a clientless remote desktop gateway
https://github.com/gravitational/teleport/blob/master/rfd/00...
-
Parsing the Postgres protocol β logging executed statements
I ordinarily would have said you reinvented Teleport <https://github.com/gravitational/teleport/tree/v14.3.7#readm...> but now that they've gone AGPL with v15 I'm guessing there's a market for MIT licensed stuff, although for sure since Teleport has been around for so long it has encountered more edge cases and undergone more security reviews. I was surprised while digging up the link that Gravatational is still releasing v13 and v14 updates under Apache 2, so maybe even Teleport will continue to have legs for those who cannot deploy AGPL stuff
-
π Top Open Source Projects of 2023 π
Teleport is an SSH for Clusters and Teams and aims to be the drop-in replacement for OpenSSH.
-
Release Radar β’ February 2024 Edition
Are you looking to set up SSO for your cloud infrastructure? Or maybe establish tunnels to access services behind NATs and firewalls. Then Teleport is for you. It provides connectivity, authentication, access controls and audit for infrastructure. The newest update has a tonne of new features and improvements including enhanced device trust support, SSH connection resumption, MFA for admin actions, improved provisioning for Okta, and heaps. more. Check out all the changes in the Teleport release notes.
-
OpenBao β FOSS Fork of HashiCorp Vault
In case you didn't see it: https://goteleport.com/blog/teleport-oss-switches-to-agpl-v3... and https://github.com/gravitational/teleport/pull/35259
I readily admit it's not the same amount of :fu: as BuSL or whatever the fuck is going on over at Sentry but still :-( as compared to their much friendlier Apache 2
-
Who's hiring developer advocates? (December 2023)
Link to GitHub -->
- Teleport relicenses from Apache 2.0 to AGPLv3
-
Gravitational Teleport alternatives - netbird, ZeroTier, and awl
4 projects | 29 Jun 2023
-
Passkeys for Infrastructure
OP here, thanks for posting! Happy to Answer any questions. I have to give our a shoutout to Alan at Teleport for all his work on Passwordless and his work to make Passwordless / TouchID work with MacOS CLI https://github.com/gravitational/teleport/blob/master/rfd/00...
What are some alternatives?
BentoML - The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!
Pomerium - Pomerium is an identity and context-aware reverse proxy for zero-trust access to web applications and services.
MLServer - An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
KeyBox - Bastillion is a web-based SSH console that centrally manages administrative access to systems. Web-based administration is combined with management and distribution of user's public SSH keys.
evidently - Evaluate and monitor ML models from validation to production. Join our Discord: https://discord.com/invite/xZjKRaNp8b
vouch-proxy - an SSO and OAuth / OIDC login solution for Nginx using the auth_request module
great_expectations - Always know what to expect from your data.
telepresence - Local development against a remote Kubernetes or OpenShift cluster
alibi-detect - Algorithms for outlier, adversarial and drift detection
Mosh - Mobile Shell
transformers - π€ Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Multi SSH Config - Mirror of https://gitlab.com/osiux/multi-ssh-config