alibi-detect
Appwrite
alibi-detect | Appwrite | |
---|---|---|
9 | 581 | |
2,085 | 41,134 | |
1.6% | 1.4% | |
7.6 | 10.0 | |
12 days ago | 5 days ago | |
Python | TypeScript | |
GNU General Public License v3.0 or later | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
alibi-detect
-
Exploring Open-Source Alternatives to Landing AI for Robust MLOps
Numerous tools exist for detecting anomalies in time series data, but Alibi Detect stood out to me, particularly for its capabilities and its compatibility with both TensorFlow and PyTorch backends.
- Looking for recommendations to monitor / detect data drifts over time
-
[D] Distributions to represent an Image Dataset
That is, to see whether a test image belongs in the distribution of the training images and to provide a routine for special cases. After a bit of reading Ive found that this is related to the field of drift detection in which I tried out alibi-detect . Whereby the training images are trained by an autoencoder and any subsequent drift will be flagged by the AE.
-
[D] Which statistical test would you use to detect drift in a dataset of images?
Wasserstein distance is not very suitable for drift detection on most problems given that the sample complexity (and estimation error) scales with O(n^(-1/d)) with n the number of instances (100k-10m in your case) and d the feature dimension (192 in your case). More interesting will be to use for instance a detector based on the maximum mean discrepancy (MMD) with estimation error of O(n^(-1/2)). Notice the absence of the feature dimension here. You can find scalable implementations in Alibi Detect (disclosure: I am a contributor): MMD docs, image example. We just added the KeOps backend for the MMD detector to scale and speed up the drift detector further, so if you install from master, you can leverage this backend and easily scale the detector to 1mn instances on e.g. 1 RTX2080Ti GPU. Check this example for more info.
-
Ask HN: Who is hiring? (January 2022)
Seldon | Multiple positions | London/Cambridge UK | Onsite/Remote | Full time | seldon.io
At Seldon we are building industry leading solutions for deploying, monitoring, and explaining machine learning models. We are an open-core company with several successful open source projects like:
* https://github.com/SeldonIO/seldon-core
* https://github.com/SeldonIO/mlserver
* https://github.com/SeldonIO/alibi
* https://github.com/SeldonIO/alibi-detect
* https://github.com/SeldonIO/tempo
We are hiring for a range of positions, including software engineers(go, k8s), ml engineers (python, go), frontend engineers (js), UX designer, and product managers. All open positions can be found at https://www.seldon.io/careers/
- What Machine Learning model monitoring tools can you recommend?
- Ask HN: Who is hiring? (December 2021)
-
[D] How do you deal with covariate shift and concept drift in production?
I work in this area and also contribute to outlier/drift detection library https://github.com/SeldonIO/alibi-detect. To tackle this type of problem, I would strongly encourage following a more principled, fundamentally (statistically) sound approach. So for instance measuring metrics such as the KL-divergence (or many other f-divergences) will not be that informative since it has a lot of undesirable properties for the problem at hand (in order to be informative requires already overlapping distributions P and Q, it is asymmetric, not a real distance metric, will not scale well with data dimensionality etc). So you should probably look at Integral Probability Metrics (IPMs) such as the Maximum Mean Discrepancy (MMD) instead which have much nicer behaviour to monitor drift. I highly recommend the Interpretable Comparison of Distributions and Models NeurIPS workshop talks for more in-depth background.
-
[D] Is this a reasonable assumption in machine learning?
All of the above functionality and more can be easily used under a simple API in https://github.com/SeldonIO/alibi-detect.
Appwrite
-
How I use Appwrite Databases with Pinia to build my own habit tracker
If you haven't tried Appwrite, make sure you give it a spin. It's a open source backend that packs authentication, databases, storage, serverless functions, and all kinds of utilities in a neat API. Appwrite can be self-hosted, or you can use Appwrite Cloud starting with a generous free plan.
-
Exploring Appwrite: A Comprehensive Guide
What is Appwrite? Appwrite is an open-source backend server that abstracts the complexity of backend development, allowing developers to focus on building their applications. It provides a wide range of services including databases, storage, functions, and authentication, all designed to work seamlessly together. This integration simplifies the development process, reducing the need for extensive configuration and integration work.
-
11 Planetscale alternatives with free tiers
Appwrite is an open source BaaS platform that provides services like serverless functions, serverless databases, user authentication, and messaging. Since its release, it has quickly become a popular choice for building websites and applications.
-
Biometric authentication with Passkeys
Appwrite for user management, databases, and serverless functions
- Appwrite
-
100+ FREE Resources Every Web Developer Must Try
Appwrite: Open-source backend server for web and mobile developers.
-
The 2024 Web Hosting Report
Today, this ecosystem is going strong with new providers like Hasura, AppWrite and Supabase powering millions of projects. There are a few reasons people choose this style of hosting, especially if they are more comfortable with frontend development. BaaS lets them set up a database in a secure way, expose some business logic on top of the data, and connect via a dev-friendly SDK from their app or website code to save data easily. These modern tools build a blend of managed database with curated plugins such as authentication, great admin dashboards, and function as a service type capability - all in one package, and often offered as a integrated hosted service.
-
Why would you use Backend as a Service (BaaS)?
View on GitHub
-
2024 Web Development Wish List
Joins - see Future of Queries - MariaDB supports json joins, so definitely possible!
-
Show HN: Mutable.ai β Turn your codebase into a Wiki
Wow, looks nice! I almost felt like I could understand Bitcoins code xD
Could you do Appwrite? https://github.com/appwrite/appwrite
I'm not affiliated to them, just wanted to get started hacking it.
What are some alternatives?
pytorch-widedeep - A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
supabase - The open source Firebase alternative.
cleanlab - The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.
Strapi - π Strapi is the leading open-source headless CMS. Itβs 100% JavaScript/TypeScript, fully customizable and developer-first.
pyod - A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
pocketbase - Open Source realtime backend in 1 file
seldon-core - An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
nhost - The Open Source Firebase Alternative with GraphQL.
river - π Online machine learning in Python
Directus - The Modern Data Stack π° β Directus is an instant REST+GraphQL API and intuitive no-code data collaboration app for any SQL database.
Anomaly_Detection_Tuto - Anomaly detection tutorial on univariate time series with an auto-encoder
parse-server - Parse Server for Node.js / Express