Top 6 model-validation Open-Source Projects

• deepchecks

  15 3,380 8.2 Python

  Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

  

Project mention: Detect, Defend, Prevail: Payments Fraud Detection using ML & Deepchecks | dev.to | 2024-01-13

Also if you have any confusion related to it. You can directly go to their discussion section in github :

• giskard

  7 3,164 10.0 Python

  🐢 Open-Source Evaluation & Testing framework for LLMs and ML models

  

Project mention: Show HN: Evaluate LLM-based RAG Applications with automated test set generation | news.ycombinator.com | 2024-04-11

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Validot

  0 281 2.7 C#

  Validot is a performance-first, compact library for advanced model validation. Using a simple declarative fluent interface, it efficiently handles classes, structs, nested members, collections, nullables, plus any relation or combination of them. It also supports translations, custom logic extensions with tests, and DI containers.

• awesome-ai-safety

  5 138 5.6

  📚 A curated list of papers & technical articles on AI Quality & Safety

  

Project mention: Ask HN: Who is hiring? (October 2023) | news.ycombinator.com | 2023-10-02

Giskard - Testing framework for ML models| Multiple roles | Full-time | France | https://giskard.ai/

We are building the first collaborative & open-source Quality Assurance platform for all ML models - including Large Language Models.

Founded in 2021 in Paris by ex-Dataiku engineers, we are an emerging player in the fast-growing market of AI Quality & Safety.

Giskard helps Data Scientists & ML Engineering teams collaborate to evaluate, test & monitor AI models. We help organizations increase the efficiency of their AI development workflow, eliminate risks of AI biases and ensure robust, reliable & ethical AI models. Our open-source platform is used by dozens of ML teams across industries, both at enterprise companies & startups.

In 2022, we raised our first round of 1.5 million euros, led by Elaia, with participation from Bessemer and notable angel investors including the CTO of Hugging Face. To read more about this fundraising and how it will accelerate our growth, you can read this announcement: https://www.giskard.ai/knowledge/news-fundraising-2022

In 2023, we received a strategic investment from the European Commission to build a SaaS platform to automate compliance with the upcoming EU AI regulation. You can read more here: https://www.giskard.ai/knowledge/1-000-github-stars-3meu-and...

We are assembling a team of champions: Software Engineers, Machine Learning researchers, and Data Scientists ; to build our AI Quality platform and expand it to new types of AI models and industries. We have a culture of continuous learning & quality, and we help each other achieve high standards & goals!

We aim to grow from 15 to 25 people in the next 12 months. We're hiring the following roles:

• PyForecastTools

  1 30 3.7 Python

  Forecast Verification/Validation Tools in Python

• dandi

  1 10 0.0 TypeScript

  🌻A modular DI, MVC, and Model binding/validation framework for NodeJS and TypeScript or ES6

  

model-validation related posts

• Detect, Defend, Prevail: Payments Fraud Detection using ML & Deepchecks

  1 project | dev.to | 13 Jan 2024

• Deepchecks: Open-source ML testing and validation library

  1 project | news.ycombinator.com | 11 Sep 2023

• Deepchecks' New Open Source is on Product Hunt, and Needs Your Help

  3 projects | /r/deeplearning | 18 Jun 2023

• Deepchecks

  1 project | /r/devopspro | 22 Aug 2022

• deepchecks: Test Suites for Validating ML Models & Data. Deepchecks is a Python package for comprehensively validating your machine learning models and data with minimal effort.

  1 project | /r/coolgithubprojects | 8 Aug 2022

• QA help comes in many forms: Sometimes, from your heavily funded competitor

  1 project | news.ycombinator.com | 13 May 2022

• Deepchecks: An open-source tool for testing machine learning models and data

  1 project | /r/datascience | 14 Feb 2022
• A note from our sponsor - SaaSHub
  www.saashub.com | 15 May 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com