awesome-ai-safety
reframe
awesome-ai-safety | reframe | |
---|---|---|
5 | 7 | |
142 | 156 | |
5.6% | - | |
5.6 | 0.0 | |
8 months ago | 9 months ago | |
Python | ||
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-ai-safety
-
Ask HN: Who is hiring? (October 2023)
Giskard - Testing framework for ML models| Multiple roles | Full-time | France | https://giskard.ai/
We are building the first collaborative & open-source Quality Assurance platform for all ML models - including Large Language Models.
Founded in 2021 in Paris by ex-Dataiku engineers, we are an emerging player in the fast-growing market of AI Quality & Safety.
Giskard helps Data Scientists & ML Engineering teams collaborate to evaluate, test & monitor AI models. We help organizations increase the efficiency of their AI development workflow, eliminate risks of AI biases and ensure robust, reliable & ethical AI models. Our open-source platform is used by dozens of ML teams across industries, both at enterprise companies & startups.
In 2022, we raised our first round of 1.5 million euros, led by Elaia, with participation from Bessemer and notable angel investors including the CTO of Hugging Face. To read more about this fundraising and how it will accelerate our growth, you can read this announcement: https://www.giskard.ai/knowledge/news-fundraising-2022
In 2023, we received a strategic investment from the European Commission to build a SaaS platform to automate compliance with the upcoming EU AI regulation. You can read more here: https://www.giskard.ai/knowledge/1-000-github-stars-3meu-and...
We are assembling a team of champions: Software Engineers, Machine Learning researchers, and Data Scientists ; to build our AI Quality platform and expand it to new types of AI models and industries. We have a culture of continuous learning & quality, and we help each other achieve high standards & goals!
We aim to grow from 15 to 25 people in the next 12 months. We're hiring the following roles:
-
Ask HN: Who is hiring? (August 2023)
Giskard - Testing framework for ML models| Multiple roles | Full-time | France | https://giskard.ai/
We are building the first collaborative & open-source Quality Assurance platform for all ML models - including Large Language Models.
Founded in 2021 in Paris by ex-Dataiku engineers, we are an emerging player in the fast-growing market of AI Safety & Security.
Giskard helps Data Scientists & ML Engineering teams collaborate to evaluate, test & monitor AI models. We help organizations increase the efficiency of their AI development workflow, eliminate risks of AI biases and ensure robust, reliable & ethical AI models. Our open-source platform is used by dozens of ML teams across industries, both at enterprise companies & startups.
In 2022, we raised our first round of 1.5 million euros, led by Elaia, with participation from Bessemer and notable angel investors including the CTO of Hugging Face. To read more about this fundraising and how it will accelerate our growth, you can read this announcement: https://www.giskard.ai/knowledge/news-fundraising-2022
In 2023, we received a strategic investment from the European Commission to build a SaaS platform to automate compliance with the upcoming EU AI regulation. You can read more here: https://www.giskard.ai/knowledge/1-000-github-stars-3meu-and...
We are assembling a team of champions: Software Engineers, Machine Learning researchers, and Data Scientists ; to build our AI Quality platform and expand it to new types of AI models and industries. We have a culture of continuous learning & quality, and we help each other achieve high standards & goals!
We aim to grow from 15 to 25 people in the next 12 months. We're hiring the following roles:
* Software Engineer - https://apply.workable.com/giskard/j/AD2C90B581/ (Python, Java, Typescript, Vue.js, Cloud skills)
* Machine Learning Researcher - https://apply.workable.com/giskard/j/E89FE8E310/ (post-PhD)
* Data Science lead - https://apply.workable.com/giskard/j/E89FE8E310/ (ML + consulting experience required)
* Growth marketing intern - https://apply.workable.com/giskard/j/C8635E9B0C/
* Data Science intern - https://apply.workable.com/giskard/j/7F0B341852/
-
Show HN: Python library to scan ML models for vulnerabilities
Hi! I’ve been working on this automatic scanner for ML models to detect issues like underperforming data slices, overconfidence in predictions, robustness problems, and others. It supports all main Python ML frameworks (sklearn, torch, xgboost, …) and integrates with the quality assurance solution we are building at Giskard AI (https://giskard.ai) to systematically test models before putting them in production.
It is still a beta and I would love to hear your feedback if you have the time to try it out.
We have quite a few tutorials in the docs with ready-made colab notebooks to make it easy to get started.
If you are interested in the code:
https://github.com/Giskard-AI/giskard/tree/main/python-clien...
-
[R] Awesome AI Safety – A curated list of papers & technical articles on AI Quality & Safety
Repository: https://github.com/Giskard-AI/awesome-ai-safety
- AI Safety – curated papers for safer, ethical, and reliable AI
reframe
- Custom domains for Airtable
-
Ask HN: Who is hiring? (August 2023)
NNext.ai » Software Engineer » Python » Full-time » NY, NY, USA » Remote
At [NNext.ai](http://NNext.ai) (read “Next.ai”), we are building building core infrastructure to simplify the process of building, deploying, and managing LLM-powered AI agents on tabular data, making it the most efficient solution available. NNext AI enables users to combine the power of Large Language Models (LLMs) like GPT with tools like the browser and Google Search, greatly increasing your productivity on workflows you once spent countless hours on. We are building a framework specialized for tabular data such as Spread sheets, Database Tables and CSVs, thereby taking advantage of the similarities and co-dependencies amongst data.
We are lean team of engineers looking for our first full time OSS contributor. Desirable experience includes distributed systems working with tools like Celery, Dash and Redis Streams. Visibility on Github is a huge plus. Show us previous OSS software you’ve contributed to or public personal projects with significant usage.
Website: https://nnext.ai
Github: https://github.com/nnextai/aigent
Email: [email protected]
-
[P] NNextDB (read: “nextdb”), an open-source, blazingly fast ⚡️, vector search database to power your AI apps 🦾.
https://github.com/nnextdb/nnext/blob/main/FAQs.md Q: How does this differ from Faiss, ScaNN and Annoy?
-
NNextDB (read: “nextdb”), an open-source, blazingly fast ⚡️, vector search database to power your AI apps 🦾.
What’s NNext? [Say “Next”] NNextDB is a blazingly fast ⚡️, open-source 📖, (vector) neural search 🔎 engine for building delightful AI Apps 🦾. Github: https://github.com/nnextdb/nnext Like what you see? Please give us a Star 🤩. Applications Vector search is a key concept in modern machine learning systems. It’s the technology behind
-
[D] Doing similarity search for images?
These things mostly work by having some vision model, chopping it off somewhere in the middle and using that layer as an "embedding" for your image. Then you look for images that have embeddings which are close together (normally in the sense of Euclidean distance, e.g.)
-
[D] What features would you like to see in a vector search database?
Code Link: https://github.com/nnextdb/nnext
-
Ask HN: What Are You Working On? (August 2022)
NNextDB - a blazing fast, open source, vector search database for building AP applications.
https://github.com/nnextdb/nnext
What are some alternatives?
opentofu - OpenTofu lets you declaratively manage your cloud infrastructure.
skeleton - A fully featured UI toolkit for Svelte + Tailwind. [Moved to: https://github.com/skeletonlabs/skeleton]
tabby - Self-hosted AI coding assistant
vector-search-compilation - A compilation of Vector Search Databases
awesome-langchain - 😎 Awesome list of tools and projects with the awesome LangChain framework
open-recipe-project - Free, and open recipes for anyone to use
giskard - 🐢 Open-Source Evaluation & Testing for LLMs and ML models
needle - A CLI tool that finds a needle (opening/intro and ending/credits) in a haystack (TV or anime episode).
refact - WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
filterbox - Index your Python objects for fast lookup by their attributes. [Moved to: https://github.com/manimino/ducks]
nl-wallet - NL Public Reference Wallet
pyroscope-rs - Pyroscope Profiler for Rust. Profile your Rust applications.