Top 18 Python retrieval-augmented-generation Projects

• txtai

  356 7,080 9.3 Python

  💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

  

Project mention: Show HN: FileKitty – Combine and label text files for LLM prompt contexts | news.ycombinator.com | 2024-05-01

• ragflow

  7 7,404 9.7 Python

  RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

  

Project mention: DeepSeek-V2 integrated, RAGFlow v0.5.0 is released | news.ycombinator.com | 2024-05-07

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• TaskingAI

  1 4,837 9.4 Python

  The open source platform for AI-native application development.

  

Project mention: TaskingAI: AI-native app development platform | news.ycombinator.com | 2024-01-30

• llmware

  9 3,717 9.8 Python

  Providing enterprise-grade LLM-based development framework, tools, and fine-tuned models.

  

Project mention: More Agents Is All You Need: LLMs performance scales with the number of agents | news.ycombinator.com | 2024-04-06

I couldn't agree more. You should check out LLMWare's SLIM agents (https://github.com/llmware-ai/llmware/tree/main/examples/SLI...). It's focusing on pretty much exactly this and chaining multiple local LLMs together.

A really good topic that ties in with this is the need for deterministic sampling (I may have the terminology a bit incorrect) depending on what the model is indended for. The LLMWare team did a good 2 part video on this here as well (https://www.youtube.com/watch?v=7oMTGhSKuNY)

I think dedicated miniture LLMs are the way forward.

Disclaimer - Not affiliated with them in any way, just think it's a really cool project.

• GenerativeAIExamples

  1 1,575 7.5 Python

  Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

  

Project mention: FLaNK Weekly 18 Dec 2023 | dev.to | 2023-12-18

• cognita

  4 1,320 7.9 Python

  RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

  

Project mention: FLaNK AI Weekly for 29 April 2024 | dev.to | 2024-04-29

• R2R

  4 1,232 9.7 Python

  The framework for fast development and deployment of RAG systems.

  

Project mention: Show HN: Ellipsis – Automated PR reviews and bug fixes | news.ycombinator.com | 2024-05-09

Hi HN, hunterbrooks and nbrad here from Ellipsis (https://www.ellipsis.dev). Ellipsis automatically reviews your PRs when opened and on each new commit. If you tag @ellipsis-dev in a comment, it can make changes to the PR (via direct commit or side PR) and answer questions, just like a human.

Demo video: https://www.youtube.com/watch?v=X61NGZpaNQA

So far, we have dozens of open source projects and companies using Ellipsis. We seem to have landed in a kind of sweet spot where there’s a good match between the current capabilities of AI tools and the actual needs of software engineers - this doesn’t replace human review, but it saves you time by catching/fixing lots of small silly stuff.

Here’s an example in the wild: https://github.com/relari-ai/continuous-eval/pull/38, where Ellipsis (1) adds a PR summary; (2) finds a bug and adds a review comment; (3) after a [human] user comments, generates a side PR with the fix; and (4) after a (human) user merges the side PR and adds another commit, re-reviews the PR and approves it

Here’s another example: https://github.com/SciPhi-AI/R2R/pull/350#pullrequestreview-..., where Ellipsis adds several comments with inline suggestions that were directly merged by the developer.

You can configure Ellipsis in natural language to enforce custom rules, style guides, or conventions. For example, here’s how the `jxnl/instructor` repo uses natural language rules to make sure that docs are kept in sync: https://github.com/jxnl/instructor/blob/main/ellipsis.yaml#L..., and here’s an example PR that Ellipsis came up with based on those rules: https://github.com/jxnl/instructor/pull/346.

Don’t worry, your code is never stored or used to train models (https://docs.ellipsis.dev/security).

Installing into your repo takes 2 clicks at https://www.ellipsis.dev. We’d really appreciate your feedback, thoughts, and ideas!

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• autollm

  1 919 9.0 Python

  Ship RAG based LLM web apps in seconds.

  

Project mention: FLaNK Stack Weekly 06 Nov 2023 | dev.to | 2023-11-06

• fastembed

  4 822 9.5 Python

  Fast, Accurate, Lightweight Python library to make State of the Art Embedding

  

Project mention: FastLLM by Qdrant – lightweight LLM tailored For RAG | news.ycombinator.com | 2024-04-01

• raptor

  3 491 6.6 Python

  The official implementation of RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

Project mention: Show HN: A phone number to text with questions about current events | news.ycombinator.com | 2024-05-10

Hi HN! For my senior thesis in CS, I built an SMS-based application to make journalism more accessible. It works like this:

1) You text the topics you're interested in to my phone number. Every day, you'll receive a text with 5 headlines from The Associated Press (https://apnews.com/) related to those topics.

2) If you have questions about any of the current events the headlines describe, you just text them back. A response is generated from the contents of the articles using the RAPTOR retrieval framework (https://github.com/parthsarthi03/raptor) and texted right back to you.

The repo can be found here: https://github.com/tdh15/pressText

I'd really appreciate any and all feedback. Whatever you got, I'd love to hear it :)

• obsidian-copilot

  5 445 7.3 Python

  🤖 A prototype assistant for writing and thinking (by eugeneyan)

Project mention: Ask HN: Has Anyone Trained a personal LLM using their personal notes? | news.ycombinator.com | 2024-04-03

hadn't seen your repo yet [1] - adding it to my list right now.

Your blog post is really neat on top - thanks for sharing

https://github.com/eugeneyan/obsidian-copilot

• AnglE

  12 361 9.2 Python

  Angle-optimized Text Embeddings | 🔥 SOTA on STS and MTEB Leaderboard (by SeanLee97)

Project mention: FLaNK Stack Weekly 22 January 2024 | dev.to | 2024-01-22

• continuous-eval

  4 327 8.7 Python

  Open-Source Evaluation for GenAI Application Pipelines

  

Project mention: Show HN: Ellipsis – Automated PR reviews and bug fixes | news.ycombinator.com | 2024-05-09

Hi HN, hunterbrooks and nbrad here from Ellipsis (https://www.ellipsis.dev). Ellipsis automatically reviews your PRs when opened and on each new commit. If you tag @ellipsis-dev in a comment, it can make changes to the PR (via direct commit or side PR) and answer questions, just like a human.

Demo video: https://www.youtube.com/watch?v=X61NGZpaNQA

So far, we have dozens of open source projects and companies using Ellipsis. We seem to have landed in a kind of sweet spot where there’s a good match between the current capabilities of AI tools and the actual needs of software engineers - this doesn’t replace human review, but it saves you time by catching/fixing lots of small silly stuff.

Here’s an example in the wild: https://github.com/relari-ai/continuous-eval/pull/38, where Ellipsis (1) adds a PR summary; (2) finds a bug and adds a review comment; (3) after a [human] user comments, generates a side PR with the fix; and (4) after a (human) user merges the side PR and adds another commit, re-reviews the PR and approves it

Here’s another example: https://github.com/SciPhi-AI/R2R/pull/350#pullrequestreview-..., where Ellipsis adds several comments with inline suggestions that were directly merged by the developer.

You can configure Ellipsis in natural language to enforce custom rules, style guides, or conventions. For example, here’s how the `jxnl/instructor` repo uses natural language rules to make sure that docs are kept in sync: https://github.com/jxnl/instructor/blob/main/ellipsis.yaml#L..., and here’s an example PR that Ellipsis came up with based on those rules: https://github.com/jxnl/instructor/pull/346.

Don’t worry, your code is never stored or used to train models (https://docs.ellipsis.dev/security).

Installing into your repo takes 2 clicks at https://www.ellipsis.dev. We’d really appreciate your feedback, thoughts, and ideas!

• txtchat

  17 226 6.9 Python

  💭 Retrieval augmented generation (RAG) and language model powered search applications

  

• repochat

  1 213 7.1 Python

  Chatbot assistant enabling GitHub repository interaction using LLMs with Retrieval Augmented Generation

Project mention: Repochat | news.ycombinator.com | 2023-10-25

• tonic_validate

  6 210 9.5 Python

  Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

  

Project mention: Validating the RAG Performance of Amazon Titan vs. Cohere Using Amazon Bedrock | news.ycombinator.com | 2024-02-09

I tried out Amazon Bedrock, and used Tonic Validate to do a head to head comparison of very simple RAG system's built using embedding and text models available in Amazon Bedrock. I compared Amazon Titan's embedding and text models to Cohere's embedding and text models in RAG systems that employ Amazon Bedrock Knowledge Bases as the vector db and retrieval components of the system.

The code for the comparison is in this jupyter notebook https://github.com/TonicAI/tonic_validate/blob/main/examples...

Let me know what you think, And your experiences building RAG with Amazon Bedrock!

• SimplyRetrieve

  1 189 8.8 Python

  Lightweight chat AI platform featuring custom knowledge, open-source LLMs, prompt-engineering, retrieval analysis. Highly customizable. For Retrieval-Centric & Retrieval-Augmented Generation.

Project mention: Show HN: Open-Source Chat AI Platform with Custom Knowledge | news.ycombinator.com | 2023-08-22

• tvallogging

  1 7 5.9 Python

  A tool for evaluating and tracking your RAG experiments. This repo contains the Python SDK for logging to Tonic Validate.

  

Project mention: Show HN: Tonic Validate Logging – an open-sourced SDK and convenient UI | news.ycombinator.com | 2023-10-31

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python retrieval-augmented-generation related posts

• Show HN: A phone number to text with questions about current events

  2 projects | news.ycombinator.com | 10 May 2024

• Show HN: Ellipsis – Automated PR reviews and bug fixes

  6 projects | news.ycombinator.com | 9 May 2024

• RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation

  1 project | news.ycombinator.com | 30 Apr 2024

• Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

  1 project | /r/patient_hackernews | 13 Jun 2023

• Obsidian-Copilot: A Prototype Assistant for Writing and Thinking

  1 project | /r/hackernews | 13 Jun 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 17 May 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!