chonkie
🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library [GET https://api.github.com/repos/chonkie-ai/chonkie: 404 - Not Found // See: https://docs.github.com/rest] (by chonkie-ai)
rag-demystified
An LLM-powered advanced RAG pipeline built from scratch (by pchunduri6)
| chonkie | rag-demystified | |
|---|---|---|
| 3 | 3 | |
| 2,845 | 832 | |
| - | 1.9% | |
| 9.8 | 8.2 | |
| 30 days ago | about 1 year ago | |
| Python | Python | |
| MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chonkie
Posts with mentions or reviews of chonkie.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2025-02-11.
-
Chunking your data for RAG
The Textractor extracts chunks of text from files and the Embeddings takes those chunks and builds an index/database. We'll use a late chunker backed by Chonkie.
-
DeepRAG: Thinking to Retrieval Step by Step for Large Language Models
Semantic chunking is where I would start with now. Also check this out: https://github.com/chonkie-ai/chonkie
- Show HN: Chonkie – A Fast, Lightweight Text Chunking Library for RAG
rag-demystified
Posts with mentions or reviews of rag-demystified.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-10-28.
- Show HN: Demystifying Advanced RAG Pipelines
- Show HN: Demystifying Advanced Rag Pipelines
-
Good LLM Validation Is Just Good Validation
This was exactly my experience trying to write a RAG pipeline that answers complex questions by generating sub-questions [1]. The hidden prompts in the complex libraries are quite difficult to get to and then start tweaking, whereas writing my own pipeline boiled down the code to 4 LLM calls.
[1] https://github.com/pchunduri6/rag-demystified
What are some alternatives?
When comparing chonkie and rag-demystified you can also consider the following projects:
denser-retriever - An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.
waggle-dance - Knowledge work automation with AI agents
TalkWithYourFiles - An LLM GUI application; enables you to interact with your files, offering dynamic parameters that can modify response behavior during runtime.
semantifly
vector_sqlite - Faiss with sqlite