Yek: Serialize your code repo (or part of it) to feed into any LLM

1. yek

   1 7 1,782 9.8 Rust

   A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption

   

2. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

3. chimeracat

   2 4 16 8.5 Python

   ccat - ChimeraCat smart code concatenator

   

   i guess I shouldn’t be surprised that many of us have approached this in different ways. it’s neat to see already multiple replies of the sort In going to make too, which is to share the approach I’ve been taking, which is to concatenate or to “summarize” the code, with particular attention on dependency resolution.

   https://github.com/scottvr/chimeracat

   It took the shape that it has because it started as a tool to concatenate a library i had been working on into a single ipynb file so that I didn’t need to install the library on the remote colab, thus the dependency graph was born (as was the ascii graph plotter ‘phart’ that it uses) and then as I realized this could be useful to share code with an LLM, started adding the summarization capabilities, and in some sort of meta-recursive-irony, worked with Claude to do so. :-)

   I’ve put a collection of ancillary tools I use to aid in the pairing with LLM process up at https://github.com/scottvr/LLMental

4. LLMental

   3 1 5 6.5

   LLMental: "elemental"ˌe-lə-ˈmen-tᵊl - tools developed to make pair-programming with LLMs more productive that have grown to be generally useful. (phart, fplit, maxify, crumb.py, retree, chimeracat)

   

   i guess I shouldn’t be surprised that many of us have approached this in different ways. it’s neat to see already multiple replies of the sort In going to make too, which is to share the approach I’ve been taking, which is to concatenate or to “summarize” the code, with particular attention on dependency resolution.

   https://github.com/scottvr/chimeracat

   It took the shape that it has because it started as a tool to concatenate a library i had been working on into a single ipynb file so that I didn’t need to install the library on the remote colab, thus the dependency graph was born (as was the ascii graph plotter ‘phart’ that it uses) and then as I realized this could be useful to share code with an LLM, started adding the summarization capabilities, and in some sort of meta-recursive-irony, worked with Claude to do so. :-)

   I’ve put a collection of ancillary tools I use to aid in the pairing with LLM process up at https://github.com/scottvr/LLMental

5. Next.js

   4 2,284 130,389 10.0 JavaScript

   The React Framework

   

   Added some benchmarking to show how fast it is:

         Here is a benchmark comparing it to [Repomix](https://github.com/jxnl/repomix) serializing the [Next.js](https://github.com/vercel/next.js) project:

6. dropnread

   5 2 30 5.2 JavaScript

   A web-based tool that helps prepare source code for Large Language Models (LLMs) by combining multiple files into a single text file. Perfect for when you need to share your codebase with AI models like GPT-4, Claude, or Gemini.

   

   You can do this all in the browser: https://dropnread.io/

7. files-to-prompt

   6 12 1,358 7.3 Python

   Concatenate a directory full of files into a single prompt for use with LLMs

   

   I have to add https://github.com/simonw/files-to-prompt as a marker guid.

   I think "the part of it" is key here. For packaging a codebase, I'll select a collection of files using rg/fzf and then concatenate them into a markdown document, # headers for paths ```filetype ``` for the contents.

   The selection of the files is key to let the LLM focus on what is important for the immediate task. I'll also give it the full file list and have the LLM request files as needed.

8. retree

   7 1 12 8.7 Shell

   Reverse Tree Utility (technically, it *inverts* what /usr/bin/tree does, it doesn't "undo" it.)

   

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. project-context

    8 1 7 5.5 TypeScript

    

    Adding my take to the mix, which has been working well for me: https://github.com/ClaireGSB/project-context.

    It outputs both a file tree of your repo, a list of the dependancies, and a select list of files you want to include in your prompt for the LLM, in a single xml file.

11. gitingest

    9 12 7,541 9.6 Python

    Replace 'hub' with 'ingest' in any github url to get a prompt-friendly extract of a codebase

    

12. sink

    10 1 7 7.8 Go

    Turn your repo into an LLM prompt (by dwrtz)

    

    i wrote something similar https://github.com/dwrtz/sink

    it has some nice features:

    - follows .gitignore patterns

    - optional file watcher to regenerate the snapshot when files are changed

    - supports glob patterns for filter/exclude

    - can report token usage

    - can use a config yaml file if you have complicated filter/exclude patterns

    i find myself using it all the time now. it's great with claude projects

13. Optician-Tool

    11 1 3 - OCaml

    Long term repository for the Optician paper

    

Suggest a related project