Patterns for Building LLM-Based Systems and Products

1. blog

   1 3 5 9.5 HTML

   Discontinued The Vespa blog - https://blog.vespa.ai (by vespa-engine)

   

2. Civic Auth

   www.civic.com featured

   Auth in Less Than 5 Minutes. Civic Auth comes with multiple SSO options, optional embedded wallets, and user management — all implemented with just a few lines of code. Start building today.

   

3. ragas

   2 11 8,898 9.7 Python

   Supercharge Your LLM Application Evaluations 🚀

   

   We have build RAGAS framework for this https://github.com/explodinggradients/ragas

4. OpenPipe

   3 18 2,577 9.8 TypeScript

   Turn expensive prompts into cheap fine-tuned models

   

   This is fantastic! I found myself nodding along in many places. I've definitely found in practice that evals are critical to shipping LLM-based apps with confidence. I'm actually working on an open-source tool in this space: https://github.com/openpipe/openpipe. Would love any feedback on ways to make it more useful. :)

5. llama_index

   4 78 41,098 9.9 Python

   LlamaIndex is the leading framework for building LLM-powered agents over your data.

   

   https://github.com/jerryjliu/llama_index. You can use something like that or another GitHub repo built with it to create a customized chatbot application in a few minutes or a few days. (It should not take two weeks and $15,000).

   It would be good to see something detailed that demonstrates an actual use case for fine tuning. Also, I don't believe that the academic tests are appropriate in that case. If you really were dead set on avoiding a leading edge closed LLM, and doing actual fine-tuning, you would want a person to look at the outputs and judge them in their specific context such as handling customer support requests for that system.

6. agenta

   5 17 2,575 10.0 Python

   The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

   

   Great project! We're building an open-source platform for building robust LLM apps (https://github.com/Agenta-AI/agenta), we'd love to integrate your library into our evaluation!

7. CodeRabbit

   coderabbit.ai featured

   CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

   

Suggest a related project