BricksLLM
helix
| BricksLLM | helix | |
|---|---|---|
| 5 | 1 | |
| 755 | 206 | |
| 9.1% | 15.0% | |
| 9.8 | 9.9 | |
| 6 days ago | 5 days ago | |
| Go | Go | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
BricksLLM
- We built a highly scalable LLM gateway with go
-
I built an open-source tool that helps add usage-based billing for your LLM projects
Here is the repo if you want to learn more about it: https://github.com/bricks-cloud/bricksllm
- Show HN: I built an OSS alternative to Azure OpenAI services
-
Create OpenAI keys with rate, spend, and time limits!
That's why we made BricksLLM, a proxy gateway that lets you create and use API keys with limited permissions.
- Show HN: Create OpenAI keys with permission controls
helix
-
Show HN: We got fine-tuning Mistral-7B to not suck
If you look at the source [1] you can see how they solved their what are the doctors going to do problem. It is literally included in one of the prompts now:
Users tend to ask broad, vague questions of the document in order to test that the system is working. We want those queries to work well. For example, a user would ask "what are the doctors going to do?" of a document that is about a junior doctors' strike. Take this into account when generating the questions - in particular, refer to noun phrases by less specific descriptions, so for example instead of "junior doctors", say "doctors" in your questions.
[1]: https://github.com/helixml/helix/blob/main/api/pkg/dataprep/...
What are some alternatives?
go-openai - OpenAI ChatGPT, GPT-3, GPT-4, DALL·E, Whisper API wrapper for Go
soulshack - soulshack, an irc chatbot: because real people are overrated. (gpt-4)
go-gpt3 - OpenAI ChatGPT, GPT-3, DALL·E, Whisper API wrapper for Go [Moved to: https://github.com/sashabaranov/go-openai]
unsloth - Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory
vllm - A high-throughput and memory-efficient inference and serving engine for LLMs
lamini-sdk