distributed-llama
Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage. (by b4rtaz)
llama-nuts-and-bolts
A holistic way of understanding how LLaMA and its components run in practice, with code and detailed documentation. (by adalkiran)
distributed-llama | llama-nuts-and-bolts | |
---|---|---|
4 | 1 | |
790 | 109 | |
- | - | |
9.2 | 8.6 | |
2 days ago | 21 days ago | |
C++ | Go | |
MIT License | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
distributed-llama
Posts with mentions or reviews of distributed-llama.
We have used some of these posts to build our list of alternatives
and similar projects.
llama-nuts-and-bolts
Posts with mentions or reviews of llama-nuts-and-bolts.
We have used some of these posts to build our list of alternatives
and similar projects.
What are some alternatives?
When comparing distributed-llama and llama-nuts-and-bolts you can also consider the following projects:
oceanbase - OceanBase is an enterprise distributed relational database with high availability, high performance, horizontal scalability, and compatibility with SQL standards.
llama2.go - LLaMA-2 in native Go
lizardfs - LizardFS is an Open Source Distributed File System licensed under GPLv3.
ollama - Get up and running with Llama 2, Mistral, Gemma, and other large language models. [Moved to: https://github.com/ollama/ollama]
LeanCopilot - LLMs as Copilots for Theorem Proving in Lean