distributed-llama

Tensor parallelism is all you need. Run LLMs on weak devices or make powerful devices even more powerful by distributing the workload and dividing the RAM usage. (by b4rtaz)
We couldn't find one of the projects to be compared. Maybe you clicked on a broken link.

Distributed-llama Alternatives

Similar projects and alternatives to distributed-llama based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better distributed-llama alternative or higher similarity.

distributed-llama discussion

Log in or Post with

distributed-llama reviews and mentions

Posts with mentions or reviews of distributed-llama. We have used some of these posts to build our list of alternatives and similar projects.

Stats

Basic distributed-llama repo stats
4
920
9.4
7 days ago

b4rtaz/distributed-llama is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of distributed-llama is C++.


Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com