Wrapyfi-examples_llama Alternatives
Similar projects and alternatives to wrapyfi-examples_llama
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better wrapyfi-examples_llama alternative or higher similarity.
wrapyfi-examples_llama reviews and mentions
Posts with mentions or reviews of wrapyfi-examples_llama.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-04.
- [D] Is it possible to run Meta's LLaMA 65B model on consumer-grade hardware?
-
Wrapyfi for distributing LLaMA by Meta on different machines
The authors present an example of combining Wrapyfi (https://github.com/fabawi/wrapyfi), a Python wrapper for message-oriented and robotics middleware, with LLaMA (https://github.com/facebookresearch/llama), a series of large language models from Meta AI. They demonstrate how Wrapyfi can enable running LLaMA on multiple mid-range machines with high inference speed and low cost. They also provide links to their GitHub repository (https://github.com/modular-ml/wrapyfi-examples_llama) and paper (https://arxiv.org/abs/2302.09648) for more details. They state that this example can revolutionize natural language processing tasks such as text generation, summarization, question answering, sentiment analysis, etc. without having to buy new hardware and use their existing infrastructure!
Stats
Basic wrapyfi-examples_llama repo stats
2
128
4.0
about 1 year ago
modular-ml/wrapyfi-examples_llama is an open source project licensed under GNU General Public License v3.0 only which is an OSI approved license.
The primary programming language of wrapyfi-examples_llama is Python.
Popular Comparisons
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com