Alpaca 7B Training - $75/Hour --> Bay Area? [P]

• pyllama

  5 2,789 5.0 Python

  LLaMA: Open and Efficient Foundation Language Models

I am the author of pyllama https://github.com/juncongmoo/pyllama

• llama.cpp

  776 57,463 10.0 C++

  LLM inference in C/C++

What's with everyone here talking out of their own arse? LLaMA 7B runs on the CPU (I work on llama.rs) or on the GPU.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llm

  41 5,931 9.4 Rust

  An ecosystem of Rust libraries for working with large language models

  

What's with everyone here talking out of their own arse? LLaMA 7B runs on the CPU (I work on llama.rs) or on the GPU.

• text-generation-webui

  876 36,552 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

What's with everyone here talking out of their own arse? LLaMA 7B runs on the CPU (I work on llama.rs) or on the GPU.

• GPTQ-for-LLaMa

  75 2,916 8.6 Python

  4 bits quantization of LLaMA using GPTQ

4-bit GPTQ performs extremely well and allows for 7B LLaMA in 4 gigabytes.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project