It can be done! (Devs attention required)

• stanford_alpaca

  108 28,816 2.0 Python

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

Even more important, they have already released the block of 52000 QA data here https://github.com/tatsu-lab/stanford_alpaca

• dalai

  59 13,051 6.5 CSS

  The simplest way to run LLaMA on your local machine

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alpaca-lora

  107 18,197 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

• alpaca.cpp

  2 13 5.9 C

  Locally run an Instruction-Tuned Chat-Style LLM (by anzz1)

• text-generation-webui

  876 36,552 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Anyone had any luck running llama 4 bit on oobabooga with windows 10? I tried following the official guide but doesn't work. https://github.com/oobabooga/text-generation-webui/wiki/LLaMA-model

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project