[R] 🤖🌟 Unlock the Power of Personal AI: Introducing ChatLLaMA, Your Custom Personal Assistant! 🚀💬

• llama.cpp

  773 56,891 10.0 C++

  LLM inference in C/C++

I did manage to run the ggml-alpaca-7b-q4.bin model using llama.cpp but it stops after a couple of exchanges.

• LLaMA-8bit-LoRA

  3 145 5.1 Python

  Repository for Chat LLaMA - training a LoRA for the LLaMA (1 or 2) models on HuggingFace with 8-bit or 4-bit quantization. Research only.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alpaca-lora

  107 18,197 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

I scrapped a stardew valley wiki and created this dataset, it's has something like 7k items of

• trl

  13 8,120 9.7 Python

  Train transformer language models with reinforcement learning.

  

You can use this -> https://github.com/lvwerra/trl/blob/main/examples/sentiment/scripts/gpt-neox-20b_peft/merge_peft_adapter.py

• Sparsebit

  1 320 5.9 Python

  A model compression and acceleration toolbox based on pytorch.

  

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Awesome! I guess the result of that could be plugged into say.. https://github.com/oobabooga/text-generation-webui since it support 4bit.

• sparsegpt-for-LLaMA

  3 65 5.2 Python

  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project