I'm running an Alpaca 13B and now I feel like 7B is a damn goldfish. But wow... the future is coming. Fast.

This page summarizes the projects mentioned and recommended in the original post on /r/singularity

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • alpaca.cpp

    Discontinued Locally run an Instruction-Tuned Chat-Style LLM

    Link of my issue on the GitHub page

  • text-generation-webui

    A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

    if you have that, I don't recommend using alpaca.cpp. Use text-generation-webui with the Alpaca LoRA and you'll have a way better time, I guarantee it.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

  • alpaca-lora

    Instruct-tune LLaMA on consumer hardware

    To get started with the best option of running Alpaca, use the repo here: https://github.com/tloen/alpaca-lora

  • dalai

    The simplest way to run LLaMA on your local machine

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts