[N] OpenLLaMA: An Open Reproduction of LLaMA

• open_llama

  52 7,179 5.3

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  

• RedPajama-Data

  19 4,329 6.0 Python

  The RedPajama-Data repository contains code for preparing large datasets for training large language models.

  

Not sure, but their wikipedia code do support limited multilingual language

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama

  184 52,603 8.1 Python

  Inference code for Llama models

  

If you have lots of available VRAM and a powerful GPU, the use the original llama inference code, which is actually open source.

• llama.cpp

  769 55,846 10.0 C++

  LLM inference in C/C++

If your GPU isn't good enough, you could use llama.cpp, which runs on CPU, or one of its forks like fastLLaMa.

• fastLLaMa

  6 402 7.1 C

  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backend.

If your GPU isn't good enough, you could use llama.cpp, which runs on CPU, or one of its forks like fastLLaMa.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project