MosaicML Agrees to Join Databricks to Power Generative AI for All

• llm-foundry

  37 3,693 9.7 Python

  LLM training code for Databricks foundation models

  

Yes? Their github is under Apache, their base model is under apache, the training data is not theirs, and they provide scripts how to convert it for the pretrain step. They have scripts for pretraining and finetuning as well. Basically for everything.

• open_llama

  52 7,193 5.3

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  

Compare it to openllama. It github doesn't have a single script on how to do anything.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• RedPajama-Data

  19 4,329 6.0 Python

  The RedPajama-Data repository contains code for preparing large datasets for training large language models.

  

Compare it to red pajama, which has scripts only for preprocessing.

Suggest a related project