TinyLlama: An Open-Source Small Language Model

• TinyLlama

  14 6,818 8.7 Python

  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

GitHub repo with links to the checkpoints: https://github.com/jzhang38/TinyLlama

• llm.f90

  13 48 8.4 Fortran

  LLM inference in Fortran

Also, I should promote the code I wrote for running this. It runs models in ggml format, the one I made available is an older checkpoint though. It's easy to convert the newer one. And it's in Fortran but it should be easy to get gfortran if you don't have it installed.

https://github.com/rbitr/llm.f90/tree/optimize16/purefortran

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• SimpleTinyLlama

  1 9 7.3 Python

  https://github.com/jzhang38/TinyLlama using only PyTorch

Here is another inference implementation in Python (only dependency is PyTorch).

https://github.com/99991/SimpleTinyLlama

The new checkpoints did not seem much better and they changed the chat format for some reason, so I did not port the new checkpoints yet. Perhaps I'll get to it this weekend.

Suggest a related project