What is the smallest ggml model available?

• ggml

  69 9,802 9.8 C

  Tensor library for machine learning

I have converted RedPajama 3b base to ggml and uploaded it to huggingface. You need to use conversion scripts from ggml gpt-neox examples as RedPajama is build on llama-like dataset but a different model architecture https://github.com/ggerganov/ggml/tree/master/examples/

• mlc-llm

  89 17,150 9.9 Python

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

First of all, you'll need Termux (a terminal emulator and Linux environment for Android). Make sure to get it from F-Droid or GitHub because their Google Play release is outdated. There might be alternatives like MLC-LLM but I don't have too much experience in them

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project