Mistral 7B Fine-Tune Optimized

• llama.cpp

  769 56,891 10.0 C++

  LLM inference in C/C++

I haven't used the llama2 models much in quite awhile, because they just aren't very good compared to other options at this point. Mistral and Mixtral seem to have very little trouble responding in JSON when I ask for it. However, with LLMs that you run yourself, you can also enforce a grammar for the response if you want to, guaranteeing that it will respond with valid JSON and no extraneous text. Something potentially helpful here: https://github.com/ggerganov/llama.cpp/discussions/2494

• unsloth

  15 7,263 9.4 Python

  Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

  

If anyone wants to finetune their own Mistral 7b model 2.2x faster and use 62% less memory - give our open source package Unsloth a try! https://github.com/unslothai/unsloth a try! :)

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project