Llm-mlc Alternatives

Similar projects and alternatives to llm-mlc

• llama.cpp

  777 57,984 10.0 C++ llm-mlc VS llama.cpp

  LLM inference in C/C++

• ollama

  208 64,536 9.9 Go llm-mlc VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• outlines

  33 5,799 9.7 Python llm-mlc VS outlines

  Structured Text Generation

  

• can-ai-code

  30 446 9.5 Python llm-mlc VS can-ai-code

  Self-evaluating interview for AI coders

• lmql

  30 3,360 9.5 Python llm-mlc VS lmql

  A language for constraint-guided and efficient LLM programming.

  

• jsonformer

  25 3,816 5.4 Jupyter Notebook llm-mlc VS jsonformer

  A Bulletproof Way to Generate Structured JSON from Language Models

• Constrained-Text-Generation-Studio

  25 197 4.1 Python llm-mlc VS Constrained-Text-Generation-Studio

  Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) workshop, jointly held at (COLING 2022)

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• guidance

  23 17,461 9.8 Jupyter Notebook llm-mlc VS guidance

  A guidance language for controlling large language models.

  

• llm

  23 2,991 9.4 Python llm-mlc VS llm

  Access large language models from the command-line (by simonw)

• TypeChat

  12 7,875 9.1 TypeScript llm-mlc VS TypeChat

  TypeChat is a library that makes it easy to build natural language interfaces using types.

  

• llama-gpt

  7 10,358 7.4 TypeScript llm-mlc VS llama-gpt

  A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

  

• llm-gpt4all

  3 180 6.9 Python llm-mlc VS llm-gpt4all

  Plugin for LLM adding support for the GPT4All collection of models

• ad-llama

  6 47 8.9 TypeScript llm-mlc VS ad-llama

  Structured inference with Llama 2 in your browser

• flashtext

  8 5,541 0.0 Python llm-mlc VS flashtext

  Extract Keywords from sentence or Replace keywords in sentences.

• relm

  3 88 5.1 Python llm-mlc VS relm

  ReLM is a Regular Expression engine for Language Models (by mkuchnik)

• torch-grammar

  3 63 5.2 Python llm-mlc VS torch-grammar
  

• llm-cluster

  3 58 4.9 Python llm-mlc VS llm-cluster

  LLM plugin for clustering embeddings

• llm-llama-cpp

  1 133 7.2 Python llm-mlc VS llm-llama-cpp

  LLM plugin for running models using llama.cpp

• DP_means

  1 45 1.7 C++ llm-mlc VS DP_means

  Dirichlet Process K-means

• datasette-faiss

  1 32 10.0 Python llm-mlc VS datasette-faiss

  Maintain a FAISS index for specified Datasette tables

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives