Llm-replicate Alternatives

Similar projects and alternatives to llm-replicate

• text-generation-webui

  876 36,827 9.9 Python llm-replicate VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  777 57,984 10.0 C++ llm-replicate VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ollama

  208 64,536 9.9 Go llm-replicate VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• gpt4all

  139 64,901 9.8 C++ llm-replicate VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• guidance

  89 12,248 9.5 Jupyter Notebook llm-replicate VS guidance

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

• ggml

  69 9,802 9.8 C llm-replicate VS ggml

  Tensor library for machine learning

• exllama

  64 2,615 9.0 Python llm-replicate VS exllama

  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• llm

  23 2,991 9.4 Python llm-replicate VS llm

  Access large language models from the command-line (by simonw)

• llm-gpt4all

  3 180 6.9 Python llm-replicate VS llm-gpt4all

  Plugin for LLM adding support for the GPT4All collection of models

• llm-mpt30b

  1 30 3.9 Python llm-replicate VS llm-mpt30b

  LLM plugin adding support for the MPT-30B language model

• guidance

  23 17,461 9.8 Jupyter Notebook llm-replicate VS guidance

  A guidance language for controlling large language models.

  

• llm-plugins

  1 39 5.4 llm-replicate VS llm-plugins

  The LLM plugins directory