Ctransformers Alternatives

Similar projects and alternatives to ctransformers

• text-generation-webui

  876 36,293 9.9 Python ctransformers VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 56,891 10.0 C++ ctransformers VS llama.cpp

  LLM inference in C/C++

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• koboldcpp

  180 3,749 10.0 C++ ctransformers VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• LocalAI

  82 19,593 9.9 C++ ctransformers VS LocalAI

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

• llama-cpp-python

  55 6,475 9.8 Python ctransformers VS llama-cpp-python

  Python bindings for llama.cpp

• WizardLM

  38 7,531 9.4 Python ctransformers VS WizardLM

  Discontinued Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath

• text-generation-inference

  29 7,881 9.6 Python ctransformers VS text-generation-inference

  Large Language Model Text Generation Inference

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• jsonformer

  25 3,774 5.4 Jupyter Notebook ctransformers VS jsonformer

  A Bulletproof Way to Generate Structured JSON from Language Models

• TornadoVM

  22 1,105 9.9 Java ctransformers VS TornadoVM

  TornadoVM: A practical and efficient heterogeneous programming framework for managed languages

  

• basaran

  22 1,281 10.0 Python ctransformers VS basaran

  Discontinued Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

  

• LangChain_PDFChat_Oobabooga

  4 65 3.0 Python ctransformers VS LangChain_PDFChat_Oobabooga

  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local

• artificial-nose

  5 342 2.3 C ctransformers VS artificial-nose

  Instructions, source code, and misc. resources needed for building a Tiny ML-powered artificial nose.

• kendryte-standalone-sdk

  4 421 0.0 C ctransformers VS kendryte-standalone-sdk

  Standalone SDK for kendryte K210

  

• blog

  5 2,011 9.8 Jupyter Notebook ctransformers VS blog

  Public repo for HF blog posts (by huggingface)

  

• lamp

  1 24 7.1 Scala ctransformers VS lamp

  deep learning and scientific computing framework with native CPU and GPU backend for the Scala programming language (by pityka)

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives