Lm-inference-engines Alternatives

Similar projects and alternatives to lm-inference-engines

• text-generation-webui

  876 36,552 9.9 Python lm-inference-engines VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• alpaca_lora_4bit

  41 529 8.6 Python lm-inference-engines VS alpaca_lora_4bit

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Cgml

  22 39 8.6 C++ lm-inference-engines VS Cgml

  GPU-targeted vendor-agnostic AI library for Windows, and Mistral model implementation.

• TensorRT-LLM

  14 6,705 8.4 C++ lm-inference-engines VS TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  

• knowledge_gpt

  10 1,520 8.2 Python lm-inference-engines VS knowledge_gpt

  Accurate answers and instant citations for your documents.

• pdfGPT

  9 6,717 8.2 Python lm-inference-engines VS pdfGPT

  PDF GPT allows you to chat with the contents of your PDF file by using GPT capabilities. The most effective open source solution to turn your pdf files in a chatbot!

• tracker-miners

  5 7 9.5 C lm-inference-engines VS tracker-miners

  Read-only mirror of https://gitlab.gnome.org/GNOME/tracker-miners

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives