bitsandbytes_jetsonX Alternatives

Similar projects and alternatives to bitsandbytes_jetsonX

• text-generation-webui

  876 36,827 9.9 Python bitsandbytes_jetsonX VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  777 57,984 10.0 C++ bitsandbytes_jetsonX VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• bitsandbytes

  61 5,482 9.4 Python bitsandbytes_jetsonX VS bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.