Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Bitsandbytes-win-prebuilt Alternatives
Similar projects and alternatives to bitsandbytes-win-prebuilt
-
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
llama-mps
Experimental fork of Facebooks LLaMa model which runs it with GPU acceleration on Apple Silicon M1/M2
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better bitsandbytes-win-prebuilt alternative or higher similarity.
bitsandbytes-win-prebuilt reviews and mentions
Posts with mentions or reviews of bitsandbytes-win-prebuilt.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-04-07.
-
bitsandbytes now for Windows (8-bit CUDA functions for PyTorch)
So there used to be a compiled version from https://github.com/DeXtmL/bitsandbytes-win-prebuilt but now I see there is a new version (from last week) at https://github.com/acpopescu/bitsandbytes/releases which appears to maybe become the start of Windows support in the official repo?
-
[D] Tutorial: Run LLaMA on 8gb vram on windows (thanks to bitsandbytes 8bit quantization)
put libbitsandbytes_cuda116.dll in C:\Users\xxx\miniconda3\envs\textgen\lib\site-packages\bitsandbytes\
-
Running Pygmalion 6b with 8GB of VRAM
Download these 2 dll files from here. then you move those files into "installer_files\env\lib\site-packages\bitsandbytes\" under your oobabooga root folder (where you've extracted the oneclick installer)
- Has anyone gotten the models to load via 8-bit for windows?!?!?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 6 May 2024
Stats
Basic bitsandbytes-win-prebuilt repo stats
4
75
10.0
over 1 year ago
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com