Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Qlora Alternatives
Similar projects and alternatives to qlora
-
-
-
InfluxDB
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
-
text-generation-webui
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
-
-
privateGPT
Interact privately with your documents using the power of GPT, 100% privately, no data leaks
-
LocalAI
:robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. No GPU required. LocalAI is a RESTful API to run ggml compatible models: llama.cpp, alpaca.cpp, gpt4all.cpp, rwkv.cpp, whisper.cpp, vicuna, koala, gpt4all-j, cerebras and many others!
-
SonarLint
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
-
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
-
-
-
-
-
ai-collection
The Generative AI Landscape - A Collection of Awesome Generative AI Applications
-
petals
🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
-
donut
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022 (by clovaai)
-
-
basaran
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
-
incubator-baremaps
Create custom vector tiles from OpenStreetMap and other data sources with Postgis and Java.
-
stylegan2-projecting-images
Projecting images to latent space with StyleGAN2.
-
jikkou
A command-line tool to help you automate the management of the configurations that live on your Apache Kafka clusters.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
qlora reviews and mentions
- A new paper has been released, QLoRA, which is nothing short of game-changing for the ability to train and fine-tune LLMs on consumers' GPUs.
- I don't think you understand what is going on and what will happen next
-
Ask HN: What's the best self hosted/local alternative to GPT-4?
I don't know the licensing and all that jazz (even if you self-host for your personal use it shouldn't matter). But, this paper[0] released a week ago claims " 99.3% of the performance level of ChatGPT while only requiring 24 hours of finetuning on a single GPU" (QLORA).
A quick test of the huggingface demo gives reasonable results[1]. The actual model behind the space is here[2], and should be self-hostable with reasonable effort.
> It's certainly not on a level with ChatGPT, but what is?
Guanaco-65B is per https://arxiv.org/abs/2305.14314
CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGML
GPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF
4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ
- FLaNK Stack Weekly 29 may 2023
-
Statement on AI Extinction - Signed by AGI Labs, Top Academics, and Many Other Notable Figures
not only is the discourse a distraction from the actual AGI research, but it falls very short of the bar for basic democratic civics and international sovereignty law. if you want to regulate all the GPUs and all the computers in the U.S., be ready to contravene the 1rst, 4th, 5th, and 10th amendments in the U.S. Bill of Rights. be ready to re-litigate the Zimmerman precedent that code, even when misclassified as a military munition, is still free speech. btw, since there's a very robust community around LoRAs and debate wrt 4-bit vs 3-bit vs 2-bit quantization, how are the "AI safety" proponents going to regulate SoCs that run QLoRA? how exactly does one clawback Falcon-40B (or the quantized iterations manifesting imminently)? are we planning on tracking every garage foundry that can ship RISC-V cores? do we even have the logistics oversight to keep track of gray market compute, since we can't even seem to handle drug smuggling in global freight?
what I see is a subreddit that (and anyone can track this) is getting Eternal September brigaded at best, and probably getting astroturfed, at worst. and after so many decades of personally being online and so much preponderance of skepticism, I'm extremely suspicious that we're only just now discussing AI licensing and regulation, just as the tech has already been democratized to an irrevocable degree. especially with the thoroughly-understood history of humans being the biggest threat of technological holocaust. seems to me that all this discussion follows a politicization of opensourced research. it would be incredibly naïve to think that the media campaign at the moment, created by controversial public figures, amplified by corporations with questionable practices, who themselves have benefitted from opensourced research, has the public interest in mind.
-
[P] Fine-tuning LLaMA on TheVault by AI4Code
github https://github.com/artidoro/qlora
- AI tools apps in one place sorted by category
-
Is anyone else getting only 443 bytes adapter_model.bin with qlora?
i did try raising a PR but I am not sure if the model it outputs is correct or not https://github.com/artidoro/qlora/pull/44
-
A note from our sponsor - InfluxDB
www.influxdata.com | 3 Jun 2023
Stats
artidoro/qlora is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of qlora is Jupyter Notebook.