Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression. Learn more →
Similar projects and alternatives to qlora
8-bit CUDA functions for PyTorch
Instruct-tune LLaMA on consumer hardware
Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.
A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.
4 bits quantization of LLaMA using GPTQ
Interact privately with your documents using the power of GPT, 100% privately, no data leaks
:robot: Self-hosted, community-driven, local OpenAI-compatible API. Drop-in replacement for OpenAI running LLMs on consumer-grade hardware. No GPU required. LocalAI is a RESTful API to run ggml compatible models: llama.cpp, alpaca.cpp, gpt4all.cpp, rwkv.cpp, whisper.cpp, vicuna, koala, gpt4all-j, cerebras and many others!
Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
An experimental open-source attempt to make GPT-4 fully autonomous.
Port of Facebook's LLaMA model in C/C++
Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
AltStore is an alternative app store for non-jailbroken iOS devices.
The Generative AI Landscape - A Collection of Awesome Generative AI Applications
🌸 Run 100B+ language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
Official Implementation of OCR-free Document Understanding Transformer (Donut) and Synthetic Document Generator (SynthDoG), ECCV 2022 (by clovaai)
JSON Stream Editor (command line utility) (by tidwall)
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
Create custom vector tiles from OpenStreetMap and other data sources with Postgis and Java.
Projecting images to latent space with StyleGAN2.
A command-line tool to help you automate the management of the configurations that live on your Apache Kafka clusters.
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
qlora reviews and mentions
A new paper has been released, QLoRA, which is nothing short of game-changing for the ability to train and fine-tune LLMs on consumers' GPUs.
2 projects | /r/integratedai | 2 Jun 2023
I don't think you understand what is going on and what will happen next
2 projects | /r/singularity | 1 Jun 2023
Ask HN: What's the best self hosted/local alternative to GPT-4?
12 projects | news.ycombinator.com | 31 May 2023
I don't know the licensing and all that jazz (even if you self-host for your personal use it shouldn't matter). But, this paper released a week ago claims " 99.3% of the performance level of ChatGPT while only requiring 24 hours of finetuning on a single GPU" (QLORA).
A quick test of the huggingface demo gives reasonable results. The actual model behind the space is here, and should be self-hostable with reasonable effort.12 projects | news.ycombinator.com | 31 May 2023
> It's certainly not on a level with ChatGPT, but what is?
Guanaco-65B is per https://arxiv.org/abs/2305.14314
CPU Version: https://huggingface.co/TheBloke/guanaco-65B-GGML
GPU Version: https://huggingface.co/TheBloke/guanaco-65B-HF
4bit GPU Version: https://huggingface.co/TheBloke/guanaco-65B-GPTQ
FLaNK Stack Weekly 29 may 2023
19 projects | dev.to | 30 May 2023
Statement on AI Extinction - Signed by AGI Labs, Top Academics, and Many Other Notable Figures
4 projects | /r/singularity | 30 May 2023
not only is the discourse a distraction from the actual AGI research, but it falls very short of the bar for basic democratic civics and international sovereignty law. if you want to regulate all the GPUs and all the computers in the U.S., be ready to contravene the 1rst, 4th, 5th, and 10th amendments in the U.S. Bill of Rights. be ready to re-litigate the Zimmerman precedent that code, even when misclassified as a military munition, is still free speech. btw, since there's a very robust community around LoRAs and debate wrt 4-bit vs 3-bit vs 2-bit quantization, how are the "AI safety" proponents going to regulate SoCs that run QLoRA? how exactly does one clawback Falcon-40B (or the quantized iterations manifesting imminently)? are we planning on tracking every garage foundry that can ship RISC-V cores? do we even have the logistics oversight to keep track of gray market compute, since we can't even seem to handle drug smuggling in global freight?4 projects | /r/singularity | 30 May 2023
what I see is a subreddit that (and anyone can track this) is getting Eternal September brigaded at best, and probably getting astroturfed, at worst. and after so many decades of personally being online and so much preponderance of skepticism, I'm extremely suspicious that we're only just now discussing AI licensing and regulation, just as the tech has already been democratized to an irrevocable degree. especially with the thoroughly-understood history of humans being the biggest threat of technological holocaust. seems to me that all this discussion follows a politicization of opensourced research. it would be incredibly naïve to think that the media campaign at the moment, created by controversial public figures, amplified by corporations with questionable practices, who themselves have benefitted from opensourced research, has the public interest in mind.
[P] Fine-tuning LLaMA on TheVault by AI4Code
2 projects | /r/LocalLLaMA | 30 May 2023
AI tools apps in one place sorted by category
5 projects | /r/ChatGPT | 29 May 2023
Is anyone else getting only 443 bytes adapter_model.bin with qlora?
2 projects | /r/LocalLLaMA | 28 May 2023
i did try raising a PR but I am not sure if the model it outputs is correct or not https://github.com/artidoro/qlora/pull/44
A note from our sponsor - InfluxDB
www.influxdata.com | 3 Jun 2023
artidoro/qlora is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of qlora is Jupyter Notebook.