optimum
Open-Assistant
optimum | Open-Assistant | |
---|---|---|
8 | 329 | |
2,209 | 36,728 | |
5.6% | 0.5% | |
9.5 | 8.3 | |
about 11 hours ago | 17 days ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
optimum
-
FastEmbed: Fast and Lightweight Embedding Generation for Text
Shout out to Huggingface's Optimum – which made it easier to quantize models.
-
[D] Is ML doomed to end up closed-source?
Optimum to accelerate inference of transformers with hardware optimization
-
[P] BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models
Yes Optimum lib's documentation is unfortunately not yet in best shape. I would be really thankful if you fill an issue detailing where the doc can be improved: https://github.com/huggingface/optimum/issues . Also, if you have features request, such as having a more flexible API, we are eager for community contributions or suggestions!
-
BetterTransformer: PyTorch-native free-lunch speedups for Transformer-based models
In order to support BetterTransformer with the canonical Transformer models from Transformers library, an integration was done with the open-source library Optimum as a one-liner:
- Why are self attention not as deployment friendly?
-
[P] Accelerated Inference with Optimum and Transformers Pipelines
It’s Lewis here from the open-source team at Hugging Face 🤗. I'm excited to share the latest release of our Optimum library, which provides a suite of performance optimization tools to make Transformers run fast on accelerated hardware!
-
[N] Hugging Face raised $100M at $2B to double down on community, open-source & ethics
Create libraries to optimize ML models during training and inference for specific hardware https://github.com/huggingface/optimum
-
[P] Python library to optimize Hugging Face transformer for inference: < 0.5 ms latency / 2850 infer/sec
Have you seen this article from HF https://huggingface.co/blog/bert-cpu-scaling-part-2 , there is also a lib https://github.com/huggingface/optimum? is the gain worth the tweaking? is OneDNN stuff easy to deploy on Triton?
Open-Assistant
-
Best open source AI chatbot alternative?
For open assistant, the code: https://github.com/LAION-AI/Open-Assistant/tree/main/inference
-
GPT-4 Turbo for free with no sign up, and most importantly no Bing
Is this being used to collect chat results for synthetic data and/or training like https://github.com/LAION-AI/Open-Assistant did? I believe they gave away GPT-4 api calls via a text interface and absorbed the cost to later build a dataset of chats.
-
OpenAI now sends email threats?!
https://open-assistant.io seems to have the same guardrails, as ChatGPT. Tried it on several prompts and it wouldn't comply.
- ChatGPT-Antworten nach Schulnoten bewerten
-
Chat GPT Alternatives?
Open-Assistant [https://open-assistant.io/]
-
What are the best AI tools you've ACTUALLY used?
Open Assistant by LAION AI on GitHub
-
Keep Artificial Intelligence Free, protect it from monopolies: please sign this petition
To add to this if you want something for free or at least close to free, contribute to OpenSource projects like https://open-assistant.io/
-
If I had to get someone from total zero to ChatGPT power user
Also, there are fairly useful alternatives like GPT4ALL and Open Assistant that you can run locally.
-
Compiling a Comprehensive List of Publicly Usable LLM Q&A Services - Need Your Input!
https://open-assistant.io - oasst-sft-6-llama-30b
- Proposal for a Crowd-Sourced AI Feedback System
What are some alternatives?
FasterTransformer - Transformer related optimization, including BERT, GPT
KoboldAI-Client
transformer-deploy - Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
safetensors - Simple, safe way to store and distribute tensors
llama.cpp - LLM inference in C/C++
TensorRT - NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
llama - Inference code for Llama models
text-generation-inference - Large Language Model Text Generation Inference
gpt4all - gpt4all: run open-source LLMs anywhere
kernl - Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.
stanford_alpaca - Code and documentation to train Stanford's Alpaca models, and generate the data.