llm-awq
formbricks
llm-awq | formbricks | |
---|---|---|
7 | 25 | |
1,902 | 5,573 | |
10.9% | 4.9% | |
8.0 | 9.9 | |
8 days ago | 5 days ago | |
Python | TypeScript | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-awq
-
TinyChat: Large Language Model on the Edge
TinyChat is an efficient, lightweight, Python-native serving framework for 4-bit LLMs by AWQ. It delivers 2.3x generation speed up on RTX4090.
Code: https://github.com/mit-han-lab/llm-awq/tree/main/tinychat
- FLaNK Stack Weekly 23 Oct 2023
-
New base model InternLM 7B weights released, with 8k context window.
I am having trouble finding any 8bit GPTQ models at all, there don't seem to be any on HF it's almost all 4bit with the odd 3bit of the big ones. Suspect I will have to make my own for eval purposes but it's lower priority on my list then finding a 4bit that's GPU friendly but doesn't have such a performance penalty... Looking at AWQ they have 3 and 4bit versions.
-
Llama33B vs Falcon40B vs MPT30B
Using the currently popular gptq the 3bit quantization hurts performance much more than 4bit, but there's also awq (https://github.com/mit-han-lab/llm-awq) and squishllm (https://github.com/SqueezeAILab/SqueezeLLM) which are able to manage 3bit without as much performance drop - I hope to see them used more commonly.
- New hardware-friendly quantization method
-
Activation-Aware Weight Quantization for LLM Compression Outperforms GPTQ
Better quantization would have a direct and meaningful impact for everyone running local LLMs. The technique has already been applied to both Vicuna and the multimodal LLaMA variant LLaVA.
https://github.com/mit-han-lab/llm-awq
-
New quantization method AWQ outperforms GPTQ in 4-bit and 3-bit with 1.45x speedup and works with multimodal LLMs
GitHub: https://github.com/mit-han-lab/llm-awq
formbricks
-
5 Open-Source Next.js Projects Rocking 2024 (Learn the Patterns!) π
Github Repository: Here
-
π₯π₯ Our awesome OSS friends π
Formbricks- Survey granular user segments at any point in the user journey. Gather up to 6x more insights with targeted micro-surveys. All open-source.
-
[Beginner Friendly] Transform Your Web App with Formbricks Surveys: A Must-Know Guideπ₯π₯π₯
You have learned how to integrate Formbricks Survey into your web application. Thanks for reading till the end. If you have any feedback, the comment section is yours. If you find this blog useful you can share this blogs.
- Show HN: Formbricks β Open-source alternative to Typeform and Sprig
-
6 AI Tools You Have To Know as a Software Developer! π Β π€―
Website: https://github.com/formbricks/formbricks
-
Show HN: Formbricks β open-source alternative to Typeform and Sprig
https://github.com/formbricks/formbricks/pull/1461
Another idea would be to let the survey creator know the current length/time to complete the survey, and if it's getting too long, show them advice on how to make it shorter, and show them that they will lose participants otherwise.
- FLaNK Stack Weekly 23 Oct 2023
-
π How To Display An In-App Survey In Next.js 13 With Supabase And Formbricks π€π οΈ
Thanks to Formbricks, we do not have to build this from scratch π
-
ππMeasure Your Product-Market Fit With Formbricks' In-App Product-Market Fit Survey ππ
In this tutorial, you'll learn how to integrate an in-app PMF survey in your Next.js application with Formbricks. It has been built to suit your needs with best practices just like Superhuman.
-
π₯ How To Get Juicy User Insights With In-App Pre-Churn Survey In Next.js With Formbricks π‘π¬
In this article, you will learn how to get juicy user insights with in-app pre-churn surveys in your Next.js application using Formbricks.
What are some alternatives?
SqueezeLLM - [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
atrilabs-engine - π§ββοΈ Open-source no-code & code web app builder
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
quillforms - Open Source TypeForm Alternative Based on React JS and Typescript | Best Typeform Clone | Conversational Multi Step Form
Voyager - An Open-Ended Embodied Agent with Large Language Models
react-material-ui-form-builder - Simple form builder using Material UI components
langchain4j-examples
Seamly2D - Open source patternmaking software to democratize fashion.
CML_AMP_AI_Text_Summarization_with_Amazon_Bedrock - CML_AMP_AI_Text_Summarization_with_Amazon_Bedrock
lang2sql - A tutorial for setting an SQL code generator with the OpenAI API
kafka-streams-dashboards - showcases Grafana dashboards for Kafka Stream applications leveraging client JMX metrics.
pypandoc - Thin wrapper for "pandoc" (MIT)