SaaSHub helps you find the best software and product alternatives Learn more →
Top 4 C bli Projects
-
Project mention: Faer-rs: Linear algebra foundation for the Rust programming language | news.ycombinator.com | 2024-04-24
BLIS is an interesting new direction in that regard: https://github.com/flame/blis
>The BLAS-like Library Instantiation Software (BLIS) framework is a new infrastructure for rapidly instantiating Basic Linear Algebra Subprograms (BLAS) functionality. Its fundamental innovation is that virtually all computation within level-2 (matrix-vector) and level-3 (matrix-matrix) BLAS operations can be expressed and optimized in terms of very simple kernels.
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
-
My bad, I directly linked to the C file instead of the project here:
So it is a program that given a model file, tokenizer file and a prompt, it continues to generate text.
So to get it to work, you need to clone and build this: https://github.com/trholding/llama2.c
So the steps are like this:
First you'll need to obtain approval from Meta to download llama3 models on hugging face.
So go to https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct, fill the form and then go to https://huggingface.co/settings/gated-repos see acceptance status. Once accepted, do the following to download model, export and run.
huggingface-cli download meta-llama/Meta-Llama-3.1-8B-Instruct --include "original/*" --local-dir Meta-Llama-3.1-8B-Instruct
git clone https://github.com/trholding/llama2.c.git
cd llama2.c/
# Export Quantized 8bit
python3 export.py ../llama3.1_8b_instruct_q8.bin --version 2 --meta-llama ../Meta-Llama-3.1-8B-Instruct/original/
# Fastest Quantized Inference build
make runq_cc_openmp
# Test Llama 3.1 inference, it should generate sensible text
./run ../llama3.1_8b_instruct_q8.bin -z tokenizer_l3.bin -l 3 -i " My cat"
-
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
C blis discussion
C blis related posts
-
Optimize sgemm on RISC-V platform
-
BLIS: Portable basis for high-performance BLAS-like linear algebra libs
-
Column Vectors vs. Row Vectors
-
BLIS: Portable software framework for high-performance linear algebra
-
BLAS-Like Library Instantiation Software Framework
-
Terrible Scaling on AMD Epyc 7662
-
Best usage for optional compilation of accelerating instructions ?
-
A note from our sponsor - SaaSHub
www.saashub.com | 12 Dec 2024
Index
What are some of the best open-source bli projects in C? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | blis | 2,327 |
| 2 | how-to-optimize-gemm | 1,752 |
| 3 | llama2.c | 1,511 |
| 4 | blislab | 466 |
Sponsored
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai