llama2-high-level-cpp
Inference Llama2 with High-Level C++. (by frost-beta)
llama2.c
Llama 2 Everywhere (L2E) (by trholding)
| llama2-high-level-cpp | llama2.c | |
|---|---|---|
| 1 | 17 | |
| 7 | 1,383 | |
| - | - | |
| 3.8 | 9.4 | |
| 3 months ago | 8 days ago | |
| C | C | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama2-high-level-cpp
Posts with mentions or reviews of llama2-high-level-cpp.
We have used some of these posts to build our list of alternatives
and similar projects.
llama2.c
Posts with mentions or reviews of llama2.c.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-03-14.
-
What would an LLM OS look like?
Nice article. We did a demo for booting to LLM and also as Kernel Module: https://github.com/trholding/llama2.c The whole things was funny and buggy, but since then we have been developing in stealth, even trying to raise VC capital. Our goal is to make computers like a buddy to whom you can talk to and explain things and get work done, kinda like a Jarvis. The way we interact with computers haven't changed for decades, its time to disrupt that to get more productivity. I also believe with this approach one can avoid installing different applications, when the computer (models) emulate activities done through applications. For example, cutting and pasting a dog from a dog photo onto a banner for a dog racing competition would not require you to be a graphics artist nor use tools like photshop / gimp. You could tell the computer and it would use segment anything to cut the dog, use Text and SD for banner text and bg paste the dog, seek your approval, search for the fastest, best and cheapest banner printing service and submit it. 10 years ago this could have been sci-fi, but now it is a possibility. Just need to connect the dots, package and polish it to make it a good product.
-
The Second Batch of the Open Source AI Grants
We are trying to create a proper OS that boots to an LLM. A toy demo is available in the releases: https://github.com/trholding/llama2.c
Can we apply?
- Llama 2 Everywhere (L2E): Standalone, Binary Portable, Bootable Llama 2
- Play a hidden framebuffer Doom on TempleDOS
- Show HN: Tiny OS that boots to LLAMA2, has DOOM and easter eggs
-
A Linux OS that boots to LLAMA2 and has a startrek like UI
I feel you!
Here it is: https://github.com/trholding/llama2.c#new---l2e-os-linux-ker...
-
OS that boots to LLAMA2 also runs LLAMA2 as kernel module
404? Try: https://github.com/trholding/llama2.c
- What if I told you that you could boot into an LLM?
What are some alternatives?
When comparing llama2-high-level-cpp and llama2.c you can also consider the following projects:
PowerInfer - High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
llama2.c - Inference Llama 2 in one file of pure C
app-llama2-c - Llama 2 Everywhere (L2E)
JohnTheRipper - John the Ripper jumbo - advanced offline password cracker, which supports hundreds of hash and cipher types, and runs on many operating systems, CPUs, GPUs, and even some FPGAs [Moved to: https://github.com/openwall/john]
blis - BLAS-like Library Instantiation Software Framework
ape - Ape Programming Language
blislab - BLISlab: A Sandbox for Optimizing GEMM