Top 5 C llm Projects

ctransformers

4 1,672 8.6 C

Python bindings for the Transformer models implemented in C/C++ using GGML library.

Project mention: Refact LLM: New 1.6B code model reaches 32% HumanEval and is SOTA for the size | news.ycombinator.com | 2023-09-04

Does ctransformer (https://github.com/marella/ctransformers#supported-models) support running refact?
I see that model type "gpt_refact" in https://huggingface.co/smallcloudai/Refact-1_6B-fim/blob/mai...
llama2.c

17 1,378 9.5 C

Llama 2 Everywhere (L2E) (by trholding)

Project mention: What would an LLM OS look like? | news.ycombinator.com | 2024-03-14

Nice article. We did a demo for booting to LLM and also as Kernel Module: https://github.com/trholding/llama2.c The whole things was funny and buggy, but since then we have been developing in stealth, even trying to raise VC capital. Our goal is to make computers like a buddy to whom you can talk to and explain things and get work done, kinda like a Jarvis. The way we interact with computers haven't changed for decades, its time to disrupt that to get more productivity. I also believe with this approach one can avoid installing different applications, when the computer (models) emulate activities done through applications. For example, cutting and pasting a dog from a dog photo onto a banner for a dog racing competition would not require you to be a graphics artist nor use tools like photshop / gimp. You could tell the computer and it would use segment anything to cut the dog, use Text and SD for banner text and bg paste the dog, seek your approval, search for the fastest, best and cheapest banner printing service and submit it. 10 years ago this could have been sci-fi, but now it is a possibility. Just need to connect the dots, package and polish it to make it a good product.
InfluxDB

www.influxdata.com
sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
llama-go

0 148 6.8 C

Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++
voicebox

2 11 7.8 C

Exploration: using technology to aid people who lack both the ability to speak and fine motor control.

Project mention: Ask HN: Looking for a project to volunteer on? (February 2024) | news.ycombinator.com | 2024-02-01

SEEKING VOLUNTEERS: Voicebox
Using LLM, Speach-to-Text and novel UIs to aid people with cerebral palsy, and allow them to communicate in real time.
https://github.com/scosman/voicebox
Explanation: https://scosman.net/blog/introducing_voicebox
llama2-high-level-cpp

1 6 3.8 C

Inference Llama2 with High-Level C++.

Project mention: Show HN: Inference Llama2 with High-Level C++ | news.ycombinator.com | 2024-02-22
WorkOS

workos.com
sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-03-14.