C llm

Open-source C projects categorized as llm
Topics: #llama #AI #Gpt #Go #C

Top 6 C llm Projects

  • ctransformers

    Python bindings for the Transformer models implemented in C/C++ using GGML library.

    Project mention: Refact LLM: New 1.6B code model reaches 32% HumanEval and is SOTA for the size | news.ycombinator.com | 2023-09-04

    Does ctransformer (https://github.com/marella/ctransformers#supported-models) support running refact?

    I see that model type "gpt_refact" in https://huggingface.co/smallcloudai/Refact-1_6B-fim/blob/mai...

  • llama2.c

    Llama 2 Everywhere (L2E) (by trholding)

    Project mention: llama2 written in C | /r/LocalLLaMA | 2023-08-30
  • SonarLint

    Clean code begins in your IDE with SonarLint. Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.

  • llama-go

    Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++

    Project mention: Port of Facebook's LLaMA (Large Language Model Meta AI) in Golang with embedded C/C++ | /r/golang | 2023-03-13
  • llama_cpp.rb

    llama_cpp provides Ruby bindings for llama.cpp

    Project mention: Llama.cpp: Full CUDA GPU Acceleration | news.ycombinator.com | 2023-06-12

    Python sits on the C-glue segment of programming languages (where Perl, PHP, Ruby and Node are also notable members). Being a glue language means having APIs to a lot of external toolchains written in not only C/C++ but many other compiled languages, APIs and system resources. Conda, virtualenv, etc. are godsend modules for making it all work, or even better, to freeze things once they all work, without resourcing to Docker, VMs or shell scripts. It's meant for application and DevOps people who need to slap together, ie, ML, Numpy, Elasticsearch, AWS APIs and REST endpoints and Get $hit Done.

    It's annoying to see them "glueys" compared to the binary compiled segment where the heavy lifting is done. Python and others exist to latch on and assimilate. Resistance is futile:

    https://pypi.org/project/pyllamacpp/

    https://www.npmjs.com/package/llama-node

    https://packagist.org/packages/kambo/llama-cpp-php

    https://github.com/yoshoku/llama_cpp.rb

  • llamazoo

    LLaMAZoo - Platform for serving LLaMA models on your PC / Mac

    Project mention: Gotzmann LLM Score | /r/LocalLLaMA | 2023-05-26

    Parameters for all tests (done with llama.cpp thru LLaMAZoo):

  • voicebox

    Exploration: using technology to aid people who lack both the ability to speak and fine motor control. (by scosman)

    Project mention: The iPad was meant to revolutionize accessibility. What happened? | news.ycombinator.com | 2023-06-25

    - New UI for text input leveraging the dynamic touchscreen of the iPad. No need to move hands, kinda like modern and user friendly Morse code.

    Source: https://github.com/scosman/voicebox

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-04.

C llm related posts

Index

What are some of the best open-source llm projects in C? This list will help you:

Project Stars
1 ctransformers 1,045
2 llama2.c 136
3 llama-go 129
4 llama_cpp.rb 73
5 llamazoo 33
6 voicebox 8
Tired of breaking your main and manually rebasing outdated pull requests?
Managing outdated pull requests is time-consuming. Mergify's Merge Queue automates your pull request management & merging. It's fully integrated to GitHub & coordinated with any CI. Start focusing on code. Try Mergify for free.
blog.mergify.com