cria
Tiny inference-only implementation of LLaMA (by recmo)
Chat-Markup-Language
This is a Repo defining a set of rules for ChatGPT to use when sending responses to a user (by ColinRyan)
cria | Chat-Markup-Language | |
---|---|---|
4 | 1 | |
77 | 2 | |
- | - | |
2.5 | 4.3 | |
about 1 year ago | about 1 year ago | |
Python | ||
- | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cria
Posts with mentions or reviews of cria.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2024-04-17.
-
Show HN: Speeding up LLM inference 2x times (possibly)
It originally started as a fork to Recmo’s cria pure numpy llama impl :)
https://github.com/recmo/cria
Took a whole night to compute a few
-
Jsonformer: A bulletproof way to generate structured output from LLMs
Not op, but I can share my approach - I went line by line by Recmo's Cria: https://github.com/recmo/cria - which is an implementation of Llama in Numpy - so very low level. Took me I think 3-4 days x 10 hours + 1-2 days of reading about Transformers to understand what's going on - but from that you can see how models generate text and have a deep understanding of what's going on.
- LLaMA for poor
Chat-Markup-Language
Posts with mentions or reviews of Chat-Markup-Language.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-02.
-
Jsonformer: A bulletproof way to generate structured output from LLMs
I like the idea of getting ChatGPT to return something easily parse-able by a program. I've been using an XML derivative for that. https://github.com/ColinRyan/Chat-Markup-Language
Never thought to use json schema. I'll check this out!
What are some alternatives?
When comparing cria and Chat-Markup-Language you can also consider the following projects:
transmogrifier - Unstructured data goes in, structured data comes out. Sometimes comedically.
jsonformer - A Bulletproof Way to Generate Structured JSON from Language Models
clownfish - Constrained Decoding for LLMs against JSON Schema
relm - ReLM is a Regular Expression engine for Language Models
magic - AI functions for Typescript
effort - An implementation of bucketMul LLM inference