cria
magic
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cria
-
Show HN: Speeding up LLM inference 2x times (possibly)
It originally started as a fork to Recmo’s cria pure numpy llama impl :)
https://github.com/recmo/cria
Took a whole night to compute a few
-
Jsonformer: A bulletproof way to generate structured output from LLMs
Not op, but I can share my approach - I went line by line by Recmo's Cria: https://github.com/recmo/cria - which is an implementation of Llama in Numpy - so very low level. Took me I think 3-4 days x 10 hours + 1-2 days of reading about Transformers to understand what's going on - but from that you can see how models generate text and have a deep understanding of what's going on.
- LLaMA for poor
magic
-
Show HN: MonkeyPatch – Cheap, fast and predictable LLM functions in Python
I built a similar library for Typescript: https://github.com/jumploops/magic
Please note: it requires the use of ttypescript or ts-patch, as Typescript transformers aren’t supported by default!
-
Jsonformer: A bulletproof way to generate structured output from LLMs
I created a toy[0] in Typescript that maps LLM responses to type-safe output.
It uses JSONSchema internally, but I’m thinking of revising it to just use Typescript directly after learning more about the ChatGPT plugin implementation (via their hackathon).
[0]https://github.com/jumploops/magic
- Magic - AI functions for Typescript
- Show HN: AI Functions for TypeScript
What are some alternatives?
transmogrifier - Unstructured data goes in, structured data comes out. Sometimes comedically.
magic-example - Example of using AI functions in Typescript
clownfish - Constrained Decoding for LLMs against JSON Schema
faker - Generate massive amounts of fake data in the browser and node.js
effort - An implementation of bucketMul LLM inference
Chat-Markup-Language - This is a Repo defining a set of rules for ChatGPT to use when sending responses to a user
marvin - ✨ Build AI interfaces that spark joy
jsonformer - A Bulletproof Way to Generate Structured JSON from Language Models