gollum
Halide
gollum | Halide | |
---|---|---|
4 | 43 | |
37 | 5,725 | |
- | 0.7% | |
6.0 | 9.5 | |
7 days ago | 5 days ago | |
Go | C++ | |
MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gollum
-
From slow to SIMD: A Go optimization story
I did a similar optimization via https://github.com/viterin/vek as the SIMD version. Some somewhat unscientific calculations showed a 10x improvement staying in float32: https://github.com/stillmatic/gollum/blob/07a9aa35d2517af8cf...
TBH my takeaway was that it was more useful to use smaller vectors as a representation
-
Agency: Pure Go LangChain Alternative
I like Go a lot for working with OpenAI etc, it's 'just' API calls and Go is great at that. I've opensourced some bits here: https://github.com/stillmatic/gollum -- in particular, function dispatch (given a prompt, return an arbitrary Go struct) is really nice, as is a very fast in-memory KNN index.
-
Introducing TypeChat from Microsoft
I've written a version of this in Golang: https://github.com/stillmatic/gollum/blob/main/dispatch.go
```go
-
FANN: Vector Search in 200 Lines of Rust
I have gotten 10x speedups with SIMD on modern hardware. Goroutines make this actually fairly tricky, as you essentially have to process all the events and then sort the entire array, which is usually the bottleneck. The heap adds a small amount of complexity but is significantly more efficient, feels like good ROI.
https://github.com/stillmatic/gollum/blob/main/vectorstore.g...
Halide
-
Show HN: Flash Attention in ~100 lines of CUDA
If CPU/GPU execution speed is the goal while simultaneously code golfing the source size, https://halide-lang.org/ might have come in handy.
- Halide v17.0.0
-
From slow to SIMD: A Go optimization story
This is a task where Halide https://halide-lang.org/ could really shine! It disconnects logic from scheduling (unrolling, vectorizing, tiling, caching intermediates etc), so every step the author describes in the article is a tunable in halide. halide doesn't appear to have bindings for golang so calling C++ from go might be the only viable option.
-
Implementing Mario's Stack Blur 15 times in C++ (with tests and benchmarks)
Probably would have been much easier to do 15 times in https://halide-lang.org/
The idea behind Halide is that scheduling memory access patterns is critical to performance. But, access patterns being interwoven into arithmetic algorithms makes them difficult to modify separately.
So, in Halide you specify the arithmetic and the schedule separately so you can rapidly iterate on either.
- Making Hard Things Easy
-
Deepmind Alphadev: Faster sorting algorithms discovered using deep RL
It is not the sorting per-se which was improved here, but sorting (particularly short sequences) on modern CPUs with really the complexity being on the difficulty of predicting what will work quickly on these modern CPUs.
Doing an empirical algorithm search to find which algorithms fit well on modern CPUs/memory systems is pretty common, see e.g. FFTW, ATLAS, https://halide-lang.org/
-
Two-tier programming language
Halide https://halide-lang.org/
- Best book on writing an optimizing compiler (inlining, types, abstract interpretation)?
-
Blog Post: Can You Trust a Compiler to Optimize Your Code?
It doesn’t apply in this case, but in general if you really want the best vectorization I would suggest using https://halide-lang.org instead of trying to coerce your compiler.
-
What would make you try a new language?
If we drop the "APL" requirement, wouldn't Halide fit your criteria for the third?
What are some alternatives?
CopilotKit - Build in-app AI chatbots 🤖, and AI-powered Textareas ✨, into react web apps. [Moved to: https://github.com/CopilotKit/CopilotKit]
taichi - Productive, portable, and performant GPU programming in Python.
ts-patch - Augment the TypeScript compiler to support extended functionality
futhark - :boom::computer::boom: A data-parallel functional programming language
ai-agents-laravel - Build AI Agents for popular LLMs quick and easy in Laravel
Image-Convolutaion-OpenCL
voy - 🕸️🦀 A WASM vector similarity search written in Rust
TensorOperations.jl - Julia package for tensor contractions and related operations
TypeChat - TypeChat is a library that makes it easy to build natural language interfaces using types.
triton - Development repository for the Triton language and compiler
Weaviate - Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database.
ponyc - Pony is an open-source, actor-model, capabilities-secure, high performance programming language