bloomz.cpp
libvips
bloomz.cpp | libvips | |
---|---|---|
4 | 24 | |
806 | 9,148 | |
- | 2.4% | |
6.0 | 9.2 | |
about 1 year ago | 4 days ago | |
C | C | |
MIT License | GNU Lesser General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bloomz.cpp
-
My largest ever quants, GPT 3 sized! BLOOMZ 176B and BLOOMChat 1.0 176B
Possibly. There's a llama.cpp fork called bloomz.cpp but it's not been updated in 2 months. So it's not going to support any of the fancy new quantisation methods, performance improvements, GPU acceleration, etc.
- Bloomz.cpp: C++ implementation for BLOOM models
- Bloomz.cpp: Run multilingual BLOOM model with C++
-
[N] bloomz.cpp: Run any BLOOM-like model in pure C++
bloomz.cpp allows running inference of BLOOM-like models in pure C/C++ (inspired by llama.cpp). It supports all models that can be loaded with BloomForCausalLM.from_pretrained(). For example, you can achieve 16 tokens per second on a M1 Pro.
libvips
-
Ask HN: How to handle user file uploads?
Read through the comments and was surprised no one mentioned libvips - https://github.com/libvips/libvips. At my current small company we were trying to allow image uploads and started with imagemagick but certain images took too long to process and we were looking for faster alternatives. It's a great tool with minimum overhead. For video thumbnails, we use ffmpeg which is really heavy. We off-load video thumbnail generation to a queue. We've had great luck with these tools.
-
Building an online image compressor
After some research, I found libvips, a demand-driven, horizontally threaded image processing library. It is designed to run quickly while using as little as memory as possible.
- Libvips: A fast image processing library with low memory needs
-
Things you might not know about Next Image
Sharp is a fast and efficient image optimization Node.js module that makes use of the native libvips library.
-
Go Image Converting
h2non/bimg can handle both if the underlying libvips is compiled with support for both formats.
-
.Webp is the bane of my existence
if you're using linux (which it doesn't seem so) there's also vispdisp https://github.com/jcupitt/vipsdisp which is based on https://github.com/libvips/libvips which will likely take over how images are decoded in the future for everything, at least methodology wise.
-
How are responsive image sets are generated, stored, and managed server-side?
The magic happens by way of a library called Libvips, which contains an ultra-high-speed low-memory image resizer.
-
imagor v1 - a fast, Docker-ready image processing server in Go, libvips and more
imagor uses one of the most efficient image processing library libvips. It is typically 4-8x faster than using the quickest ImageMagick and GraphicsMagick settings.
-
[OSError] Cannot find pyvips library (DLLs)
Try the solutions here: https://github.com/libvips/libvips/issues/2479
-
Image library for fast read of huge Tif files?
in that case maybe take a look at https://github.com/libvips/libvips
What are some alternatives?
llama.cpp - LLM inference in C/C++
OpenCV - Open Source Computer Vision Library
lm-evaluation-harness - A framework for few-shot evaluation of language models.
imagick - Go binding to ImageMagick's MagickWand C API
vosk - VOSK Speech Recognition Toolkit
sharp - High performance Node.js image processing, the fastest module to resize JPEG, PNG, WebP, AVIF and TIFF images. Uses the libvips library.
ggml - Tensor library for machine learning
GD - GD Graphics Library
tesseract-ocr - Tesseract Open Source OCR Engine (main repository)
FreeImage - A custom distribution of FreeImage, with a CMake-based build system. Used by the Athena Game Framework.
CImg - The CImg Library is a small and open-source C++ toolkit for image processing
FFmpeg - Mirror of https://git.ffmpeg.org/ffmpeg.git