govips
baseplate.go
Our great sponsors
govips | baseplate.go | |
---|---|---|
5 | 7 | |
1,140 | 90 | |
- | - | |
7.1 | 6.6 | |
4 days ago | 5 days ago | |
Go | Go | |
MIT License | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
govips
-
Just In Time Image Optimization at Reddit Scale
We chose to use govips which is a cgo wrapper around the libvips image manipulation library. The majority of new development for services in our backend is written using baseplate.go. But Go is not an ideal choice for media processing as it cannot keep up with the performance of native code. The most widely used image-processing libraries like libmagick are primarily written in C or C++. Speed was a major factor in selecting libvips in order to keep latency low on CDN cache misses for images. In our tests, libvips was 3–4 times faster than libmagick on basic image processing operations. Content-aware smart cropping was implemented by porting smartcrop.js to Go. This is the only operation implemented in pure Go.
- Image manipulation with Go
-
Open source projects for beginner
Hi! You are willing to dive into some cgo we have a couple of feature requests :) https://github.com/davidbyttow/govips
- Show HN: Govips 2.0, lightning fast image processing for Go
baseplate.go
-
Just In Time Image Optimization at Reddit Scale
We chose to use govips which is a cgo wrapper around the libvips image manipulation library. The majority of new development for services in our backend is written using baseplate.go. But Go is not an ideal choice for media processing as it cannot keep up with the performance of native code. The most widely used image-processing libraries like libmagick are primarily written in C or C++. Speed was a major factor in selecting libvips in order to keep latency low on CDN cache misses for images. In our tests, libvips was 3–4 times faster than libmagick on basic image processing operations. Content-aware smart cropping was implemented by porting smartcrop.js to Go. This is the only operation implemented in pure Go.
-
Python use by SWEs
Even Reddit has python backends https://github.com/reddit/baseplate.py based on Pyramid. They also have a go one. https://github.com/reddit/baseplate.go
-
Reddit System Design/Architecture
there's a multitude of services in reddit's architecture. as far as i can tell, they mostly using reddit's baseplate framework (which has implementations in both python and go).
-
3 of the top 5 fastest web frameworks are written in Rust! (#1, #3 and #5)
FWIW, I believe Reddit has rewritten some Python into Go because of scaling issues. I don't know of any public write ups to confirm it, but at the least there's a public repo that contains their base template.
- How do you maintain quality of code in a Go project?
-
Evolving Reddit’s ML Model Deployment and Serving Architecture
Gazette Inference Service is a baseplate.go (Reddit’s golang web services framework) thrift service whose single responsibility is serving ML inference requests to it’s clients. It is deployed with Reddit’s modern kubernetes infrastructure.
-
Deadline Budget Propagation for Baseplate.py
Baseplate is implemented in Python and Go, and although they share the same main functionality, smaller features differ between the two. One such feature that was previously on the Go implementation but not Python was deadline budget propagation, which passes on the remaining timeout available from the initial client request all the way through the server and any other requests that may follow. The lack of this feature in Baseplate.py meant that many resources were being wasted by servers doing unnecessary work, despite clients no longer awaiting their response due to timeout.
What are some alternatives?
bimg - Go package for fast high-level image processing powered by libvips C library
Apache Thrift - Apache Thrift
resize - Pure golang image resizing
markup.rs - A blazing fast, type-safe template engine for Rust.
gg - Go Graphics - 2D rendering in Go with a simple API.
gocv - Go package for computer vision using OpenCV 4 and beyond. Includes support for DNN, CUDA, and OpenCV Contrib.
lilliput - Resize images and animated GIFs in Go
imaging - Imaging is a simple image processing package for Go
imagick - Go binding to ImageMagick's MagickWand C API
geopattern - :triangular_ruler: Create beautiful generative image patterns from a string in golang.
go-opencv - Go bindings for OpenCV / 2.x API in gocv / 1.x API in opencv
imaginary - Fast, simple, scalable, Docker-ready HTTP microservice for high-level image processing