GOMEMLIMIT (Go 1.19) is a game-changer for high-memory applications

• Weaviate

  76 9,436 10.0 Go

  Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

  

Building up the vector index is CPU-bound. It's a lot of distance calculations and temporary structures such as priority queues, etc. We've even replaced the pure Go distance calculations with Assembly code so that we can make use of SIMD instructions, such as AVX2. Also the "regular" DB operations such as inserting a new document is essentially a write to an LSM store memtable, which is in turn an RB-tree. That operation is CPU-bound. Long story short, Weaviate utilizes its CPUs quite well under the load, leading to a high non-GC related load.

• dump

  1 7 5.6 Go

  A code dump of things not worth putting into their own repo. (by felixge)

See https://github.com/felixge/dump/tree/master/gc-overhead for proof.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project