Go Database

Open-source Go projects categorized as Database

Top 23 Go Database Projects

  • prometheus

    The Prometheus monitoring system and time series database.

    Project mention: How to prevent breaking API changes with API Gateway | dev.to | 2023-09-25

    Monitor the routes passing through the gateway. If a previously available route suddenly starts returning 404 errors, it's a potential sign that the API has undergone a change or an endpoint has been deprecated. Enable the API health check feature to monitor continuously the overall health of upstream nodes. If one of the nodes starts to fail, responding faster or slower than usual, it might indicate a change in the underlying backend service's processing. Integrate APISIX with monitoring tools like Prometheus using the prometheus plugin. Set up alerts based on metrics, such as an increased rate of 4xx or 5xx errors, which could indicate breaking changes in your API.

  • etcd

    Distributed reliable key-value store for the most critical data of a distributed system

    Project mention: The Complete Microservices Guide | dev.to | 2023-09-21

    Service Discovery: Microservices need to discover and communicate with each other dynamically. Service discovery tools like etcd, Consul, or Kubernetes built-in service discovery mechanisms help locate and connect to microservices running on different nodes within the infrastructure.

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • tidb

    TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://tidbcloud.com/free-trial

    Project mention: TiDB: Open-source, cloud-native, distributed, MySQL compatible database | news.ycombinator.com | 2023-08-30
  • cockroach

    CockroachDB - the open source, cloud-native distributed SQL database.

    Project mention: Is it bad to create a publicly accessible RDS database for my serverless web app? | /r/aws | 2023-08-11

    For example, when you create a serverless postgres database with a platform like CockroachDB or Neon, you effectively get a connection string with a strong password. Anyone can connect to your database from anywhere so long as they have the right connection string. There are no security settings in these services to change this behavior.

  • Milvus

    A cloud-native vector database, storage for next generation AI applications

    Project mention: Code Search with Vector Embeddings: A Transformer's Approach | dev.to | 2023-08-27

    As the size of the codebase grows, storing and searching through embeddings in memory becomes inefficient. This is where vector databases come into play. Tools like Milvus, Faiss, and others are designed to handle large-scale vector data and provide efficient similarity search capabilities. I've wrtten about how to also use sqlite to store vector embeddings. By integrating a vector database, you can scale your code search tool to handle much larger codebases without compromising on search speed.

  • dgraph

    The high-performance database for modern applications

    Project mention: Is Dgraph dead? (should I continue using it) | news.ycombinator.com | 2023-09-18
  • jaeger

    CNCF Jaeger, a Distributed Tracing Platform

    Project mention: Building for Failure | dev.to | 2023-10-02

    The best way to do this, is with the help of tracing tools such as paid tools such as Honeycomb, or your own instance of the open source Jaeger offering, or perhaps Encore's built in tracing system.

  • Revelo Payroll

    Free Global Payroll designed for tech teams. Building a great tech team takes more than a paycheck. Zero payroll costs, get AI-driven insights to retain best talent, and delight them with amazing local benefits. 100% free and compliant.

  • vitess

    Vitess is a database clustering system for horizontal scaling of MySQL.

    Project mention: PlanetScale Scaler Pro | news.ycombinator.com | 2023-07-06

    This is great news. I strolled around https://github.com/vitessio/vitess/issues/12967.

    Are there any public discussions of more trade-offs vitess has to make to enable fks?

  • dolt

    Dolt – Git for Data

    Project mention: Pg_branch: Pre-alpha Postgres extension brings Neon-like branching | news.ycombinator.com | 2023-10-01

    Interesting that branching is now better supported and almost free. I wonder if merging can be simplified or whether it already is as simple and as fast as it can be?

    I guess I am inspired by Dolt’s ability to branch and merge: https://github.com/dolthub/dolt

  • rqlite

    The lightweight, distributed relational database built on SQLite

    Project mention: I'm All-In on Server-Side SQLite | news.ycombinator.com | 2023-09-22
  • go-sql-driver/mysql

    Go MySQL Driver is a MySQL driver for Go's (golang) database/sql package (by go-sql-driver)

    Project mention: Tools besides Go for a newbie | /r/golang | 2023-03-26

    IDE: use whatever make you productive. I personally use vscode. VCS: git, as golang communities use github heavily as base for many libraries. AFAIK Linter: use staticcheck for linting as it looks like mostly used linting tool in go, supported by many also. In Vscode it will be recommended once you install go plugin. Libraries/Framework: actually the standard libraries already included many things you need, decent enough for your day-to-day development cycles(e.g. `net/http`). But here are things for extra: - Struct fields validator: validator - Http server lib: chi router , httprouter , fasthttp (for non standard http implementations, but fast) - Web Framework: echo , gin , fiber , beego , etc - Http client lib: most already covered by stdlib(net/http), so you rarely need extra lib for this, but if you really need some are: resty - CLI: cobra - Config: godotenv , viper - DB Drivers: sqlx , postgre , sqlite , mysql - nosql: redis , mongodb , elasticsearch - ORM: gorm , entgo , sqlc(codegen) - JS Transpiler: gopherjs - GUI: fyne - grpc: grpc - logging: zerolog - test: testify , gomock , dockertest - and many others you can find here

  • TinyGo

    Go compiler for small places. Microcontrollers, WebAssembly (WASM/WASI), and command-line tools. Based on LLVM.

    Project mention: Show HN: A new stdlib for Golang focusing on platform native support | news.ycombinator.com | 2023-10-02

    Reminds me of https://tinygo.org/ - a project that brings Golang to embedded devices, browser (wasm) contexts. Do you converge or diverge from that project?

  • badger

    Fast key-value DB in Go.

    Project mention: What would be some database with extreme raw performance? (details in) | /r/Database | 2023-05-25
  • migrate

    Database migrations. CLI and Golang library.

    Project mention: Building RESTful API with Hexagonal Architecture in Go | dev.to | 2023-09-27

    Golang-migrate is a database migration tool designed for Go applications. It helps manage and apply changes to the database schema as the application grows, ensuring that the code and database structure stay in sync.

  • groupcache

    groupcache is a caching and cache-filling library, intended as a replacement for memcached in many cases.

    Project mention: [imcache] A generic in-memory cache Go library. Feedback appreciated. | /r/golang | 2023-04-09
  • VictoriaMetrics

    VictoriaMetrics: fast, cost-effective monitoring solution and time series database

    Project mention: InfluxDB CTO: Why We Moved from Go to Rust | news.ycombinator.com | 2023-10-01

    Not sure I follow since there are very competitive tools written in Go such as https://victoriametrics.com for an example in this space.

  • sqlc

    Generate type-safe code from SQL

    Project mention: Open-sourcing SQX, a way to build flexible database models in Go | news.ycombinator.com | 2023-09-02

    This does look like it's a little bit better than a lot of the other options in the Go ecosystem for database access, but this introduction misses something important: what SQL dialects does this support? It appears to be partly a wrapper around Squirrel. Squirrel is not new (and apparently also not maintained?) but I actually have no idea which and how much of each SQL dialect Squirrel supports.

    Every time I see SQL and Go stuff, I feel literally obligated to introduce people to sqlc. That said, sqlc only has good support for PostgreSQL, and you'd have to generate code for each dialect... so that's something worth considering. (I still find it to be one of my favorite SQL tools, even with its issues.)

    https://sqlc.dev/

  • Tile38

    Real-time Geospatial and Geofencing

    Project mention: Show HN: TG – Fast geometry library in C | news.ycombinator.com | 2023-09-22

    [2] https://github.com/tidwall/tile38

  • immudb

    immudb - immutable database based on zero trust, SQL/Key-Value/Document model, tamperproof, data change history

    Project mention: Was tun gegen den ganzen Papierkram? | /r/de_EDV | 2023-02-15
  • usql

    Universal command-line interface for SQL databases

    Project mention: xo/usql: Universal command-line interface for SQL databases | /r/devel | 2023-06-08
  • go-clean-arch

    Go (Golang) Clean Architecture based on Reading Uncle Bob's Clean Architecture

    Project mention: A Go (Golang) Backend Clean Architecture Project | /r/golang | 2023-01-08

    Try this

  • pgweb

    Cross-platform client for PostgreSQL databases

    Project mention: Slashbase: A modern in-browser database IDE & CLI for your dev & data workflows. Supports PostgreSQL & MongoDB. | /r/programming | 2023-01-04
  • FerretDB

    A truly Open Source MongoDB alternative

    Project mention: MongoDB’s New Query Engine | news.ycombinator.com | 2023-09-21

    There is FerretDB. But they are not fully compatible to Mongo yet.

    https://www.ferretdb.io/

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-10-02.

Go Database related posts

Index

What are some of the best open-source Database projects in Go? This list will help you:

Project Stars
1 prometheus 50,032
2 etcd 44,566
3 tidb 34,908
4 cockroach 27,854
5 Milvus 23,098
6 dgraph 19,622
7 jaeger 18,334
8 vitess 16,815
9 dolt 15,549
10 rqlite 14,044
11 go-sql-driver/mysql 13,686
12 TinyGo 13,497
13 badger 12,780
14 migrate 12,325
15 groupcache 12,310
16 VictoriaMetrics 9,465
17 sqlc 9,131
18 Tile38 8,697
19 immudb 8,355
20 usql 8,235
21 go-clean-arch 8,093
22 pgweb 8,061
23 FerretDB 7,692
Clean code begins in your IDE with SonarLint
Up your coding game and discover issues early. SonarLint is a free plugin that helps you find & fix bugs and security issues from the moment you start writing code. Install from your favorite IDE marketplace today.
www.sonarlint.org