Top 23 SQL Open-Source Projects
Apache Spark - A unified analytics engine for large-scale data processingProject mention: How to use Spark and Pandas to prepare big data | dev.to | 2022-05-10
Apache Spark is one of the most actively developed open-source projects in big data. The following code examples require that you have Spark set up and can execute Python code using the PySpark library. The examples also require that you have your data in Amazon S3 (Simple Storage Service). All this is set up on AWS EMR (Elastic MapReduce).
TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try free: https://tidbcloud.com/signupProject mention: Insights for any repository on Github | reddit.com/r/programming | 2022-05-14
As the database supporter for ossinsight.io, I also use this to get many insights for TiDB itself, see https://ossinsight.io/analyze/pingcap/tidb.
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
Free universal database tool and SQL clientProject mention: Most popular PostgreSQL GUIs in 2022: the (almost) scientific list | dev.to | 2022-05-17
OmniDB is more complex than a Postico or TablePlus but less advanced than a DataGrip or Navicat. It's a good free option but maybe less complete than DBeaver, which has a better documentation and a seemingly larger community.
An easy-to-use and promise-based multi SQL dialects ORM tool for Node.js | Postgres, MySQL, MariaDB, SQLite, MSSQL, Snowflake & DB2Project mention: Do Open Source programs have supervisors? | reddit.com/r/opensource | 2022-05-16
CockroachDB - the open source, cloud-native distributed SQL database.Project mention: How we built a cost-based SQL optimizer | reddit.com/r/programming | 2022-04-29
CRDB implements the algorithm described in a 2013 paper called "On the correct and complete enumeration of the core search space". It is a bottom-up DP approach that is able to handle inner, left, anti, semi, full, etc. joins (many papers only cover inner joins). In addition, CRDB extends it in a few ways that enable reorderings in some important practical cases that the paper doesn't cover (a full description can be found here). As a result, it's able to reorder in a number of cases that other optimizers don't even consider.
Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure, GCP, DNS, Elastic, Network, Virtualization. DevOps Interview QuestionsProject mention: Joining DevOps! | reddit.com/r/devops | 2022-04-19
This guy https://github.com/bregman-arie/devops-exercises made an awesome practice material for DevOps tasks
ClickHouse® is a free analytics DBMS for big dataProject mention: Ask HN: Free and open source distributed database written in C++ or C | news.ycombinator.com | 2022-05-16
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
SQL powered operating system instrumentation, monitoring, and analytics.Project mention: invintory for linux. | reddit.com/r/sysadmin | 2022-05-09
osquery, with or without fleetdm or kolide.
MyBatis SQL mapper framework for JavaProject mention: 20 years of Hibernate | reddit.com/r/java | 2021-05-24
How about batch insert, updates, and deletes? I had to fix a broken MyBatis project recently and was surprised that this feature doesn't even seem to be implemented, at least according to this GitHub issue.
A query builder for PostgreSQL, MySQL, CockroachDB, SQL Server, SQLite3 and Oracle, designed to be flexible, portable, and fun to use.Project mention: SQL: One to Many Join Query in an Optimal way with Node.js | dev.to | 2022-05-16
Knex.js as Query Builder
Dapper - a simple object mapper for .NetProject mention: i get a "Unable to cast object of type 'System.Byte' to type 'System.Int32'.'" error. I have looked on google but I can't really find a solution | reddit.com/r/csharp | 2022-04-15
Dude, cant use dapper? https://github.com/DapperLib/Dapper
The official home of the Presto distributed SQL query engine for big dataProject mention: Let's write a compiler, part 5: A code generator | news.ycombinator.com | 2021-08-19
An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.Project mention: Database structure for pipelines | reddit.com/r/algotrading | 2022-05-16
If you need persistent storage, TimescaleDB is a PostgreSQL extension designed for time-series data.
📊 Cube — Headless Business Intelligence for Building Data ApplicationsProject mention: Building a Bubble Dashboard with Cube | reddit.com/r/api | 2022-05-19
In this piece, we will teach you how to leverage the power of Cube to build an analytics dashboard that aggregates data from a relational database and displays it using Bubble.
Go MySQL Driver is a MySQL driver for Go's (golang) database/sql package (by go-sql-driver)Project mention: Golang future web frameworks! | reddit.com/r/golang | 2022-04-24
go-sql-driver/mysql 12.1k Stars, Used by 72.4k
Dolt – It's Git for DataProject mention: [Self Promotion] Hosted Dolt is here! | reddit.com/r/Database | 2022-05-18
For those of you new to Dolt (https://github.com/dolthub/dolt). Dolt is like Git and MySQL had a baby. We built a SQL database from the storage engine up to support branch, merge, clone, diff and all the other Git idioms.
The lightweight, distributed relational database built on SQLiteProject mention: Let's build a distributed Postgres proof of concept | news.ycombinator.com | 2022-05-17
Every node in the cluster "knows" the network address of the Leader. It knows because a) it's part of the Raft cluster configuration, and every follower "heartbeats" to the Leader periodically.
So it's actually pretty simple. If a node receives a request which must be performed on the leader, and that node is not itself the Leader, it can do one of the following things:
1) reject the request with an error, but this isn't really a production-viable option.
2) reject the request with an error, but tell the client where the leader can be found, so the leader can retry the request.
3) transparently forward the request to the leader, wait for the leader to execute the request, get the respond, and return the response to the client. In this case the client doesn't even know the forwarding to the leader happened.
rqlite supports mode 2 and 3, client can choose which behavior it wants, on a request-by-request basis. Option 3 is the default.
The reason I originally looked into this was to see if there's a way to use sqlite in wasm with indexeddb as the storage backend, getting a full SQL engine in the browser (like WebSQL, but actually using web standard API). Here is sqlite compiled to wasm, but only with the in-memory database, which is only of limited use. My conclusion was that it might be possible, but needs a ton of work in C interfacing with web APIs through emscripten, which is not fun at all.
The core infrastructure backend (API, database, Docker, etc). (by bitwarden)Project mention: How to disable robust password requirement? | reddit.com/r/portainer | 2022-05-18
This has been answered already, but until the patch comes out a password manager like bitwarden can trivialize the issue.
Modern and easy to use SQL client for MySQL, Postgres, SQLite, SQL Server, and more. Linux, MacOS, and Windows.Project mention: Looking for a very simple GUI for a beginner | reddit.com/r/sqlite | 2022-05-09
q - Run SQL directly on delimited files and multi-file sqlite databases (by harelba)Project mention: OpenOffice. Necesito ver una hoja de cálculo que tiene 6 millones de columnas, pero no puedo | reddit.com/r/AskArgentina | 2022-05-15
SQL related posts
Organising SQL queries in Flask app
1 project | reddit.com/r/learnpython | 21 May 2022
Best ORM to use with FastAPI?
1 project | reddit.com/r/Python | 21 May 2022
Using Rust to build a web API
4 projects | reddit.com/r/rust | 20 May 2022
questdb: NEW Data - star count:8487.0
1 project | reddit.com/r/algoprojects | 20 May 2022
Diesel - A safe, extensible orm and query builder for rust
1 project | reddit.com/r/github | 20 May 2022
Hacker News top posts: May 20, 2022
1 project | reddit.com/r/hackerdigest | 20 May 2022
Show HN: Objectiv – open-source product analytics infrastructure
2 projects | news.ycombinator.com | 19 May 2022
What are some of the best open-source SQL projects? This list will help you:
Are you hiring? Post a new remote job listing for free.