Hctree is an experimental high-concurrency database back end for SQLite

• multiversion-concurrency-control

  19 66 7.3 Java

  Implementation of multiversion concurrency control, Raft, Left Right concurrency Hashmaps and a multi consumer multi producer Ringbuffer, concurrent and parallel load-balanced loops, parallel actors implementation in Main.java, Actor2.java and a parallel interpreter

  This is very interesting. Thank you for submitting this and thank you for working on this.

  I am highly interested in parallelism and high concurrency. I implemented multiversion concurrency control in Java.

  https://github.com/samsquire/multiversion-concurrency-contro...

  I am curious how to handle replication with high concurrency. I'm not sure how you detect dangerous reads+writes to the same key (tuples/fields) across different replica machines. In other words, multiple master.

  I am aware Google uses truetime and some form of timestamp ordering and detection of interfering timestamps. But I'm not sure how to replicate that.

  I began working on an algorithm to synchronize database records, do a sort, then a hash for each row where hash(row) = hash(previous_row.hash + row.data)

  Then do a binary search on hashes matching/not matching. This is a synchronization algorithm I'm designing that requires minimal data transfer but multiple round trips.

  The binary search would check the end of the data set for hash(replica_a.row[last]) == hash(replica_b.row[last]) then split the hash list in half and check the middle item, this shall tell you which row and which columns are different.

• multiversion-concurrency-contro

  16 - -

  This is very interesting. Thank you for submitting this and thank you for working on this.

  I am highly interested in parallelism and high concurrency. I implemented multiversion concurrency control in Java.

  https://github.com/samsquire/multiversion-concurrency-contro...

  I am curious how to handle replication with high concurrency. I'm not sure how you detect dangerous reads+writes to the same key (tuples/fields) across different replica machines. In other words, multiple master.

  I am aware Google uses truetime and some form of timestamp ordering and detection of interfering timestamps. But I'm not sure how to replicate that.

  I began working on an algorithm to synchronize database records, do a sort, then a hash for each row where hash(row) = hash(previous_row.hash + row.data)

  Then do a binary search on hashes matching/not matching. This is a synchronization algorithm I'm designing that requires minimal data transfer but multiple round trips.

  The binary search would check the end of the data set for hash(replica_a.row[last]) == hash(replica_b.row[last]) then split the hash list in half and check the middle item, this shall tell you which row and which columns are different.

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• embedded-postgres

  5 321 5.7 Java

  Java embedded PostgreSQL component for testing (by zonkyio)

  

  I use an embedded postgres testing library for the JVM that does something along those lines.

  Well no actually it just unpacks the tar file in a temp dir and runs the full postgres, but it mostly feels like what you describe (minus the single file part) and starts surprisingly fast. That would totally work for a little proof of concept (https://github.com/zonkyio/embedded-postgres)

• rqlite

  112 14,835 9.9 Go

  The lightweight, distributed relational database built on SQLite.

  

  Meaning something like rqlite[1]? The age of fat desktop clients all connecting back to the central SQL server is long behind us, so yeah there is probably little reason beyond fun for something like that, but where there is fun!

  [1] https://github.com/rqlite/rqlite

• postlite

  18 1,190 0.0 Go

  Discontinued Postgres wire compatible SQLite proxy.

• WorkOS

  workos.com

  sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project