py-caskdb VS db_tutorial

self plug: I wanted to learn how databases work internally, like how they store and retrieve data, build indexes, etc.

I built an educational KV store to teach someone to write a database from scratch. I have set up this project in TDD fashion with the tests. So, you start with simple functions, pass the tests, and the difficulty level goes up. There are hints if you get stuck. When all the tests pass, you would have written a persistent key-value store in the end.

link: https://github.com/avinassh/py-caskdb

link: https://github.com/avinassh/py-caskdb

If you like databases, you start exploring the internals and start writing one! There is no going back once you dig deep into storage internals, KV stores, and distributed systems.

plug: I made an educational project which can help you write a database in python, from scratch - https://github.com/avinassh/py-caskdb

Build your own disk based KV store

link - https://github.com/avinassh/py-caskdb

I am trying to recreate work from https://cstack.github.io/db_tutorial/ Basically it is recreating very simple SQLite, loading data from a file at the start of the program, and storing data in memory when the program runs then saving data to a file when we close the program. I believe that my issues are connected to working in the Windows instead of the Linux. Right now I am at part 5 when we start saving our data to the file when we close our program.

Stoped open source contributions recently, will be working on Build your Own Text Editor and Let's Build a Simple Database probably after landing an internship or a job

Last I heard, micro controllers still extensively use C and C-like sibling languages (like The Arduino Language). Most system applications use UI kits like Qt or GTK, which are also C libraries. Most of the Linux kernel consists of C code. Both SQL and NoSQL database backend are written mostly in C, with C++ coming in second, and only a few written in Rust, Zig or Golang (if you're interested in creating your own simple database, this is a great tutorial). TensorFlow and Pytorch, the machine learning libraries used for creating ANN-based architectures, uses libtensorflow and libtorch behind the scene that uses a mix of C and C++ libraries, then there's also GPU stuff like CUDA and RoCM that uses a mix of Fortran, C and Julia. Vulkan is also written in C and is supported in C++. Almost all performant libraries in Ruby, Python, Rust or Julia uses C bindings.

Have you thought about writing a DB from scratch in C? You'll learn lots of cool stuff about memory and OS abstractions: cstack.github.io/db_tutorial/

There's an online tutorial started a while back: https://cstack.github.io/db_tutorial