How Litestream Eliminated My Database Server for $0.03/month

• logpaste

  8 310 6.7 Go

  A simple web service for storing text log files

My tool is called LogPaste. It allows users to generate shareable URLs for text files. I use it in my open-source KVM over IP device so that users can easily share diagnostic logs with me.

• litestream

  165 9,964 7.5 Go

  Streaming replication for SQLite.

# Build LogPaste from source RUN go build \ -mod=readonly \ -v \ -o /app/server \ ./main.go # Download Litestream executable RUN wget "https://github.com/benbjohnson/litestream/releases/download/v${litestream_version}/${litestream_deb_filename}"

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• bolt

  22 11,201 0.0 Go

A few months ago, I saw that Ben Johnson, author of the popular Bolt database, had taken on a new project: Litestream. It's a simple, open-source tool that replicates a SQLite database to Amazon's S3 cloud storage.

• litestream-s6-example

  2 75 2.6 Dockerfile

  Discontinued Example repository for building a multi-process Docker container.

The minor hack is in that trailing &. It tells the script to run the Litestream process in the background, which is how I can execute two long-running processes in the same Docker container. Ben Johnson has published a cleaner solution, but I'm using the hacky version for ease of demonstration.

• s6-overlay

  27 3,515 4.6 Shell

  s6 overlay for containers (includes execline, s6-linux-utils & a custom init)

  

litestream-s6-example: A more advanced and robust method for running Litestream alongside your app in a Docker container. It uses s6-overlay to restart the Litestream instance on failure.

• tinypilot

  105 2,783 9.0 Python

  Use your Raspberry Pi as a browser-based KVM.

  

I'm using LogPaste in production for TinyPilot, my open-source KVM over IP device. Because users run my software on devices they own, I can't see any diagnostic information when they report issues. LogPaste provides a convenient way for users to share their logs with me.

• flyctl

  544 1,302 9.9 Go

  Command line tools for fly.io services

  

Sharing text files isn't exactly revolutionary, but serverless data replication might be. Here's a demo of me migrating my LogPaste app server between two separate hosting platforms: Heroku and fly.io. There's no database server or data migration step, but all of my data persists between platforms:

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project