-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
I take advantage of I/O being parallel in Python in my mazzle continuous integration pipeline tool. I'm not sharing mutable state.
I spin up a graph of python Threads and each joins others in a graph. This way we can run graphs in parallel. See this graph - the parts that look like this:
dependency -> {parallel1; parallel2; parallel3} -> postparallel
parallel1, parallel2, parallel3 can run in parallel in a separate python thread because the IO is parallel.
postparallel joins parallel1, parallel2, parallel3 and waits for them all to complete.
Where parallel1-3 is things like ansible, packer (slow), AMI builds, chef runs etc.
https://github.com/samsquire/mazzle-starter/blob/master/arch...
Related posts
-
No More Passwords! Terraform Module Makes GCP-GitHub Authentication a Breeze
-
Open Source Infrastructure Deployment Tool for Early Stage Startups
-
Stack Grafana deployed on AWS ECS -Part 1 - Create a Cluster
-
Terraform Starter Boilerplate for GCP using Terragrunt
-
Authorization and Amazon Verified Permissions - A New Way to Manage Permissions Part XIV: AVP Getting Started