Architecting your Cloud Native Infrastructure

• cloud-foundation-fabric

  8 1,333 9.8 HCL

  End-to-end modular samples and landing zones toolkit for Terraform on GCP.

  

If you would like to look at some sample implementations, I would recommend looking at this repository which helps users setup all these different networking models in GCP including hub and spoke via peering, hub and spoke via VPN, DNS and Google Private Access for on-premises, Shared VPC with GKE support, ILB as next hop and so on using Terraform

• kubefed

  7 2,476 6.6 Go

  Discontinued Kubernetes Cluster Federation

  

And the interesting thing about networking in cloud is that it need not be just be limited to the cloud provider within your region but can span across multiple providers across multiple regions as needed and this is where projects like Kubefed, Crossplane definitely does help.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• alertmanager

  13 6,284 9.2 Go

  Prometheus Alertmanager

  

In any such scenarios, a tool like Prometheus can act as the time series database to collect all the metrics for you along with something like OpenTelemetry to expose metrics from the application and the various tools using inbuilt exporters, Alertmanager to send notifications and alerts to multiple channels, Grafana as the dashboard to visualize everything at one place and so on giving users a complete visibility on the infrastructure as a whole.

• clair

  21 10,030 9.2 Go

  Vulnerability Static Analysis for Containers

  

Harbor is an OCI compliant registry which is made of various components which includes Docker registry V2, Harbor UI, Clair, Notary, backed by a cache like Redis and a database like Postgres.

• zipkin

  36 16,713 9.4 Java

  Zipkin is a distributed tracing system

  

But what about tracing your request spanning across multiple microservices and tools? This is where distributed tracing also becomes very important especially considering the complexity that microservices comes with. And this is an area where tools like Zipkin and Jaeger have been pioneers with the recent entrant to this space being Tempo

• Fluentd

  25 12,531 8.0 Ruby

  Fluentd: Unified Logging Layer (project under CNCF)

  

Having complex systems like these also require the use of log aggregation systems so that all the logs can be streamed into a single place for easier debugging. This is where people tend to use the ELK or EFK stack with Logstash or FluentD doing the log aggregation and filtering for you based on your constraints. But there are new players in this space, like Loki and Promtail which does the same thing but in a different way.

• consul

  57 27,774 9.9 Go

  Consul is a distributed, highly available, and data center aware solution to connect and configure applications across dynamic, distributed infrastructure.

  

Setting up a service mesh if needed (eg. LinkerD, Istio, Consul, etc.)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• velero

  42 8,212 9.6 Go

  Backup and migrate Kubernetes applications and their persistent volumes

  

But site reliability does not end with just monitoring, visualization and alerting. You have to be ready to handle any failures in any part of the system with regular backups and failovers in place so that either there is no data loss or the extent of data loss is minimized. This is where tools like Velero play a major role.

• rook

  51 11,905 9.9 Go

  Storage Orchestration for Kubernetes

  

This is where file systems like Ceph has already proved itself being used for a long time in production by a lot of companies. But considering that it was not built with Kubernetes in mind and is very hard to deploy and manage, this is where a project like Rook can really help.

• ingress-nginx

  202 16,638 9.6 Go

  Ingress-NGINX Controller for Kubernetes

  

Setting up Ingress controllers and API Gateways (eg. Nginx, Ambassador, Kong, Gloo, etc.)

• hub-feedback

  379 231 0.0

  Feedback and bug reports for the Docker Hub

  

If you are onboard a cloud provider, there is a high chance that they already provide image registry as a service already (eg. GCR, ECR, ACR, etc.) which takes away all the complexity from you and you should be good to go and if your cloud provider does not provide one, you can also go for third party registries like Docker Hub, Quay, etc.

• gRPC

  201 40,685 9.9 C++

  The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)

  

Setting up inter-service communication between various services using protocols and tools like GRPC, Thrift or HTTP

• Harbor

  74 22,485 9.7 Go

  An open source trusted cloud native registry project that stores, signs, and scans content.

  

If this is the case, then going for a private image registry like Harbor might actually help. This is what the architecture of Harbor looks like (Source: https://goharbor.io/docs/1.10/install-config/harbor-ha-helm/)

• CoreDNS

  41 11,800 9.3 Go

  CoreDNS is a DNS server that chains plugins

  

Setting up the service discovery within the cluster (which is handled by default by CoreDNS)

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project