cloud-native

Open-source projects categorized as cloud-native | Edit details

Top 23 cloud-native Open-Source Projects

  • GitHub repo Kong

    🦍 The Cloud-Native API Gateway

    Project mention: 27 open-source tools that can make your Kubernetes workflow easier 🚀🥳 | dev.to | 2021-11-09
  • GitHub repo tidb

    TiDB is an open source distributed HTAP database compatible with the MySQL protocol

    Project mention: Comparing Nginx Performance in Bare Metal and Virtual Environments | news.ycombinator.com | 2021-10-29

    I do agree with you in that regard, however, that's also a dangerous line of thinking.

    There are attempts to provide horizontal scalability for RDBMSes in a transparent way, like TiDB https://pingcap.com/ (which is compatible with the MySQL 5.7 drivers), however, the list of functionality that's sacrificed to achieve easily extensible clusters is a long one: https://docs.pingcap.com/tidb/stable/mysql-compatibility

    There are other technologies, like MongoDB, which sometimes are more successful at a clustered configuration, however most of the traditional RDBMSes work best in a leader-follower type of replication scenario, because even those aforementioned systems oftentimes have data consistency issues that may eventually pop up.

    Essentially, my argument is that the lack of good horizontally scalable databases or other data storage solutions is easily explainable by the fact that the problem itself isn't solvable in any easy way, apart from adopting eventual consistency, which is probably going to create more problems than it will solve in case of any pre-existing code that makes assumptions about what ways it'll be able to access data and operate on it: https://en.wikipedia.org/wiki/Fallacies_of_distributed_compu...

    To that end, i'd perhaps like to suggest an alternative: use a single vertically scalable RDBMS instance when possible, with a hot standby if you have the resources for that. Let the architecture around it be horizontally scalable instead, and let it deal with the complexities of balancing the load and dealing with backpressure - introduce a message queue if you must, maybe even an in-memory one for simplicity's sake, or consider an event based architecture where "what needs to be done" is encapsulated within a data structure that can be passed around and applied whenever possible. In my eyes, such solutions can in many cases be better than losing the many benefits of having a single source of truth.

    Alternatively, consider sharding as a possibility, or, alternatively, do some domain driven design, figure out where to draw some boundaries and split your service into multiple ones that cover the domain with which you need to work with. Then you have one DB for sales, one for account management, one for reports and so on, all separated by something as simple as REST interfaces and with rate limits or any of the other mechanisms.

    If, however, neither of those two groups of approaches don't seem to be suitable for the loads that you're dealing with, then you probably have a team of very smart people and a large amount of resources to figure out what will work best.

    To sum up, if there are no good solutions in the space, perhaps that's because the problems themselves haven't been solved yet. Thus, sooner or later, they'll need to be sidestepped and their impact mitigated in whatever capacity is possible.

  • Scout APM

    Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo lens

    Lens - The Kubernetes IDE

    Project mention: Gui app for managing the cluster,portainer? | reddit.com/r/kubernetes | 2021-12-04

    Lens maybe?

  • GitHub repo jina

    Cloud-native neural search framework for 𝙖𝙣𝙮 kind of data

    Project mention: Open source tools to track github repository stats? | reddit.com/r/opensource | 2021-10-24

    I use this tool everyday to track growth for Jina (an open-source neural search framework)

  • GitHub repo Akka

    Build highly concurrent, distributed, and resilient message-driven applications on the JVM

    Project mention: Best modern approaches to building composable distributed systems? | news.ycombinator.com | 2021-10-24
  • GitHub repo hydra

    OpenID Certified™ OpenID Connect and OAuth Provider written in Go - cloud native, security-first, open source API security for your infrastructure. SDKs for any language. Compatible with MITREid.

    Project mention: Simple OpenID Connect (OIDC) Provider? | reddit.com/r/selfhosted | 2021-10-23
  • GitHub repo micro

    Micro is a distributed cloud operating system (by micro)

    Project mention: Micro - A distributed cloud operating system | reddit.com/r/opensource | 2021-11-30
  • Nanos

    Run Linux Software Faster and Safer than Linux with Unikernels.

  • GitHub repo awesome-microservices

    A curated list of Microservice Architecture related principles and technologies.

    Project mention: Observability and Resilience in Microservices-based Environments | reddit.com/r/kubernetes | 2021-06-24
  • GitHub repo NATS

    High-Performance server for NATS.io, the cloud and edge native messaging system.

    Project mention: Processing billions of events in real time at Twitter | news.ycombinator.com | 2021-11-15

    NATS is built with golang which is one of the reasons I like it…

    https://github.com/nats-io/nats-server

  • GitHub repo rook

    Storage Orchestration for Kubernetes

    Project mention: First raspberry pi cluster | reddit.com/r/homelab | 2021-11-24

    I wonder how well rook.io performs with 8GB pis and usb SSDs.

  • GitHub repo Quarkus

    Quarkus: Supersonic Subatomic Java.

    Project mention: Twelve Years of Go | news.ycombinator.com | 2021-11-10
  • GitHub repo kubesphere

    The container platform tailored for Kubernetes multi-cloud, datacenter, and edge management ⎈ 🖥 ☁️

    Project mention: KubeSphere 3.2.0 GA: Bringing AI-oriented GPU Scheduling and Flexible Gateways to Kubernetes Management | dev.to | 2021-11-17

    KubeSphere is a distributed operating system for cloud-native application management, using Kubernetes as its kernel. It provides a plug-and-play architecture, allowing third-party applications to be seamlessly integrated into its ecosystem.   KubeSphere offers wizard web UI and various enterprise-grade features for operation and maintenance, including multi-cloud and multi-cluster management, DevOps (CI/CD), application lifecycle management, service mesh, multi-tenancy, observability, storage and network management, and GPU support.    For more information, you can visit https://kubesphere.io or https://github.com/kubesphere.

  • GitHub repo landscape

    🌄The Cloud Native Interactive Landscape filters and sorts hundreds of projects and products, and shows details including GitHub stars, funding or market cap, first and last commits, contributor counts, headquarters location, and recent tweets.

    Project mention: Show HN: A microservice framework, listed in CNCF Landscape, 1 year 10k+ stars | news.ycombinator.com | 2021-09-20

    It is an official CNCF project, but its not very difficult to get added, see https://github.com/cncf/landscape#new-entries you need 300 github stars and to be cloud native.

  • GitHub repo conduit

    Ultralight, security-first service mesh for Kubernetes. Main repo for Linkerd 2.x.

    Project mention: Nginx – The Architecture of Open Source Applications | news.ycombinator.com | 2021-11-02

    > As a relatively young dev, the idea of a "web server" as a standalone binary that serves your application (vs a library that you use to write your own "server") feels strange.

    In my eyes, the ideal setup is one that's layered: where you have an ingress that's basically a load balancer that also ensures that you have SSL/TLS certificates, enforces rate limits, perhaps is used for some very basic logging, or can optionally do any URL rewriting that you need. Personally, i think that Caddy (https://caddyserver.com/) is lovely for this, whereas some people prefer something like Traefik (https://traefik.io/), though the older software packages like Nginx (https://nginx.org/en/) or even Apache (https://www.apache.org/) are good too, as long as the pattern itself is in place.

    Then, you may additionally have any sorts of middleware that you need, such as a service mesh for service discovery, or providing internal SSL/TLS - personally Docker Swarm (https://docs.docker.com/engine/swarm/) overlay networks have always been enough for me in this regard, though some people enjoy other solutions, such as Hashicorp Consul (https://www.consul.io/), or maybe something intended for Kubernetes or other platforms that you already may be using, like Linkerd (https://linkerd.io/).

    Finally, you have your actual application with its server. Personally, i think that the web server should be embedded (for example, embedded Tomcat with Spring Boot) or indeed just be a library that's a part of the application executable, as long as you can update it easily enough by rebuilding the application - containers are good for this, but aren't strictly necessary, since sometimes other forms of automation and packaging are also enough.

    The reason why i believe this, is because i've seen plenty of deployments where that just isn't the case:

      - attempts to store certificates within the application, each application server having different requirements for the formats to be used, making management (and automation) of renewal a total nightmare

  • GitHub repo apisix

    The Cloud-Native API Gateway

    Project mention: Ask HN: What API Gateways do you use? | news.ycombinator.com | 2021-11-24

    I'm currently looking into using Apache APISIX, seems really interesting - especially the part of writing custom plugins.

    At Swisscom [1] we've created an APISIX [2] Plugin [3] to interact with Open Policy Agent (OPA) [4] to perform certain actions depending on the result of a policy evaluation.

    An integration with Ory Keto [5] could allow us to have a centralized API Gateway with authentication and authorization termination (by using opa-keto [6]).

    This is the power of open source technologies :)

    [1]: https://swisscom.ch

    [2]: https://apisix.apache.org/

    [3]: https://github.com/swisscom/apisix-opa-plugin

    [4]: https://www.openpolicyagent.org/

    [5]: https://www.ory.sh/keto/docs/

    [6]: https://github.com/swisscom/opa-keto

  • GitHub repo openebs

    Leading Open Source Container Attached Storage, built using Cloud Native Architecture, simplifies running Stateful Applications on Kubernetes.

    Project mention: Why OpenEBS 3.0 for Kubernetes and Storage? | dev.to | 2021-10-02

    We are grateful for the support and contributions of the vibrant open-source community that OpenEBS has received. We are also thankful to the Cloud Native Computing Foundation (CNCF) for including OpenEBS as one of its storage projects. And a special thanks to the CNCF for being a reference user of OpenEBS as well - you can read about their experience and that of others including TikTok / ByteDance and Verizon / Yahoo on Adopters.md. Collectively, these aspects have helped my team to notice challenges and opportunities and of course to resolve bugs and improve the polish of OpenEBS with each release.

  • GitHub repo OPA (Open Policy Agent)

    An open source, general-purpose policy engine.

    Project mention: Policyer Action | dev.to | 2021-12-05

    Policyer is an open source project (more like a vision) I created after inspired by policy engines that become very popular lately (OPA,Checkov) Policyer going to focus on providing platform to run and create meaningful reports, data engagement and plugin system to let you provide any data, some time it can be k8s yaml and in other it can be user data.

  • GitHub repo yugabyte-db

    The high-performance distributed SQL database for global, internet-scale apps.

    Project mention: Query PostgreSQL, or any 🐘-compatible like Amazon Redshift, from YugabyteDB 🚀 thanks to Postgres FDW | dev.to | 2021-11-22

    I've used import_collate 'false' because we don't support yet the COLLATE clause (see #1127)

  • GitHub repo Dragonfly

    Dragonfly is an intelligent P2P based image and file distribution system. (by dragonflyoss)

    Project mention: Can Kubernetes pre-pull and cache images? | reddit.com/r/kubernetes | 2021-07-06
  • GitHub repo linkerd

    Old repo for Linkerd 1.x. See the linkerd2 repo for Linkerd 2.x.

    Project mention: Stuff mentioned in a microservice related job posting | dev.to | 2020-12-23

    Linkerd is a transparent service mesh, designed to make modern applications safe and sane by transparently adding service discovery, load balancing, failure handling, instrumentation, and routing to all inter-service communication.

  • GitHub repo pouch

    An Efficient Enterprise-class Container Engine

    Project mention: Ask HN: Any Good Alternative for Docker? | news.ycombinator.com | 2021-08-31
  • GitHub repo kubeedge

    Kubernetes Native Edge Computing Framework (project under CNCF)

    Project mention: KubeEdge v1.7 is out now | news.ycombinator.com | 2021-06-01
  • GitHub repo crossplane

    Your Universal Control Plane

    Project mention: Postgres Database and User Operators? | reddit.com/r/kubernetes | 2021-12-05

    Crossplane Configured by CRD Generic SQL provider Can only be run as an operator

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-12-05.

cloud-native related posts

Index

What are some of the best open-source cloud-native projects? This list will help you:

Project Stars
1 Kong 30,697
2 tidb 29,718
3 lens 16,374
4 jina 12,418
5 Akka 11,898
6 hydra 11,802
7 micro 10,731
8 awesome-microservices 10,605
9 NATS 10,169
10 rook 9,294
11 Quarkus 8,950
12 kubesphere 8,164
13 landscape 7,874
14 conduit 7,836
15 apisix 7,809
16 openebs 7,242
17 OPA (Open Policy Agent) 5,868
18 yugabyte-db 5,836
19 Dragonfly 5,706
20 linkerd 5,381
21 pouch 4,481
22 kubeedge 4,420
23 crossplane 4,359
Find remote jobs at our new job board 99remotejobs.com. There are 32 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com