|about 23 hours ago||4 days ago|
|Mozilla Public License 2.0||GNU Affero General Public License v3.0|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Designing large scale apps using micro services
2 projects | reddit.com/r/node | 16 Nov 2021
Check out Consul from HashiCorp. https://www.consul.io/
Nginx – The Architecture of Open Source Applications
5 projects | news.ycombinator.com | 2 Nov 2021
> As a relatively young dev, the idea of a "web server" as a standalone binary that serves your application (vs a library that you use to write your own "server") feels strange.
In my eyes, the ideal setup is one that's layered: where you have an ingress that's basically a load balancer that also ensures that you have SSL/TLS certificates, enforces rate limits, perhaps is used for some very basic logging, or can optionally do any URL rewriting that you need. Personally, i think that Caddy (https://caddyserver.com/) is lovely for this, whereas some people prefer something like Traefik (https://traefik.io/), though the older software packages like Nginx (https://nginx.org/en/) or even Apache (https://www.apache.org/) are good too, as long as the pattern itself is in place.
Then, you may additionally have any sorts of middleware that you need, such as a service mesh for service discovery, or providing internal SSL/TLS - personally Docker Swarm (https://docs.docker.com/engine/swarm/) overlay networks have always been enough for me in this regard, though some people enjoy other solutions, such as Hashicorp Consul (https://www.consul.io/), or maybe something intended for Kubernetes or other platforms that you already may be using, like Linkerd (https://linkerd.io/).
Finally, you have your actual application with its server. Personally, i think that the web server should be embedded (for example, embedded Tomcat with Spring Boot) or indeed just be a library that's a part of the application executable, as long as you can update it easily enough by rebuilding the application - containers are good for this, but aren't strictly necessary, since sometimes other forms of automation and packaging are also enough.
The reason why i believe this, is because i've seen plenty of deployments where that just isn't the case:
- attempts to store certificates within the application, each application server having different requirements for the formats to be used, making management (and automation) of renewal a total nightmare
An Update on Our Outage
3 projects | news.ycombinator.com | 31 Oct 2021
Programming Microservices Communication With Istio
7 projects | dev.to | 28 Oct 2021
Service discovery — Traditionally provided by platforms like Netflix Eureka or Consul.
1 project | reddit.com/r/PrometheusMonitoring | 11 Sep 2021
For discovery outside of Kubernetes, you can use whatever your configuration management database is to generate the discovery configs. But you might want to look at Consul. The down side to using discovery scripts is the monolithic update lag. I used to have a medium sized setup with Chef and Nagios. It took something like 5 minutes just to run one config cycle. As we transitioned to Prometheus we cut the cycle down to a couple minutes, because we had smaller targeted configs.
HashiCorp Consul: What's the catch?
5 projects | reddit.com/r/devops | 4 Sep 2021
So, my tech lead has once more had the sweet whispers of HashiCorp blaring in his ear, and to my irritation has decreed that we will be prioritizing bringing Consul into our environment despite pretty much everything else we have being in various states of rotting popsicle sticks and scotch tape.
An Introduction to Microservices pt. 3
1 project | dev.to | 24 Aug 2021
Harbormaster: The anti-Kubernetes for your personal server
20 projects | news.ycombinator.com | 19 Aug 2021
> There is gap in the market between VM oriented simple deployments and kubernetes based setup.
In my experience, there are actually two platforms that do this pretty well.
First, there's Docker Swarm ( https://docs.docker.com/engine/swarm/ ) - it comes preinstalled with Docker, can handle either single machine deployments or clusters, even multi-master deployments. Furthermore, it just adds a few values to Docker Compose YAML format ( https://docs.docker.com/compose/compose-file/compose-file-v3... ) , so it's incredibly easy to launch containers with it. And there are lovely web interfaces, such as Portainer ( https://www.portainer.io/ ) or Swarmpit ( https://swarmpit.io/ ) for simpler management.
Secondly, there's also Hashicorp Nomad ( https://www.nomadproject.io/ ) - it's a single executable package, which allows similar setups to Docker Swarm, integrates nicely with service meshes like Consul ( https://www.consul.io/ ), and also allows non-containerized deployments to be managed, such as Java applications and others ( https://www.nomadproject.io/docs/drivers ). The only serious downsides is having to use the HCL DSL ( https://github.com/hashicorp/hcl ) and their web UI being read only in the last versions that i checked.
There are also some other tools, like CapRover ( https://caprover.com/ ) available, but many of those use Docker Swarm under the hood and i personally haven't used them. Of course, if you still want Kubernetes but implemented in a slightly simpler way, then there's also the Rancher K3s project ( https://k3s.io/ ) which packages the core of Kubernetes into a smaller executable and uses SQLite by default for storage, if i recall correctly. I've used it briefly and the resource usage was indeed far more reasonable than that of full Kubernetes clusters (like RKE).
What Is a Service Mesh, and Why Is It Essential for Your Kubernetes Deployments?
2 projects | dev.to | 17 Aug 2021
With multiple services running, it’s hard to discover where they’re located. The dependencies between multiple services are not always easily found, and new services may be deployed with a new dependency on an older service. Those services can be deployed anywhere in the infrastructure, so what you need is a Service Discovery service. There are plenty available, such as Netflix Eureka or HashiCorp Consul.
Request routing for horizontally scaled services
6 projects | dev.to | 8 Aug 2021
The myriad of request processing middlewares does not end here - there is also the very trendy topic of service meshes that we could cover, but I choose to leave that as an exercise to interested readers, as it is a rapidly evolving and complex space (see: Istio, linkerd, Consul, Tanzu, etc).
Minio: High Performance, Kubernetes Native Object Storage
1 project | news.ycombinator.com | 14 Nov 2021
Certificate-Based Authentication for S3 with MinIO
1 project | news.ycombinator.com | 10 Nov 2021
Semi-related: I really like minio, and there is only so much I can complain about since it _is_ free…
… but I do wish they would implement being able to store objects at arbitrary keys. Some combinations of keys are not possible to store at the same time. And I guess to me it seems… odd… and maybe even frustrating?, that they say it was a “blunder” on AWS’s part to implement such a thing.
The falsehoods of anti-AGPL propaganda (2020)
3 projects | news.ycombinator.com | 24 Oct 2021
MinIO has switched their license to AGPL (the community is not happy https://github.com/minio/minio/issues/12143). The company behind the project is now contacting all users and tells them to pay for the commercial license. They try to make the users feels insecure about the way they use the product. They don't tell you that you are violating the license, they tell you to check with your legal, etc. So most companies will finally just buy it.
It is working as intended but we need to fix the behavior here which is not anticipated.
1 project | reddit.com/r/programmingcirclejerk | 29 Sep 2021
Replaced disk offline after heal
1 project | reddit.com/r/minio | 10 Sep 2021
This is what I was referring to, but if you had to modify any entry manually, then it is a bug as it should have been handled automatically. If you have a valid reproducer I would recommend opening an issue on GitHub (https://github.com/minio/minio/issues).
Scaling node.js backend service (Help to choose perfect design pattern and tools)
2 projects | reddit.com/r/node | 29 Aug 2021
Files uploaded to a Minio bucket. I also use Tus to handle the transfers as well, but it's not mandatory.
Minio browser - download multiple files
1 project | reddit.com/r/minio | 26 Aug 2021
Managed services on top of cheap dedicated hosting
2 projects | reddit.com/r/selfhosted | 23 Aug 2021
There is a self-hosted S3 service available. https://github.com/minio/minio
MinIO: A Bare Metal Drop-In for AWS S3
9 projects | news.ycombinator.com | 10 Aug 2021
I also hit a very frustrating issue in minio where CORS headers weren't being set properly and there were many similar cases in their issues history. Their response was basically "works for me, sorry".
I'm pretty sure there was something weird going on with how minio was reading the config state, as I definitely was not the only one hitting it. Luckily I only had to use it for local testing in the project, but the whole thing didn't leave me feeling good.9 projects | news.ycombinator.com | 10 Aug 2021
My usage was "setup a basic single node for testing, upload a file with mc client, delete a file with mc client". They failed that test. It was responding with 200s but the file was never deleted.
There are loads of issues like this on their github: https://github.com/minio/minio/issues/8873
What are some alternatives?
GlusterFS - Gluster Filesystem : Build your distributed storage in minutes
Nextcloud - ☁️ Nextcloud server, a safe home for all your data
Seaweed File System - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
Swift - OpenStack Storage (Swift). Mirror of code maintained at opendev.org.
Samba - https://gitlab.com/samba-team/samba is the Official GitLab mirror of https://git.samba.org/samba.git -- Merge requests should be made on GitLab (not on GitHub)
ownCloud - :cloud: ownCloud web server core (Files, DAV, etc.)
Go IPFS - IPFS implementation in Go
etcd - Distributed reliable key-value store for the most critical data of a distributed system
Seafile - High performance file syncing and sharing, with also Markdown WYSIWYG editing, Wiki, file label and other knowledge management features.
traefik - The Cloud Native Application Proxy
syncthing - Open Source Continuous File Synchronization