datree
goseaweedfs
datree | goseaweedfs | |
---|---|---|
34 | 9 | |
6,410 | 113 | |
0.1% | - | |
5.2 | 0.0 | |
12 days ago | over 1 year ago | |
Go | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
datree
-
Show HN: Datree (YC W20) ā End-to-End Policy Management for Kubernetes
Hi HN, Iām Shimon, the co-founder of Datree: A policy management solution for Kubernetes. We help DevOps engineers prevent misconfigurations in their Kubernetes by enforcing an organizational policy on their clusters. Engineers can define a custom policy or use one of Datreeās built-in policies, such as NIST/NSA Hardening Guide, EKS Security Best Practices, CIS Benchmark, and more.
Our website is at https://datree.io and our GitHub is here: https://github.com/datreeio/datree
This is not the first time I have shown Datree to the HN community: A little over a year ago, I posted here an earlier version of Datree (https://news.ycombinator.com/item?id=28918850). At that time, Datree consisted of a CLI tool to detect Kubernetes misconfigurations during the development process (locally or in the CI/CD), unlike the version I present today in which the enforcement happens in production.
We built the CLI tool because we detected a big problem among Kubernetes operators: Misconfigurations. Kubernetes is extremely complex and flexible, which makes it very easy to poorly configure it in ways that are not secure. And indeed, we talked to dozens of Kubernetes operators who suffered from various problems, starting with failed audits, all the way to downtime in production, all because of misconfigurations.
Our solution was simple: Give the developers the means to shift-left security testing during the development process with a CLI tool that can be integrated into the CI/CD. We thought this was the best way to approach the problem: It is easiest to fix misconfigurations in the development process before they are deployed to production, it prevents context-switching and relieves resources from the DevOps team.
While the CLI tool was very popular among the open-source community (it got over 6000 stars on GitHub), we soon realized that CI/CD enforcement is not enough. As we talked with Datreeās users, we realized we had made a fundamental mistake: We thought of misconfiguration prevention in technical terms rather than organizational terms.
Indeed, from a technical point of view, it makes sense to shift-left Kubernetes security. But when considering the organizational structure in which it takes place, it simply isnāt enough. DevOps engineers told us that they love the shift-left concept, but they simply cannot rely on the goodwill of the engineers to run a CLI tool locally or to monitor all the pipelines leading to production. They need governance, something to help them stay in control of the state of their clusters.
Moreover, we realized that many companies who use Kubernetes are heavily regulated, and cannot take any chances with their security. Sure, these companies want the engineers to fix misconfigurations during development, but they also want something to make sure that no matter what, their clusters remain misconfiguration-free.
Based on this understanding, we developed a new version of Datree that sits on the cluster itself (rather than in the CI/CD) and protects the production environment by blocking misconfigured resources with an admission webhook. It has a centralized policy management solution to enable governance, and native monitoring to get real-time insights into the state of your Kubernetes.
I look forward to hearing your feedback and answering any questions you may have.
- Is OPA Gatekeeper the best solution for writing policies for k8s clusters?
- datreeio/datree: Prevent Kubernetes misconfigurations from reaching production (again š¤ )! Datree is a CLI tool to ensure K8s configs follow stability & security best practices as well as your organizationās policies. See our docs: https://hub.datree.io
- Question for the Argo-Verse
-
How to create a react app with Go support using WebAssembly in under 60 seconds
Go is a statically typed, compiled programming language designed at Google, it is syntactically similar to C, but with memory safety, garbage collection, structural typing, and CSP-style concurrency. In my case, I needed to run Go for JSON schema validations, in other cases, you might want to perform a CPU-intensive task or use a CLI tool written in Go.
- Techworld with Nana: Enforce K8s Best Practices with Datree
-
Gatekeeper vs Kyverno
I worked with both of them and from my experience Gatekeeper is more solid and accountable, I even wrote an article about Gatekeeper. Both Gatekeeper and Kyverno require a lot of heavy lifting work. On the one hand, Gatekeeper will probably require more configuration work however the community and the tool itself are more stable than Kyverno. On the other hand, Kyverno policy-as-code capabilities are much easier to use/understand. This way or another, for me using Kyvernoās policy language or Rego for my policies, wasnāt such a pleasant experience. I personally believe in GitOps and shifting left so if youāre looking for tools I would highly recommend you to review Datree, which is an open-source CLI (Disclaimer: Iām one of the developers at Datree). Datree is a more centralized policy management solution rather than a policy engine. Unlike Kyverno/Gatekeeper Datree was built to help DevOps teams to shift left and practice GitOps by delegating more responsibilities to the developers more efficiently. In practice, Datree already comes with built-in rules and policies along with YAML and schema validation for K8s resources and CRDs such as Argo CRDs. Datreeās policies are written in JSONScheme which is a common solid policy language supported by the community for many years. Additionally, Datreeās CLI also comes with a dashboard app where you can monitor the policies in your organization. You can modify and update your policies, review which policies are being used in practice, and control who can create/delete/update your policies. The major difference is that at the moment, unlike Kyverno/Gatekeeper Datree doesnāt provide native policy enforcement in the Kubernetes cluster at the moment but we expect to release this support very soon. At the moment, we provide a way to scan the cluster using a kubectl plugin. Feel free to check it out :)
-
Working with Datreeās Helm Plugin
$ helm plugin install https://github.com/datreeio/helm-datree Installing helm-datree... https://github.com/datreeio/datree/releases/download/1.0.6/datree-cli_1.0.6_Darwin_x86_64.zip % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 673 100 673 0 0 1439 0 --:--:-- --:--:-- --:--:-- 1469 100 6901k 100 6901k 0 0 1852k 0 0:00:03 0:00:03 --:--:-- 2865k helm-datree is installed. See https://hub.datree.io for help getting started. Installed plugin: datree
-
Adding custom rules in Datree
GitHub
- Learn from Nana, AWS Hero & CNCF Ambassador, how to enforce K8s best practices with Datree.
goseaweedfs
-
How data is stored in S3, RDS and DynamiDB.
You can check SeaweedFS https://github.com/chrislusf/seaweedfs
-
Top 200 Kubernetes Tools for DevOps Engineer Like You
ChubaoFS - distributed file system and object storage Longhorn - Cloud-Native distributed block storage built on and for Kubernetes OpenEBS - Kubernetes native - hyperconverged block storage with multiple storage engines Rook - Storage Orchestration for Kubernetes SeaweedFS - Distributed file system supports read-write many volumes TiKV - Distributed transactional key-value database velero - Backup and migrate Kubernetes applications and their persistent volumes Vitess - Vitess is a database clustering system for horizontal scaling of MySQL kaDalu - A lightweight Persistent storage solution for Kubernetes / OpenShift using GlusterFS in background
-
File Systems implemented in Go
seaweedfs - SeaweedFS is a simple and highly scalable distributed file system for small files.
-
File system with permanent public random uuid url
Seaweedfs looks quite promising but its public url uuid is in the form of <32-bit volume, 64-bit file key, 32-bit file cookie>. The volume is probably fixed most of the time, the file key is an incrementing number while the file cookie is random. 32-bit seems too small to prevent guessing.
-
MinIO: A Bare Metal Drop-In for AWS S3
MinIO team care about an issue if you are paid customer, not for people who use the open source. Indeed MinIO is not even fully S3 compatible with many edge cases and close the issues related to it by saying itās not a priority.
You might want to look at other options as well like SeaweedFS [0] a POSIX compliant S3 compatible distributed file system.
[0] https://github.com/chrislusf/seaweedfs
-
Tools & Info for Sysadmins - MS Mac Downloads, Cabling Tip, CSP Cheatsheet & More
SeaweedFS is a fast, distributed storage system for blobs, objects, files and data that stores/serves billions of files. Can transparently integrate with the cloud with both fast local access and elastic cloud storage capacity. Blob store has O(1) disk seek, local and cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop and WebDAV. chrislusf finds "it is much faster than the 'high performance' Minio."
-
Finding smaller open source projects
welcome to help with https://github.com/chrislusf/seaweedfs
-
Using a disk-backed Redis alternative to reduce AWS S3 bill
(I work on SeaweedFS) How about using SeaweedFS? https://github.com/chrislusf/seaweedfs
With your dedicated server, the latency is consistent, No API/network cost. Extra data can be tiered to S3.
Basically it is a key-file store.
https://github.com/chrislusf/seaweedfs/wiki/Filer-as-a-Key-L...
https://github.com/chrislusf/seaweedfs/wiki/Cloud-Tier
-
Minio has changed is license - what are the best alternatives? update license change for MinIO Ā· minio/minio@0694325
I am working on SeaweedFS. But seriously, use http://github.com/chrislusf/seaweedfs
What are some alternatives?
KubeArmor - Runtime Security Enforcement System. Workload hardening/sandboxing and implementing least-permissive policies made easy leveraging LSMs (BPF-LSM, AppArmor).
Seaweed File System - SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. [Moved to: https://github.com/seaweedfs/seaweedfs]
polaris - Validation of best practices in your Kubernetes clusters
goofys - a high-performance, POSIX-ish Amazon S3 file system written in Go
kube-score - Kubernetes object analysis with recommendations for improved reliability and security. kube-score actively prevents downtime and bugs in your Kubernetes YAML and Charts. Static code analysis for Kubernetes.
minio - The Object Store for AI Data Infrastructure
polaris - Shopifyās design system to help us work together to build a great experience for all of our merchants.
k8s - How to deploy Portainer inside a Kubernetes environment.
reviewdog - š¶ Automated code review tool integrated with any code analysis tools regardless of programming language
cachenator - Distributed, sharded in-memory cache and proxy for S3
Kyverno - Kubernetes Native Policy Management
fsnotify - Cross-platform file system notifications for Go.