sparkmagic
kustomize-sops
| sparkmagic | kustomize-sops | |
|---|---|---|
| 4 | 8 | |
| 1,286 | 600 | |
| 0.4% | 1.7% | |
| 7.6 | 6.8 | |
| 3 days ago | 15 days ago | |
| Python | Go | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sparkmagic
-
Doing ML works in AWS. Need help installing cartopy
Please file an issue at https://github.com/jupyter-incubator/sparkmagic
-
Ask HN: Who's an open source maintainer/project that needs sponsorship or help?
I maintain several open source projects, most notably:
Sparkmagic (https://github.com/jupyter-incubator/sparkmagic)
Sparkmagic provides jupyter magics and kernels for working with remote Spark clusters. It's used by thousands of developers and companies like Pinterest, Amazon, more!
I've been maintaining for the past few years and would love help!
KSOPS (https://github.com/viaduct-ai/kustomize-sops)
KSOPS, or kustomize-SOPS, is a kustomize KRM exec plugin for SOPS encrypted resources. KSOPS can be used to decrypt any Kubernetes resource, but is most commonly used to decrypt encrypted Kubernetes Secrets and ConfigMaps. As a kustomize plugin, KSOPS allows you to manage, build, and apply encrypted manifests the same way you manage the rest of your Kubernetes manifests.
KSOPS is the most popular kustomize plugin and I'd love help maintaining and improving it from out GitOps fanatics.
-
Spark is lit onceĀ again
Things get a bit more complicated on interactive sessions. We've created Sparkmagic compatible REST API so that Sparkmagic kernel could communicate with Lighter the same way as it does with Apache Livy. When a user creates an interactive session Lighter server submits a custom PySpark application which contains an infinite loop which constantly checks for new commands to be executed. Each Sparkmagic command is saved on Java collection, retrieved by the PySpark application through Py4J Gateway and executed.
-
An SQL Solution for Jupyter
Jupyter would be even better if it supported the seamless combination of Python and SQL code cells.
My notebook code typically involves a data prep stage with querying a SQL database, then downloading into Python for more complex analysis, ML modelling, integration with external data sources, etc. So the notebook has a Python kernel with SQL usually as embedded """-quoted strings.
Does anyone have a solution to treating selected code cells as SQL - with SQL highlighting and tooltips - exposed as string variables to the Python code?
Sparkmagic [1] does part of this for Python/SQL/Spark interoperability, but as far as I recall, doesn't support SQL syntax highlighting.
[1] https://github.com/jupyter-incubator/sparkmagic
kustomize-sops
-
Ask HN: Who's an open source maintainer/project that needs sponsorship or help?
I maintain several open source projects, most notably:
Sparkmagic (https://github.com/jupyter-incubator/sparkmagic)
Sparkmagic provides jupyter magics and kernels for working with remote Spark clusters. It's used by thousands of developers and companies like Pinterest, Amazon, more!
I've been maintaining for the past few years and would love help!
KSOPS (https://github.com/viaduct-ai/kustomize-sops)
KSOPS, or kustomize-SOPS, is a kustomize KRM exec plugin for SOPS encrypted resources. KSOPS can be used to decrypt any Kubernetes resource, but is most commonly used to decrypt encrypted Kubernetes Secrets and ConfigMaps. As a kustomize plugin, KSOPS allows you to manage, build, and apply encrypted manifests the same way you manage the rest of your Kubernetes manifests.
KSOPS is the most popular kustomize plugin and I'd love help maintaining and improving it from out GitOps fanatics.
- KSOPS v4 Supports KRM Exec Functions
-
Secret Management in Kubernetes: Approaches, Tools, and Best Practices
ArgoCD users would have to build container images with SOPS baked in using Helm chart extensions or Kustomize extensions. Flux allows configuring sops directly into the Flux manifests.
- Show HN: A Flexible Kustomize Plugin for SOPS Encrypted Resource
- ArgoCD vs. FluxCD and how they handle Secrets
-
5 Ways to Access Kubernetes Clusters
The common wisdom is to use something that reconciles in cluster (e.g. a CSI driver as recommended in AKS, or sealed secrets, or vault injector) or a kustomize plugin (like ksops, advantage of just rendering out standard secrets in the cluster itself)
-
Gotta love gitops
We've considered this, but then went with argocd + ksops for the key agility.
-
10 Anti-patterns for Kubernetes Deployment !!
Check out ksops from viaduct https://github.com/viaduct-ai/kustomize-sops
What are some alternatives?
lighter - REST API for Apache Spark on K8S or YARN
argocd-vault-plugin - An Argo CD plugin to retrieve secrets from Secret Management tools and inject them into Kubernetes secrets
Jupyter Scala - A Scala kernel for Jupyter
sealed-secrets - A Kubernetes controller and tool for one-way encrypted Secrets
Apache Spark - Apache Spark - A unified analytics engine for large-scale data processing
flux2 - Open and extensible continuous delivery solution for Kubernetes. Powered by GitOps Toolkit.
nbmake - š Pytest plugin for testing notebooks
helm-secrets - A helm plugin that help manage secrets with Git workflow and store them anywhere
nbgrader - A system for assigning and grading notebooks
sops-secrets-operator - Kubernetes SOPS secrets operator
xeus-sql - Jupyter kernel for SQL databases
etcd - Distributed reliable key-value store for the most critical data of a distributed system