helm-charts VS cert-manager

Helm installed on your machine. The Elastic modules will be installed using the official Elastic Helm repo. Although the repo is now read-only, it is still fully functional, and the community is expected to maintain it.

The Elastic Stack is our Swiss Army Knife on the cluster. The whole Elastic Stack has been installed in version 8.5.1 inside the cluster. We know it's not recommended to have stateful apps in Kubernetes, but we are in the early stage of our production.

Hi, I am looking to load the default dashboards that come pre-built in Kibana by setting up a Kibana endpoint in metricbeat configuration. The "setup.kibana" option is not really available in the official metricbeat helm charts as a setting (https://github.com/elastic/helm-charts/blob/main/metricbeat/values.yaml). The option to setup a kibana endpoint is only available in the regular metricbeat.yml file which we generally use in a VM based deployment. (https://www.elastic.co/guide/en/beats/metricbeat/current/metricbeat-reference-yml.html).

apiVersion: networking.k8s.io/v1 kind: Ingress #https://kubernetes.io/docs/concepts/services-networking/ingress/ metadata: name: quickstart-es-http-ingress annotations: # nginx.ingress.kubernetes.io/rewrite-target: / #https://github.com/elastic/helm-charts/issues/779 https://stackoverflow.com/questions/68893838/ingress-for-eck-elasticsearch-not-working-502-gateway #kubernetes.io/ingress.class: nginx #think this is wrong for our class? kubernetes.io/tls-acme: "true" #nginx.ingress.kubernetes.io/proxy-ssl-secret: "resources/elastic-certificate-pem" #=> need to point to ES certificate pem. nginx.ingress.kubernetes.io/proxy-ssl-verify: "false" #=> must be false if you use elasticsearch-utils to generate CA. nginx.ingress.kubernetes.io/backend-protocol: "HTTPS" #=> must be HTTPS <- this one fixed it. spec: ingressClassName: public rules: - http: paths: - path: / pathType: Prefix backend: service: name: quickstart-es-http port: number: 9200

Unfortunately the new security system introduced by ES 8.0 has produced problems with the official helm chart, so we cannot use the standard Okteto Chart deploy system. In this article we will see how deploy ES 8.x into kubernetes (k8s) using the Okteto Cloud as platform.

This might help you, you'd need to run this separately from the operator: https://github.com/elastic/helm-charts/blob/main/logstash/ Before embarking on a logstash journey you may want to check if beats (or agent) combined with Elasticsearch ingestion pipelines can meet your needs

We will deploy the Elasticsearch and Kibana using the official Helm charts which can be found here(Elasticsearch, Kibana). For installing via Helm you would need a helm binary on your path but installation of Helm is outside the scope of this post.

They have the repo with their helm charts published on github. Here's the values.yaml for elastic. The other apps (kibana, filebeat, etc) are in adjacent folders. The values you see in these files are the defaults.

Looks like they have recently changed node.roles https://github.com/elastic/helm-charts/pull/1186

cert-manager

The second one is a combination of tools: External DNS, cert-manager, and NGINX ingress. Using these as a stack, you can quickly deploy an application, making it available through a DNS with a TLS without much effort via simple annotations. When I first discovered External DNS, I was amazed at its quality.

On top of its core components, SpinKube depends on cert-manager. cert-Manager is responsible for provisioning and managing TLS certificates that are used by the admission webhook system of the Spin Operator. Let’s install cert-manager and KWasm using the commands shown here:

terraform { required_providers { kubectl = { source = "gavinbunney/kubectl" version = "1.14.0" } } } # The reference to the current project or a AWS project data "google_client_config" "provider" {} # The reference to the current cluster or EKS data "google_container_cluster" "my_cluster" { name = var.cluster_name location = var.cluster_location } # We configure the kubectl provider to use those values for authenticating provider "kubectl" { host = data.google_container_cluster.my_cluster.endpoint token = data.google_client_config.provider.access_token cluster_ca_certificate = base64decode(data.google_container_cluster.my_cluster.master_auth[0].cluster_ca_certificate) } #Download the multiple manifests file. data "http" "cert_manager_crds" { url = "https://github.com/cert-manager/cert-manager/releases/download/v${var.cert_manager_version}/cert-manager.crds.yaml" } data "kubectl_file_documents" "cert_manager_crds" { content = data.http.cert_manager_crds.response_body lifecycle { precondition { condition = 200 == data.http.cert_manager_crds.status_code error_message = "Status code invalid" } } } # We use the for_each or else this kubectl_manifest will only import the first manifest in the file. resource "kubectl_manifest" "cert_manager_crds" { for_each = data.kubectl_file_documents.cert_manager_crds.manifests yaml_body = each.value }

SSL certificates thanks to Cloudflare and cert-manager

kubectl apply -f https://github.com/cert-manager/cert-manager/releases/download/${CERT_MANAGER_VERSION}/cert-manager.crds.yaml

put the Sub-CA inside hashicorp vault to be used for automatic signing of services like https://cert-manager.io/ inside our k8s clusters.

install-cert-manager: desc: Install cert-manager deps: - init-cluster cmds: - kubectl apply -f https://github.com/cert-manager/cert-manager/releases/download/{{.CERT_MANAGER_VERSION}}/cert-manager.yaml - echo "Waiting for cert-manager to be ready" && sleep 25 status: - kubectl -n cert-manager get pods | grep Running | wc -l | grep -q 3

I've been pretty frustrated with how private CAs are supported. Your private root CA can be maliciously used to MITM every domain on the Internet, even though you intend to use it for only a couple domain names. Most people forget to set Name Constraints when they create these and many helper tools lack support [1][2]. Worse, browser support for Name Constraints has been slow [3] and support isn't well tracked [4]. Public CAs give you certificate transparency and you can subscribe to events to detect mis-issuance. Some hosted private CAs like AWS's offer logs [5], but DIY setups don't.

Even still, there are a lot of folks happily using private CAs, they aren't the target audience for this initial release.

[1] https://github.com/FiloSottile/mkcert/issues/302

[2] https://github.com/cert-manager/cert-manager/issues/3655

[3] https://alexsci.com/blog/name-non-constraint/

[4] https://github.com/Netflix/bettertls/issues/19

[5] https://docs.aws.amazon.com/privateca/latest/userguide/secur...

the Cert Manager