google-cloud
blackbox_exporter
google-cloud | blackbox_exporter | |
---|---|---|
11 | 47 | |
3,602 | 4,306 | |
0.6% | 1.1% | |
9.9 | 8.3 | |
6 days ago | 2 days ago | |
Go | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
google-cloud
-
Out of process pagination on BigQuery table
Hello. So we use big query as database for all events that are happening in the project. And one of the features on the frontend is to display events with detailed view and so. Also one thing that we're using there is infinite scroll, so you can hit and fetch more requests. Based on that I do not know if the current approach is something correct. Basically we need out of process pagination where we create a job on the first request and then on next requests we paginate over the results. Using more or less this solution now: https://github.com/googleapis/google-cloud-go/issues/8173
-
Bigquery response mismatch with httpreplay
I am trying to run the tests with https://github.com/googleapis/google-cloud-go.
-
A common iterator pattern
is this different from google’s? https://github.com/googleapis/google-cloud-go/wiki/Iterator-Guidelines
-
Is it just me or does google not provide SDK documentation
Go
-
Learn AWS or GCP for Go?
I would go with GCP. There are Go examples everywhere in the GCP documentation and here is the official Go lib for GCP https://github.com/googleapis/google-cloud-go
- Does the aiplatform (VertexAI) Go grpc implementation work?
-
Check Certificate Expiration date from Bash to Go - help needed
I'm struggling to find the idiomatic Go SDK API from GCP and how to use the existing one https://cloud.google.com/go/docs/reference # don't have DNS package https://github.com/googleapis/google-cloud-go # don't have DNS package https://github.com/googleapis/google-api-go-client # has DNS package but I can't find one way to list my managed DNS zones So in this case, what can I do? So far I've done the following, I want to change the func hostList() to something dynamic generated based on my Google Cloud DNS zones.
-
Effective Go on Cloud Run: Structured Logging
package logx import ( "fmt" "net/http" ) func info(r *http.Request, message interface{}, projectID string) { get := r.Header.Get("X-Cloud-Trace-Context") traceID, spanID, traceSampled := deconstructXCloudTraceContext(get) traceID = fmt.Sprintf("projects/%s/traces/%s", projectID, traceID) entry := logEntry{ Severity: "INFO", Message: message, HttpRequest: &httpRequest{ RequestMethod: r.Method, RequestUrl: r.URL.String(), UserAgent: r.UserAgent(), RemoteIp: r.RemoteAddr, Referer: r.Referer(), }, Timestamp: time.Now(), Labels: map[string]string{"labels": "rock"}, SpanID: spanID, TraceID: traceID, TraceSampled: traceSampled, } writelog(&entry) } func writelog(entry *logEntry) { if err := json.NewEncoder(os.Stderr).Encode(entry); err != nil { fmt.Printf("failure to write structured log entry: %v", err) } } // taken from https://github.com/googleapis/google-cloud-go/blob/master/logging/logging.go#L774 var reCloudTraceContext = regexp.MustCompile( // Matches on "TRACE_ID" `([a-f\d]+)?` + // Matches on "/SPAN_ID" `(?:/([a-f\d]+))?` + // Matches on ";0=TRACE_TRUE" `(?:;o=(\d))?`) func deconstructXCloudTraceContext(s string) (traceID, spanID string, traceSampled bool) { // As per the format described at https://cloud.google.com/trace/docs/setup#force-trace // "X-Cloud-Trace-Context: TRACE_ID/SPAN_ID;o=TRACE_TRUE" // for example: // "X-Cloud-Trace-Context: 105445aa7843bc8bf206b120001000/1;o=1" // // We expect: // * traceID (optional): "105445aa7843bc8bf206b120001000" // * spanID (optional): "1" // * traceSampled (optional): true matches := reCloudTraceContext.FindStringSubmatch(s) traceID, spanID, traceSampled = matches[1], matches[2], matches[3] == "1" if spanID == "0" { spanID = "" } return }
-
Finding and fixing memory leaks in Go
The Google Cloud Client Libraries for Go generally use gRPC under the hood to connect with Google Cloud APIs. When you create an API client, the library initializes a connection to the API then leaves that connection open until you call Close on the Client.
-
Anyone figure out a way to test/trigger locally google pubsub?
Anyone have experience with testing google pubsub event handlers locally? https://github.com/googleapis/google-cloud-go/tree/pubsub/v1.5.0/pubsub
blackbox_exporter
-
How I would automate monitoring DNS queries in basic Prometheus
https://github.com/prometheus/blackbox_exporter/blob/master/...
So you need 2 modules, one for each ip version. As for autamating setting these up, we deploy our Prometheus server with salt so we can use Jinja templating in all our Prometheus config files. That really cuts down on repeating boiler plate code.
This is also interesting for other reasons; in host downtime situations you can sometime see they will drop one type of traffic and not the other.
-
Raspberry Pi Remote Server Monitoring over Wifi: Micropython code to monitor tcp port using usocket
A Pi is more than enough to run a full monitoring stack. Why reinvent the wheel?
- Service for monitoring your external IP adresses from a file.
-
Uplink Monitor - Internal IP's to External Facing Status Page
You can also use the blackbox_exporter to probe various endpoints. But in reality, you don't need to do this most of the time since the up metric gets you what you want.
-
Server down detector
Synthetic Monitoring is the Grafana Cloud implementation. It uses the blackbox_exporter
-
how do I start to build an uptime monitoring system such as UptimeRobot or OnlineOrNot?
Prometheus blackbox_exporter. Free and open source.
-
alert for self sign certs
Check something called blackboxexporter https://github.com/prometheus/blackbox_exporter
-
Use prometheus+grafana for bug bounty / pentesting data collection
I have seen some people doing with these traditional relational databases, and I was wondering if it could be a good fit for prometheus+grafana as I have been messing around with prometheus BlackBox exporter (https://github.com/prometheus/blackbox_exporter) for web status monitoring.
-
Prometheus Monitoring Checklist
You should look into the projects https://github.com/prometheus/node_exporter and https://github.com/prometheus/blackbox_exporter
-
Uptime monitoring (~1000 urls)
You could use prometheus as a monitoring tool, blackbox_exporter to "export" the urls to prometheus, alertmanager for notifications, and grafana for nice gui dashboards (and maybe also notifications).
What are some alternatives?
ghost - A Go library for Snapchat's API
cloudprober - [Moved to cloudprober/cloudprober] An active monitoring software to detect failures before your customers do.
megos - Go(lang) client library for accessing information of an Apache Mesos cluster.
ping_exporter - Prometheus exporter for ICMP echo requests using https://github.com/digineo/go-ping
clarifai - DEPRECATED: please use https://github.com/Clarifai/clarifai-go-grpc
ssh_exporter
minio-go - MinIO Go client SDK for S3 compatible object storage
Zabbix - Real-time monitoring of IT components and services, such as networks, servers, VMs, applications and the cloud.
goamz
Telegraf - The plugin-driven server agent for collecting & reporting metrics.
telegram-bot-api - Golang bindings for the Telegram Bot API
smokeping_prober - Prometheus style smokeping