skyplane
go-cloud
skyplane | go-cloud | |
---|---|---|
5 | 21 | |
973 | 9,395 | |
1.4% | 0.4% | |
6.9 | 8.5 | |
2 months ago | 7 days ago | |
Python | Go | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
skyplane
- Moving cloud storage
-
UC Berkeley Launches SkyPilot to Help Navigate Soaring Cloud Costs
I'm one of the creators of Skyplane. Skyplane can migrate large datasets between cloud regions at 10s of Gbps while compressing data to reduce egress fees. Happy to chime in!
https://github.com/skyplane-project/skyplane
-
IaSQL and Skyplane: Open Source Projects to Boost Your AWS Deployments
Skyplane, is an open source tool developed at UC Berkeley to optimize the transfer of large datasets between cloud providers, reducing transfer times and costs. It creates an overlay network on top of the cloud providers so it can route around congested cloud network links.
-
Those using AWS, have you ever tried to use AWS Transfer Family to transfer files into an S3 bucket? Can I use python to make these uploads, and if so how do I set it up in aws?
In case you want to move very large data between clouds, I recommend taking a look at https://github.com/skyplane-project/skyplane/
- Skyplane: 110x faster data transfers on any cloud
go-cloud
-
Mitchell reflects as he departs HashiCorp
Even when going multi-cloud you can employ different strategies. Vault is definitely one of them, but you can also use federation to exchange one cloud's credentials for another's, giving you the ability to centralize secrets in one of them. You can use a layer of abstraction like GoCloud [0]. You can also build for each cloud separately and decide either not to centralize secrets at all, or build some trivial bespoke tooling to synchronize some of them. I'm not endorsing any of the options, just pointing out that Vault isn't the only one.
https://github.com/google/go-cloud
-
Deno Queues
> If Google started adding Google Cloud specific primitives natively to Go would you call that forward thinking as well?
Go actually ships with a quite forward thinking SQL interface. It's an abstract interface over a DB, and you just import the "driver" that powers it. The driver conforms to a standard interface, so all of them behave roughly the same.
I think this is what everyone wants from Deno/etc - why can't there also be a KV interface that's universal, or a Queue interface that's universal?
People attempted this w/ go [1], where it attempts to use the same nice experience of the SQL logic, but it never seemed to gain traction.
https://gocloud.dev
-
Event Observer Pattern in Go
github.com/google/go-cloud/pubsub package provides a set of interfaces and tools to work with publish/subscribe messaging. This package allows easy communication between independent components by decoupling the sender and the receiver.
-
Google’s Wire: Automated Dependency Injection in Go
I'm guessing this is a reasonable example of what they're using it for? server.go
-
What's the status of pulumi-cloud https://github.com/pulumi/pulumi-cloud?
https://github.com/google/go-cloud probably out of context, but not IaC but agnostic backend development with Go across multiple clouds
-
Is there a zero-boilerplate zero-configuration cloud serverless framework for Go?
The plan is to have a process for generating AWS CDK targeting Lambda (pluggable providers, but start with AWS CDK, because it's what I use), and to use the Google Cloud Development Kit (also called CDK, but not the same) https://github.com/google/go-cloud to abstract the services.
-
Go Cloud Development Kit
In this post, I will talk about an exciting project maintained by the team that develops the Go language: the Go Cloud Development Kit, also known as the Go CDK.
- GitHub - google/go-cloud: The Go Cloud Development Kit (Go CDK): A library and tools for open cloud development in Go.
-
imagor v1.3 - a high-level Go image processing library using libvips
The API of gocloud.dev, is stable. We are at ariga.io, already use gocloud.dev for internal service, and even in the public for easy adopt multi-clouds provider: https://github.com/ariga/atlas/commit/ef0b0eae65a61375482497ceb9ed9790a469b56e
-
Should we switch to Rust?
On Go, which has a community focused on the cloud, there is even GoCloud, a library with a single, common, and high-level API that allows an application to support any of those clouds and even on-premise alternatives for those services. All can be configurable at deploy time by the infrastructure team.
What are some alternatives?
skypilot - SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.
cloudpods - A cloud-native open-source unified multi-cloud and hybrid-cloud platform. 开源、云原生的多云管理及混合云融合平台
cloudgamestream - A Powershell one-click solution to enable NVIDIA GeForce Experience GameStream on a cloud machine with a GRID supporting GPU.
prowler - Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more
hackingthe.cloud - An encyclopedia for offensive and defensive security knowledge in cloud native technologies.
cloud-custodian - Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources
ungoogled-chromium-portable - 🚀 Ungoogled Chromium portable for Windows
s5cmd - Parallel S3 and local filesystem execution tool.
aws-sdk-go - AWS SDK for the Go programming language.
docker-android - Android in docker solution with noVNC supported and video recording
fss3 - FSS3 is an S3 filesystem abstraction layer for Golang