skypilot
skyplane
| skypilot | skyplane | |
|---|---|---|
| 33 | 5 | |
| 5,675 | 973 | |
| 3.6% | 1.4% | |
| 9.8 | 6.9 | |
| 1 day ago | 2 months ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
skypilot
- Ask HN: Most efficient way to fine-tune an LLM in 2024?
- SGLang: Fast and Expressive LLM Inference with RadixAttention for 5x Throughput
- Serving Your Private Code Llama-70B with API, Chat, and VSCode Access
- A new old kind of R&D lab
- New Recipe: Serving Llama-2 with VLLM's OpenAI-Compatible API Server
- Train Your Own Vicuna on Llama-2
- Run Llama2 in your cloud privately
- SkyPilot: Run LLMs, AI, and Batch jobs on any cloud
- Chat with your documents using LocalGPT and SkyPilot
- Chat with your PDFs by self-hosting LocalGPT on any cloud
skyplane
- Moving cloud storage
-
UC Berkeley Launches SkyPilot to Help Navigate Soaring Cloud Costs
I'm one of the creators of Skyplane. Skyplane can migrate large datasets between cloud regions at 10s of Gbps while compressing data to reduce egress fees. Happy to chime in!
https://github.com/skyplane-project/skyplane
-
IaSQL and Skyplane: Open Source Projects to Boost Your AWS Deployments
Skyplane, is an open source tool developed at UC Berkeley to optimize the transfer of large datasets between cloud providers, reducing transfer times and costs. It creates an overlay network on top of the cloud providers so it can route around congested cloud network links.
-
Those using AWS, have you ever tried to use AWS Transfer Family to transfer files into an S3 bucket? Can I use python to make these uploads, and if so how do I set it up in aws?
In case you want to move very large data between clouds, I recommend taking a look at https://github.com/skyplane-project/skyplane/
- Skyplane: 110x faster data transfers on any cloud
What are some alternatives?
reflex - 🕸️ Web apps in pure Python 🐍
cloudpods - A cloud-native open-source unified multi-cloud and hybrid-cloud platform. 开源、云原生的多云管理及混合云融合平台
tiktoken - tiktoken is a fast BPE tokeniser for use with OpenAI's models.
prowler - Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, GXP, Well-Architected Security, ENS and more
bricks - Open-source natural language enrichments at your fingertips.
cloud-custodian - Rules engine for cloud security, cost optimization, and governance, DSL in yaml for policies to query, filter, and take actions on resources
min - A fast, minimal browser that protects your privacy
s5cmd - Parallel S3 and local filesystem execution tool.
pynimate - Python package for statistical data animations
docker-android - Android in docker solution with noVNC supported and video recording
spring-pulsar - Spring Friendly Abstractions for Apache Pulsar
cloud_sizes - Track the sizes of different cloud providers