data_engineering_on_gcp_book
vopono
Our great sponsors
data_engineering_on_gcp_book | vopono | |
---|---|---|
12 | 34 | |
116 | 755 | |
- | - | |
2.6 | 7.5 | |
about 3 years ago | 13 days ago | |
Rust | ||
- | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data_engineering_on_gcp_book
-
How possible is it for a beginner to establish pipelines, data warehouse, and visualization solution as a team of 1?
This book will walk you through setting up a complete data engineering stack on GCP: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Python & SQL knowledge needed for ETL?
As for resources, this book goes over a lot of these: https://github.com/Nunie123/data_engineering_on_gcp_book. However, this goes over the 'how', not the 'why'. The only method I know for understanding the 'why' is experience. Whether at work or personal projects.
-
Learning Python and SQL: What should be my next step?
Here's a good book to follow along to introduce you to common tooling and design patterns: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Github Repo with All Data tranformation,Cleaning,Validation
I'm not sure if this is exactly what you're looking for, but here's a book on GitHub that talks about the tools and steps for building data pipelines into a data warehouse: https://github.com/Nunie123/data_engineering_on_gcp_book
-
What is the low hanging fruit for a brand new GCP data engineer to learn?
Check out this book: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Unsure about overall process of data engineering
If you're interested in example of how to build a complete data engineering infrastructure, you should check out this book: https://github.com/Nunie123/data_engineering_on_gcp_book
-
[HELP] Airflow Reverse proxy + load balancer +docker
If you want to try Airflow without the setup headache, you can try Composer on GCP, which is a hosted version of Airflow. I wrote some info on how to do that here: https://github.com/Nunie123/data_engineering_on_gcp_book/blob/master/ch_2_orchestration.md
-
Transition from a Quality engineer to Data engineer
This book might be a good resource for you: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Accepted a data engineer intern role at a Big N company - how do I learn as much as possible?
If you want a place to start on personal projects you can check out this book, https://github.com/Nunie123/data_engineering_on_gcp_book, which will walk you through the basics of setting up a full data engineering stack.
-
What tools, software, programming languages, and etc. does a data engineer need to have in 2021
If you are interested in tooling, here's a free book on setting up a basic data engineering tech stack on GCP: https://github.com/Nunie123/data_engineering_on_gcp_book
vopono
-
Ask HN: What are some unpopular technologies you wish people knew more about?
Vopono (https://github.com/jamesmcm/vopono):
"vopono is a tool to run applications through VPN tunnels via temporary network namespaces. This allows you to run only a handful of applications through different VPNs simultaneously, whilst keeping your main connection as normal.
vopono includes built-in killswitches for both Wireguard and OpenVPN."
-
Split-tunnelling on Linux for League of Legends
I think for now on Linux you (still!) have to use external application to do the splitting. Such is vopono
- Using linuxserver/wireguard container. How to set up Wireguard to connect to one of the servers at random?
-
Average not Southern Europe moment
I use vopono to manage it for me with Mullvad though.
-
The Mullvad Browser
you might want to check out vopono, i've gotten it working with firefox and its nice
https://github.com/jamesmcm/vopono
-
Me after renewing Mullvad monthly just so I can keep my low powered computer seeding while I'm at work
I highly recommend using something like vopono with this on Linux that runs only the target application (e.g. Transmission) in a network namespace in the VPN and only forwards the specified ports and only allows traffic via the VPN.
-
More than a decade of doing this and I finally get a letter...
This is why I use vopono - you can run just the torrent client in the VPN on its own and the killswitch keeps it safe.
-
How to get around website blocks?
You can find the option in the settings of windows and android apps. Unfortunately, it's Still not available for Linux. As a workaround for Linux, you can use vopono, which has OpenVPN support for Proton. Or just manually add routing table entries :)
- Vpn with plex
-
Your favourite Rust CLI utilities this year?
I wrote vopono, I use it all the time for quickly spinning up browsers through different VPNs for checking geographical restrictions, etc.
What are some alternatives?
shotcaller - A moddable RTS/MOBA game made with bracket-lib and minigene.
VimMode.spoon - Adds vim keybindings to all OS X inputs
FactGraph - FactGraph monorepo (backend + frontend + landing page + blog)
SDRPlusPlus - Cross-Platform SDR Software
beubo - Beubo is a free, simple, and minimal CMS with unlimited extensibility using plugins
scraper - Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
distribyted - Torrent client with HTTP, fuse, and WebDAV interfaces. Start exploring your torrent files right away, even zip, rar, or 7zip archive contents!
manim - A community-maintained Python framework for creating mathematical animations.
go-plugin - Golang plugin system over RPC.
Arthur - How to build your own AI art installation from scratch [Moved to: https://github.com/maxvfischer/DIY-ai-art]
dali - Indie assembler/linker for Dalvik VM .dex & .apk files (Work In Progress)
scraper - A scraper for EmulationStation written in Go using hashing