data_engineering_on_gcp_book
scraper
Our great sponsors
data_engineering_on_gcp_book | scraper | |
---|---|---|
12 | 3 | |
116 | 445 | |
- | - | |
2.6 | 0.0 | |
about 3 years ago | over 2 years ago | |
Go | ||
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data_engineering_on_gcp_book
-
What is your “I don't care if this succeeds” project?
A book for setting up data engineering infrastructure on GCP: https://github.com/Nunie123/data_engineering_on_gcp_book
It's almost done, and I do plan to spend a little effort promoting it when it's complete, but it's been a great focus for me even if no one ever reads it.
I use a fair bit of infrastructure at my job that was set up by others. It was nice to go through the practice of setting it up myself.
I learned a good bit, but also it's nice to have all this knowledge written down in a place not owned by the company I work for. If I use GCP at future jobs I'm sure I'll reference this book myself.
scraper
-
Is there a scraper in existence that uses file hashes instead of file names?
Thanks, I'm reading the source code now. It looks like the hash comparison is done against OpenVGDB, but I'm also curious how the images are fetched. Would you happen to know this by chance?
What are some alternatives?
playwright-python - Python version of the Playwright testing and automation library.
pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)
vopono - Run applications through VPN tunnels with temporary network namespaces
Scrapy - Scrapy, a fast high-level web crawling & scraping framework for Python.
Arthur - How to build your own AI art installation from scratch [Moved to: https://github.com/maxvfischer/DIY-ai-art]
VimMode.spoon - Adds vim keybindings to all OS X inputs
OpenVGDB - OpenVGDB
exomind - A personal knowledge management tool hosted on your own personal cloud
go-plugin - Golang plugin system over RPC.
Yue - A library for creating native cross-platform GUI apps
listudy - Listudy - chess training server
shotcaller - A moddable RTS/MOBA game made with bracket-lib and minigene.