meal-scheduler
data_engineering_on_gcp_book
meal-scheduler | data_engineering_on_gcp_book | |
---|---|---|
3 | 12 | |
- | 116 | |
- | - | |
- | 2.6 | |
- | about 3 years ago | |
- | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
meal-scheduler
-
Ask HN: Do you use an optimization solver? Which one? Why? Do you like it?
I use Minizinc in a personal toy project (https://gitlab.com/dustin-space/meal-scheduler), and GECODE or Google's ortools solver at the backend. It's used for meal planning. Unfortunately it's way way slower than I'd hope. I suspect I just have the domain not modeled efficiently. Maybe if I had a few days to put into it, and learn how to properly debug the CSP solver step by step, it might help...
-
What is your “I don't care if this succeeds” project?
That sounds like a fun application, both the usage and the implementation.
I wonder if you have any interesting example data-files that could be used with the model, preferable both something small and something larger? Would be fun to test the model locally to see how it behaves.
Notes: I'm assuming here that https://gitlab.com/dustin-space/meal-scheduler/-/blob/master... is the model used.
data_engineering_on_gcp_book
-
How possible is it for a beginner to establish pipelines, data warehouse, and visualization solution as a team of 1?
This book will walk you through setting up a complete data engineering stack on GCP: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Python & SQL knowledge needed for ETL?
As for resources, this book goes over a lot of these: https://github.com/Nunie123/data_engineering_on_gcp_book. However, this goes over the 'how', not the 'why'. The only method I know for understanding the 'why' is experience. Whether at work or personal projects.
-
Learning Python and SQL: What should be my next step?
Here's a good book to follow along to introduce you to common tooling and design patterns: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Github Repo with All Data tranformation,Cleaning,Validation
I'm not sure if this is exactly what you're looking for, but here's a book on GitHub that talks about the tools and steps for building data pipelines into a data warehouse: https://github.com/Nunie123/data_engineering_on_gcp_book
-
What is the low hanging fruit for a brand new GCP data engineer to learn?
Check out this book: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Unsure about overall process of data engineering
If you're interested in example of how to build a complete data engineering infrastructure, you should check out this book: https://github.com/Nunie123/data_engineering_on_gcp_book
-
[HELP] Airflow Reverse proxy + load balancer +docker
If you want to try Airflow without the setup headache, you can try Composer on GCP, which is a hosted version of Airflow. I wrote some info on how to do that here: https://github.com/Nunie123/data_engineering_on_gcp_book/blob/master/ch_2_orchestration.md
-
Transition from a Quality engineer to Data engineer
This book might be a good resource for you: https://github.com/Nunie123/data_engineering_on_gcp_book
-
Accepted a data engineer intern role at a Big N company - how do I learn as much as possible?
If you want a place to start on personal projects you can check out this book, https://github.com/Nunie123/data_engineering_on_gcp_book, which will walk you through the basics of setting up a full data engineering stack.
-
What tools, software, programming languages, and etc. does a data engineer need to have in 2021
If you are interested in tooling, here's a free book on setting up a basic data engineering tech stack on GCP: https://github.com/Nunie123/data_engineering_on_gcp_book
What are some alternatives?
HiGHS - Linear optimization software
shotcaller - A moddable RTS/MOBA game made with bracket-lib and minigene.
ppp_thing - A poorly written, minimum viable PPPoE client with session handoff between redundant FreeBSD routers
FactGraph - FactGraph monorepo (backend + frontend + landing page + blog)
electron-browser-shell - A minimal, tabbed web browser with support for Chrome extensions—built on Electron.
beubo - Beubo is a free, simple, and minimal CMS with unlimited extensibility using plugins
listudy - Listudy - chess training server
distribyted - Torrent client with HTTP, fuse, and WebDAV interfaces. Start exploring your torrent files right away, even zip, rar, or 7zip archive contents!
Arthur - How to build your own AI art installation from scratch [Moved to: https://github.com/maxvfischer/DIY-ai-art]
go-plugin - Golang plugin system over RPC.
singyeong - 신경 - Cloud-native messaging/pubsub with powerful routing
dali - Indie assembler/linker for Dalvik VM .dex & .apk files (Work In Progress)