practical-data-engineering
faros-community-edition
| practical-data-engineering | faros-community-edition | |
|---|---|---|
| 4 | 19 | |
| 455 | 403 | |
| 6.2% | 1.7% | |
| 7.7 | 7.6 | |
| about 2 months ago | 7 days ago | |
| Jupyter Notebook | TypeScript | |
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
practical-data-engineering
- Show HN: Hands-On Data Engineering with a Real-Estate Project Guide
-
What's your favorite end-to-end tech stack?
Or in a side project: I combined an extensive amount of tools for web-scraping real-estates, uploading them to S3 with MinIO, Spark, and Delta Lake, adding some Data Science magic with Jupyter Notebooks, ingesting into Data Warehouse Apache Druid, visualizing dashboards with Superset and managing everything with Dagster (blog, github)
-
✨ 5 Open Source Data Engineering Projects 🔥
2️⃣ Building a Data Engineering Project in 20 Minutes
-
Building a Data Engineering Project in 20 Minutes
The source-code you can find on practical-data-engineering for the data pipeline or in data-engineering-devops with all it’s details to set things up. Although not all is finished, you can observe the current status of the project on real-estate-project.
faros-community-edition
- Show HN: Git and Jira analytics in under 10 minutes
- Show HN: Open-Source Metrics for GitHub, Gitlab, Jira, Bitbucket
-
Git + Jira Analytics in 10 minutes on your laptop
Open source code
- Show HN
- Show HN: Open-Source Engineering Metrics for GitHub, Gitlab and Jira
- Show HN: Open-Source Dora Metrics for GitHub, Gitlab and Jira
- Show HN: Open-Source EngOps Metrics for GitHub, Gitlab, Bitbucket and Jira
-
Making the case for the EngOps data fabric
Clearly, you shouldn’t be focusing on building such an EngOps data fabric. It is challenging to build and not your core business. This is what we build at Faros AI: the connected engineering operations platform. We want to unlock the power of all that EngOps data for your organization. You can check out our open-source version: https://github.com/faros-ai/faros-community-edition.
What are some alternatives?
ngods-stocks - New Generation Opensource Data Stack Demo
airbyte-connectors - Airbyte connectors (sources & destinations) + Airbyte CDK for JavaScript/TypeScript
open-data-stack - Open Data Stack Projects: Examples of End to End Data Engineering Projects
data-engineering-devops - Full stack data engineering tools and infrastructure set-up
PANDAS-TUTORIAL - Jupyter Notebooks and Data Sets for Pandas Library
SpaceEye - Live geostationary weather satellite imagery for your desktop background
fragments - Transform and compose data for HTTP transactions.
Data-Engineering-Projects - Personal Data Engineering Projects
superset - Apache Superset is a Data Visualization and Data Exploration Platform
HashtagCashtag - My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - Apache Kafka for data ingestions, Apache Spark & Spark Streaming for batch & real-time processing, Apache Cassandra f or storage, Flask, Bootstrap and HighCharts f or frontend.
Grafana - The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.