✨ 5 Open Source Data Engineering Projects 🔥

• HashtagCashtag

  1 424 10.0 Scala

  My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggregates Twitter and US stock market data for user sentiment analysis using open source tools - ​Apache Kafka ​for data ingestions, Apache Spark ​& ​Spark Streaming ​for batch & real-time processing, ​Apache Cassandra f​ or storage, ​Flask​, ​Bootstrap and ​HighCharts f​ or frontend.

1️⃣ HashtagCashtag

• PANDAS-TUTORIAL

  4 158 4.0 Jupyter Notebook

  Jupyter Notebooks and Data Sets for Pandas Library (by TirendazAcademy)

✨ Follow me Twitter | Instagram | YouTube| Tiktok | Medium for more content on data engineering.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• practical-data-engineering

  4 449 7.7 Jupyter Notebook

  Practical Data Engineering: A Hands-On Real-Estate Project Guide

  

2️⃣ Building a Data Engineering Project in 20 Minutes

• WebCrawlerForOnlineInflation

  1 169 10.0 Python

  Price Crawler - Tracking Price Inflation

4️⃣ Web Crawler For Online Inflation

• Data-Engineering-Projects

  2 637 10.0 Jupyter Notebook

  Personal Data Engineering Projects

5️⃣ Data Engineering Projects

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project