finnhub-streaming-data-pipeline
reddit-streaming-pipeline
finnhub-streaming-data-pipeline | reddit-streaming-pipeline | |
---|---|---|
2 | 1 | |
250 | 81 | |
- | - | |
5.6 | 6.7 | |
6 months ago | 9 months ago | |
HCL | HCL | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
finnhub-streaming-data-pipeline
-
Reddit Sentiment Analysis Real-Time* Data Pipeline
I didn't use any specific guide. It was mostly build, test, integrate and repeat for each component. For some of them, I went through official documentation on getting started with each application and implemented it in the cluster. However, I reckon you can find other tutorials to setup each application by itself. A few github projects helped me in planning the project architecture and codebase structure like https://github.com/RSKriegs/finnhub-streaming-data-pipeline and https://gitlab.fit.cvut.cz/kozlovit/ni-dip-project-kozlovit.
- Where can I find online projects end-to-end?
reddit-streaming-pipeline
-
Reddit Sentiment Analysis Real-Time* Data Pipeline
Github link: https://github.com/nama1arpit/reddit-streaming-pipeline
What are some alternatives?
Reddit-API-Pipeline
quickstart - Quickstarts to provision Kubernetes with Otomi
streamify - A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
terraform-aws-observability-accelerator - Open source project to help accelerate and ease observability setup on AWS environments
surf_dash
platform - All Saleor services started from a single repository with Ansible, Terraform, and Kubernetes.
data-engineering-zoomcamp - Free Data Engineering course!
world_cup_twitter_sentiment - Measuring sentiment of World Cup matches using Tinybird and the Twitter API v2
audiophile-e2e-pipeline - Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.
terraform-aws-eks - Terraform module to create AWS Elastic Kubernetes (EKS) resources πΊπ¦