apache-spark-docker
docker-hadoop
apache-spark-docker | docker-hadoop | |
---|---|---|
1 | 4 | |
40 | 2,118 | |
- | 1.1% | |
0.0 | 0.0 | |
almost 2 years ago | 3 months ago | |
VBA | Shell | |
Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
apache-spark-docker
-
Data Engineering Projects for Beginners
Learn how to dockerize an Apache Spark Standalone Cluster
docker-hadoop
-
Install Hadoop for Beginner
You can use docker images or get a Cloudera QuickStart VM
-
Hadoop on M1 Mac?
git clone https://github.com/big-data-europe/docker-hadoop.git cd docker-hadoop docker-compose up
-
An Overview of Lambda Architecture
Heroku serves well as a container-based cloud platform-as-a-service (PaaS), allowing you to deploy and scale your applications with ease. For the batch layer, you would likely deploy a docker container for Apache Hadoop. As the speed layer, you might consider deploying Apache Storm or Apache Spark. Lastly, for the serving layer, you could deploy docker containers for Apache Cassandra or MongoDB, coupled with indexing and querying by Elasticsearch.
-
Run Python MapReduce on local Docker Hadoop Cluster
We will use the Docker image by big-data-europe repository to set up Hadoop.
What are some alternatives?
docker-livy - Dockerizing and Consuming an Apache Livy environment
Docker-OSX - Run macOS VM in a Docker! Run near native OSX-KVM in Docker! X11 Forwarding! CI/CD for OS X Security Research! Docker mac Containers.
Dropout-Students-Prediction - The goal of this project is to identify students at risk of dropping out the school
winutils - winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows
uber-expenses-tracking - The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
winutils - Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)
recommendation-system - Build a Content-Based Movie Recommender System (TF-IDF, BM25, BERT)
NiFItoKafkaConnect - NiFi -> Kafka Connect -> HDFS
text-analysis-speeches-amlo - Text analysis of the speeches, conferences and interviews of the current president of Mexico
awesome-kubernetes - A curated list for awesome kubernetes sources :ship::tada:
Dokku - A docker-powered PaaS that helps you build and manage the lifecycle of applications