|8 months ago||about 1 month ago|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Inspecting joins in PostgreSQL
2 projects | dev.to | 11 Jan 2022
Create a folder still in the root folder of your C: drive named Hadoop. Then, click this repository link, identify the bin folder of your Spark installation Hadoop version, and download the winutils.exe file.
Free Spark dev environment on Local?
2 projects | reddit.com/r/dataengineering | 20 Aug 2021
Contain links to outdated winutils builds. There should be newer builds here.
Getting Started with the latest version of Apache Spark using Python and Scala in your local PC using Intellij , Windows, Mac , Linux Databricks and Apache Zeppelin.
1 project | reddit.com/r/Stream2Learn | 8 Jul 2021
Install Hadoop for Beginner
1 project | reddit.com/r/dataengineering | 7 Nov 2021
You can use docker images or get a Cloudera QuickStart VM
Hadoop on M1 Mac?
1 project | reddit.com/r/dataengineering | 26 Apr 2021
git clone https://github.com/big-data-europe/docker-hadoop.git cd docker-hadoop docker-compose up
An Overview of Lambda Architecture
1 project | dev.to | 23 Feb 2021
Heroku serves well as a container-based cloud platform-as-a-service (PaaS), allowing you to deploy and scale your applications with ease. For the batch layer, you would likely deploy a docker container for Apache Hadoop. As the speed layer, you might consider deploying Apache Storm or Apache Spark. Lastly, for the serving layer, you could deploy docker containers for Apache Cassandra or MongoDB, coupled with indexing and querying by Elasticsearch.
Run Python MapReduce on local Docker Hadoop Cluster
1 project | dev.to | 5 Oct 2020
We will use the Docker image by big-data-europe repository to set up Hadoop.
What are some alternatives?
Docker-OSX - Run macOS VM in a Docker! Run near native OSX-KVM in Docker! X11 Forwarding! CI/CD for OS X Security Research! Docker mac Containers.
pkg - Package your Node.js project into an executable
NiFItoKafkaConnect - NiFi -> Kafka Connect -> HDFS
Greenplum - Greenplum Database - Massively Parallel PostgreSQL for Analytics. An open-source massively parallel data platform for analytics, machine learning and AI.
awesome-kubernetes - A curated list for awesome kubernetes sources :ship::tada:
Dokku - A docker-powered PaaS that helps you build and manage the lifecycle of applications
winutils - Windows binaries for Hadoop versions (built from the git commit ID used for the ASF relase)
awesome-cli-binaries - Popular Linux x86_64 CLI app binaries