data-engineer-roadmap
Apache Hive
Our great sponsors
data-engineer-roadmap | Apache Hive | |
---|---|---|
68 | 14 | |
11,939 | 5,326 | |
1.3% | 1.2% | |
0.0 | 9.6 | |
over 2 years ago | 3 days ago | |
Java | ||
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
data-engineer-roadmap
- Pitanje za data engineering?
-
How should I start learning/implementing DevOps in data engineering projects?
In DevOps tools I've worked with GitHub + Jenkins, GitLab + k8s, and I'm now primarily working in the Argo Stack. Depending on where you're at technically, you might use something different. IaC is a ust as well, maybe some config management. Generally I've found that as a Data Engineer with a lot of infra/CICD knowledge, I generally get pigeonholed into those positions on a team, so be prepared for that. I really like this roadmap for DevOps , so you can see where your tech skills are at currently, and what you may need to learn. On top of that, you'll need to learn some data tools. Airflow + dbt is hot right now, Argo is sometimes used in MLOps, Azure Data Stack (I'm not familiar with it) seems common, and probably Spark in almost all cases. You can also checkout in visualization tools probably further down the line, I generally stick to something free when learning on my own, Superset or Google Data Studio (Might be Looker Studio now? Not sure, it's been a while). Here's a roadmap for DE too. I love these roadmaps for getting started, but don't let them distract you from exploring a path more appropriate to what you want to achieve. Generally I've found that as a Data Enigneer with a lot of infra/CICD knowledge, I generally get pigeonholed into those positions on a team
- What is roadmap to enter into data engineering?
- Need help on Data Engineering Roadmap
-
Woman interested in data engineering with Python background
Anyways, sorry bit of a rant - I land somewhere in the middle. I would say take formal classes and resources when you can. If you have access to a free course a semester, that's incredible in my opinion. If I were in your shoes, I would follow a roadmap and see if there are courses that check off a box in that roadmap. So for example, you know you need to learn CS fundamentals - see if you can take a DSA class or something. Or take a class on databases. Or an OOP or databases class. I would take those classes if I had the opportunity just because I didn't when I was in college. No one course will check every box for sure.
- 1 Year Development Plan
- How to utilise SQL/Data engineering skills
-
Got my first DE role as a JR
I don't remember all of the name of the courses but I think this roadmap can put you in the right direction https://github.com/datastacktv/data-engineer-roadmap
- What things must I master as a data engineer?
-
What do you do professionally and how much do you earn?
You can follow this roadmap https://github.com/datastacktv/data-engineer-roadmap I have already replied some redditors with suggestions, you can read them.
Apache Hive
-
Apache Iceberg as storage for on-premise data store (cluster)
Trino or Hive for SQL querying. Get Trino/Hive to talk to Nessie.
-
In One Minute : Hadoop
Hive, A data warehouse infrastructure that provides data summarization and ad hoc querying.
- Visionary French entrepreneur, David Gurle, launches new venture – Hive
-
DeWitt Clause, or Can You Benchmark %DATABASE% and Get Away With It
Apache Drill, Druid, Flink, Hive, Kafka, Spark
-
Apache Spark, Hive, and Spring Boot — Testing Guide
In this article, I'm showing you how to create a Spring Boot app that loads data from Apache Hive via Apache Spark to the Aerospike Database. More than that, I'm giving you a recipe for writing integration tests for such scenarios that can be run either locally or during the CI pipeline execution. The code examples are taken from this repository.
- Apache Hive in the vein!
-
Jinja2 not formatting my text correctly. Any advice?
ListItem(name='Apache Hive', website='https://hive.apache.org/', category='Interactive Query', short_description='Apache Hive is a data warehouse software project built on top of Apache Hadoop for providing data query and analysis. Hive gives an SQL-like interface to query data stored in various databases and file systems that integrate with Hadoop.'),
-
Understanding SQL Dialects
Apache Hive takes in a specific SQL dialect and converts it to map-reduce.
-
The Data Engineer Roadmap 🗺
Apache Hive
-
Open Source SQL Parsers
Apache Calcite is a popular parser/optimizer that is used in popular databases and query engines like Apache Hive, BlazingSQL and many others.
What are some alternatives?
golang-developer-roadmap - Roadmap to becoming a Go developer in 2020
superset - Apache Superset is a Data Visualization and Data Exploration Platform
developer-roadmap - Interactive roadmaps, guides and other educational content to help developers grow in their careers.
ObjectBox Java (Kotlin, Android) - Java and Android Database - fast and lightweight without any ORM
Data-Science-Roadmap - Data Science Roadmap from A to Z
HikariCP - 光 HikariCP・A solid, high-performance, JDBC connection pool at last.
adventofcode - :christmas_tree: Advent of Code (2015-2023) in C#
Apache Phoenix - Apache Phoenix
materialize - The data warehouse for operational workloads.
Flyway - Flyway by Redgate • Database Migrations Made Easy.
Apache HBase - Apache HBase
Presto - The official home of the Presto distributed SQL query engine for big data