How-to-Guide: Contributing to Open Source

• awesome-for-beginners

  20 59,369 4.5

  A list of awesome beginners-friendly projects.

  Here is a list of open source projects that are said to be awesome for beginners.

• Apache Spark

  25 37,352 9.9 Scala

  Apache Spark - A unified analytics engine for large-scale data processing

  

  Apache Spark

• InfluxDB

  www.influxdata.com

  sponsored

  Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  

• missing-semester

  114 4,476 0.0 CSS

  The Missing Semester of Your CS Education 📚

  

  If you’re still new to development in general and not that comfortable with development tools (using an IDE, the terminal, etc.) check out this link: the missing semester in your CS education. It covers the more practical sides of coding that aren’t taught in university courses. Learn this along the way.

• Airflow

  32 32,645 10.0 Python

  Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

  

  Apache Airflow

• dbt-core

  18 7,882 9.0 Python

  dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

  

  dbt Core

• Apache Parquet

  0 2,240 8.9 Java

  Apache Parquet

  

  Apache Parquet

• Apache Avro

  6 2,645 9.0 Java

  Apache Avro is a data serialization system.

  

  Apache Avro

• Onboard AI

  getonboard.dev

  sponsored

  Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  

• sqlfluff

  10 6,845 9.5 Python

  A modular SQL linter and auto-formatter with support for multiple dialects and templated code.

  

  SQLFluff

• Apache Arrow

  18 12,852 9.9 C++

  Apache Arrow is a multi-language toolbox for accelerated data interchange and in-memory processing

  

  Apache Arrow

• Apache Cassandra

  3 8,306 9.4 Java

  Mirror of Apache Cassandra

  

  Apache Cassandra

• Apache Hadoop

  7 14,026 9.6 Java

  Apache Hadoop

  

  Apache Hadoop

• Apache Kafka

  4 26,347 9.8 Java

  Mirror of Apache Kafka

  

  Apache Kafka

• delta

  22 6,552 9.5 HTML

  An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs (by delta-io)

  

  Delta Lake

• pinot

  3 4,906 9.8 Java

  Apache Pinot - A realtime distributed OLAP datastore

  

  Apache Pinot

• nifi

  14 4,100 0.0 Java

  Apache NiFi

  

  Apache NiFi

• hudi

  4 4,669 7.9 Java

  Upserts, Deletes And Incremental Processing on Big Data.

  

  Apache Hudi

• versatile-data-kit

  7 378 9.7 Python

  One framework to develop, deploy and operate data workflows with Python and SQL.

  

• Trino

  12 8,934 10.0 Java

  Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

  

  Although Trino (formerly Presto) is in the awesome for beginners list, it’s also a really good DE project as it is a distributed query engine that connects to most of the projects listed above. So depending on where you work in this project you can gain a depth of knowledge on the query engine or breadth across all the connectors …or go hybrid .

• ploomber

  3 3,271 0.0 Python

  The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

  

  As our project grows, we've seen first-hand how difficult it is for others to contribute to open-source: from setting up the development environment, understanding the codebase, drafting a PR, etc. We've learned a lot from helping others successfully contribute to our project so we share our thoughts here in a blog post, don't hesitate to reach out if you need help! Happy to help you contribute to any of our projects or any other!

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Suggest a related project