Python Bigquery

Open-source Python projects categorized as Bigquery | Edit details

Top 8 Python Bigquery Projects

  • GitHub repo Redash

    Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

    Project mention: How often do you use SQL query tool or service in your daily work? | reddit.com/r/SQL | 2021-11-21

    Regarding the subqueries: try https://tablum.io or https://redash.io, they materialize queried data so you can do a subquery multiple times.

  • GitHub repo professional-services

    Common solutions and tools developed by Google Cloud's Professional Services team

    Project mention: Best way to trigger an archive function | reddit.com/r/googlecloud | 2021-06-28

    Are you downloading the file from a bucket and reuploading it to another? You can just copy it as a metadata operation. See an example here: https://github.com/GoogleCloudPlatform/professional-services/pull/663

  • Nanos

    Run Linux Software Faster and Safer than Linux with Unikernels.

  • GitHub repo ethereum-etl

    Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, transfers, receipts, logs, contracts, internal transactions. Data is available in Google BigQuery https://goo.gl/oY5BCQ

    Project mention: Trying To Recover Old ETH | reddit.com/r/ethereum | 2021-01-01

    You can use https://github.com/blockchain-etl/ethereum-etl

  • GitHub repo BigQuery-Python

    Simple Python client for interacting with Google BigQuery.

    Project mention: How To Access And Query Your Google BigQuery Data Using Python And R | dev.to | 2021-09-16

    To query your Google BigQuery data using Python, we need to connect the Python client to our BigQuery instance. We do so using a cloud client library for the Google BigQuery API. You can also choose to use any other third-party option to connect BigQuery with Python; the BigQuery-Python library by tylertreat is also a great option.

  • GitHub repo elementary-lineage

    Elementary is an open-source data observability framework for modern data teams, starting with data lineage.

    Project mention: Launch HN: Metaplane (YC W20) – Datadog for Data | news.ycombinator.com | 2021-11-15

    I recently stumbled on an open-source tool with a similar premise: https://github.com/elementary-data/elementary-lineage

    you can check it out

  • GitHub repo CueObserve

    Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases

    Project mention: [Project] Open-source Anomaly detection on SQL data | reddit.com/r/MachineLearning | 2021-07-27

    We are building CueObserve, an open source repo to run anomaly detection on data in your SQL data warehouses and databases. It currently supports BigQuery, RedShift, Snowflake, Postgres, MySQL and Druid. It is available at github.com/cuebook/cueobserve.

  • GitHub repo bigquery_fdw

    BigQuery Foreign Data Wrapper for PostgreSQL

    Project mention: Is using pandas considered terrible practice in ELT? | reddit.com/r/dataengineering | 2021-10-17

    You can also take a look at this repo: https://github.com/gabfl/bigquery_fdw/blob/main/src/bqclient.py if not for the FDW, then at least to the python bit that reads data, though I'm not sure how well it goes through large datasets.

  • Scout APM

    Scout APM: A developer's best friend. Try free for 14-days. Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

  • GitHub repo iris3

    An upgraded and improved version of the Iris automatic GCP-labeling project

    Project mention: Simplify Google Cloud resources for manageability and easier billing reporting | reddit.com/r/googlecloud | 2021-04-22

    Iris3 can help you to simplify management and billing reporting for Google Cloud resources. With Iris3, each resource in a Google Cloud Platform Organization will get automatically generated labels with a key like iris_zone (the prefix is configurable) and the relevant value. For example, a Google Compute Engine instance would get labels like [iris_name:nginx], [iris_region:us-central1] and [iris_zone:us-central1-a].

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2021-11-21.

Python Bigquery related posts

Index

What are some of the best open-source Bigquery projects in Python? This list will help you:

Project Stars
1 Redash 19,987
2 professional-services 1,899
3 ethereum-etl 1,325
4 BigQuery-Python 411
5 elementary-lineage 170
6 CueObserve 126
7 bigquery_fdw 61
8 iris3 23
Find remote jobs at our new job board 99remotejobs.com. There are 34 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com