ethereum-etl
bigquery_fdw
Our great sponsors
ethereum-etl | bigquery_fdw | |
---|---|---|
3 | 2 | |
2,823 | 89 | |
1.6% | - | |
6.9 | 3.9 | |
18 days ago | 3 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ethereum-etl
-
Blockchain transactions decoding: making wallet activity understandable
Event is a log entity which EVM smart contracts can emit during transaction execution. Events are very good at signalling that an some action has taken place on-chain. Applications can subscribe and listen to events to trigger some off-chain logic or they can index, transform and store events in some off-chain storage (look at The Graph protocol or Ethereum ETL).
-
data engineering in web3
I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here
-
Trying To Recover Old ETH
You can use https://github.com/blockchain-etl/ethereum-etl
bigquery_fdw
-
Is using pandas considered terrible practice in ELT?
You can also take a look at this repo: https://github.com/gabfl/bigquery_fdw/blob/main/src/bqclient.py if not for the FDW, then at least to the python bit that reads data, though I'm not sure how well it goes through large datasets.
-
Good way to pull data from BQ to PostgreSQL?
Give this a try and report back, https://github.com/gabfl/bigquery_fdw
What are some alternatives?
CueObserve - Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
helium-etl-queries - A collection of SQL views used to enrich data produced by a Helium blockchain-etl
dopg_cli - ๐๐ณ๐ A python command line interface for DigitalOcean postgres clusters (5+ integrations).
rainbow_csv - ๐Rainbow CSV - Vim plugin: Highlight columns in CSV and TSV files and run queries in SQL-like language
firebird_fdw - A PostgreSQL foreign data wrapper (FDW) for Firebird - latest version 1.3.1 (2022-06-22)
NetXML-to-CSV - Convert .netxml file into CSV file
Redash - Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
dbd - dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
pgcli - Postgres CLI with autocompletion and syntax highlighting
spotty - Training deep learning models on AWS and GCP instances
gcptree - Like the unix tree command but for GCP Org Heirarchy