bigquery_fdw
ethereum-etl
bigquery_fdw | ethereum-etl | |
---|---|---|
2 | 3 | |
89 | 2,834 | |
- | 1.0% | |
3.9 | 6.9 | |
3 months ago | about 1 month ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bigquery_fdw
-
Is using pandas considered terrible practice in ELT?
You can also take a look at this repo: https://github.com/gabfl/bigquery_fdw/blob/main/src/bqclient.py if not for the FDW, then at least to the python bit that reads data, though I'm not sure how well it goes through large datasets.
-
Good way to pull data from BQ to PostgreSQL?
Give this a try and report back, https://github.com/gabfl/bigquery_fdw
ethereum-etl
-
Blockchain transactions decoding: making wallet activity understandable
Event is a log entity which EVM smart contracts can emit during transaction execution. Events are very good at signalling that an some action has taken place on-chain. Applications can subscribe and listen to events to trigger some off-chain logic or they can index, transform and store events in some off-chain storage (look at The Graph protocol or Ethereum ETL).
-
data engineering in web3
I'm surprised this is the only good response in this thread so far. Blockchain data is completely open but requires some organization in order to perform analytics. Nansen for example is a product that is built on top of ethereum-etl which you can checkout here
-
Trying To Recover Old ETH
You can use https://github.com/blockchain-etl/ethereum-etl
What are some alternatives?
CueObserve - Timeseries Anomaly detection and Root Cause Analysis on data in SQL data warehouses and databases
dopg_cli - ๐๐ณ๐ A python command line interface for DigitalOcean postgres clusters (5+ integrations).
helium-etl-queries - A collection of SQL views used to enrich data produced by a Helium blockchain-etl
firebird_fdw - A PostgreSQL foreign data wrapper (FDW) for Firebird - latest version 1.3.1 (2023-06-22)
rainbow_csv - ๐Rainbow CSV - Vim plugin: Highlight columns in CSV and TSV files and run queries in SQL-like language
Redash - Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
NetXML-to-CSV - Convert .netxml file into CSV file
pgcli - Postgres CLI with autocompletion and syntax highlighting
dbd - dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.
spotty - Training deep learning models on AWS and GCP instances
gcptree - Like the unix tree command but for GCP Org Heirarchy