aws-data-wrangler
demo-code
| aws-data-wrangler | demo-code | |
|---|---|---|
| 1 | 2 | |
| 3,559 | 28 | |
| - | - | |
| 10.0 | 0.0 | |
| 9 months ago | 3 months ago | |
| Python | Jupyter Notebook | |
| Apache License 2.0 | Creative Commons Zero v1.0 Universal |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aws-data-wrangler
-
Interacting with Amazon S3 using AWS Data Wrangler (awswrangler) SDK for Pandas: A Comprehensive Guide
AWS Data Wrangler GitHub Repository: https://github.com/awslabs/aws-data-wrangler
demo-code
-
Difference between databricks and EMR +jupyper?
Sounds good - the setup steps are still a bit manual since it’s in preview, but CloudFormation support was just released and I’ll be posting a template in my demo-code repo next week.
-
Lessons From Building a Highly Reproducible Data Warehouse
Pretty nice article! I've been experimenting lately with using AWS CDK to deploy a big data stack including EMR on EKS and Airflow. The code is available on my GitHub - dacort/demo-code and I also just recorded a video stepping through how it's all put together.
What are some alternatives?
boto3 - AWS SDK for Python
quilt - Quilt is a data mesh for connecting people with actionable data
Trapheus - This tool automates restoration of RDS database instances from snapshots into any dev, staging or production environments. It supports individual RDS Snapshot as well as cluster snapshot restore operations.
pyspark-on-aws-emr - The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on writing pyspark code.
Pandas - Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more
amazon-emr-with-delta-lake - Amazon EMR Notebook to show how to read from and write to Delta tables with Amazon EMR
ray_snowflake - Ray Data Connector for Snowflake
AWS Data Wrangler - pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).
aws-simple-websocket - Using AWS's API Gateway + Lambda to run a simple websocket application. For learning/testing.
cc-notebooks - Various Jupyter notebooks about Common Crawl data
dagster-example-pipeline - Template Dagster repo using poetry and a single Docker container; works well with CICD
reactivesearch - Search UI components for React and Vue