aws_lambda_reddit_api
Batch data processing project using data from the reddit api. (by PanzerFlow)
CoinCap-firehose-s3-DynamicPartitioning
AWS CDK project using typescript. Services: Lambda, Kinesis Firehose, Glue, Quicksight. (by TrygviZL)
| aws_lambda_reddit_api | CoinCap-firehose-s3-DynamicPartitioning | |
|---|---|---|
| 2 | 1 | |
| 0 | 0 | |
| - | - | |
| 4.2 | 10.0 | |
| about 2 years ago | over 2 years ago | |
| Python | TypeScript | |
| - | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
aws_lambda_reddit_api
Posts with mentions or reviews of aws_lambda_reddit_api.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-08.
-
What's the best tool to build pipelines from REST APIs?
I have a small project like this i done before. Which i am gonna shamelessly plug in lol. https://github.com/PanzerFlow/aws_lambda_reddit_api
- Is it worth me applying to Data Engineering roles with this Resume/CV?
CoinCap-firehose-s3-DynamicPartitioning
Posts with mentions or reviews of CoinCap-firehose-s3-DynamicPartitioning.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-10-08.
-
What's the best tool to build pipelines from REST APIs?
I agree with the Cron triggered Lambda approach. For inspiration I have a small project where a lambda pulls data from a public api and writes it to a firehose which buffers the data and writes it to s3. There is also a cron job on Glue which catalogues the data. https://github.com/TrygviZL/CoinCap-firehose-s3-DynamicPartitioning
What are some alternatives?
When comparing aws_lambda_reddit_api and CoinCap-firehose-s3-DynamicPartitioning you can also consider the following projects:
astro-sdk - Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
jq - Command-line JSON processor [Moved to: https://github.com/jqlang/jq]
memphis - Memphis.dev is a highly scalable and effortless data streaming platform
gnu-parallel - A clone of GNU Parallel (git://git.savannah.gnu.org/parallel.git)
Mage - 🧙 The modern replacement for Airflow. Mage is an open-source data pipeline tool for transforming and integrating data. https://github.com/mage-ai/mage-ai
aws_lambda_reddit_api vs astro-sdk
CoinCap-firehose-s3-DynamicPartitioning vs jq
aws_lambda_reddit_api vs memphis
CoinCap-firehose-s3-DynamicPartitioning vs gnu-parallel
aws_lambda_reddit_api vs gnu-parallel
CoinCap-firehose-s3-DynamicPartitioning vs Mage
CoinCap-firehose-s3-DynamicPartitioning vs astro-sdk