sec-airflow-ingester

Use Airflow to pull in remote data via API, pub/sub, kinesis, s3 etc. and then store it in s3 for later consumption by other services. (by alias454)

Sec-airflow-ingester Alternatives

Similar projects and alternatives to sec-airflow-ingester based on common topics and language

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better sec-airflow-ingester alternative or higher similarity.

sec-airflow-ingester reviews and mentions

Posts with mentions or reviews of sec-airflow-ingester. We have used some of these posts to build our list of alternatives and similar projects.
  • Amazon Managed Workflows for Apache Airflow
    1 project | /r/ETL | 14 Mar 2022
    I've been using MWAA for a couple months now and so far, it has been decent for my use case. I'm pulling in remote security feeds and pushing data into s3 so it's a pretty simple workflow. In the event we outgrow the managed service or find some other reasons to migrate, we can do that pretty easily at that point. I also created a Terraform project to manage MWAA environments https://github.com/alias454/sec-airflow-ingester. Overall, using MWAA will cost a bit more but I haven't had to touch it other than trying to figure out what works and what doesn't when standing it up.
  • Sharing a new Terraform project for deploying Airflow in AWS using MWAA
    1 project | /r/Terraform | 14 Mar 2022
    I have been working with Airflow for the last month or two and created a Terraform deployment project for it. Sharing it here https://github.com/alias454/sec-airflow-ingester

Stats

Basic sec-airflow-ingester repo stats
2
12
0.0
about 2 years ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com