The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Makefile etl-framework Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: Why do companies still build data ingestion tooling instead of using a third-party tool like Airbyte? | /r/dataengineering | 2023-12-06Coincidently, I saw a presentation today on a nice half-way-house solution: using embeddable Python libraries like Sling and dlt - both open-source. See https://www.youtube.com/watch?v=gAqOLgG2iYY There is also singer.io which is more of a protocol than a library, but can also be installed although it looks like it is a true community effort and not so well maintained.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Makefile etl-framework related posts
- Why do companies still build data ingestion tooling instead of using a third-party tool like Airbyte?
- Data sources episode 2: AWS S3 to Postgres Data Sync using Singer
- Design patter for Python ETL
- Basic data engineering question.
- I have hundreds of API data endpoints with different schemas. How do I organize?
- CDC (Change Data Capture) with 3rd party APIs
- Questions about Integration Singer Specification with AWS Glue
-
A note from our sponsor - WorkOS
workos.com | 27 Apr 2024
Index
Project | Stars | |
---|---|---|
1 | getting-started | 1,220 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com