dlt
ingestr
dlt | ingestr | |
---|---|---|
6 | 4 | |
1,758 | 2,336 | |
9.0% | 5.3% | |
9.9 | 9.0 | |
5 days ago | 19 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dlt
-
Ask HN: Freelancer? Seeking freelancer? (December 2023)
SEEKING FREELANCER | REMOTE | GERMANY
dltHub is looking for a freelance help in the following repos:
- https://github.com/dlt-hub/dlt
-
Show HN: Data load tool(dlt)-Python library to automate the creation of datasets
You can use pydantic models to define schemas, validate data (we also load instances of the models natively): https://dlthub.com/docs/general-usage/resource#define-a-sche...
We have a PR (https://github.com/dlt-hub/dlt/pull/594) that is about to merge that makes the above highly configurable, between evolution and hard stopping:
- Data load tool (dlt) – open-source Python library that makes data loading easy
-
[Discussion] How to implement Data Contracts generically? Seeking advice from data contract users.
customize pipeline with hooks
- Which ETL/ELT tools do you think have future in data engineering space?
ingestr
- FLaNK 04 March 2024
- Show HN: I built an open-source data copy tool called ingestr
- Ingestr: CLI tool to copy data between any databases with a single command
-
The Pains of Data Ingestion
🌟 Give it a look and give us a star on GitHub! We’d love to hear your feedback and feel free to join our Slack community here.
What are some alternatives?
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
sling-cli - Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.
Proxmox-load-balancer - Designed to constantly maintain the Proxmox cluster in balance
AndroidTacticalAssaultKit-CIV
grablinks - A simple and streamlined Python script to extract and filter links from a remote HTML resource.
library - 70+ CLI tools to build, browse, and blend your media library. An index for your archive.
Udacity-Data-Engineering-Projects - Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
FXGL - Java / JavaFX / Kotlin Game Library (Engine)
data-engineering-zoomcamp - Free Data Engineering course!
sdxl-koala - Compressing SDXL via knowledge-distillation
DXY-COVID-19-Data - 2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
PyRIT - The Python Risk Identification Tool for generative AI (PyRIT) is an open access automation framework to empower security professionals and machine learning engineers to proactively find risks in their generative AI systems.