grablinks
dlt
| grablinks | dlt | |
|---|---|---|
| 2 | 6 | |
| 23 | 1,792 | |
| - | 9.0% | |
| 3.9 | 9.9 | |
| 6 months ago | about 7 hours ago | |
| Python | Python | |
| GNU General Public License v3.0 only | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
grablinks
-
How can I scrape every .sensorpanel attachment from this thread?
You can grab my grablinks.py Python3 script from here: https://github.com/the-real-tokai/grablinks
- Looking for a Python (or R) program or package to save only images from any plain vanilla website
dlt
-
Ask HN: Freelancer? Seeking freelancer? (December 2023)
SEEKING FREELANCER | REMOTE | GERMANY
dltHub is looking for a freelance help in the following repos:
- https://github.com/dlt-hub/dlt
-
Show HN: Data load tool(dlt)-Python library to automate the creation of datasets
You can use pydantic models to define schemas, validate data (we also load instances of the models natively): https://dlthub.com/docs/general-usage/resource#define-a-sche...
We have a PR (https://github.com/dlt-hub/dlt/pull/594) that is about to merge that makes the above highly configurable, between evolution and hard stopping:
- Data load tool (dlt) – open-source Python library that makes data loading easy
-
[Discussion] How to implement Data Contracts generically? Seeking advice from data contract users.
customize pipeline with hooks
- Which ETL/ELT tools do you think have future in data engineering space?
What are some alternatives?
open-mcr - :pencil: Exam bubble sheet scorer. Created with OpenCV and Python.
airbyte - The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
NewPipePlaylistExtractor - Download your NewPipe created playlists as mp3, wav or other codec and listen to it offline.
Proxmox-load-balancer - Designed to constantly maintain the Proxmox cluster in balance
oorlu-cli - Simple URL shortener CLI written in Python using https://oor.lu API
Udacity-Data-Engineering-Projects - Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
pdf2doi - A python library/command-line tool to extract the DOI or other identifiers of a scientific paper from a pdf file.
data-engineering-zoomcamp - Free Data Engineering course!
Scrapy - Scrapy, a fast high-level web crawling & scraping framework for Python.
DXY-COVID-19-Data - 2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
versatile-data-kit - One framework to develop, deploy and operate data workflows with Python and SQL.
Spooq