-
dude
dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
But for documentation, I use mkdocs-material as it can easily be used with minor customization and changes can be easily deployed in Github: https://roniemartinez.github.io/dude/
great suggestions in this thread. i also recommend performance testing your codebase. these include techniques such as: - creating micro performance benchmarks - using [cProfile] (and learning how to plot / read flame graphs) - memory profiling (e.g. via memray)
Related posts
-
Scrapy: A Fast and Powerful Scraping and Web Crawling Framework
-
Implementing case sensitive headers in Scrapy (not through `_caseMappings`)
-
Dicas para projetos usando web scraping
-
Best tools to use for web scraping ??
-
I'm using python to scrape web page content and extract keywords, how can I make it faster to process?