Web-scraping without much Python knowledge

This page summarizes the projects mentioned and recommended in the original post on /r/learnpython
Web Crawling Python Scraping Crawling Framework

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • Scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    • The scrapy framework would be a good fit for what you want to do (especially if you plan on hosting the crawler), however the learning curve is quite steep, especially if you don't have much experience using python.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Scrapy: A Fast and Powerful Scraping and Web Crawling Framework

    1 project | news.ycombinator.com | 16 Feb 2024

  • Implementing case sensitive headers in Scrapy (not through `_caseMappings`)

    4 projects | /r/scrapy | 3 Jul 2023

  • Dicas para projetos usando web scraping

    1 project | /r/brdev | 27 Jun 2023

  • Best tools to use for web scraping ??

    1 project | /r/learnpython | 25 Jun 2023

  • I'm using python to scrape web page content and extract keywords, how can I make it faster to process?

    1 project | /r/datascience | 10 Jun 2023