Web-scraping without much Python knowledge

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/learnpython

Our great sponsors
  • Scout APM - Less time debugging, more time building
  • JetBrains - Developer Ecosystem Survey 2022
  • SonarQube - Static code analysis for 29 languages.
  • Scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    The scrapy framework would be a good fit for what you want to do (especially if you plan on hosting the crawler), however the learning curve is quite steep, especially if you don't have much experience using python.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts