Our great sponsors
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
I'd use an asynchronous programming package like grequests or Scrapy. Basically, store all the links you want to visit in a list then prepare them, send the requests, and then iterate over the content of the response. If the website needs JavaScript to then you can use requests-html with AsyncHTMLSession to render the JavaScript. ``` import grequests
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a more popular project.