Is python a good language to automate interaction with web pages?

This page summarizes the projects mentioned and recommended in the original post on /r/learnpython

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • geckodriver

    WebDriver for Firefox

  • Yeah, check out selenium. You'll have to install it (with pip) AND download the accompanying webdriver for your browser (e.g. chromedriver for chrome, geckodriver for firefox, etc..). This can be combined with tools like BeautifulSoup (from bs4) for great effect.

  • keychron_availability_monitor

    keychron_availability_monitor

  • I was able to buy a Keychron Keyboard by using Python. If you want to have a look at the code I wrote - https://github.com/eupendra/keychron_availability_monitor

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • webscrape-dotnet

  • By the way, you can also use JavaScript (Puppeteer/Axios+Cheerio), or C# (HtmlAgilityPack), Java(Jsoup/HTMLUnit), and many other programming languages but Python is the most flexible one.

  • Scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

  • I am not a beginner and prefer Scrapy over BeautifulSoup.

  • By the way, you can also use JavaScript (Puppeteer/Axios+Cheerio), or C# (HtmlAgilityPack), Java(Jsoup/HTMLUnit), and many other programming languages but Python is the most flexible one.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Scrapy: A Fast and Powerful Scraping and Web Crawling Framework

    1 project | news.ycombinator.com | 16 Feb 2024
  • Implementing case sensitive headers in Scrapy (not through `_caseMappings`)

    4 projects | /r/scrapy | 3 Jul 2023
  • Dicas para projetos usando web scraping

    1 project | /r/brdev | 27 Jun 2023
  • Best tools to use for web scraping ??

    1 project | /r/learnpython | 25 Jun 2023
  • I'm using python to scrape web page content and extract keywords, how can I make it faster to process?

    1 project | /r/datascience | 10 Jun 2023