Web Scraper: Python vs Rust (From a beginner stand point)

This page summarizes the projects mentioned and recommended in the original post on /r/rust
Rust HTTP HTTP Clients Asynchronous Networking

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

  • httpx

    A next generation HTTP client for Python. 🦋

    • Your Python async code is not really async. That's why I think you are getting the same numbers in both cases. You are declaring the function async but then use the sync requests.get call. You should use an async http client library, like httpx , like in this example:

  • tokio

    A runtime for writing reliable asynchronous applications with Rust. Provides I/O, networking, scheduling, timers, ...

    • So going down the rabbit hole, I found this issue: https://github.com/tokio-rs/tokio/issues/2401 that confirms that join_all is less efficient.

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Rustpad: Collaborative text editing app using Tokio + Warp

    4 projects | /r/rust | 5 Jun 2021

  • Validating JSON input in Rust web services

    4 projects | dev.to | 14 Feb 2021

  • The More You Gno: Gno.land Monthly Updates - 6

    8 projects | /r/Gnoland | 30 Nov 2023

  • What's the canonical way of doing it in rust?

    1 project | /r/rust | 16 Oct 2023

  • netcrab: a networking tool

    4 projects | dev.to | 14 Oct 2023