Cascadia.jl VS dude

https://github.com/Algocircle/Cascadia.jl is a julia library for css-style queries on Gumbo.jl parsed HTML.

I haven't seen that tutorial, but I agree that HTTP.jl, Gumbo.jl, and Cascadia.jl are the way. I used them to export public wishlists from bookdepository, which has no API nor a built in exporting tool.

Please check https://github.com/roniemartinez/dude

You can use my library which also uses Playwright. I have an example here: https://github.com/roniemartinez/dude/discussions/116

I also built a framework so I can easily switch between these libraries with less code change (still on hiatus for a few months before going back to it): https://github.com/roniemartinez/dude

There's a lot of options but I am quite happy with Github Actions workflows + Poetry as it handles tests and publish to PyPI. Just an example, in my workflows, I deploy to TestPyPI and PyPI here: https://github.com/roniemartinez/dude/tree/master/.github/workflows

But for documentation, I use mkdocs-material as it can easily be used with minor customization and changes can be easily deployed in Github: https://roniemartinez.github.io/dude/

Add an adblocker. I implemented Dude/pydude with the this and page results are clean without ads and pop-ups. For the screenshot, here is an example: https://github.com/roniemartinez/dude/discussions/116

You can also use my library if you want things to be simpler:) https://github.com/roniemartinez/dude

I use my own library, Dude! https://github.com/roniemartinez/dude

I built a simple web scraper that is simple to use but this is still a work-in-progress - https://github.com/roniemartinez/dude