AngleSharp VS Flurl.Http

Instead, what I ended up doing is utilizing AngleSharp for transforming the existing (dynamic) websites into static files. I've stored them on disk and made them ready to be served statically.

AngleSharp

Read and understand the HTML DOM with something like this https://anglesharp.github.io/

Personally, if that script I wrote did need to be used on Core I probably would have compiled AngleSharp, loaded the HTML Parser DLL into the script, and used that.

Now, assuming you have to scrape, C# does have two decent scraping libraries: AngleSharp and Html Agility Pack. I personally prefer AngleSharp.

I would love a blog post or even a series of them about scraping local HTML files with either AngleSharp or HTMLAgilityPack.

If you want a cleaner and modern alternative to HtmlAgilityPack then I'd suggest https://github.com/AngleSharp/AngleSharp

Use anglesharp for parsing html

Flurl and others

Is Flurl.HTTP the same as https://flurl.dev/ I assume? (It doesn't mention a specific http package)

As far as your code goes, take a look at flurl (https://flurl.dev/). It is oh so much cleaner and more readable than the httpclient stuff.

I would also add flurl to that list https://flurl.dev/. It's an amazing library and can be super helpful for quick one off API calls.

Linqpad for me, it's my go to scratch pad when testing out either new tech or edge cases and POCs than firing up a new console project. Especially when wanting to try out new nuget packages and see how they work. Even for messing with external apis I use it with Flurl, especially for apis that don't have any proper documentation.

If you working with api use flurl You can also read source code on github.

Flurl: