AngleSharp VS playwright-dotnet

Instead, what I ended up doing is utilizing AngleSharp for transforming the existing (dynamic) websites into static files. I've stored them on disk and made them ready to be served statically.

AngleSharp

Read and understand the HTML DOM with something like this https://anglesharp.github.io/

Personally, if that script I wrote did need to be used on Core I probably would have compiled AngleSharp, loaded the HTML Parser DLL into the script, and used that.

Now, assuming you have to scrape, C# does have two decent scraping libraries: AngleSharp and Html Agility Pack. I personally prefer AngleSharp.

I would love a blog post or even a series of them about scraping local HTML files with either AngleSharp or HTMLAgilityPack.

If you want a cleaner and modern alternative to HtmlAgilityPack then I'd suggest https://github.com/AngleSharp/AngleSharp

Use anglesharp for parsing html

Playwright

Check out Playwright which is developed by Microsoft. It's like Selenium, but newer and maybe better. You can use it outside unit tests as a regular library.

SDET? Check out Playwright's .NET connector: https://github.com/microsoft/playwright-dotnet

I'd suggest looking into https://github.com/microsoft/playwright-dotnet, it has been so much nicer to work with than Selenium.

I believe playwright can do the job, https://playwright.dev/dotnet/

Then you'd take that output and generate a PDF with Chrome: https://playwright.dev/dotnet/

If you've already got ASP.NET generating pages then you should try use this to save pages as PDF: https://github.com/microsoft/playwright-dotnet

If you've ever wanted to pull data periodically from a website, or you are a QA automation person looking to do E2E (end to end) testing, then Playwright might be an option for you. Similar to Cypress or PhantomJS, Playwright is a library that allows you to automate ineractions with websites, you can even take screenshots and PDFs!