selenium-powershell VS public-apis

There is a powershell module for it as well Selenium-powershell

If the website is using a JS library like React and the spinning you’re referring to is the JS library trying to pull data back to drop into the DOM then you can look at the Selenium PowerShell module to see if expected HTML gets dropped in. Info on the PowerShell module: https://github.com/adamdriscoll/selenium-powershell

I'm trying to access a website that is protected by Cloudflare. Whenever I use Invoke-WebRequest, I get a 403 error. Even if I use Selenium, I get a checkbox to verify that I am human. Is there any way to access the website using Powershell or is Cloudflare designed to stop this type and similiar requests?

I've used Selenium and PowerShell to do it in the past.

I've had great success using selenium in powershell 5.1 (it was very slow with ps core for some reason): https://github.com/adamdriscoll/selenium-powershell

for PS + Selenium, review the following: https://github.com/adamdriscoll/selenium-powershell/blob/master/Examples/A-Simple-Google-Search.ps1

If you want to do this in PowerShell, I'd start by looking at the popular selenium module: Here is the first search result I found for this topic: https://saucelabs.com/resources/articles/print-page-pdf. Here is the PowerShell repo: https://github.com/adamdriscoll/selenium-powershell

This module and the included browser drivers are great for automating browser stuff https://github.com/adamdriscoll/selenium-powershell

Powershell module from adamdriscoll/selenium-powershell: PowerShell module to run a Selenium WebDriver. (github.com) but the problem also persists if i load the driver manually in powershell.

For inspirations on what type of agents I should build, I turned to the Public APIs GitHub repository which has a curated lists of free APIs. I narrowed my search for an API that does not require sign-up or an API key and returns useful information. I ultimately decided to use the Free Currency Exchange Rates API, which seemed promising upon some basic testing.

✅ public-apis/public-apis : https://github.com/public-apis/public-apis

Public-Apis Github Repo — A list of free public APIs.

Interesting thread at https://github.com/public-apis/public-apis/issues/3104

Use curl to access a free public API and get a random joke, cat fact, or whatever.

I remember the forking of https://github.com/public-apis/public-apis and the long git issue discussions. The company owning the repository stopped maintaining it but didn't give up control either. Over the years you've put in a lot of work in publicapis.dev and that is much appreciated.

Also, that isn't really a list of "contributors", but of "organisations with the most stars". Those are different things.

For example "public-apis"[1] didn't "contribute" anything as that's not a person, and looking at GitHub[2] there are a bunch of substantial contributors (the person who created the organisation/repo only has 12 commits by the way);

[1]: https://opensource-heroes.com/o/public-apis

[2]: https://github.com/public-apis/public-apis/graphs/contributo...