undetected-chromedriver VS selenium-python-helium

This command-line tool clicks ads for a certain query on Google/Bing search using undetected_chromedriver package. Supports proxy, running multiple simultaneous browsers, ad targeting/exclusion, and running in loop.

You can check this out. https://github.com/ultrafunkamsterdam/undetected-chromedriver If i didn't understand you wrong then this is what you're asking for.

403 often means that the server recognized the scraper and blocked you. If you use Selenium, this plugin is very good for passing bot detection: https://github.com/ultrafunkamsterdam/undetected-chromedriver.

Ultrafunkamsterdam created a ChromeDriver that has excellent support for bypassing all major bot detection systems such as Distil, Datadome, Cloudflare, and others.

One solution would be to install Selenium and then scrape using a real browser like Chrome. If this solution gets blocked, you could install obfuscation plugins like this very good one: https://github.com/ultrafunkamsterdam/undetected-chromedriver

Undetected_ChromeDriver also works on Brave Browser and many other Chromium-based browsers. For more, you can check out this project on GitHub.

I don't get why people still use XPaths, CSS selectors or HTML IDs to identify elements, even when they are "recorded". Please please please just use my https://github.com/mherrmann/selenium-python-helium instead. It makes so much more sense.

You can, though it might not be the best tool for this. Automation of web entry is better done with selenium, or my favorite variation helium.

Regarding automatic selectors: check out my open source library https://github.com/mherrmann/selenium-python-helium.

quick example https://github.com/mherrmann/selenium-python-helium

If this all fails you'll have to fall back on a web driver like selenium or one of its wrappers like helium.

Simplest would probably be not using Selenium directly, but a wrapper like helium. Most of its functions you'd need are listed here.

If you're talking about CSS I reckon you want to click/input things on a website inside your browser. In this case you would use a web driver which can automate a web browser like Chrome or Firefox. Something like Helium, Selenium or pyppeteer.