awesome-test-automation
awesome-web-scraping
Our great sponsors
| awesome-test-automation | awesome-web-scraping | |
|---|---|---|
| 3 | 6 | |
| 6,107 | 6,308 | |
| 1.0% | - | |
| 4.8 | 5.1 | |
| 2 months ago | 16 days ago | |
| Makefile | ||
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-test-automation
-
Show HN: OpenAPI DevTools – Chrome ext. that generates an API spec as you browse
https://github.com/atinfo/awesome-test-automation/blob/maste...
vcr.py, playback, and rr do [HTTP,] test recording and playback. httprunner can replay HAR. DevTools can save http requests and responses to HAR files.
awesome-web-archiving lists a number of tools that work with WARC; but only har2warc:
-
Thursday Daily Thread: Python Careers, Courses, and Furthering Education!
I don't have personal experience, but I have this link bookmarked, might help you: https://github.com/atinfo/awesome-test-automation/blob/master/python-test-automation.md
-
Testing
For large projects, simple assert statements aren't enough to adequately write and manage tests. You'll require built-in module unittest or popular third-party modules like pytest. See python test automation frameworks for more resources.
awesome-web-scraping
-
Ask HN: LinkedIn sent me a cease and desist for my Chrome extension. Help?
>I can scrape linkedin with a python script. That doesn't mean linkedin can shut down python.
Well said!
Also, what about copy-and-paste? The last time I checked, data could be highlighted in the browser, copied, and pasted...
Does that mean that LinkedIn can shut down the copy-and-paste capability of your browser and/or operating system?
What about "Save Page As..." functionality (the ability of a browser to save a page offline?)
Can LinkedIn shut down "Save Page As..." ?
Also, what about the Print Screen (take a screen snapshot) capabilities of your operating system?
Can LinkedIn shut down that?
Finally, there's literally oodles of software that can be used for web scraping; what follows below is just one non-canonical list:
https://github.com/lorien/awesome-web-scraping
Is LinkedIn going to shut down all of that, at the same time?
Anyway, an excellent point about Python!
- Awesome-web-scraping – List of libraries, tools and APIs for web scraping
-
How does webscraping a website work and putting the data into my website?
Because at least for the scraping part there are open-source and paid services that will probably get you the data today if you need it (unless these are some really hard-to-scrape websites you're targeting) But if you are keen on learning yourself just scroll down this subreddit you will find many guides users shared along the years...
-
Russian Flag in Readme
E.g. how would a Ukrainian dev feel having his project showcased in this list, under the Russian flag?
[0] https://github.com/lorien/awesome-web-scraping/issues/136
- A central repository for scrapping scripts
What are some alternatives?
Horde - This is the old, deprecated, monolith Horde repository, archived here for historical reasons.
proxy-list - A list of free, public, forward proxy servers. UPDATED DAILY!
jasonelle - 🛸 A small and Cozy Framework for iOS 🍎 and Android Apps 🤖
Proxyman - Modern. Native. Delightful Web Debugging Proxy for macOS, iOS, and Android ⚡️
symflower - Symflower is a Java unit test generation tool for IntelliJ IDEA, Visual Studio Code, Android Studio, and CLI. Use it to write and maintain test code with ease. This repository is for providing community support.
awesome-micropython - A curated list of awesome MicroPython libraries, frameworks, software and resources.
CuratedLists - Curated Lists of various things
TabNine - AI Code Completions
flume-to-nifi - Examples for Apache Flume to Apache NiFi
Awesome-Warez - All your base are belong to us!
command_help - :information_source: Extract help text from builtin commands and man pages
syntax-highlighter - Syntax Highlighter extension for Visual Studio Code (VSCode). Based on Tree-sitter.