awesome-web-scraping
bookmarks
Our great sponsors
awesome-web-scraping | bookmarks | |
---|---|---|
6 | 9 | |
6,308 | 413 | |
- | 1.7% | |
5.1 | 0.0 | |
17 days ago | 7 months ago | |
Makefile | ||
GNU General Public License v3.0 or later | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
awesome-web-scraping
-
Ask HN: LinkedIn sent me a cease and desist for my Chrome extension. Help?
>I can scrape linkedin with a python script. That doesn't mean linkedin can shut down python.
Well said!
Also, what about copy-and-paste? The last time I checked, data could be highlighted in the browser, copied, and pasted...
Does that mean that LinkedIn can shut down the copy-and-paste capability of your browser and/or operating system?
What about "Save Page As..." functionality (the ability of a browser to save a page offline?)
Can LinkedIn shut down "Save Page As..." ?
Also, what about the Print Screen (take a screen snapshot) capabilities of your operating system?
Can LinkedIn shut down that?
Finally, there's literally oodles of software that can be used for web scraping; what follows below is just one non-canonical list:
https://github.com/lorien/awesome-web-scraping
Is LinkedIn going to shut down all of that, at the same time?
Anyway, an excellent point about Python!
- Awesome-web-scraping – List of libraries, tools and APIs for web scraping
-
How does webscraping a website work and putting the data into my website?
Because at least for the scraping part there are open-source and paid services that will probably get you the data today if you need it (unless these are some really hard-to-scrape websites you're targeting) But if you are keen on learning yourself just scroll down this subreddit you will find many guides users shared along the years...
-
Russian Flag in Readme
E.g. how would a Ukrainian dev feel having his project showcased in this list, under the Russian flag?
[0] https://github.com/lorien/awesome-web-scraping/issues/136
- A central repository for scrapping scripts
bookmarks
-
Improve Your Dev Productivity with Bookmarks, Snippets and Notes Management
Codever offers all this and more, plus it's free and open source at github.com/CodeverDotDev
-
How to configure and use environment specific values in Angular
//environment.ts export const environment = { production: false, HOST: 'http://localhost:4200', API_URL: 'http://localhost:3000/api', }; //environment.prod.ts export const environment = { production: true, HOST: 'https://www.codever.land', API_URL: 'https://www.codever.land/api', };
-
Increase productivity by visually differentiating between environments
As mentioned How I manage my dev bookmarks to save time and nerves I use heavily Codever to manage my bookmarks and code snippets, so there is always a browser tab open with the website. Lately I've also been developing quite a bunch of new features on the project. Lots of testing happens in the browser, and until now there was no quick way to differentiate between the production and development version, unless I look at the URL in the browser's navigation bar of course.
-
How to copy to clipboard with angular material
See it in action at www.codever.land:
-
How to define and use variables in sass
Use the $ sign to define the variable $variable_name: variable_value. Below we define anthracite-gray colour in the _colors.scss file used in the Codever project. Then we reference the variable in the class definition:
-
How to set focus on angular material autcomplete input field
Project Codever
-
How to sanitize your urls in angular
On Codever you can backup your bookmarks and snippets. When backing up you are presented a dialog where you can choose to display the items in browser. For that we use a blob URL we know for sure it is safe.
-
Angular material dialog example
The following example shows the elements required to implement an angular material dialog to ask the user to log in on Codever, when this is needed (like following tags).
-
GraphQL - where do I start?
Bonus - GraphQL Public Bookmarks
What are some alternatives?
proxy-list - A list of free, public, forward proxy servers. UPDATED DAILY!
codever - Bookmarks, Snippets and Notes Manager for Developers & Co (website)
Proxyman - Modern. Native. Delightful Web Debugging Proxy for macOS, iOS, and Android ⚡️
hello-open-source - Your milestone to say Hello to the world of Open Source !
awesome-micropython - A curated list of awesome MicroPython libraries, frameworks, software and resources.
eurorack-awesome - awesome eurorack diy and opensource
TabNine - AI Code Completions
awesome-naming - A curated list for when naming things is done right.
Awesome-Warez - All your base are belong to us!
awesome-programming-books - List of good programming books for beginners and professionals
syntax-highlighter - Syntax Highlighter extension for Visual Studio Code (VSCode). Based on Tree-sitter.
software-engineer-library - Software Engineer Library (EN/RU)