Makefile Crawling

Open-source Makefile projects categorized as Crawling

Makefile Crawling Projects

  • awesome-web-scraping

    List of libraries, tools and APIs for web scraping and data processing.

    Project mention: Ask HN: LinkedIn sent me a cease and desist for my Chrome extension. Help? | | 2023-01-31

    >I can scrape linkedin with a python script. That doesn't mean linkedin can shut down python.

    Well said!

    Also, what about copy-and-paste? The last time I checked, data could be highlighted in the browser, copied, and pasted...

    Does that mean that LinkedIn can shut down the copy-and-paste capability of your browser and/or operating system?

    What about "Save Page As..." functionality (the ability of a browser to save a page offline?)

    Can LinkedIn shut down "Save Page As..." ?

    Also, what about the Print Screen (take a screen snapshot) capabilities of your operating system?

    Can LinkedIn shut down that?

    Finally, there's literally oodles of software that can be used for web scraping; what follows below is just one non-canonical list:

    Is LinkedIn going to shut down all of that, at the same time?

    Anyway, an excellent point about Python!

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-01-31.


Project Stars
1 awesome-web-scraping 5,974
Static code analysis for 29 languages.
Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.