Our great sponsors
-
udemyscraper
Discontinued A Udemy Course Scraper built with bs4 and selenium, that fetches udemy course information. Get udemy course information and convert it to json, csv or xml file, without authentication!
-
dca-detect
Python webscaper which emails you with row specific updates to Florida District Court of Appeals cases
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
mcdm
Multicriteria decision making in Python. Simple implementation of the Pugh qualitative design ideas.
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Here is the project in case u wanna see it- https://github.com/sortedcord/udemyscraper
I have made various small "cook bots" for niche products I wanted, not like the typical hype brands. I have also made one-off scrapers that would email me when a website would change (I have a basic template down for this, usually I'll just hash the site if possible, store in a file for comparison), used this for the HackMIT challenges for example. Another more specialized version of this was for the Florida District Court of Appeals, my father was a victim of crime and I wanted to keep up with the case. The scraper would parse out the table, clean it up, figure out what rows were newer than the last time checked, and then reconstitute it back into HTML (sounds kludgey but it otherwise looked like a mess) and send me purely the updates, row-by-row.
here I uploaded the script with README. https://github.com/abdu95/data-exercises please let me know if you have any questions
Here it is - https://github.com/kafooo/RealtyChecker its pretty crappy code whiich i wrote several years ago when i was learning python from automate boring stuff :) bht thanks to that code i landed a job as junior python developer recently :)
Time and money saver for sure! :) Btw. its on Github:https://github.com/grumpyp/backlink-checker