open-gov-crawlers
burplist
open-gov-crawlers | burplist | |
---|---|---|
13 | 5 | |
61 | 12 | |
- | - | |
6.8 | 6.8 | |
27 days ago | 3 days ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
open-gov-crawlers
-
What are the best repos that are a display of clean code and good programming practices that I can learn from?
I get feedback occasionally that this is the cleanest web scraping code someone’s seen: https://github.com/public-law/open-gov-crawlers
-
Sunday Daily Thread: What's everyone working on this week?
Writing more scrapers for legal glossaries of many country governments: adding Australia and the UK: https://github.com/public-law/open-gov-crawlers
-
Just a little custom coding to auto-generate spider info in a repo
Here's the repo's README.md with the table. I made this to help onboarding new open-source developers. Also to help people understand what's there.
-
Why and how to use conda?
I find it very agnostic. I use it for app development, not packages. E.g.: https://github.com/public-law/open-gov-crawlers
-
Wanted: contractor who can complete this HTML scrape
The original PDF: https://github.com/public-law/open-gov-crawlers/blob/rome-statute-english/docs/Rome-Statute.pdf
- Is there anything a webdev can do to help Ukraine right now ?
-
I want to make International Law easy to read and search: how many versions of Chinese do I need to publish?
For techies, here's the GitHub repo: https://github.com/public-law/open-gov-crawlers/discussions/70
- Project in support of Ukraine: International Criminal Law parsers/crawlers
- Scrapy project in support of Ukraine: International Criminal Law (war crimes and the crime of aggression)
- New project in support of Ukraine: International Criminal Law parsers/crawlers
burplist
-
Say Goodbye to Heroku Free Tier: Here Are 4 Alternatives
Heroku Dynos apps — Burplist was migrated to Koyeb. Having tried out other notable Heroku alternatives like Fly.io, Northflank, and Railway, I can safely say that the migration from Heroku to Koyeb required the least amount of effort and kinks. It just works in my case.
-
Saying Goodbye to Heroku Postgres for Now
A little less than a year ago, I built Burplist, a free search engine for craft beer in Singapore. With the goal to keep my infrastructure cost as low as possible, I started off with Heroku Postgres free tier.
-
I Built a Craft Beer Search Engine for Free
The link is to an article about how the search engine was built. The search engine itself can be found here:
https://burplist.me/
You should mention that this is only for Singapore. Nothing wrong with that, just that HN is predomonantly US and if someone goes to https://burplist.me/ searching US craft beers they are going to be a bit unhappy.
-
How I Built A Craft Beer Search Engine For Free
Rather than slamming in code examples in this post, I write about a high-level overview of how and why things are done in such a manner. So, you may find links to articles in different sections of this post on the know-how of how some steps were achieved, including the source code.
What are some alternatives?
scrapy-playwright - 🎭 Playwright integration for Scrapy
clean-code-python - :bathtub: Clean Code concepts adapted for Python
Flask-Migrate - SQLAlchemy database migrations for Flask applications using Alembic
auto-backup - python project to easily backup via CLI to different remote storages
hltv-scraping - Scraping data from hltv.org
clean-code-typescript - Clean Code concepts adapted for TypeScript
programming-principles - Categorized overview of programming principles & design patterns
clean-code-dotnet - :bathtub: Clean Code concepts and tools adapted for .NET
miniforge - A conda-forge distribution.
conda-lock - Lightweight lockfile for conda environments
build-your-own-x - Master programming by recreating your favorite technologies from scratch.