| calishot | demeter | |
|---|---|---|
| 3 | 2 | |
| 16 | 174 | |
| - | - | |
| 0.0 | 0.0 | |
| about 2 years ago | over 2 years ago | |
| Python | Go | |
| - | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
calishot
-
CALISHOT 2022-01: Find ebooks among 373 Calibre sites this month
Other resources will be proposed on it soon, like a wiki, tips, the datasets, original calibres, and some news about related tools like calisuck, calishot ... which are now turning into a single new project and will be released soon.
-
CALISHOT 2021-06: Find ebooks among 383 Calibre sites
If you want to build the db with your own list of servers, here is the python project on Github with commands to run on you own list of servers.
-
Need help with an OD indexer that I am writing in Python
This way you can also evolve your application to become async. As your using requests rather than aiohttp, may I suggest you to use gevent with a pool of requests in parallel (not too much ~ 10). You can look at this file as an example.
demeter
-
GitHub - gnur/booksing: web-based epub indexer
Maybe https://github.com/gnur/demeter, from the same author?
-
CALISHOT 2021-06: Find ebooks among 383 Calibre sites
If you just want to download every books of a site in a single format and curate them afterwards use this tool.
What are some alternatives?
open-directory-downloader - A NodeJS wrapper around KoalaBear84/OpenDirectoryDownloader
emacs-builds - Self-contained Emacs.app builds for macOS, with native-compilation support.
spider - scripts and baselines for Spider: Yale complex and cross-domain semantic parsing and text-to-SQL challenge
booksing - web-based epub indexer
odcrawler-scanner - A reddit bot that scans ODs over at /r/OpenDirectories and submits the results to the ODCrawler discovery server
GMDB - GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)
spider - spider is an OD crawler that crawls through opendirectories and indexes the urls
lux - 👾 Fast and simple video download library and CLI tool written in Go
DiskCache - Python disk-backed cache (Django-compatible). Faster than Redis and Memcached. Pure-Python.
Ferret - Declarative web scraping
ODmovieindexer - Extract and index movie information of movies found in open directories posted on r/opendirectories.
colly - Elegant Scraper and Crawler Framework for Golang