mwoffliner
wikiscript
mwoffliner | wikiscript | |
---|---|---|
7 | 1 | |
256 | 6 | |
1.2% | - | |
9.2 | 0.0 | |
22 days ago | over 3 years ago | |
TypeScript | Ruby | |
GNU General Public License v3.0 only | Creative Commons Zero v1.0 Universal |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mwoffliner
-
Wiktionary doesn’t support tables
You can also directly open a ticket at https://github.com/openzim/mwoffliner/issues with as much info as possible so we can look into it (zim name, language, date, article name, etc.)
-
Recent Wiktionary ZIM files don't show a search bar
Welp yes, that's a bug (likely a regression from a recent update). Can you please open a ticket at https://github.com/openzim/zim-requests/issues (we might move it later on but that's as good a starting place as can be).
-
Latest Wikipedia zim dump (97 GB) is available for download
https://github.com/openzim/mwoffliner/issues/1655 Unfortunate that there's no way to convert the easiest way to make proper dumps of wikis (ArchiveTeam's wikiteam-tools) to Kiwix Zims. That would allow for all sorts of niche information to be preserved in a readable way.
-
What's the "best" way to make your own ZIMs (in docker)?
I'm looking at making my own ZIM though not sure the best way to go about it. I've seen zimit on Github and the mwoffliner on Github too.
-
Self made ZIM-File only contains [object object]
Generally speaking, I'd advise opening a ticket on https://github.com/openzim/mwoffliner/issues
-
Creating ZIM files for Kiwix by myself?
r/kiwix would be the place to ask, but at the end of the day it all comes down to heading out to openzim.org (or the corresponding github repo) and figuring it out. You can either grab zimit and run it locally, or access all the libraries that will help you build your own scraper (Nautilus will assemble documents and videos into a single file library, MWoffliner will do for wikis, youtube will do YouTube, etc.).
wikiscript
-
The State-of-Wikipedia & Wikidata in the Ruby Universe - Looking for Parser, API Clients, Template Functions, Apps, etc.
In my little wikiscript parser I try to make it easy to add new templates - a template is just a ruby function, see https://github.com/wikiscript/wikiscript/blob/master/countries/templates.rb but yes, maybe the template source itself from Wikipedia can get used (as a fallback).
What are some alternatives?
wikipedia-mirror - 🌐 Guide and tools to run a full offline mirror of Wikipedia.org with three different approaches: Nginx caching proxy, Kiwix + ZIM dump, and MediaWiki/XOWA + XML dump
markdown-wikitext - A cheatsheet mirroring Markdown and Wikitext
nautilus - Turns a collection of documents into a browsable ZIM file
wikicloth - Ruby implementation of the MediaWiki markup language.
zimit - Make a ZIM file from any Web site and surf offline!
infoboxer - Wikipedia information extraction library
kiwix-tools - Command line Kiwix tools: kiwix-serve, kiwix-manage, ...
sport.db - sport.db - open sports database (e.g. football.db, formula1.db etc.) command line tool and libraries
scraper - Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Supported databases: SQLite, MySQL, PostgreSQL. Supported headless clients: Puppeteer, Playwright, Cheerio, JSdom.
reality - Comprehensive data proxy to knowledge about real world
libkiwix - Common code base for all Kiwix ports
HLTV - The unofficial HLTV Node.js API