wikiextractor
A tool for extracting plain text from Wikipedia dumps (by attardi)
pudzu-packages
Various python packages, mostly geared towards dataviz. (by Udzu)
Our great sponsors
wikiextractor | pudzu-packages | |
---|---|---|
3 | 6 | |
3,630 | 1 | |
- | - | |
0.0 | 7.9 | |
3 months ago | about 2 months ago | |
Python | Python | |
GNU Affero General Public License v3.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
wikiextractor
Posts with mentions or reviews of wikiextractor.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-06-13.
-
Letter and next letter frequencies for 24 languages (see comments for non-English plots) [OC]
Larger text corpora: each plot is generated from around 450MB of Wikipedia article text (or as much as is available), extracted using wikiextractor.
-
Most similar language to each European language, based purely on letter distribution [OC]
Methodology: extracted 100MB of article texts from each of the different Wikipedias using https://github.com/attardi/wikiextractor, and counted the character prevalences using Python. The similarity measure is just the sum of the absolute differences in character prevalences (so a lower score means more similar): e.g. if language A has distribution {A: 0.5, B: 0.3, C: 0.2} and language B has distribution {A: 0.8, B: 0.2} then their similarity is |0.5-0.8|+|0.3-0.2|+|0.2-0.0|=0.6. The final chart was generated using graphviz and pillar.
-
Finding a English Wikipedia dump
With the help of wikiextractor, i was able to query it and process the dump. However, when i start inspecting it, some articles are empty. For example AccessibleComputing should not be empty, but the dump gave: ``` AccessibleComputing 0 10 854851586 2021-01-23T15:15:01Z Elli shel wikitext text/x-wiki #REDIRECT [[Computer accessibility]]
pudzu-packages
Posts with mentions or reviews of pudzu-packages.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-06-13.
-
[OC] Foreign coaches at the FIFA World Cup
Tools: Python and pudzu-charts.
-
Letter and next letter frequencies for 24 languages (see comments for non-English plots) [OC]
Like last time, the plots were generated using Python and pillar.
-
Most popular European countries among Britons
A hacky Python script to scrape the data from yougov and generate the chart using this hacky library that I wrote.
-
Flags of the world by aspect ratio [OC]
Generated using Python and pudzu. Flag images from Wikipedia. Afghanistan's flag is the outgoing flag, though the likely new flag of the Islamic Emirate of Afghanistan has the same aspect ratio.
-
European countries at the Summer Paralympics [OC]
Medal (and population) data downloaded from Wikipedia. Graph generated in Python using pudzu-charts.
-
Fatality rates for G7 national leaders [OC]
The annual fatality rates were calculated by dividing the number of leaders who died in office by the number of years that office has existed for. For French presidents this omits the Second Empire period (1852-1870), while for German chancellors it omits the Allied Occupation (1945-49) though it also starts in 1867 with the North German Confederation. The data is all from Wikipedia, and the chart was plotted using Python and pudzu.
What are some alternatives?
When comparing wikiextractor and pudzu-packages you can also consider the following projects:
hangul-jamo - A library to compose and decompose Hangul syllables using Hangul jamo characters
colorgram.py - A Python module for extracting colors from images. Get a palette of any picture!
twemoji-parser - A python module made on top of PIL that draws twemoji from text to image.
pudzu - Various python scripts, mostly geared towards dataviz.