How to get the links of 15,000 Wiki-articles

• wiki-links

  1 41 0.0

  Discontinued Automatically exported from code.google.com/p/wiki-links

  

Looks like there are a few datasets people have already compiled that meet your requirements including wiki-links (whitepaper) and WikiLinkGraphs (whitepaper). Wiki-links seems to be up-to-date but harder to parse, and WikiLinkGraphs is only as recent as 2017 but looks very easy to parse.

• danker

  1 53 8.0 Python

  Compute PageRank on >3 billion Wikipedia links on off-the-shelf hardware.

Oh cool, I had my students do PageRank when I taught that class. Implementing the actual PageRank algorithm should be pretty easy, gathering and processing the data into usable form is harder, especially in Matlab which does not excel at that kind of task. You might compare your program to danker for verification and validation. I think Wikipedia also makes their page view / article popularity data available, which might be of interest to you.

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project