Cristian Consonni bio photo

Cristian Consonni

Ph.D. in Computer Science, free software activist, physicist and storyteller

Email Twitter Facebook LinkedIn Github Stackoverflow keybase

Datasets: Wikipedia pagecounts-ez (2007-12-09 – 2011-11-15)

This dataset is a compressed format of the pageview data of Wikimedia projects from 2007-12-09 to 2011-11-15. It has been created by processing Wikimedia’s pagecounts-raw dataset. For the period 2011-11-15 onwards, data are available on pagecounts-ez, where you can also find more information about the dataset.


This dataset can be downloaded in two different ways:

HTTP (preferred method)

You can find the dataset on:

You can download the dataset with the following command:

lynx -dump -listonly | awk '{print $2}' | grep -E '^http://cricca\.disi\.unitn\.it/datasets/pagecounts-ez/' | xargs -L1 -I{} wget -R '\?C=' {}

dat (experimental)

You can download the dataset using dat, the dataset is available at

Once you have installed dat, you can download the dataset with:

dat clone dat://07d810c54bdc547191b700ac1c12500af9eaa25a3ea054847e9819533acd4891 ~/dat-wikipedia-pagecounts-ez




The original dataset was published in the Public Domain (Public Domain Mark 1.0).

You can reuse this dataset under the same license.

How to cite

Please cite this dataset as:

Cristian Consonni, Alberto Montresor. Wikipedia pagecounts-raw sorted by article. doi coming soon


What is the total size of the dataset, the number of files and the largest file in the dataset?

The total dataset size is 518GB, and it contains 1,435 files. The average file size is 371MB and the largest file is 581MB.

How are files organized?

Files are divided in directories, one for each month, like this:

├── md5sums.txt
├── pagecounts-2007-12-09.bz2
├── pagecounts-2007-12-10.bz2
├── pagecounts-2011-11-14.bz2
└── pagecounts-2011-11-15.bz2

Who produced this dataset and why?

The dataset has been produced by Cristian Consonni and Alberto Montresor, from the Department of Information Engineering and Computer Science (DISI), University of Trento, Trento, Italy.

This dataset has also been utilized in the research related to the ENGINEROOM project, in collaboration with David Laniado of Eurecat - Centre Tecnològic de Catalunya, Barcelona, Spain. EU ENGINEROOM has received funding from the European Union’s Horizon 2020 research and innovation programme under the Grant Agreement no 780643.

Is this dataset used in currently in-review or future papers that cite it?

This dataset is published as part of the ENGINEROOM project and it will be cited in the related scientific publications.


For further info send me an e-mail.