The BLOGS08 test collection
6th April 2008
BLOGS08 is a TREC
test collection, created and distributed by the University of Glasgow.
- A crawl of Feeds, and associated Permalink and homepage documents (from early 2008 and early 2009).
- 1,303,520 feeds were polled once a week from 14th January 2008 to 10th February 2009.
- At the time of each poll of a feed, newly found permalinks were saved for later downloading.
- Each new permalink document was downloaded at least 2 weeks after first discovery.
- Collection is supplied with redirect (URL->URL) tables, in case these are useful e.g. for link-analysis.
- Each homepage mentioned by the feeds were downloaded once only.
|Total Number of Feeds:||1,303,520||Average feeds collected every day:||38,557
|Uncompressed Size:||808GB |
|Compressed Size:||193GB |
|Total number of permalink documents:||28,488,766|
|Average documents every day:||73,048|
|Total number of homepages: ||1,011,733|
Total size of collection is 453GB
Distribution information: http://ir.dcs.gla.ac.uk/test_collections/access_to_data.html