The BLOGS08 test collection
Modified:
6th April 2008
BLOGS08 is a TREC
test collection, created and distributed by the University of Glasgow.
- A crawl of Feeds, and associated Permalink and homepage documents (from early 2008 and early 2009).
- 1,303,520 feeds were polled once a week from 14th January 2008 to 10th February 2009.
- At the time of each poll of a feed, newly found permalinks were saved for later downloading.
- Each new permalink document was downloaded at least 2 weeks after first discovery.
- Collection is supplied with redirect (URL->URL) tables, in case these are useful e.g. for link-analysis.
- Each homepage mentioned by the feeds were downloaded once only.
Stats
Feeds:
| Total Number of Feeds: | 1,303,520 |
Average feeds collected every day: | 38,557 |
| Uncompressed Size: | 808GB |
| Compressed Size: | 193GB |
Permalink Documents:
| Total number of permalink documents: | 28,488,766 |
| Average documents every day: | 73,048 |
| Uncompressed Size: | 1445GB |
| Compressed Size: | 245GB |
Homepage Documents:
| Total number of homepages: | 1,011,733 |
| Uncompressed Size: | 56GB |
| Compressed Size: | 12GB |
Total size of collection is 453GB
Distribution information: http://ir.dcs.gla.ac.uk/test_collections/access_to_data.html