Terrier/WT10G

WT10G

WT10G is a general Web crawl, used by the TREC Web track 2000-2001. It can be obtained from the [WWW] University of Glasgow. The topics and qrels are available from the TREC website:

Indexing the WT10G collection is easy with Terrier. No terrier.properties are required to be altered from the default created by trec_setup. If you wish URLs in your index, then set the following properties:

trec.collection.class=TRECWebCollection
indexer.meta.forward.keys=docno,url
indexer.meta.forward.keylens=26,256

See the Terrier documentation on [WWW] Web-based Terrier to see how to build a Web search engine for this collection.

last edited 2011-06-14 19:48:36 by CraigMacdonald