Labrador

Labrador is a distributed web Crawler (or spider), written in Perl. It has been locally designed and implemented to be integrated with the Terrier information retrieval platform.

URL: [WWW] http://www.dcs.gla.ac.uk/~craigm/labrador/