PHPCrawl is a class for crawling/spidering Websites. It
supports URL- and Content-Type-filtering, cookie-
handling, limiter-options, and other features to specify
the behaviour of the crawler. By overriding a special
method of the class users can decide what should
happen to the pages and their content, files and other
information the crawler finds.
