I have been messing about more with search engines and crawlers. If you take a look at http://www.robotii.co.uk/crawler/ and use the add url function there, it should crawl a bit of your site and report the results.
The results will be stored in the search database. I recommend using the second edition search at http://www.robotii.co.uk/search/ to [...]
Entries from August 2004
Search Engine Creations
August 31st, 2004 · No Comments
Tags: General




