Perlfect Solutions

[Perlfect-search] How come directory got indexed also?

Daniel Naber
Tue, 6 Aug 2002 12:34:59 +0200
On Tuesday 06 August 2002 03:53, ehnya chnia wrote:

> I have the HTTP_START_URL variable set to = 'http://mySite/aDirectory'.
> When I run the indexer, it seemed to index http://mySite/aDirectory as
> well, inclusive of all the files under it.

The search engine doesn't know about directories, as there might be an 
index.html file that should be indexed or not. So you'd have to configure 
your server not to list directory contents if there's no index.html.