[Perlfect-search] patch to support robots.txt

[Jerrad Pierce]

ugh, I guess that's what I get for making a "simple" change untested.
After applying the patch 1 from the previous post you need to apply this one
Sorry about that.

=cut
+++ indexer.pl  Thu Mar 21 00:36:53 2002
@@ -130,6 +130,7 @@
     open(ROBOT, $url="$DOCUMENT_ROOT/robots.txt") ||
       warn("Could not fetch robots.txt: $!");
     read(ROBOT, $robots_txt, -s $url);
+    $url = 'http://localhost/robots.txt';
   }
   #Give some - output here like no index?
   $ROBOT->parse($url, $robots_txt) if $robots_txt;
-- 
H4sICNoBwDoAA3NpZwA9jbsNwDAIRHumuC4NklvXTOD0KSJEnwU8fHz4Q8M9i3sGzkS7BBrm
OkCTwsycb4S3DloZuMIYeXpLFqw5LaMhXC2ymhreVXNWMw9YGuAYdfmAbwomoPSyFJuFn2x8
Opr8bBBidccAAAA=
--
MOTD on Prickle-Prickle, the 6th of Discord, in the YOLD 3168:
Soy un perdedor!