|
|
[Perlfect-search] Crontab
Dave Campbell dave@cpfc.org
Sun, 8 Apr 2001 11:56:32 +0100
Hi run perlfect search indexer via cron nightly. Our machine is high spec
so it can index 20,000 pages reasonably quickly:
Anyways two points:
1) I get the following trancript from cron emailed to me
Today is Tue Mar 27 01:00:00 EST 2001
Rebuild Primary search engine indices
Using DB_File...
Checking for old temp files...
Building string of special characters...
Loading 'no index' regular expressions:
- /home/cpfc/www/search
Loading stopwords...Done.
Starting crawler...
/home/cpfc/www/
1: /home/cpfc/www/index.html
2: /home/cpfc/www/401.html
3: /home/cpfc/www/403.html
4: /home/cpfc/www/404.html
so forth for entire index
Then at the end
20020: /home/cpfc/www/ubb/Forum9/HTML/000231.html
20021: /home/cpfc/www/ubb/Forum9/HTML/000232.html
20022: /home/cpfc/www/ubb/Forum9/HTML/000244.html
Out of memory!
Index Built
What does the out of memory staement mean?
2) Is there any way to run the indexer in silent mode? I don't want to use
>/dev/null as I want to confirm that the indexer has run
Thanks
Dave
|
|