I am running the spider on a dedicated server, 256 MB of RAM and a low load. I am just wondering how fast the spider "usually" works? I think right now it is averaging about 15 seconds per page - does that sound about right? I guess it isn't too bad, but I hoped it would be faster with over 4000 pages to index. =) At this rate it probably won't be done until sometime tomorrow afternoon.
I'd hate to see how long it would take for a bigger job. ;)
Rob Bartlett
AAA Internet Publishing, Inc.
http://www.AAAInternet.com
I'd hate to see how long it would take for a bigger job. ;)
Rob Bartlett
AAA Internet Publishing, Inc.
http://www.AAAInternet.com