Gossamer Forum
Home : Products : Links 2.0 : Customization :

Need a working spider mod!

Quote Reply
Need a working spider mod!
Does anyone out there have a working version of gofetch.cgi 2.2 or some other spider script used to build databases?



Please don’t tell me to look at any more threads with pieces of code and dead links.



Thanks a bunch,

Jake
Quote Reply
Re: [awwa] Need a working spider mod! In reply to
I did find an old gofetch.cgi mod in the resource center. There are some bugs even when using the origional links 2.0 script with no add ons except priority logo.

First problem is that the templates have <%build_site_title%> instead of the default <%site_title%> in them which causes errors. That's simple to fix.

The next problem is the dmoz.cgi script has Flock problems. Changing CHMOD from 664 to 666 and back on the dmoz.db file pops up the following error.



CGI ERROR
==========================================
Error Message : Cannot change mode of /usr1/home/awwa/public_html/cgi-bin/links2/admin/data/dmoz.db
to read only: Operation not permitted
Script Location : /usr1/home/awwa/public_html/cgi-bin/links2/admin/dmoz.cgi
Perl Version : 5.006001


Any Perl code masters have any hint to what the problem may be?

I'll attach the dmoz.cgi and the gofetch.cgi.

Thanks,

Jake
Quote Reply
Re: [awwa] Need a working spider mod! In reply to
The problem is in this chunk of code in dmoz.cgi where i have it commented out.

if (($success) && ($status ne 'duplicate')) {
open (DMOZ, ">>$db_dmoz_name") or &cgierr("error in add_record. unable to open dmoz file: $db_dmoz_name. Reason: $!");
flock(DMOZ, 2) unless (!$db_use_flock);
print DMOZ $in{'url'} . "\n";
#chmod(0666, $db_dmoz_name) || &cgierr("Cannot change mode of $db_dmoz_name to read only: $!");
close DMOZ; # automatically removes file lock
&html_addurl_form("Added new category: $in{'url'}");

After commenting it out it works but you can only store one category in the dmoz.db file at a time. It is supposed to act as a queue of cats to spider.
Quote Reply
Re: [awwa] Need a working spider mod! In reply to
Hallo,
i donīt know what is going on.

I only get an 500 Error if i trie to runn this goFatch.cgi

What can be the Problem?
The Pat to Perl is ok
ThePat to links.cfg is also ok.

I will be verry hapy, if someone can help me.

Mutch Greatings
Manfred
Quote Reply
Re: [ManfredG] Need a working spider mod! In reply to
Hallo,
is it necesarry to use both the gofetch.cgi and the dmoz.cgi togeder?

Is this gofetch.cgi normaly working with the no SQL Version fore links 2.0?

Now i get allways this ERROR:

CGI ERROR
==========================================
Error Message : unable to open spidered file. Reason: No such file or directory

Script Location : gofetch.cgi
Perl Version : 5.006001

------------------------------------------------------

I donīt know, what is going on.
Pleas can somebody help me?

Thanks
Manfred
Quote Reply
Re: [ManfredG] Need a working spider mod! In reply to
Where can we find gofetch.cgi gofetch dmoz mod zip file is not available for download
Megrisoft
Web Hosting Company
India Software Company
SEO Company