here is a little that i added to the fetch that ceglobe originally posted. it will add a checkbox, and a delete button to delete the fields so if you're tired of emailing them, you can just eliminate them. it calls the admin so it will do all the necesary things to delete the record properly.
also, i can't decide what i would like to do about emailing. i want an automated function, but i don't want it to email them every time i check (in case i just want to know) i would like it to print to a text file the id, url, recip, and email address then when i am ready i can email
also i am working to just check both the URL and the recip URL since i have several hundred records already in the database and those don't have a reciprocal field. who knows, many of these submissions may have even posted me on their front page
eventually, i would like to have this spider the origal url 1 level, but that is on the burner
this has been a great thread... keep it alive if you have anything
#!/usr/local/bin/perl
## Program Name: fetch.pl
#put the url you want to check for
$site_check = "search_phrase";
require "links.cfg";
$perpage=0;
if ($ENV{'QUERY_STRING'}){
$perpage=$ENV{'QUERY_STRING'};}
$increment = 20;
print "Content-type: text/html\n\n";
print "<html><title>testing - $perpage</title>\n";
print "<body>\n";
print "<form action=admin.cgi METHOD=POST><input type=hidden name=db value=links>";
use LWP::Simple;
open (LINK, "$db_links_name") or &cgierr("unable to open url index $db_url_name. Reason: $!");
if ($db_use_flock) {
flock (LINK, 14) or &cgierr("unable to get exclusive lock. Reason: $!");
}
seek (LINK, 0, 0); # rewind to beginning.
# Go through the Links database and find the link we want to go to.
LINE: while (<LINK> ) {
next LINE if (/^#/); # Skip comment lines.
next LINE if (/^\s*$/); # Skip blank lines.
@links=split (/\|/);
if (($links[0] < $perpage+$increment) and ($links[0] >= $perpage)) {
#print "checking $links[14] - ";
&getcontent("$links[14]",
"0",
"1",
"<html>",
"</html>");
}
elsif ($links[0] > $perpage+$increment) {
$perpage=$perpage+$increment;
print "<a href=fetch.pl?$perpage>Next $increment</a><br>";
&del_button;
exit;
}
} #end of while
close (LINK);
## End of program.
sub getcontent{
$counter=0;
local ($url,$base_url_img, $base_url_href, $start_string, $end_string) = @_;
defined ($page = get($url));
@page = split(/\n/,$page);
foreach $line(@page) {
if ($line =~ /$site_check/i) {
$counter=1;
}
}
if ($counter > 0) {
print "They are linking back<br>";
}
else {
print "ID $links[0] <input TYPE=CHECKBOX NAME=$links[0] VALUE=\"delete\">checking \<a href\=\"$links[14]\"\>$links[14]\<\/a\> \- They are not linking back ";
print "\<a href\=\"mailto\:$links[7]\"\> $links[7]\<\/a\><br>";
}
}
sub del_button{
print "<INPUT TYPE=SUBMIT name=delete_records VALUE=Delete Checked Link(s)> <INPUT TYPE=RESET VALUE=Reset>\n";
print "</body></html>\n";
}
&del_button;
