Hello,
I dont want to make a mistake and would like your lightings on the following dream I have:
I want to add a FIELDNAME to my existing Links database called "grabhome"
Then I want the spider to go to all the links in my database and capture all 1st pages of all the links I have (excluding empty or robots etc.. pages)
After all that completed I would like to export all the 1st pages grabbed from the spider to the links database (synchronized with all related links of course)
To finish I would like to let my visitors do a search and show more results caus the search are not only done on the small descriptions of my normal links but also on the words contained into that new field. (of course the text grabbed from the spider will never be shown to the visitors in the index nor in the search results, just the links and the definitions.)
I hope someone understand and could help me clearly what I have to do to achieve that goal.
Best regards and thank you for your help!
I dont want to make a mistake and would like your lightings on the following dream I have:
I want to add a FIELDNAME to my existing Links database called "grabhome"
Then I want the spider to go to all the links in my database and capture all 1st pages of all the links I have (excluding empty or robots etc.. pages)
After all that completed I would like to export all the 1st pages grabbed from the spider to the links database (synchronized with all related links of course)
To finish I would like to let my visitors do a search and show more results caus the search are not only done on the small descriptions of my normal links but also on the words contained into that new field. (of course the text grabbed from the spider will never be shown to the visitors in the index nor in the search results, just the links and the definitions.)
I hope someone understand and could help me clearly what I have to do to achieve that goal.
Best regards and thank you for your help!