Gossamer Forum: General: Perl Programming: wget - good way to grab a "list" of files? (Andy)

Hi,

I'm trying to do something for one of my sites, which "grabs" a large number of images (in the region of around 100,000). ATM, it does something like;

Code:
while (<>) { 
  `wget -OID.gif 'http://www.domain.com/somewhere/image1234.gif'`; 
}

Basically, I'm wondering if there is a better way to grab them (all at once) .. i.e a delimited list, or even a .sh file;

Quote:

wget -OID.gif 'http://www.domain.com/somewhere/image12347.gif'
wget -OID1.gif 'http://www.domain.com/somewhere/image12345.gif'
wget -OID2.gif 'http://www.domain.com/somewhere/image12344.gif'
wget -OID3.gif 'http://www.domain.com/somewhere/image12343.gif'
wget -OID4.gif 'http://www.domain.com/somewhere/image12342.gif'
wget -OID5.gif 'http://www.domain.com/somewhere/image12341.gif'
...etc

Currently, the wget method is taking too long .. especially with the number of images I'm trying to grab.

TIA

Andy (mod)
andy@ultranerds.co.uk

Subject	Author	Views	Date
wget - good way to grab a "list" of files?	Andy	9087	Jan 10, 2006, 12:22 AM

Re: [Andy] wget - good way to grab a "list" of files?	webmaster33	8948	Jan 10, 2006, 8:09 PM

Re: [webmaster33] wget - good way to grab a "list" of files?	Andy	8951	Jan 10, 2006, 11:58 PM

Re: [Andy] wget - good way to grab a "list" of files?	webmaster33	8884	Jan 11, 2006, 6:38 AM

Re: [Andy] wget - good way to grab a "list" of files?	mkp	8778	May 11, 2006, 8:22 AM

Re: [mkp] wget - good way to grab a "list" of files?	Andy	8703	May 11, 2006, 3:03 PM

Subject

Author

Views

Date

wget - good way to grab a "list" of files?

Andy

9087

Jan 10, 2006, 12:22 AM

Re: [Andy] wget - good way to grab a "list" of files?

webmaster33

8948

Jan 10, 2006, 8:09 PM