Re: How can I compile a list of URLs matching a pattern?

2007-05-01 Thread Steven M. Schweda
From: Karim Ali > [...] I want to traverse a given site, > but only retrieve the URL's that matche a particular pattern. > [...] > [...] I'd like it if wget > would just return the URL's it finds during its recursive > traversal, but not return the data. [...] If wget is to "traverse a given

Requests are always HTTP/1.0 ?!

2007-05-01 Thread Greg Lindahl
I'm thinking I must be smoking something, but: When I use wget, it is always emitting HTTP/1.0 requests, which is actually a lie. For example: write(3, "GET /pics/button_forum.png HTTP/1.0\r\n User-Agent: Wget/1.10.2\r\n Accept: */*\r\n Host: kpic1\r\n Connection: Keep-Alive\r\n \r\n ", 114) =

How can I compile a list of URLs matching a pattern?

2007-05-01 Thread Karim Ali
Hello, I have an application where I want to traverse a given site, but only retrieve the URL's that matche a particular pattern. The pattern would include a specific naming convention http://domain.com/docsx for example. I'd like it if wget would just return the URL's it finds during i

Wget image problem

2007-05-01 Thread KJ
Hello, This is the first time i'm mailing to this list so please forgive me if this is the wrong one. I'm having issues with a wget command in that it'll download all the site files except for the images. I've tried lots of variations but still no result. The command i am using is: wget