Re: [Bug-wget] request for help with wget (crawling search results of a website)

2013-11-03 Thread Tony Lewis
Altug Tekin wrote: > To achieve this I created the following wget-command: > > wget --reject=js,txt,gif,jpeg,jpg \ > --accept=html \ > --user-agent=My-Browser \ > --recursive --level=2 \ > www.voanews.com/search/?st=article&k=germany&df=08%2F21%2F2013&dt=09%2F20%2F 2013&ob=dt#articl

Re: [Bug-wget] request for help with wget (crawling search results of a website)

2013-11-03 Thread Dagobert Michelsen
Hi, Am 03.11.2013 um 09:13 schrieb Altug Tekin : > I am trying to crawl the search results of a news website using *wget*. > > The name of the website is *www.voanews.com *. > > After typing in my *search keyword* and clicking search on the website, it > proceeds to the r

[Bug-wget] request for help with wget (crawling search results of a website)

2013-11-03 Thread Altug Tekin
Dear mailing List members, According to the website http://www.gnu.org/software/wget/ it is ok to write emails with help requests to this mailing list. I have the following problem: I am trying to crawl the search results of a news website using *wget*. The name of the website is *www.voanews.co