[Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Tomas Hozza
Hello. In Fedora I have a bug [1] from guy that is using wget to test web server network load. He runs multiple instances of wget to download some site recursively. Something like this: for i in `seq 20`; do wget -r http://www.makerwise.com/ & done Some of those wget instances are killed wi

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Tim Ruehsen
On Tuesday 03 September 2013 03:17:56 Tomas Hozza wrote: > In Fedora I have a bug [1] from guy that is using wget > to test web server network load. He runs multiple > instances of wget to download some site recursively. > Something like this: > > for i in `seq 20`; do > wget -r http://www.mak

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Tomas Hozza
- Original Message - > On Tuesday 03 September 2013 03:17:56 Tomas Hozza wrote: > > In Fedora I have a bug [1] from guy that is using wget > > to test web server network load. He runs multiple > > instances of wget to download some site recursively. > > Something like this: > > > > for i

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Tim Ruehsen
On Tuesday 03 September 2013 03:48:15 Tomas Hozza wrote: > > BTW, read() instead of mmap() would not help in this case. > > It would eliminate the SIGBUS because the length of the file > is determined from the number of read bytes by read(). This way > we might end up with truncated file, but will

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Daniel Stenberg
On Tue, 3 Sep 2013, Tim Ruehsen wrote: but in general it is a good idea not to suppress errors or misbehavior, just to make people feel better. Then it should return an error and error message etc, it shouldn't crash with a SIGBUS... -- / daniel.haxx.se

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Darshit Shah
> but in general it is a good idea not to suppress errors or misbehavior, >> just to make people feel better. >> > > Then it should return an error and error message etc, it shouldn't crash > with a SIGBUS... > We could add a simple signal handler to catch a SIGBUS and gracefully exit. -- Thank

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Tim Ruehsen
On Tuesday 03 September 2013 10:59:20 Daniel Stenberg wrote: > On Tue, 3 Sep 2013, Tim Ruehsen wrote: > > but in general it is a good idea not to suppress errors or misbehavior, > > just to make people feel better. > > Then it should return an error and error message etc, it shouldn't crash > with

[Bug-wget] [PATCH] add PFS (Perfect Forward Security) value to --secure-protocol

2013-09-03 Thread Tim Ruehsen
especially PFS (Perfect Forward Security). This patch adds 'PFS' (Perfect Forward Security) as a valid value to --secure-protocol for OpenSSL and GnuTLS. I also added it to the docs and added secureprotocol to sample.wgetrc. Regards, Tim >From b52ea219d6c8f6f8668daab1db336476f35d78ea Mon Sep 17

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Daniel Stenberg
On Tue, 3 Sep 2013, Tim Ruehsen wrote: "There was an unexpected signal SIGBUS. It may be a bug or a misuse of Wget or your hardware is broken. Please think about it.". If you think SIGBUS is the ultimate way to inform a user about an error situation, then by all means do that. I wouldn't. -

Re: [Bug-wget] Race condition on downloaded files among multiple wget instances

2013-09-03 Thread Ángel González
On 03/09/13 11:16, Tim Ruehsen wrote: What should it say than ? My ideas are limited to something like "There was an unexpected signal SIGBUS. It may be a bug or a misuse of Wget or your hardware is broken. Please think about it.". This does not give more information than a "SIGBUS". Ideas welco

[Bug-wget] wget and .m3u8

2013-09-03 Thread c-line
hello, i using wget for downloads and i try a .m3u8 url with wget download,but that does not work? this is the video url, but that does not work? http://ingest.er.ercdn.com/vod/_definst_/mp4:turkweb/high/film/katma_deger_saban/69531.mp4/playlist.m3u8 can you please a new version of wget also