[Bug-wget] Help or feature request - WGET -N option preventing file overwrite

Hello, I have been trying to use WGET to download some files but have been unable to find a combination of options to achieve what I need to do. The site I am downloading from publishes a new version of a file every hour but the exact time it is available is not specified. The replacement h

[Bug-wget] Request: Handle -np better when URL omits final slash character

Looks like -np is ignored for URL "directories" that omit the trailing slash. At least this is what I see happen with Homebrew wget. Could we get -np to act more flexibly, continuing to prohibit upwards navigation when the original URL leaves off the slash? -- Cheers, Andrew

Re: [Bug-wget] [Secunia Research] GNU wget Vulnerability Report - Request for Details

On 4/4/19 3:14 AM, Secunia Research wrote: > Hello, > > We are currently processing a report published by a third-party [1] for GNU > wget and are currently evaluating it to publish a Secunia Advisory for this. > Please see the original report for details. > > We would appreciate to receive your

Re: [Bug-wget] [Secunia Research] GNU wget Vulnerability Report - Request for Details

On 04.04.19 09:27, Tim Rühsen wrote: > On 4/4/19 3:14 AM, Secunia Research wrote: >> Hello, >> >> We are currently processing a report published by a third-party [1] for GNU >> wget and are currently evaluating it to publish a Secunia Advisory for this. >> Please see the original report for details

Re: [Bug-wget] [Secunia Research] GNU wget Vulnerability Report - Request for Details

On 4/4/19 4:42 PM, Josef Moellers wrote: > On 04.04.19 09:27, Tim Rühsen wrote: >> On 4/4/19 3:14 AM, Secunia Research wrote: >>> Hello, >>> >>> We are currently processing a report published by a third-party [1] for GNU >>> wget and are currently evaluating it to publish a Secunia Advisory for thi

[Bug-wget] wget -T 0 option re-issues the request in 1 hour

Hi I am using the wget for https request submitted to my application for a service through a shell script running on linux server. The request may take more than an hour depending on the load. "wget" waits for the reply to mark the request as complete. I am using -T 0 option to d

[Bug-wget] OT - Request for review of Metalink (XML for downloads) Internet Draft

We are seeking review of our Internet Draft. http://tools.ietf.org/html/draft-bryan-metalink Abstract This document specifies Metalink, an XML-based download description format. Metalink describes alternate download locations (mirrors), checksums, and other information. Clients can trans

Re: [Bug-wget] Feature request/suggestion: option to pre-allocate space for files

Hello, ma...@clara.co.uk writes: > On Linux, fallocate() and posix_fallocate() can be used to pre-allocate > space. The advantage of fallocate() is that, by using the > FALLOC_FL_KEEP_SIZE flag, space is allocated but the apparent file size is > unchanged. That means resuming with --continue wor

Re: [Bug-wget] Help request: Limit recursion, but unconditionally include all media files

On Monday 21 October 2013 12:33:10 Alexander Tobias Heinrich wrote: > For example, I tried: > wget --tries=3 --retry-connrefused --no-clobber --load-cookies=cookies.txt > --convert-links --page-requisites --adjust-extension --recursive > --include-directories /strategy/live-poker,/download > http:/

[Bug-wget] request for help with wget (crawling search results of a website)

Dear mailing List members, According to the website http://www.gnu.org/software/wget/ it is ok to write emails with help requests to this mailing list. I have the following problem: I am trying to crawl the search results of a news website using *wget*. The name of the website is *www.voanews.co

Re: [Bug-wget] Incorrect handling of Cyrillic characters in http request - any workaround?

der > Cygwin) and the file system will display the cyrillic strings no problem. > If I provide a command like this: > > http://translate.google.com/translate_tts?tl=ru&q=мазать > > wget incorrectly processes the Cyrillic characters _before_ sending the > http request, so what

Re: [Bug-wget] Incorrect handling of Cyrillic characters in http request - any workaround?

On Tue, Mar 31, 2015 at 10:11 AM, Stephen Wells wrote: > Dear all - I am currently trying to use wget to obtain mp3 files from the > Google Translate TTS system. In principle this can be done using: > > wget -U Mozilla -O "${string}.mp3" " > http://translate.google.com/translate_tts?tl=TL&q=${stri

Re: [Bug-wget] Incorrect handling of Cyrillic characters in http request - any workaround?

t (under > > Cygwin) and the file system will display the cyrillic strings no problem. > > If I provide a command like this: > > > > http://translate.google.com/translate_tts?tl=ru&q=мазать > > > > wget incorrectly processes the Cyrillic characters _before_ s

Re: [Bug-wget] Incorrect handling of Cyrillic characters in http request - any workaround?

THANK YOU Random Coder! That did the trick. Apparently my earlier attempts were unsuccessful because the problem I was trying to solve was not the problem I actually had :) Specifically I went to whatsmyuseragent.com and my browser id'd as "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (K

Re: [Bug-wget] Incorrect handling of Cyrillic characters in http request - any workaround?

On 01/04/15 00:16, Stephen Wells wrote: Hi Tim, Sorry for the ambiguity. To be more specific, the file name is fine: in the shell script the file name $*.mp3 expands correctly to e.g. мазать.mp3 . The audio within the file consists of the Google robot voice reading the string of percent-escaped

Re: [Bug-wget] [oss-security] CVE Request - Gnu Wget 1.17 - Design Error Vulnerability

On Thu, Aug 11, 2016 at 3:11 PM, Misra, Deapesh wrote: > Hi, > > -- > - Background - > -- > > Here at iDefense, Verisign Inc, we have a Vulnerability Contributor > Program (VCP) where we buy vulnerabilities. > > Recently, security researcher Dawid Golunski sold us

Re: [Bug-wget] [oss-security] CVE Request - Gnu Wget 1.17 - Design Error Vulnerability

On Donnerstag, 11. August 2016 21:34:14 CEST Kurt Seifried wrote: > On Thu, Aug 11, 2016 at 3:11 PM, Misra, Deapesh wrote: > > Hi, > > > > -- > > - Background - > > -- > > > > Here at iDefense, Verisign Inc, we have a Vulnerability Contributor > > Program (VCP) wh

Re: [Bug-wget] wget -T 0 option re-issues the request in 1 hour

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Abhishek Saxena wrote: > Hi > > I am using the wget for https request submitted to my application for a > service through a shell script running on linux server. The request may > take more than an hour depending on the load. "

[Bug-wget] Feature request: allow proper interpretation of url() elements in the style= attribute

I am trying to use wget to get an offline version of the site www.w3schools.com. This is not working properly because wget cannot interpret the embedded urls within the url() element in the style attribute of tags, for example It would be nice if wget were to be able to properly download this site

Re: [Bug-wget] request for help with wget (crawling search results of a website)

Hi, Am 03.11.2013 um 09:13 schrieb Altug Tekin : > I am trying to crawl the search results of a news website using *wget*. > > The name of the website is *www.voanews.com *. > > After typing in my *search keyword* and clicking search on the website, it > proceeds to the r

Re: [Bug-wget] request for help with wget (crawling search results of a website)

Altug Tekin wrote: > To achieve this I created the following wget-command: > > wget --reject=js,txt,gif,jpeg,jpg \ > --accept=html \ > --user-agent=My-Browser \ > --recursive --level=2 \ > www.voanews.com/search/?st=article&k=germany&df=08%2F21%2F2013&dt=09%2F20%2F 2013&ob=dt#articl

[bug #58525] HTTP request sent, awaiting response... Read error (Bad file descriptor) in headers.

URL: <https://savannah.gnu.org/bugs/?58525> Summary: HTTP request sent, awaiting response... Read error (Bad file descriptor) in headers. Project: GNU Wget Submitted by: gnats Submitted on: Sun 07 Jun 2020 08:49:53

[bug #58525] HTTP request sent, awaiting response... Read error (Bad file descriptor) in headers.

Devices,L=Austin,ST=Texas,C=US issuer: CN=GeoTrust RSA CA 2018,OU=www.digicert.com,O=DigiCert Inc,C=US X509 certificate successfully verified and matches host drivers.amd.com ... HTTP request sent, awaiting response... seconds 900,00, Winsock error: 0 ---response begin--- HTTP/1.1 302 Moved

Re: [Bug-wget] Feature request: allow proper interpretation of url() elements in the style= attribute

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Kerrick Staley wrote: > I am trying to use wget to get an offline version of the site > www.w3schools.com. This is not working properly because wget cannot > interpret the embedded urls within the url() element in the style > attribute of tags, for exa

[Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7

Hello Hniksic, Could you give me a favor about the below issue for wget? But other linux installing wget 1.8.2-15.rpm is ok. Now I want to degrade version 1.8.2-15, can you help me how to install it? Because that exists many dependent relationship. Appreciate that very much!!! [root@whou-linux

[Bug-wget] [bug #50579] wget --continue: Download fails when server does not support HEAD request

Update of bug #50579 (project wget): Category: Program Logic => Feature Request Status:None => Needs Discussion Summary: wget --continue: URL with trailing slash '/' (but Content-Disp

[Bug-wget] [bug #50579] wget --continue: Download fails when server does not support HEAD request

Follow-up Comment #2, bug #50579 (project wget): RFC 2616 section 9.4 says that an HTTP server should return the same headers for a HEAD request as it does for a GET of the same URL. So I see nothing incorrect with wget relying on that behavior

[Bug-wget] [bug #50579] wget --continue: Download fails when server does not support HEAD request

Follow-up Comment #3, bug #50579 (project wget): As Dale mentions, what Wget does is exactly according to the RFC. In fact it is the server that breaks the spec. And a workaround for this server may cause breakages for other servers that actually follow the specifications. As a result, I vote that

[Bug-wget] [bug #50579] wget --continue: Download fails when server does not support HEAD request

Update of bug #50579 (project wget): Status:Needs Discussion => Wont Fix Open/Closed:Open => Closed ___ Reply to this item at:

How can you only show User-Agent GET request without rest of the Debug output?

Is there no way to just show the GET request User-Agent: only with debug -d. I would like to just see ---request begin--- GET output of only what user agent is being used not all the other debug info. Reason being if I set --user-agent="Agent 007" I would like to know it is workin

Re: [Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7

Zitat von Wallance Hou : Could you give me a favor about the below issue for wget? But other linux installing wget 1.8.2-15.rpm is ok. Now I want to degrade version 1.8.2-15, can you help me how to install it? Because that exists many dependent relationship. [root@whou-linux ~]# wget http

Re: [Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7

bug-wget@gnu.org Subject: Re: [Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7 Zitat von Wallance Hou : > Could you give me a favor about the below issue for wget? But other > linux installing wget 1.8.2-15.rpm is ok. Now I want to degrade > versi

Re: [Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7

Zitat von Wallance Hou : Currently Does wget new version support or verify SAN/UCC SSL certificate? If yes, but I tried to install wget 1.13.x, but there still was issue as below. (gnutls-2.12.14 without p11-kit-1), Please advie. [root@xx-linux wget-1.13.4]# wget -v -O xx https://www.ve

Re: [Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7

er 25, 2011 5:23 AM To: Wallance Hou Cc: bug-wget@gnu.org Subject: RE: [Bug-wget] wget feature request: support for SAN/UCC SSL Certs RFC 3280 part 4.2.1.7 Zitat von Wallance Hou : > Currently Does wget new version support or verify SAN/UCC SSL > certificate? If yes, but I tried to i

[Bug-wget] [bug #51155] Page requisite requests should use GET method irrespective of original request method

URL: <http://savannah.gnu.org/bugs/?51155> Summary: Page requisite requests should use GET method irrespective of original request method Project: GNU Wget Submitted by: None Submitted on: Thu 01 Jun 2017 10:16:34

[Bug-wget] [bug #51155] Page requisite requests should use GET method irrespective of original request method

Update of bug #51155 (project wget): Status:None => Wont Fix Open/Closed:Open => Closed ___ Reply to this item at:

[bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #8, bug #44674 (project wget): [comment #3 comment #3:] > Just open a second console and start > nc -l -p > > Start wget in your first console > http_proxy=localhost: wget http://www.example.com > > nc will now dump everything that Wget sends. You could even gener

[bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #9, bug #44674 (project wget): [comment #3 comment #3:] > Just open a second console and start > nc -l -p > > Start wget in your first console > http_proxy=localhost: wget http://www.example.com > > nc will now dump everything that Wget sends. You could even gener

[bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #10, bug #44674 (project wget): https://edu-blog-1.blogspot.com https://boston-edu-seo.blogspot.com https://ciaira-edu.blogspot.com https://dexter-edu.blogspot.com https://eagle-eye-seo.blogspot.com https://falcon-edu.blogspot.com https://grape-edu.blogspot.com https://izak-edu.b

[bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #11, bug #44674 (project wget): https://blog-edu-477.blogspot.com/ https://blog-edu-478.blogspot.com/ https://blog-edu-479.blogspot.com/ https://blog-edu-480.blogspot.com/ https://blog-edu-481.blogspot.com/ https://blog-edu-482.blogspot.com/ https://blog-edu-483.blogspot.com/ htt

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

URL: <http://savannah.gnu.org/bugs/?44674> Summary: Add an option that will send the HTTP request to stderr or a file Project: GNU Wget Submitted by: jidanni Submitted on: Tue 31 Mar 2015 04:06:57 AM GMT Category: T

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #1, bug #44674 (project wget): Sure one could use tcpflow to see what is being sent, but what if it is an https address, and what if we want to see it before we send it? ___ Reply to this item at:

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #2, bug #44674 (project wget): OK one could send to http://example.net/ recording with tcpflow... but still one shouldn't need to do that. ___ Reply to this item at: __

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #3, bug #44674 (project wget): Just open a second console and start nc -l -p Start wget in your first console http_proxy=localhost: wget http://www.example.com nc will now dump everything that Wget sends. You could even generate an answer (e.g. with copy & paste).

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #4, bug #44674 (project wget): You can use the --debug flag to show the HTTP request and response headers, including when the traffic is encrypted with SSL. ___ Reply to this item at: <http://savannah.gnu.org/b

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

starting and waiting on a given system. Anonymous: the --debug part of the man page doesn't say clearly what it will give, also --debug might not be compiled in. And in fact --debug gives more than just the request, and --debug needs one to attempt the request without any "--dry-r

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #6, bug #44674 (project wget): Also --debug doesn't show full FORM bodies. ___ Reply to this item at: ___ Message sent via/by Savannah

[Bug-wget] [bug #44674] Add an option that will send the HTTP request to stderr or a file

Follow-up Comment #7, bug #44674 (project wget): Maybe we can implement a --dry-run option to allow the user to see how the request would look like without actually sending it. It would still require the --debug option to see the actual request

<    1   2