When I retrieve recursively a directory using a site with https protocol, it searches for http://sitename/robots.txt but the site has only port 443 (https) open, so there is a connection refused error. Wget thinks the site is down and aborts the transfer. Wget should search for https://sitename/robots.txt !!
Wget is the best downloading program, so I hope this bug get fixed very soon. Thank you
