On Wednesday 10 May 2006 09:28, you wrote: > Even in this case, how it is possible discriminate between files? > I mean, why can I download some files and I can't with others that have > similar features? It sounds strange to me... > Thanks anyway > G
Check the link: http://www.robotstxt.org/wc/norobots-rfc.txt It explains how one can craft a robots.txt file to keep programs like Wget or LWP from fetching specific documents. As was noted by Steven, what platform are you running on? what version of wget? what links won't Wget download? What is the site? If the material is acceptable for a company to download, and it's not very large I can try to download it and see if I can recreate your problem. Curtis
