I've seen a bit later that the issue raised quite a lot of times in the past,
My point is though that wget compiled on Tru64 OS does work with huge files.
Jonathan Stewart wrote:
Wget doesn't support >2GB files. It is a known issue that is brought up a lot.
Please patch if you're able, so far no fix has been forthcoming.
Cheers, Jonathan
----- Original Message ----- From: david coornaert <[EMAIL PROTECTED]> Date: Thu, 09 Sep 2004 12:41:31 +0200 Subject: 2 giga file size limit ? To: [EMAIL PROTECTED]
Hi all, I'm trying to get around this kind of message on I*86 linux boxes
with wget 1.9.1
--11:12:08-- ftp://ftp.ensembl.org/pub/current_human/data/mysql/homo_sapiens_snp_23_34e/RefSNP.txt.table.gz => `current_human/data/mysql/homo_sapiens_snp_23_34e/RefSNP.txt.table.gz' ==> CWD not required. ==> PASV ... done. ==> RETR RefSNP.txt.table.gz ... done. Length: -1,212,203,102
The file is actually more than 3giga, since my main goal is to mirror the whole thing @ensembl-org, It
would be very fine if mirroring could be used with huge files too
There is no trouble though on Tru64 machines.
here is what the .listing file says for this file on the linux boxes :
total 3753518 -rw-rw-r-- 1 0 0 97960 Jul 21 17:05 Assay.txt.table.gz -rw-rw-r-- 1 0 0 279 Jul 21 19:29 CHECKSUMS.gz -rw-rw-r-- 1 0 0 153157540 Jul 21 17:08 ContigHit.txt.table.gz -rw-rw-r-- 1 0 0 32 Jul 21 17:08 DataSource.txt.table.gz -rw-rw-r-- 1 0 0 18359087 Jul 21 17:09 Freq.txt.table.gz -rw-rw-r-- 1 0 0 46848 Jul 21 17:09 GTInd.txt.table.gz -rw-rw-r-- 1 0 0 185265599 Jul 21 17:13 Hit.txt.table.gz -rw-rw-r-- 1 0 0 35914149 Jul 21 17:14 Locus.txt.table.gz -rw-rw-r-- 1 0 0 20 Jul 21 17:14 Pop.txt.table.gz -rw-rw-r-- 1 0 0 3082764194 Jul 21 19:21 RefSNP.txt.table.gz -rw-rw-r-- 1 0 0 195 Jul 21 19:21 Resource.txt.table.gz -rw-rw-r-- 1 0 0 72306055 Jul 21 19:23 Strain.txt.table.gz -rw-rw-r-- 1 0 0 9480171 Jul 21 19:23 SubPop.txt.table.gz -rw-rw-r-- 1 0 0 286116716 Jul 21 19:27 SubSNP.txt.table.gz -rw-rw-r-- 1 0 0 49095 Jul 21 19:23 Submitter.txt.table.gz -rw-rw-r-- 1 0 0 1697 Jul 21 19:27 homo_sapiens_snp_23_34e.sql.gz
You can see that the file is appropriately listed , though once the ftp session is started it reports a negative size..
any solution ?
