[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13129805#comment-13129805 ] Stefan Bodewig commented on COMPRESS-36: As of svn revision 1185722 the zips needed for integration tests are part of a .tar.bz2 archive in svn trunk (which is about two MB of size and expands to more than 100 MB of highly redundant zips). I'll remove the zips from my home dir on people.a.o shortly. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Assignee: Stefan Bodewig Fix For: 1.3 Attachments: 5GB_of_Zeros.zip, 5GB_of_Zeros_7ZIP.zip, 5GB_of_Zeros_PKZip.zip, 5GB_of_Zeros_WinZip.zip, 5GB_of_Zeros_WindowsCompressedFolders.zip, 5GB_of_Zeros_jar.zip, zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13081754#comment-13081754 ] Stefan Bodewig commented on COMPRESS-36: Code is complete but needs to get cleaned up - some methods have grown pretty big by now. Once that is done and everything is documented I'm going to close the issue. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Assignee: Stefan Bodewig Fix For: 1.3 Attachments: 5GB_of_Zeros.zip, 5GB_of_Zeros_7ZIP.zip, 5GB_of_Zeros_WindowsCompressedFolders.zip, 5GB_of_Zeros_jar.zip, zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13079332#comment-13079332 ] Stefan Bodewig commented on COMPRESS-36: Status update: ZipArchiveInputStream and ZipFile seem to be complete now ZipArchiveOutputStream works transparently except for the single case when a DEFLATED entry of unknown size gets written to a non-seekable stream. This one cannot work transparently and it will be pretty easy to implenent once we have decided at which granularity and with which defaults the user code will have to ask for ZIP64 features to be enabled, Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Assignee: Stefan Bodewig Fix For: 1.3 Attachments: 5GB_of_Zeros.zip, 5GB_of_Zeros_7ZIP.zip, 5GB_of_Zeros_WindowsCompressedFolders.zip, 5GB_of_Zeros_jar.zip, zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13073499#comment-13073499 ] Stefan Bodewig commented on COMPRESS-36: http://people.apache.org/~bodewig/commons-compress/ now contains three more archives containing 100k files, generated by Windows Compressed Folders, 7ZIP and Java7's jar respectively. The current ZipArchiveInputStream code successfully reads all of them. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Assignee: Stefan Bodewig Fix For: 1.3 Attachments: 5GB_of_Zeros.zip, 5GB_of_Zeros_7ZIP.zip, 5GB_of_Zeros_WindowsCompressedFolders.zip, 5GB_of_Zeros_jar.zip, zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13073430#comment-13073430 ] Stefan Bodewig commented on COMPRESS-36: The ZIP64 branch has been merged back to trunk. Current status: ZipArchiveInputStream looks good, ZipArchiveOutputStream is almost complete, need to decide how to handle the case of DEFLATED entries with unknown size when we are writing to a stream as I don't see any way to decide without user intervention whether we should enable ZIP64 or not. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Assignee: Stefan Bodewig Fix For: 1.3 Attachments: 5GB_of_Zeros.zip, zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13070955#comment-13070955 ] Stefan Bodewig commented on COMPRESS-36: I also have an archive with 64k empty files via $ for a in 0 1 2 3 4 5 6 7 8 9; do for b in 0 1 2 3 4 5 6 7 8 9; do for c in 0 1 2 3 4 5 6 7 8 9; do for d in 0 1 2 3 4 5 6 7 8 9; do for e in 0 1 2 3 4 5 6 7 8 9; do mkdir -p $a/$b/$c/$d; touch $a/$b/$c/$d/$e; done; done; done; done; done $ zip -r 100k_Files.zip [0-9] but can't attach it because it is 15MB in size and exceeds the JIRA limit. Placed it in http://people.apache.org/~bodewig/commons-compress/ Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Assignee: Stefan Bodewig Fix For: 1.3 Attachments: 5GB_of_Zeros.zip, zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13068761#comment-13068761 ] Stefan Bodewig commented on COMPRESS-36: As Jörg points out on the user list http://mail-archives.apache.org/mod_mbox/commons-user/201107.mbox/%3Cj06j2k$pc9$1...@dough.gmane.org%3E Java7's java.util.zip package and the NIO2 ZIP filesystem provider support Zip64 now. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Components: Archivers Reporter: Christian Grobmeier Attachments: zip64-sample.zip Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (COMPRESS-36) Add Zip64 Suport
[
https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13068775#comment-13068775
]
Stefan Bodewig commented on COMPRESS-36:
Just browsed through APPNOTE.TXT
http://www.pkware.com/documents/casestudies/APPNOTE.TXT and took some notes on
what ZIP64 means
* new end of central directory record and end of central directory locator
records
* sizes in data descriptor will be 8 bytes when written with ZIP64
* there are two different versions of end of central directory record for ZIP
spec 4.5-6.1 and spec 6.2+
* will need to set version needed to extract to 4.5 or 6.2 depending on the
eocdr version used.
* size is stored in an extra field if the archive uses ZIP64 and the size in
the local file header / central directory entry is 0x
This is also true for disk number or file numbers (only with 0x rather
than four bytes)
This new extra field has varying structure, for example it may only contain
the uncompressed size but not the compressed size if the compressed size fits
into four bytes.
* new zip64 extensible data sector
We likely won't implement this (completely) because of
{quote}Portions of this extended tape processing technology is
covered under a pending patent application. The use or
implementation in a product of certain technological
aspects set forth in the current APPNOTE, including
those with regard to strong encryption, patching or
extended tape operations, requires a license from
PKWARE. Please contact PKWARE with regard to acquiring
a license.{quote}
* note that the new sizes potentially exceed Long.MAX_VALUE as they are
unsigned which will cause trouble with ZipFile and its
usage of RandomAccessFile
Same is true for things like ZipArchiveEntry#getSize/setSize
Add Zip64 Suport
Key: COMPRESS-36
URL: https://issues.apache.org/jira/browse/COMPRESS-36
Project: Commons Compress
Issue Type: New Feature
Components: Archivers
Reporter: Christian Grobmeier
Attachments: zip64-sample.zip
Add Zip64 support. This will make it work to deal with zipfiles 2 GB.
Planned for compress 1.1
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12864695#action_12864695 ] Paco Avila commented on COMPRESS-36: This means that I can't create ZIP archives bigger than 2GB? Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Reporter: Christian Grobmeier Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12864753#action_12864753 ] Stefan Bodewig commented on COMPRESS-36: It means inidividual archived files cannot be bigger than 2GB, the whole archive can. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Reporter: Christian Grobmeier Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12864788#action_12864788 ] Paco Avila commented on COMPRESS-36: Thanks for the clarification. Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Reporter: Christian Grobmeier Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Commented: (COMPRESS-36) Add Zip64 Suport
[ https://issues.apache.org/jira/browse/COMPRESS-36?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12864481#action_12864481 ] Paco Avila commented on COMPRESS-36: Is this improvement scheduled for 1.1 ? Add Zip64 Suport Key: COMPRESS-36 URL: https://issues.apache.org/jira/browse/COMPRESS-36 Project: Commons Compress Issue Type: New Feature Reporter: Christian Grobmeier Add Zip64 support. This will make it work to deal with zipfiles 2 GB. Planned for compress 1.1 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
