[ https://issues.apache.org/jira/browse/MAPREDUCE-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated MAPREDUCE-1428: ---------------------------------------------- Attachment: BinaryFileGenerator.java Here is a program to generate files with different sizes. I used it to test archive with max_k=32. BinaryFileGenerator.java: generate files with sizes 0, 2^k-1, 2^k and 2^k+1 for k=1,.., max_k. > Make block size and the size of archive created files configurable. > ------------------------------------------------------------------- > > Key: MAPREDUCE-1428 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1428 > Project: Hadoop Map/Reduce > Issue Type: Improvement > Components: harchive > Reporter: Mahadev konar > Assignee: Mahadev konar > Fix For: 0.22.0 > > Attachments: BinaryFileGenerator.java > > > Currently the block size used by archives is the default block size of the > hdfs filesystem. We need to make it configurable so that the block size can > be higher for the part files that archives create. > Also, we need to make the size of part files in archives configurable again > to make it bigger in size and create less number of such files. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.