[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871765#comment-13871765 ] Hadoop QA commented on HDFS-5138: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5704: Attachment: editsStored HDFS-5704-branch2.patch Backport the change to branch-2. The backpor

[jira] [Updated] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5777: Status: Patch Available (was: Open) > Update LayoutVersion for the new editlog op OP_ADD_BLOCK > --

[jira] [Updated] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5777: Attachment: HDFS-5777.000.patch Patch uploaded. > Update LayoutVersion for the new editlog op OP_ADD_BLOCK

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871717#comment-13871717 ] Jing Zhao commented on HDFS-5704: - Thanks Nicholas! I created HDFS-5777 to update the layou

[jira] [Created] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-5777: --- Summary: Update LayoutVersion for the new editlog op OP_ADD_BLOCK Key: HDFS-5777 URL: https://issues.apache.org/jira/browse/HDFS-5777 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871707#comment-13871707 ] Tsz Wo (Nicholas), SZE commented on HDFS-5704: -- We should update LayoutVersion

[jira] [Resolved] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-5752. -- Resolution: Fixed Fix Version/s: HDFS-5535 (Rolling upgrades) Hadoop

[jira] [Commented] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871678#comment-13871678 ] Jing Zhao commented on HDFS-5752: - +1 for the new patch. > Add a new DFSAdminCommand for r

[jira] [Commented] (HDFS-5776) support quorum read in DFSClient

2014-01-14 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871671#comment-13871671 ] Liang Xie commented on HDFS-5776: - Please feel free to modify this JIRA's title and descrip

[jira] [Commented] (HDFS-5776) support quorum read in DFSClient

2014-01-14 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871670#comment-13871670 ] Liang Xie commented on HDFS-5776: - thanks for comments, probably "quorum read" is not accur

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871662#comment-13871662 ] Hadoop QA commented on HDFS-5762: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5776) support quorum read in DFSClient

2014-01-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871660#comment-13871660 ] stack commented on HDFS-5776: - Good on you [~xieliang007] Is it // read or start up read on se

[jira] [Commented] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871656#comment-13871656 ] Hadoop QA commented on HDFS-5775: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5776) support quorum read in DFSClient

2014-01-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871654#comment-13871654 ] Suresh Srinivas commented on HDFS-5776: --- Is this really quorum read or just reading i

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871638#comment-13871638 ] Hadoop QA commented on HDFS-5768: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5752: - Attachment: (was: h5752_20140115.patch) > Add a new DFSAdminCommand for rollin

[jira] [Updated] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5752: - Attachment: h5752_20140115.patch > Add a new DFSAdminCommand for rolling upgrade >

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2014-01-14 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5138: - Attachment: HDFS-5138.patch While doing some manual testing I realized that punting on that sugges

[jira] [Updated] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5752: - Attachment: h5752_20140115.patch Jing, good point. Thanks again. h5752_20140115.

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871618#comment-13871618 ] Andrew Wang commented on HDFS-5709: --- Test failure is the new test I added, use the binary

[jira] [Commented] (HDFS-5776) support quorum read in DFSClient

2014-01-14 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871604#comment-13871604 ] Liang Xie commented on HDFS-5776: - I have made a raw patch against 2.0 branch yesterday, wi

[jira] [Created] (HDFS-5776) support quorum read in DFSClient

2014-01-14 Thread Liang Xie (JIRA)
Liang Xie created HDFS-5776: --- Summary: support quorum read in DFSClient Key: HDFS-5776 URL: https://issues.apache.org/jira/browse/HDFS-5776 Project: Hadoop HDFS Issue Type: Improvement Co

[jira] [Comment Edited] (HDFS-5728) [Diskfull] Block recovery will fail if the metafile not having crc for all chunks of the block

2014-01-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871170#comment-13871170 ] Uma Maheswara Rao G edited comment on HDFS-5728 at 1/15/14 3:27 AM: -

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871553#comment-13871553 ] Hudson commented on HDFS-5704: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4997 (See [https:

[jira] [Updated] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5762: --- Attachment: HDFS-5762.002.patch > BlockReaderLocal doesn't return -1 on EOF when doing

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871549#comment-13871549 ] Colin Patrick McCabe commented on HDFS-5762: bq. WATERMELON print in the test

[jira] [Updated] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2014-01-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5223: --- Attachment: HDFS-5223.004.patch Here is a first version implementing the feature flag

[jira] [Commented] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871533#comment-13871533 ] Hadoop QA commented on HDFS-4858: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871516#comment-13871516 ] Hadoop QA commented on HDFS-5709: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871489#comment-13871489 ] Jing Zhao commented on HDFS-5704: - I've committed the patch to trunk. Looks like we need a

[jira] [Commented] (HDFS-5612) NameNode: change all permission checks to enforce ACLs in addition to permissions.

2014-01-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871467#comment-13871467 ] Chris Nauroth commented on HDFS-5612: - Thanks for the review, Haohui. Just to clarify,

[jira] [Updated] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5775: - Attachment: HDFS-5775.000.patch > Consolidate the code for serialization in CacheManager > ---

[jira] [Updated] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5775: - Status: Patch Available (was: Open) This patch also applies to trunk. Submit it to jenkins. > Consolidat

[jira] [Created] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-14 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5775: Summary: Consolidate the code for serialization in CacheManager Key: HDFS-5775 URL: https://issues.apache.org/jira/browse/HDFS-5775 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5612) NameNode: change all permission checks to enforce ACLs in addition to permissions.

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871432#comment-13871432 ] Haohui Mai commented on HDFS-5612: -- +1. I'll commit it shortly. > NameNode: change all pe

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871431#comment-13871431 ] Hadoop QA commented on HDFS-5704: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871416#comment-13871416 ] Andrew Wang commented on HDFS-5762: --- Nice find. I'm a little annoyed that our read method

[jira] [Updated] (HDFS-5612) NameNode: change all permission checks to enforce ACLs in addition to permissions.

2014-01-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5612: Attachment: HDFS-5612.4.patch Thanks, Haohui. Here is patch version 4. I was only able to consolid

[jira] [Resolved] (HDFS-5772) Serialize under-construction file information in FSImage

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5772. - Resolution: Fixed Fix Version/s: HDFS-5698 (FSImage in protobuf) Hadoop Flags: Reviewed I've c

[jira] [Commented] (HDFS-5772) Serialize under-construction file information in FSImage

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871404#comment-13871404 ] Haohui Mai commented on HDFS-5772: -- +1 > Serialize under-construction file information in

[jira] [Updated] (HDFS-5772) Serialize under-construction file information in FSImage

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5772: Attachment: HDFS-5772.001.patch Thanks for the review, Haohui! Update the patch to address your comments. >

[jira] [Commented] (HDFS-5773) NN may reject formerly dead DNs

2014-01-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871385#comment-13871385 ] Daryn Sharp commented on HDFS-5773: --- Issue was seen on 0.23 and believed to be 2.x but is

[jira] [Created] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-14 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5774: Summary: Serialize CachePool directives in protobuf Key: HDFS-5774 URL: https://issues.apache.org/jira/browse/HDFS-5774 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871379#comment-13871379 ] Jing Zhao commented on HDFS-5752: - The new patch looks good to me. Just one question: so cu

[jira] [Commented] (HDFS-5772) Serialize under-construction file information in FSImage

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871377#comment-13871377 ] Haohui Mai commented on HDFS-5772: -- The patch looks good to me. {code} + message FileUnd

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871371#comment-13871371 ] Hadoop QA commented on HDFS-5318: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2014-01-14 Thread Chris Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871357#comment-13871357 ] Chris Li commented on HDFS-3544: Okay, we're very interested in SRC in our clusters and we

[jira] [Updated] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5709: -- Status: Patch Available (was: Open) > Improve upgrade with existing files and directories named ".snaps

[jira] [Updated] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5709: -- Attachment: hdfs-5709-1.patch Binary patch attached. High-level notes: * I went with a full-substitutio

[jira] [Created] (HDFS-5773) NN may reject formerly dead DNs

2014-01-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5773: - Summary: NN may reject formerly dead DNs Key: HDFS-5773 URL: https://issues.apache.org/jira/browse/HDFS-5773 Project: Hadoop HDFS Issue Type: Bug Affects Versi

[jira] [Updated] (HDFS-5772) Serialize under-construction file information in FSImage

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5772: Attachment: HDFS-5772.000.patch > Serialize under-construction file information in FSImage > ---

[jira] [Assigned] (HDFS-5709) Improve upgrade with existing files and directories named ".snapshot"

2014-01-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-5709: - Assignee: Andrew Wang > Improve upgrade with existing files and directories named ".snapshot" > --

[jira] [Created] (HDFS-5772) Serialize under-construction file information in FSImage

2014-01-14 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-5772: --- Summary: Serialize under-construction file information in FSImage Key: HDFS-5772 URL: https://issues.apache.org/jira/browse/HDFS-5772 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5768: - Attachment: HDFS-5768.001.patch Fix import errors for trunk. > Consolidate the serialization code in Dele

[jira] [Commented] (HDFS-5612) NameNode: change all permission checks to enforce ACLs in addition to permissions.

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871300#comment-13871300 ] Haohui Mai commented on HDFS-5612: -- The patch looks good. nit: you might be able to simpli

[jira] [Commented] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871294#comment-13871294 ] Jing Zhao commented on HDFS-4858: - One quick question: the current patch uses "RetryPolicie

[jira] [Resolved] (HDFS-5765) Snapshot file is broken after appending to original file

2014-01-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-5765. --- Resolution: Duplicate Duplicate of HDFS-5343 > Snapshot file is broken after appending to ori

[jira] [Updated] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-4858: - Assignee: Jagane Sundar > HDFS DataNode to NameNode RPC should timeout > -

[jira] [Commented] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871267#comment-13871267 ] Konstantin Boudnik commented on HDFS-4858: -- The patch is still applicable to the t

[jira] [Updated] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-5677: - Resolution: Fixed Status: Resolved (was: Patch Available) Thank you Vincent! Comm

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871262#comment-13871262 ] Hudson commented on HDFS-5677: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4995 (See [https:

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871257#comment-13871257 ] Suresh Srinivas commented on HDFS-5704: --- +1 for the new patch. > Change OP_UPDATE_BL

[jira] [Updated] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5704: Attachment: HDFS-5704.003.patch Thanks for the review, Suresh! Looks like the 002 patch needs some rebase (f

[jira] [Updated] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-4858: - Fix Version/s: 2.3.0 > HDFS DataNode to NameNode RPC should timeout >

[jira] [Updated] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-4858: - Fix Version/s: 3.0.0 > HDFS DataNode to NameNode RPC should timeout >

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871240#comment-13871240 ] Konstantin Boudnik commented on HDFS-5677: -- +1 on the patch, it looks good. > Nee

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-14 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871230#comment-13871230 ] Suresh Srinivas commented on HDFS-5704: --- The newer patch looks much cleaner. Thanks f

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-14 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871237#comment-13871237 ] Konstantin Boudnik commented on HDFS-5677: -- That's a great idea, indeed. But I thi

[jira] [Created] (HDFS-5771) Track progress when loading fsimage

2014-01-14 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5771: Summary: Track progress when loading fsimage Key: HDFS-5771 URL: https://issues.apache.org/jira/browse/HDFS-5771 Project: Hadoop HDFS Issue Type: Sub-task Affect

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871208#comment-13871208 ] Hadoop QA commented on HDFS-5768: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-5770) Exception hit in TestPersistBlocks

2014-01-14 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5770: --- Summary: Exception hit in TestPersistBlocks Key: HDFS-5770 URL: https://issues.apache.org/jira/browse/HDFS-5770 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5768: - Status: Patch Available (was: Open) This patch also applies to trunk, so submit the patch to Jenkins as w

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-14 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871199#comment-13871199 ] Eric Sirianni commented on HDFS-5318: - I have created HDFS-5769 for bootstrapping a pip

[jira] [Updated] (HDFS-5744) Serialize information for token managers in protobuf

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5744: - Attachment: HDFS-5744.000.patch > Serialize information for token managers in protobuf > -

[jira] [Created] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-5768: Summary: Consolidate the serialization code in DelegationTokenSecretManager Key: HDFS-5768 URL: https://issues.apache.org/jira/browse/HDFS-5768 Project: Hadoop HDFS

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5768: - Target Version/s: HDFS-5698 (FSImage in protobuf) Affects Version/s: HDFS-5698 (FSImage in protobuf)

[jira] [Created] (HDFS-5769) Bootstrap a write pipeline from read-only replicas

2014-01-14 Thread Eric Sirianni (JIRA)
Eric Sirianni created HDFS-5769: --- Summary: Bootstrap a write pipeline from read-only replicas Key: HDFS-5769 URL: https://issues.apache.org/jira/browse/HDFS-5769 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5768: - Attachment: HDFS-5768.000.patch > Consolidate the serialization code in DelegationTokenSecretManager > ---

[jira] [Updated] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-5767: Description: I'm seeing that the nfs implementation assumes unique pair to be returned by command

[jira] [Created] (HDFS-5767) Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes

2014-01-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-5767: --- Summary: Nfs implementation assumes userName userId mapping to be unique, which is not true sometimes Key: HDFS-5767 URL: https://issues.apache.org/jira/browse/HDFS-5767

[jira] [Commented] (HDFS-5728) [Diskfull] Block recovery will fail if the metafile not having crc for all chunks of the block

2014-01-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871170#comment-13871170 ] Uma Maheswara Rao G commented on HDFS-5728: --- {code} That will be a implicit trunc

[jira] [Updated] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-14 Thread Eric Sirianni (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Sirianni updated HDFS-5318: Attachment: HDFS-5318a-branch-2.patch Patch file implementing changes as discussed in JIRA. * Exclud

[jira] [Commented] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871122#comment-13871122 ] Uma Maheswara Rao G commented on HDFS-5730: --- Thanks Colin, for your feedback on t

[jira] [Commented] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2014-01-14 Thread Weiyan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871108#comment-13871108 ] Weiyan Wang commented on HDFS-3544: --- Chris, Sorry for the late reply, we are actually not

[jira] [Updated] (HDFS-5738) Serialize INode information in protobuf

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5738: Attachment: HDFS-5738.005.patch Update the patch for Haohui since the fix is trivial. > Serialize INode inf

[jira] [Resolved] (HDFS-5738) Serialize INode information in protobuf

2014-01-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-5738. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Serialize INode information in prot

[jira] [Updated] (HDFS-3544) Ability to use SimpleRegeratingCode to fix missing blocks

2014-01-14 Thread Weiyan Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiyan Wang updated HDFS-3544: -- Assignee: (was: Weiyan Wang) > Ability to use SimpleRegeratingCode to fix missing blocks > -

[jira] [Commented] (HDFS-5730) Inconsistent Audit logging for HDFS APIs

2014-01-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13871004#comment-13871004 ] Colin Patrick McCabe commented on HDFS-5730: Thanks for filing this, Uma. I ag

[jira] [Commented] (HDFS-5477) Block manager as a service

2014-01-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870951#comment-13870951 ] Daryn Sharp commented on HDFS-5477: --- Yes, it is true that the BM will have a large heap.

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-14 Thread Vincent Sheffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870943#comment-13870943 ] Vincent Sheffer commented on HDFS-5677: --- Yet another option to help HDFS users would

[jira] [Commented] (HDFS-5760) Fix HttpServer construct

2014-01-14 Thread Eric Charles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870927#comment-13870927 ] Eric Charles commented on HDFS-5760: [~stack] yes, please move it to Hadoop Common, I d

[jira] [Updated] (HDFS-5329) Update FSNamesystem#getListing() to handle inode path in startAfter token

2014-01-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-5329: Component/s: nfs Hi Brandon, I'm adding "nfs" as a component of this bug in addition to namenode. W

[jira] [Commented] (HDFS-5760) Fix HttpServer construct

2014-01-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870913#comment-13870913 ] stack commented on HDFS-5760: - [~echarles] Do you mean 'Hadoop Common'? If so, I can move it t

[jira] [Commented] (HDFS-5318) Support read-only and read-write paths to shared replicas

2014-01-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870899#comment-13870899 ] Arpit Agarwal commented on HDFS-5318: - Yes of course. > Support read-only and read-wri

[jira] [Updated] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5752: - Attachment: h5752_20140114b.patch Thanks Jing for the review. h5752_20140114b.pat

[jira] [Updated] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5752: - Attachment: (was: h5752_20140114b.patch) > Add a new DFSAdminCommand for rolli

[jira] [Updated] (HDFS-5752) Add a new DFSAdminCommand for rolling upgrade

2014-01-14 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5752: - Attachment: h5752_20140114b.patch > Add a new DFSAdminCommand for rolling upgrade

[jira] [Commented] (HDFS-5760) Fix HttpServer construct

2014-01-14 Thread Eric Charles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13870795#comment-13870795 ] Eric Charles commented on HDFS-5760: btw, don't know why I created under HDFS. This is

[jira] [Updated] (HDFS-5760) Fix HttpServer construct

2014-01-14 Thread Eric Charles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Charles updated HDFS-5760: --- Attachment: HDFS-5760-2.patch Additional accessors and also parameter in the builder to make it more f

  1   2   >