[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871779#comment-13871779 ] Hadoop QA commented on HDFS-5704: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5778) Document new commands and parameters for improved rolling upgrades

2014-01-15 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created HDFS-5778: --- Summary: Document new commands and parameters for improved rolling upgrades Key: HDFS-5778 URL: https://issues.apache.org/jira/browse/HDFS-5778 Project: Hadoop HDFS

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871812#comment-13871812 ] Andrew Wang commented on HDFS-5704: --- Just a heads up, there's been another LV change in

[jira] [Issue Comment Deleted] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-5704: -- Comment: was deleted (was: Just a heads up, there's been another LV change in trunk/branch-2. We

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871895#comment-13871895 ] Hadoop QA commented on HDFS-5777: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Vijay (JIRA)
Vijay created HDFS-5779: --- Summary: Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name Key: HDFS-5779 URL: https://issues.apache.org/jira/browse/HDFS-5779

[jira] [Updated] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Vijay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay updated HDFS-5779: Description: xx@testhost:/home/xx/Lab/hdfs/namenodep$ hadoop namenode -format Warning: $HADOOP_HOME is

[jira] [Updated] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Vijay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay updated HDFS-5779: Description: xx@testhost:/home/xx/Lab/hdfs/namenodep$ hadoop namenode -format Warning: $HADOOP_HOME is

[jira] [Commented] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Vijay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871917#comment-13871917 ] Vijay commented on HDFS-5779: - As per this, I feel the login user Id is not getting picked ..

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871936#comment-13871936 ] Hudson commented on HDFS-5704: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #453 (See

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13871935#comment-13871935 ] Hudson commented on HDFS-5677: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #453 (See

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872054#comment-13872054 ] Hudson commented on HDFS-5677: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1670 (See

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872047#comment-13872047 ] Hudson commented on HDFS-5704: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1645 (See

[jira] [Commented] (HDFS-5677) Need error checking for HA cluster configuration

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872046#comment-13872046 ] Hudson commented on HDFS-5677: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1645 (See

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872055#comment-13872055 ] Hudson commented on HDFS-5704: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1670 (See

[jira] [Updated] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5704: - Component/s: namenode Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872058#comment-13872058 ] Tsz Wo (Nicholas), SZE commented on HDFS-5777: -- Need to fix editsStored files

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872081#comment-13872081 ] Tsz Wo (Nicholas), SZE commented on HDFS-5704: -- +1 the branch-2 patch looks

[jira] [Resolved] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-5779. -- Resolution: Invalid A configuration problem, not a bug in hadoop, Closing as invalid. Sorry

[jira] [Commented] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Vijay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872129#comment-13872129 ] Vijay commented on HDFS-5779: - Hi Steve, Can you suggest any workaround for my problem.

[jira] [Commented] (HDFS-5585) Provide admin commands for data node upgrade

2014-01-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872214#comment-13872214 ] Kihwal Lee commented on HDFS-5585: -- bq. The nice thing about going through NN is NN has

[jira] [Commented] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

2014-01-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872269#comment-13872269 ] Kihwal Lee commented on HDFS-5535: -- bq. The total time required to upgrade a cluster MUST

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-5138: - Attachment: HDFS-5138.patch Attached patch is no different from the last, except for again

[jira] [Commented] (HDFS-5535) Umbrella jira for improved HDFS rolling upgrades

2014-01-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872303#comment-13872303 ] Kihwal Lee commented on HDFS-5535: -- {quote} bq. This will allow an 8600 node cluster to

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872331#comment-13872331 ] Suresh Srinivas commented on HDFS-5777: --- [~jingzhao], alternatively we can move the

[jira] [Commented] (HDFS-5778) Document new commands and parameters for improved rolling upgrades

2014-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872357#comment-13872357 ] Suresh Srinivas commented on HDFS-5778: --- [~ajisakaa], this an many other commands

[jira] [Updated] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-15 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack updated HDFS-5776: Summary: Support 'hedged' reads in DFSClient (was: support quorum read in DFSClient) Support 'hedged' reads in

[jira] [Commented] (HDFS-5776) Support 'hedged' reads in DFSClient

2014-01-15 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872402#comment-13872402 ] stack commented on HDFS-5776: - I had a go at the subject for you [~xieliang007] I am a native

[jira] [Commented] (HDFS-5766) bypass addToDeadNodes() while InvalidEncryptionKeyException happens in fetchBlockByteRange

2014-01-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872430#comment-13872430 ] Colin Patrick McCabe commented on HDFS-5766: +1. Thanks, Liang. bypass

[jira] [Commented] (HDFS-5241) Provide alternate queuing audit logger to reduce logging contention

2014-01-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872438#comment-13872438 ] Daryn Sharp commented on HDFS-5241: --- I can document in the defaults if you'd like. I'd

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872439#comment-13872439 ] Haohui Mai commented on HDFS-5768: -- The failure looks like a transient one. I ran the test

[jira] [Updated] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5762: --- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-5242) Reduce contention on DatanodeInfo instances

2014-01-15 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5242: -- Attachment: HDFS-5242.patch Added volatile to the reference. AtomicReference is just a wrapper around

[jira] [Updated] (HDFS-5766) In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange

2014-01-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5766: --- Summary: In DFSInputStream, do not add datanode to deadNodes after

[jira] [Updated] (HDFS-5766) In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange

2014-01-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5766: --- Resolution: Fixed Fix Version/s: 2.4.0 Target Version/s: 2.4.0

[jira] [Updated] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5777: Attachment: HDFS-5777.001.patch editsStored Thanks for the review Nicholas and Suresh!

[jira] [Commented] (HDFS-5762) BlockReaderLocal doesn't return -1 on EOF when doing zero-length reads

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872474#comment-13872474 ] Hudson commented on HDFS-5762: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5003 (See

[jira] [Commented] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872476#comment-13872476 ] Jing Zhao commented on HDFS-5704: - Thanks Nicholas! Then I will create a separate jira for

[jira] [Updated] (HDFS-5704) Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5704: Resolution: Fixed Fix Version/s: 3.0.0 Release Note: Add a new editlog record (OP_ADD_BLOCK)

[jira] [Created] (HDFS-5780) TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN times out intemittently on branch-2

2014-01-15 Thread Mit Desai (JIRA)
Mit Desai created HDFS-5780: --- Summary: TestRBWBlockInvalidation#testBlockInvalidationWhenRBWReplicaMissedInDN times out intemittently on branch-2 Key: HDFS-5780 URL: https://issues.apache.org/jira/browse/HDFS-5780

[jira] [Updated] (HDFS-5780) TestRBWBlockInvalidation times out intemittently on branch-2

2014-01-15 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HDFS-5780: Summary: TestRBWBlockInvalidation times out intemittently on branch-2 (was:

[jira] [Updated] (HDFS-5780) TestRBWBlockInvalidation times out intemittently on branch-2

2014-01-15 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HDFS-5780: Description: i recently found out that the test

[jira] [Updated] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2014-01-15 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HDFS-5324: Attachment: Checklist Of Changes.docx This document lists all the changes to existing trunk

[jira] [Updated] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2014-01-15 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HDFS-5324: Attachment: trunk_1544305_12-12-13.patch Current patch for trunk. Even if the size of the

[jira] [Updated] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2014-01-15 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HDFS-5324: Status: Patch Available (was: Open) Make Namespace implementation pluggable in the

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872503#comment-13872503 ] Hadoop QA commented on HDFS-5138: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2014-01-15 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872506#comment-13872506 ] Milind Bhandarkar commented on HDFS-5324: - Most of the work on this patch has been

[jira] [Commented] (HDFS-5766) In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange

2014-01-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872511#comment-13872511 ] Hudson commented on HDFS-5766: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5004 (See

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2014-01-15 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872510#comment-13872510 ] Milind Bhandarkar commented on HDFS-5324: - Soliciting feedback. Make Namespace

[jira] [Created] (HDFS-5781) Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value

2014-01-15 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-5781: --- Summary: Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value Key: HDFS-5781 URL: https://issues.apache.org/jira/browse/HDFS-5781 Project:

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Description: When the number of blocks on the DataNode grows large we start running into a few

[jira] [Updated] (HDFS-5774) Serialize CachePool directives in protobuf

2014-01-15 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5774: - Attachment: HDFS-5774.000.patch Serialize CachePool directives in protobuf

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Description: When the number of blocks on the DataNode grows large we start running into a few

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Affects Version/s: (was: Heterogeneous Storage (HDFS-2832)) 3.0.0

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Description: When the number of blocks on the DataNode grows large we start running into a few

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-2832) Datanode should stagger

[jira] [Updated] (HDFS-5781) Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5781: Attachment: HDFS-5781.000.patch Use a map to record the mapping between FSEditLogOpCode and the

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: HDFS-5153.01.patch Preliminary patch to get Jenkins test results. Datanode should

[jira] [Commented] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872518#comment-13872518 ] Hadoop QA commented on HDFS-5324: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5781) Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5781: Status: Patch Available (was: Open) Use a map to record the mapping between FSEditLogOpCode and the

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Description: When the number of blocks on the DataNode grows large we start running into a few

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Description: When the number of blocks on the DataNode grows large we start running into a few

[jira] [Commented] (HDFS-4858) HDFS DataNode to NameNode RPC should timeout

2014-01-15 Thread Henry Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872528#comment-13872528 ] Henry Wang commented on HDFS-4858: -- Wasn't able to reproduce TestDFSClientRetries failure

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Status: Patch Available (was: Open) Datanode should stagger block reports from individual

[jira] [Commented] (HDFS-5608) WebHDFS: implement GETACLSTATUS and SETACL.

2014-01-15 Thread Sachin Jose (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872533#comment-13872533 ] Sachin Jose commented on HDFS-5608: --- Thank you for the detailed review. Please review the

[jira] [Updated] (HDFS-5608) WebHDFS: implement GETACLSTATUS and SETACL.

2014-01-15 Thread Sachin Jose (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sachin Jose updated HDFS-5608: -- Attachment: HDFS-5608.2.patch WebHDFS: implement GETACLSTATUS and SETACL.

[jira] [Commented] (HDFS-5749) Access time of HDFS directories stays at 1969-12-31

2014-01-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872538#comment-13872538 ] Yongjun Zhang commented on HDFS-5749: - I found the reason that the access time stays at

[jira] [Resolved] (HDFS-5749) Access time of HDFS directories stays at 1969-12-31

2014-01-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-5749. - Resolution: Not A Problem Access time of HDFS directories stays at 1969-12-31

[jira] [Commented] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872539#comment-13872539 ] Hadoop QA commented on HDFS-5153: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5779) Caused by: javax.security.auth.login.LoginException: java.lang.NullPointerException: invalid null input: name

2014-01-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872568#comment-13872568 ] Steve Loughran commented on HDFS-5779: -- no. Follow the link for suggestions on how to

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: (was: HDFS-5153.01.patch) Datanode should stagger block reports from individual

[jira] [Updated] (HDFS-5153) Datanode should stagger block reports from individual storages

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Attachment: HDFS-5153.01.patch Datanode should stagger block reports from individual storages

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872577#comment-13872577 ] Todd Lipcon commented on HDFS-5138: --- +1, lgtm Support HDFS upgrade in HA

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872592#comment-13872592 ] Suresh Srinivas commented on HDFS-5138: --- Still looking through the patch. Can some of

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872604#comment-13872604 ] Aaron T. Myers commented on HDFS-5138: -- bq. Can some of the unnecessary import changes

[jira] [Commented] (HDFS-5194) Robust support for alternate FsDatasetSpi implementations

2014-01-15 Thread David Powell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872613#comment-13872613 ] David Powell commented on HDFS-5194: Hi Arpit, Thanks for taking a look. I'll try to

[jira] [Updated] (HDFS-5758) NameNode: complete implementation of inode modifications for ACLs.

2014-01-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5758: Attachment: HDFS-5758.2.patch I'm uploading patch version 2. This is the complete patch this time,

[jira] [Created] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

2014-01-15 Thread David Powell (JIRA)
David Powell created HDFS-5782: -- Summary: BlockListAsLongs should take lists of Replicas rather than concrete classes Key: HDFS-5782 URL: https://issues.apache.org/jira/browse/HDFS-5782 Project: Hadoop

[jira] [Updated] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

2014-01-15 Thread David Powell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Powell updated HDFS-5782: --- Attachment: HDFS-5782.patch BlockListAsLongs should take lists of Replicas rather than concrete

[jira] [Updated] (HDFS-5782) BlockListAsLongs should take lists of Replicas rather than concrete classes

2014-01-15 Thread David Powell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Powell updated HDFS-5782: --- Target Version/s: 3.0.0 Status: Patch Available (was: Open) BlockListAsLongs should

[jira] [Updated] (HDFS-5689) FsDatasetImpl registers mbean using uninitialized DataNode UUID

2014-01-15 Thread David Powell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Powell updated HDFS-5689: --- Fix Version/s: (was: 3.0.0) FsDatasetImpl registers mbean using uninitialized DataNode UUID

[jira] [Commented] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2014-01-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872634#comment-13872634 ] Todd Lipcon commented on HDFS-5223: --- Just skimmed really quick. I noticed that this

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872657#comment-13872657 ] Suresh Srinivas commented on HDFS-5138: --- [~atm], I am looking at this patch. As I see

[jira] [Commented] (HDFS-5242) Reduce contention on DatanodeInfo instances

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872661#comment-13872661 ] Hadoop QA commented on HDFS-5242: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872660#comment-13872660 ] Suresh Srinivas commented on HDFS-5138: --- Another thing that comes mind is, the lock

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872670#comment-13872670 ] Suresh Srinivas commented on HDFS-5138: --- bq. That probably happened while resolving

[jira] [Commented] (HDFS-5777) Update LayoutVersion for the new editlog op OP_ADD_BLOCK

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872675#comment-13872675 ] Hadoop QA commented on HDFS-5777: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5153) Datanode should send block reports for each storage in a separate message

2014-01-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5153: Summary: Datanode should send block reports for each storage in a separate message (was: Datanode

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2014-01-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872690#comment-13872690 ] Aaron T. Myers commented on HDFS-5138: -- bq. In documentation you say [[2]] Both NNs

[jira] [Commented] (HDFS-5781) Use a map to record the mapping between FSEditLogOpCode and the corresponding byte value

2014-01-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872696#comment-13872696 ] Hadoop QA commented on HDFS-5781: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5768: Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-5698) Consolidate the

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872741#comment-13872741 ] Jing Zhao commented on HDFS-5768: - Let's do code refactoring in trunk. Consolidate the

[jira] [Updated] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5775: Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-5698) Consolidate the code for

[jira] [Commented] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872753#comment-13872753 ] Brandon Li commented on HDFS-5768: -- +1 Consolidate the serialization code in

[jira] [Updated] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5775: - Affects Version/s: 3.0.0 Consolidate the code for serialization in CacheManager

[jira] [Commented] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872758#comment-13872758 ] Brandon Li commented on HDFS-5775: -- +1 Consolidate the code for serialization in

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5768: - Component/s: namenode Consolidate the serialization code in DelegationTokenSecretManager

[jira] [Updated] (HDFS-5775) Consolidate the code for serialization in CacheManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5775: - Component/s: namenode Consolidate the code for serialization in CacheManager

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5768: - Affects Version/s: (was: HDFS-5698 (FSImage in protobuf)) 3.0.0 Consolidate

[jira] [Updated] (HDFS-5768) Consolidate the serialization code in DelegationTokenSecretManager

2014-01-15 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-5768: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

  1   2   >