[jira] [Commented] (HDFS-6824) Additional user documentation for HDFS encryption.

2014-10-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179619#comment-14179619 ] Yi Liu commented on HDFS-6824: -- +1 Thanks Andrew for the contribution. > Additional user doc

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Zhe Zhang (JIRA)
> HDFS-7165-20141015-v1.patch, HDFS-7165-20141021-v1.patch, > HDFS-7165-20141021-v2.patch > > > We see a lot of escalations because someone has written teragen output with a > replication factor of 1, a DN goes down, and a bunch of missing blocks show > up. These are no

[jira] [Commented] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179612#comment-14179612 ] Hadoop QA commented on HDFS-7276: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-10-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179551#comment-14179551 ] Yongjun Zhang commented on HDFS-7226: - Hi [~jingzhao], many thanks for your review and

[jira] [Updated] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-10-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7226: Attachment: HDFS-7226.003.patch > TestDNFencing.testQueueingWithAppend failed often in latest test >

[jira] [Updated] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-10-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7226: Attachment: (was: HDFS-7226.003.patch) > TestDNFencing.testQueueingWithAppend failed often in lat

[jira] [Updated] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-10-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-7226: Attachment: HDFS-7226.003.patch > TestDNFencing.testQueueingWithAppend failed often in latest test >

[jira] [Commented] (HDFS-7257) Add the time of last HA state transition to NN's /jmx page

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179532#comment-14179532 ] Hadoop QA commented on HDFS-7257: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7254) Add documents for hot swap drive

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179497#comment-14179497 ] Hadoop QA commented on HDFS-7254: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Hadoop QA (JIRA)
s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676217/HDFS-7165-20141021-v2.patch against trunk revision b294276. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch app

[jira] [Updated] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7276: -- Status: Patch Available (was: Open) > Limit the number of byte arrays used by DFSOutputS

[jira] [Updated] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-21 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7276: -- Attachment: h7276_20141021.patch h7276_20141021.patch: adds ByteArrayManager to limit the

[jira] [Assigned] (HDFS-7017) Implement OutputStream for libhdfs3

2014-10-21 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang reassigned HDFS-7017: -- Assignee: Zhanwei Wang > Implement OutputStream for libhdfs3 > -

[jira] [Created] (HDFS-7276) Limit the number of byte arrays used by DFSOutputStream

2014-10-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7276: - Summary: Limit the number of byte arrays used by DFSOutputStream Key: HDFS-7276 URL: https://issues.apache.org/jira/browse/HDFS-7276 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7226) TestDNFencing.testQueueingWithAppend failed often in latest test

2014-10-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179465#comment-14179465 ] Jing Zhao commented on HDFS-7226: - The patch looks good to me. Maybe we can change the "hea

[jira] [Commented] (HDFS-7257) Add the time of last HA state transition to NN's /jmx page

2014-10-21 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179435#comment-14179435 ] Haohui Mai commented on HDFS-7257: -- I wonder why the string format is required -- I suppos

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179434#comment-14179434 ] Yi Liu commented on HDFS-7243: -- Will commit later today. > HDFS concat operation should not b

[jira] [Updated] (HDFS-7257) Add the time of last HA state transition to NN's /jmx page

2014-10-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7257: --- Attachment: HDFS-7257.003.patch Hi [~andrew.wang], Thanks for the review! I've uploaded .003 of the p

[jira] [Commented] (HDFS-7270) Implementing congestion control in writing pipeline

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179406#comment-14179406 ] Colin Patrick McCabe commented on HDFS-7270: bq. Deriving the right configurati

[jira] [Commented] (HDFS-7014) Implement input and output streams to DataNode for native client

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179401#comment-14179401 ] Colin Patrick McCabe commented on HDFS-7014: I guess we can put the OutputStrea

[jira] [Resolved] (HDFS-7015) Implement C++ interface for file system for libhdfs3

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7015. Resolution: Duplicate > Implement C++ interface for file system for libhdfs3 > --

[jira] [Commented] (HDFS-7260) Make DFSOutputStream.MAX_PACKETS configurable

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179381#comment-14179381 ] Colin Patrick McCabe commented on HDFS-7260: How about calling this {{dfs.clien

[jira] [Commented] (HDFS-7258) CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179380#comment-14179380 ] Colin Patrick McCabe commented on HDFS-7258: Seems reasonable to me. We added

[jira] [Updated] (HDFS-7254) Add documents for hot swap drive

2014-10-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7254: Attachment: HDFS-7254.003.patch [~cmccabe] Sorry, it needs a rebase. This is the correct patch. > Ad

[jira] [Comment Edited] (HDFS-7254) Add documents for hot swap drive

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179372#comment-14179372 ] Colin Patrick McCabe edited comment on HDFS-7254 at 10/22/14 12:08 AM: --

[jira] [Commented] (HDFS-7254) Add documents for hot swap drive

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179372#comment-14179372 ] Colin Patrick McCabe commented on HDFS-7254: [~lei]: I think you included some

[jira] [Commented] (HDFS-6988) Add configurable limit for percentage-based eviction threshold

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179354#comment-14179354 ] Colin Patrick McCabe commented on HDFS-6988: That sounds reasonable to me. Tha

[jira] [Commented] (HDFS-7180) NFSv3 gateway frequently gets stuck

2014-10-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179349#comment-14179349 ] Jing Zhao commented on HDFS-7180: - The patch looks good to me. One question is that if we l

[jira] [Commented] (HDFS-7244) Reduce Namenode memory using Flyweight pattern

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179341#comment-14179341 ] Colin Patrick McCabe commented on HDFS-7244: bq. I wasn't planning on introduci

[jira] [Updated] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7165: Attachment: HDFS-7165-20141021-v2.patch The last patch was created wrong and missed one line in {{PBHelper

[jira] [Commented] (HDFS-7274) Disable SSLv3 (POODLEbleed vulnerability) in HttpFS

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179246#comment-14179246 ] Hadoop QA commented on HDFS-7274: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7275) Add TLSv1.2 to HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
Robert Kanter created HDFS-7275: --- Summary: Add TLSv1.2 to HttpFS Key: HDFS-7275 URL: https://issues.apache.org/jira/browse/HDFS-7275 Project: Hadoop HDFS Issue Type: Bug Components: w

[jira] [Commented] (HDFS-7225) Failed DataNode lookup can crash NameNode with NullPointerException

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179198#comment-14179198 ] Hadoop QA commented on HDFS-7225: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7274) Disable SSLv3 (POODLEbleed vulnerability) in HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated HDFS-7274: Attachment: HDFS-7274.patch The patch sets the sslEnabledProtocols to TLSv1,TLSv1.1. I would have als

[jira] [Updated] (HDFS-7274) Disable SSLv3 (POODLEbleed vulnerability) in HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated HDFS-7274: Status: Patch Available (was: Open) > Disable SSLv3 (POODLEbleed vulnerability) in HttpFS >

[jira] [Created] (HDFS-7274) Disable SSLv3 (POODLEbleed vulnerability) in HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
Robert Kanter created HDFS-7274: --- Summary: Disable SSLv3 (POODLEbleed vulnerability) in HttpFS Key: HDFS-7274 URL: https://issues.apache.org/jira/browse/HDFS-7274 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-7204) balancer doesn't run as a daemon

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179149#comment-14179149 ] Hudson commented on HDFS-7204: -- FAILURE: Integrated in Hadoop-trunk-Commit #6306 (See [https:

[jira] [Updated] (HDFS-7204) balancer doesn't run as a daemon

2014-10-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7204: --- Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HDFS-7225) Failed DataNode lookup can crash NameNode with NullPointerException

2014-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179124#comment-14179124 ] Zhe Zhang commented on HDFS-7225: - Sure we should cleanup when a DN is removed. {{wipeDatan

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Hadoop QA (JIRA)
s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676138/HDFS-7165-20141021-v1.patch against trunk revision 6f2028b. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch app

[jira] [Commented] (HDFS-7035) Make adding volume an atomic operation.

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179094#comment-14179094 ] Colin Patrick McCabe commented on HDFS-7035: Thanks for working on this. The p

[jira] [Updated] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated HDFS-7199: -- Assignee: (was: Chen He) > DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O > e

[jira] [Commented] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179051#comment-14179051 ] Colin Patrick McCabe commented on HDFS-6877: {code} 1231try { 1232

[jira] [Commented] (HDFS-7222) Expose DataNode network errors as a metric

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179043#comment-14179043 ] Hadoop QA commented on HDFS-7222: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7254) Add documents for hot swap drive

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179044#comment-14179044 ] Hadoop QA commented on HDFS-7254: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Work started] (HDFS-6988) Add configurable limit for percentage-based eviction threshold

2014-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6988 started by Xiaoyu Yao. > Add configurable limit for percentage-based eviction threshold > ---

[jira] [Commented] (HDFS-6988) Add configurable limit for percentage-based eviction threshold

2014-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179032#comment-14179032 ] Xiaoyu Yao commented on HDFS-6988: -- Thanks [~cmccabe] for the feedback. I'm picking up th

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179035#comment-14179035 ] Hudson commented on HDFS-6581: -- FAILURE: Integrated in Hadoop-trunk-Commit #6305 (See [https:

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-10-21 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6581: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Write to single re

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Andrew Wang (JIRA)
patch, > HDFS-7165-20141015-v1.patch, HDFS-7165-20141021-v1.patch > > > We see a lot of escalations because someone has written teragen output with a > replication factor of 1, a DN goes down, and a bunch of missing blocks show > up. These are normally false positives, since

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-10-21 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179025#comment-14179025 ] Jitendra Nath Pandey commented on HDFS-6581: Updated CHANGES.txt in trunk. > W

[jira] [Commented] (HDFS-7173) Only keep successfully loaded volumes in the configuration.

2014-10-21 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179004#comment-14179004 ] Colin Patrick McCabe commented on HDFS-7173: Looks good overall. Let's call th

[jira] [Assigned] (HDFS-6988) Add configurable limit for percentage-based eviction threshold

2014-10-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-6988: Assignee: Xiaoyu Yao > Add configurable limit for percentage-based eviction threshold >

[jira] [Commented] (HDFS-7257) Add the time of last HA state transition to NN's /jmx page

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178964#comment-14178964 ] Andrew Wang commented on HDFS-7257: --- Hi Charles, couple notes: * Need to use Time.now(),

[jira] [Commented] (HDFS-7221) TestDNFencingWithReplication fails consistently

2014-10-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178961#comment-14178961 ] Charles Lamb commented on HDFS-7221: Thanks [~andrew.wang] > TestDNFencingWithReplicat

[jira] [Commented] (HDFS-7221) TestDNFencingWithReplication fails consistently

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178956#comment-14178956 ] Hudson commented on HDFS-7221: -- FAILURE: Integrated in Hadoop-trunk-Commit #6304 (See [https:

[jira] [Updated] (HDFS-7221) TestDNFencingWithReplication fails consistently

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7221: -- Resolution: Fixed Fix Version/s: 2.7.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178939#comment-14178939 ] Andrew Wang commented on HDFS-6581: --- Hey Jitendra, could you update the trunk CHANGES.txt

[jira] [Commented] (HDFS-7221) TestDNFencingWithReplication fails consistently

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178933#comment-14178933 ] Andrew Wang commented on HDFS-7221: --- LGTM I'll commit shortly > TestDNFencingWithReplica

[jira] [Commented] (HDFS-7225) Failed DataNode lookup can crash NameNode with NullPointerException

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178907#comment-14178907 ] Andrew Wang commented on HDFS-7225: --- Why not do this cleanup immediately when we remove t

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2014-10-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178854#comment-14178854 ] Konstantin Shvachko commented on HDFS-7056: --- Hey Guo. Thanks for uploading the de

[jira] [Updated] (HDFS-7215) Add JvmPauseMonitor to NFS gateway

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7215: - Resolution: Fixed Status: Resolved (was: Patch Available) > Add JvmPauseMonitor to NFS gateway > -

[jira] [Updated] (HDFS-7215) Add JvmPauseMonitor to NFS gateway

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7215: - Fix Version/s: 2.6.0 > Add JvmPauseMonitor to NFS gateway > -- > >

[jira] [Updated] (HDFS-7225) Failed DataNode lookup can crash NameNode with NullPointerException

2014-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7225: Attachment: HDFS-7225-v2.patch This patch removes invalidation work under a DN if the lookup returns null. Th

[jira] [Updated] (HDFS-7222) Expose DataNode network errors as a metric

2014-10-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7222: --- Attachment: HDFS-7222.003.patch Thanks for the review [~andrew.wang]. Those are good suggestions and ar

[jira] [Commented] (HDFS-7215) Add JvmPauseMonitor to NFS gateway

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178839#comment-14178839 ] Brandon Li commented on HDFS-7215: -- Thank you, Colin! I've just committed the path. > Add

[jira] [Updated] (HDFS-7215) Add JvmPauseMonitor to NFS gateway

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7215: - Hadoop Flags: Reviewed > Add JvmPauseMonitor to NFS gateway > -- > >

[jira] [Commented] (HDFS-7215) Add JvmPauseMonitor to NFS gateway

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178833#comment-14178833 ] Hudson commented on HDFS-7215: -- FAILURE: Integrated in Hadoop-trunk-Commit #6302 (See [https:

[jira] [Updated] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7165: Attachment: HDFS-7165-20141021-v1.patch > Separate block metrics for files with replication coun

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178773#comment-14178773 ] Zhe Zhang commented on HDFS-7165: - Thanks, that makes sense. bq. In ClientProtocol#getStat

[jira] [Updated] (HDFS-7259) Unresponseive NFS mount point due to deferred COMMIT response

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7259: - Fix Version/s: 2.6.0 > Unresponseive NFS mount point due to deferred COMMIT response >

[jira] [Commented] (HDFS-6581) Write to single replica in memory

2014-10-21 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178741#comment-14178741 ] Jitendra Nath Pandey commented on HDFS-6581: I have merged this to branch-2 and

[jira] [Commented] (HDFS-7222) Expose DataNode network errors as a metric

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178718#comment-14178718 ] Andrew Wang commented on HDFS-7222: --- Hi Charles, thanks for working on this, few comments

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178706#comment-14178706 ] Andrew Wang commented on HDFS-7165: --- It's okay to make whitespace changes if they're near

[jira] [Commented] (HDFS-7259) Unresponseive NFS mount point due to deferred COMMIT response

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178697#comment-14178697 ] Hudson commented on HDFS-7259: -- FAILURE: Integrated in Hadoop-trunk-Commit #6300 (See [https:

[jira] [Commented] (HDFS-7165) Separate block metrics for files with replication count 1

2014-10-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178693#comment-14178693 ] Zhe Zhang commented on HDFS-7165: - [~andrew.wang] Thanks for the review. While I look into

[jira] [Updated] (HDFS-7259) Unresponseive NFS mount point due to deferred COMMIT response

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-7259: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Unrespo

[jira] [Commented] (HDFS-7259) Unresponseive NFS mount point due to deferred COMMIT response

2014-10-21 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178668#comment-14178668 ] Brandon Li commented on HDFS-7259: -- Thank you, Jing. I've committed the patch. > Unrespon

[jira] [Updated] (HDFS-7254) Add documents for hot swap drive

2014-10-21 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7254: Attachment: HDFS-7254.002.patch Thank you very much for spotting this typo, [~azuryy]. I have updated

[jira] [Commented] (HDFS-7184) Allow data migration tool to run as a daemon

2014-10-21 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178638#comment-14178638 ] Benoy Antony commented on HDFS-7184: I have opened HDFS-7273 to add the start/stop wra

[jira] [Commented] (HDFS-7273) Add start and stop wrapper scripts for mover

2014-10-21 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178641#comment-14178641 ] Benoy Antony commented on HDFS-7273: Will update the patch as soon as I test the script

[jira] [Created] (HDFS-7273) Add start and stop wrapper scripts for mover

2014-10-21 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-7273: -- Summary: Add start and stop wrapper scripts for mover Key: HDFS-7273 URL: https://issues.apache.org/jira/browse/HDFS-7273 Project: Hadoop HDFS Issue Type: Improv

[jira] [Updated] (HDFS-6964) NN fails to fix under replication leading to data loss

2014-10-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-6964: - Target Version/s: 2.7.0 (was: 2.6.0) > NN fails to fix under replication leading to data loss > --

[jira] [Commented] (HDFS-6964) NN fails to fix under replication leading to data loss

2014-10-21 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178625#comment-14178625 ] Kihwal Lee commented on HDFS-6964: -- Retargetting for 2.7.0 for now. If the issue is reprod

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178526#comment-14178526 ] Hadoop QA commented on HDFS-7243: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7272) Concurrency problem in Dfsck/URLConnectionFactory classes

2014-10-21 Thread Maciej Arciuch (JIRA)
Maciej Arciuch created HDFS-7272: Summary: Concurrency problem in Dfsck/URLConnectionFactory classes Key: HDFS-7272 URL: https://issues.apache.org/jira/browse/HDFS-7272 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-7266) HDFS Peercache enabled check should not lock on object

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178495#comment-14178495 ] Hudson commented on HDFS-7266: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1933 (See [htt

[jira] [Commented] (HDFS-7184) Allow data migration tool to run as a daemon

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178493#comment-14178493 ] Hudson commented on HDFS-7184: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1933 (See [htt

[jira] [Commented] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178500#comment-14178500 ] Hudson commented on HDFS-7154: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1933 (See [htt

[jira] [Commented] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178430#comment-14178430 ] Hudson commented on HDFS-7154: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1908 (See [https://

[jira] [Commented] (HDFS-7184) Allow data migration tool to run as a daemon

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178423#comment-14178423 ] Hudson commented on HDFS-7184: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1908 (See [https://

[jira] [Commented] (HDFS-7266) HDFS Peercache enabled check should not lock on object

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178425#comment-14178425 ] Hudson commented on HDFS-7266: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1908 (See [https://

[jira] [Commented] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-21 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178342#comment-14178342 ] Yi Liu commented on HDFS-7243: -- Thanks Charles for updating. +1, pending jenkins. > HDFS

[jira] [Commented] (HDFS-7257) Add the time of last HA state transition to NN's /jmx page

2014-10-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178335#comment-14178335 ] Charles Lamb commented on HDFS-7257: The two failures (TestDNFencing) are known failure

[jira] [Updated] (HDFS-7243) HDFS concat operation should not be allowed in Encryption Zone

2014-10-21 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7243: --- Attachment: HDFS-7243.004.patch [~hitliuyi], Oh yes, good points. The latest patch addesses this. Tha

[jira] [Commented] (HDFS-7266) HDFS Peercache enabled check should not lock on object

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178306#comment-14178306 ] Hudson commented on HDFS-7266: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #719 (See [https://b

[jira] [Commented] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178311#comment-14178311 ] Hudson commented on HDFS-7154: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #719 (See [https://b

[jira] [Commented] (HDFS-7184) Allow data migration tool to run as a daemon

2014-10-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178304#comment-14178304 ] Hudson commented on HDFS-7184: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #719 (See [https://b

[jira] [Updated] (HDFS-7268) Can't append with SYNC_BLOCK

2014-10-21 Thread Bogdan Raducanu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Raducanu updated HDFS-7268: -- Description: It seems to me that currently it's not possible to start appending to a file with C

[jira] [Commented] (HDFS-6658) Namenode memory optimization - Block replicas list

2014-10-21 Thread Amir Langer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178078#comment-14178078 ] Amir Langer commented on HDFS-6658: --- Thanks [~shv] I agree that the scenario of a remove

  1   2   >