[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-30 Thread Jingcheng Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingcheng Du updated HDFS-9668: --- Attachment: HDFS-9668-6.patch Rebase and upload the new patch V6 to fix the merging issues. [~drankye],

[jira] [Comment Edited] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451307#comment-15451307 ] Xiao Chen edited comment on HDFS-10820 at 8/31/16 6:23 AM: --- +1,

[jira] [Commented] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451307#comment-15451307 ] Xiao Chen commented on HDFS-10820: -- +1, will commit after 24 hours. > Reuse closeRespond

[jira] [Updated] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10820: - Summary: Reuse closeResponder to reset the response variable in DataStreamer#run (was: DataStreamer#Respo

[jira] [Commented] (HDFS-10820) DataStreamer#Responder close fails that break down the pipeline recovery

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451293#comment-15451293 ] Hadoop QA commented on HDFS-10820: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails that break down the pipeline recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Summary: DataStreamer#Responder close fails that break down the pipeline recovery (was: DataStreamer#Resp

[jira] [Commented] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451268#comment-15451268 ] Hadoop QA commented on HDFS-10426: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Priority: Minor (was: Major) > DataStreamer#Responder close fails lead the error recovery > -

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Attachment: HDFS-10820.002.patch Good catch, thanks [~xiaochen] for the quick review! Attach a new patch f

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451232#comment-15451232 ] Hadoop QA commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9668: Fix Version/s: 3.0.0-alpha2 Status: Patch Available (was: Open) > Optimize the locking in FsDatas

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed to branch-2.7. > Fix

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Fix Version/s: 2.7.4 > Fix path related byte array conversion bugs > -

[jira] [Commented] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451131#comment-15451131 ] Xiao Chen commented on HDFS-10820: -- This is a trivial refactor, so no test needed. Error

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451120#comment-15451120 ] Xiao Chen commented on HDFS-6532: - Yep, sadly I'm not able to locally reproduce this at all

[jira] [Commented] (HDFS-9696) Garbage snapshot records lingering forever

2016-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451074#comment-15451074 ] Brahma Reddy Battula commented on HDFS-9696: Oh, branch-2.6 patch is same with

[jira] [Updated] (HDFS-9696) Garbage snapshot records lingering forever

2016-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9696: --- Attachment: HDFS-9696-branch-2.7.patch FYR..Uploading the branch-2.7 patch which was c

[jira] [Updated] (HDFS-10426) TestPendingInvalidateBlock failed in trunk

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10426: - Attachment: HDFS-10426.004.patch I make a improvement based on my last patch. I construct a new method for

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450964#comment-15450964 ] Hadoop QA commented on HDFS-10713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450902#comment-15450902 ] Hadoop QA commented on HDFS-10817: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450892#comment-15450892 ] Hadoop QA commented on HDFS-4025: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-10722) Fix race condition in TestEditLog#testBatchedSyncWithClosedLogs

2016-08-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450875#comment-15450875 ] Brahma Reddy Battula commented on HDFS-10722: - As this is reverted from branch

[jira] [Commented] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450870#comment-15450870 ] Hadoop QA commented on HDFS-10780: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450844#comment-15450844 ] Hadoop QA commented on HDFS-10820: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450833#comment-15450833 ] Yiqun Lin commented on HDFS-6532: - Thanks [~xiaochen] for the comment. {quote} It does look

[jira] [Comment Edited] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450798#comment-15450798 ] Yiqun Lin edited comment on HDFS-10820 at 8/31/16 2:13 AM: --- Atta

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Attachment: HDFS-10820.001.patch > DataStreamer#Responder close fails lead the error recovery > --

[jira] [Updated] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10820: - Status: Patch Available (was: Open) Attach a simple patch for fixing this. According the comment from [~x

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.001.patch Thank you [~arpitagarwal] for reviewing the patch. I have fixed

[jira] [Created] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10820: Summary: DataStreamer#Responder close fails lead the error recovery Key: HDFS-10820 URL: https://issues.apache.org/jira/browse/HDFS-10820 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450779#comment-15450779 ] Manoj Govindassamy commented on HDFS-10780: --- Filed HDFS-10819 to track the Probl

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450777#comment-15450777 ] Hadoop QA commented on HDFS-10742: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450774#comment-15450774 ] Hudson commented on HDFS-10813: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10819: -- Description: TestDataNodeHotSwapVolumes occasionally fails in the unit test testRemoveV

[jira] [Created] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-08-30 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10819: - Summary: BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck Key: HDFS-10819 URL: https://issues.

[jira] [Updated] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10813: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) [~

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450738#comment-15450738 ] Erik Krogen commented on HDFS-10817: Thanks for the comments [~zhz]! Uploading a new p

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Attachment: HDFS-10817.002.patch > Add Logging for Long-held NN Read Locks > -

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450716#comment-15450716 ] Anu Engineer commented on HDFS-10813: - [~linyiqun] You are right, I was anticipating t

[jira] [Commented] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450701#comment-15450701 ] Hadoop QA commented on HDFS-10655: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450689#comment-15450689 ] Hadoop QA commented on HDFS-10655: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10780: -- Attachment: HDFS-10780.001.patch More details on the Issue 1: *Problem:* — After pipeli

[jira] [Updated] (HDFS-10780) Block replication not proceeding after pipeline recovery -- TestDataNodeHotSwapVolumes fails

2016-08-30 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10780: -- Status: Patch Available (was: Open) > Block replication not proceeding after pipeline r

[jira] [Updated] (HDFS-4025) QJM: Sychronize past log segments to JNs that missed them

2016-08-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-4025: - Attachment: HDFS-4025.001.patch Thank you [~jingzhao] for reviewing the patch and suggesting improv

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450677#comment-15450677 ] Anu Engineer commented on HDFS-10808: - [~eddyxu] Thank you very much for taking time o

[jira] [Comment Edited] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450640#comment-15450640 ] Yiqun Lin edited comment on HDFS-10813 at 8/31/16 12:59 AM: Th

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450640#comment-15450640 ] Yiqun Lin commented on HDFS-10813: -- Thanks [~anu] for the review. {quote} could you plea

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450609#comment-15450609 ] Hadoop QA commented on HDFS-10817: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-10808) DiskBalancer does not execute multi-steps plan-redux

2016-08-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450594#comment-15450594 ] Lei (Eddy) Xu commented on HDFS-10808: -- Thanks for the explanation, [~anu] bq. The

[jira] [Updated] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10742: -- Attachment: HDFS-10742.009.patch Removed per-method measurement and aggregate stats to minimize overhead

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450558#comment-15450558 ] Zhe Zhang commented on HDFS-10817: -- Thanks [~xkrogen] for the work! Patch looks pretty go

[jira] [Assigned] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reassigned HDFS-9392: - Assignee: Ming Ma > Admins support for maintenance state > > >

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Attachment: HDFS-10817.001.patch Uploaded new patch that doesn't use semaphores; forgot about Java's

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450440#comment-15450440 ] Xiao Chen commented on HDFS-10784: -- Thanks for the new patch, Andrew. Checkstyle is not

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-30 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450435#comment-15450435 ] Fenghua Hu commented on HDFS-10804: --- [~vagarychen], thanks for the suggestion. My intent

[jira] [Commented] (HDFS-9038) DFS reserved space is erroneously counted towards non-DFS used.

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450427#comment-15450427 ] Arpit Agarwal commented on HDFS-9038: - Thanks for sticking with this difficult fix [~br

[jira] [Commented] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450414#comment-15450414 ] Erik Krogen commented on HDFS-10817: Added a patch to implement this with a configurab

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Attachment: HDFS-10817.000.patch > Add Logging for Long-held NN Read Locks > -

[jira] [Updated] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10817: --- Status: Patch Available (was: In Progress) > Add Logging for Long-held NN Read Locks > --

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Attachment: HDFS-10655-branch-2.7.patch branch-2.7 patch attached. > Fix path related byte array conversi

[jira] [Updated] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10655: - Status: Patch Available (was: Reopened) > Fix path related byte array conversion bugs > -

[jira] [Reopened] (HDFS-10655) Fix path related byte array conversion bugs

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10655: -- Sorry to reopen it, I want to backport it to branch-2.7 and have a full Jenkins run before doing that. > F

[jira] [Created] (HDFS-10818) KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request

2016-08-30 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10818: - Summary: KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request Key: HDFS-10818 URL: https://issues.apache.org/jira/browse/HDFS-10818 Pro

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-08-30 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450224#comment-15450224 ] Kai Zheng commented on HDFS-8901: - Hey [~zhz], Do you think [~Sammi] and the latest patch

[jira] [Resolved] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma resolved HDFS-9392. --- Resolution: Fixed > Admins support for maintenance state > > >

[jira] [Reopened] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma reopened HDFS-9392: --- > Admins support for maintenance state > > > Key: HDFS-9392 >

[jira] [Commented] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450186#comment-15450186 ] Hudson commented on HDFS-9392: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1037

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-08-30 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9392: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-9953) Download File from UI broken after pagination

2016-08-30 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450131#comment-15450131 ] Ravi Prakash commented on HDFS-9953: Yupp. Sorry about that. I forgot initially and the

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450042#comment-15450042 ] Rushabh S Shah commented on HDFS-10816: --- Forgot to mention +1 (non-binding) > TestC

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15450035#comment-15450035 ] Rushabh S Shah commented on HDFS-10816: --- [~ebadger]: Thanks for reporting and analyz

[jira] [Commented] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449980#comment-15449980 ] Arpit Agarwal commented on HDFS-10742: -- Hi [~vagarychen], a couple of comments: # {{c

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449965#comment-15449965 ] Xiao Chen commented on HDFS-6532: - Thanks Yiqun for working on this. It does look like we c

[jira] [Commented] (HDFS-10729) NameNode crashes when loading edits because max directory items is exceeded

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449921#comment-15449921 ] Wei-Chiu Chuang commented on HDFS-10729: All failed tests passed locally. [~kihwal

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449865#comment-15449865 ] Zhe Zhang commented on HDFS-9145: - Thanks [~kihwal] for noticing this. But are we still usi

[jira] [Commented] (HDFS-10799) NameNode should use loginUser(hdfs) to serve iNotify requests

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449857#comment-15449857 ] Wei-Chiu Chuang commented on HDFS-10799: Correct me if I am wrong, but wouldn't ug

[jira] [Commented] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449841#comment-15449841 ] Vinitha Reddy Gankidi commented on HDFS-10809: -- Thanks [~zhz]. I could not re

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2016-08-30 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449824#comment-15449824 ] Roman Shaposhnik commented on HDFS-6994: Note to everybody, but most recently [~sga

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449812#comment-15449812 ] Hadoop QA commented on HDFS-10784: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6994) libhdfs3 - A native C/C++ HDFS client

2016-08-30 Thread Stephen G Ahlgren (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449810#comment-15449810 ] Stephen G Ahlgren commented on HDFS-6994: - Thank you for the note Zhanwei. I've be

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10809: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) Just com

[jira] [Updated] (HDFS-10809) getNumEncryptionZones causes NPE in branch-2.7

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10809: - Hadoop Flags: Reviewed Thanks Vinitha. +1 on the patch. Reported test failures are not related and I veri

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-08-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449776#comment-15449776 ] Arpit Agarwal commented on HDFS-10713: -- Thanks for the patch [~hanishakoneru]. # We c

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449734#comment-15449734 ] Hudson commented on HDFS-10760: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Fix Version/s: 3.0.0-alpha2 > DataXceiver#run() should not log InvalidToken exception as an er

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availabl

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Hadoop Flags: Reviewed Release Note: Log InvalidTokenException at debug level in DataXceive

[jira] [Updated] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10760: --- Release Note: Log InvalidTokenException at trace level in DataXceiver#run(). (was: Log Invali

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449672#comment-15449672 ] Eric Badger commented on HDFS-10816: The test failure is unrelated to the patch > Tes

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449652#comment-15449652 ] Hadoop QA commented on HDFS-10816: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449598#comment-15449598 ] Vinitha Reddy Gankidi commented on HDFS-10814: -- Thanks Zhe and Andrew! > Add

[jira] [Commented] (HDFS-10804) Use finer-granularity lock for ReplicaMap

2016-08-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449549#comment-15449549 ] Chen Liang commented on HDFS-10804: --- Hi [~fenghua_hu], thanks for the work! Instead of

[jira] [Updated] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10784: --- Attachment: HDFS-10784.003.patch Thanks for reviewing Xiao. Yep, we should hit HttpFS also, but if you

[jira] [Commented] (HDFS-10760) DataXceiver#run() should not log InvalidToken exception as an error

2016-08-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449489#comment-15449489 ] Wei-Chiu Chuang commented on HDFS-10760: Thanks for correcting me. You're right ab

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-08-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449485#comment-15449485 ] Anu Engineer commented on HDFS-10813: - [~linyiqun] Thanks for the patch. I will commit

[jira] [Work started] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10817 started by Erik Krogen. -- > Add Logging for Long-held NN Read Locks > --- >

[jira] [Created] (HDFS-10817) Add Logging for Long-held NN Read Locks

2016-08-30 Thread Erik Krogen (JIRA)
Erik Krogen created HDFS-10817: -- Summary: Add Logging for Long-held NN Read Locks Key: HDFS-10817 URL: https://issues.apache.org/jira/browse/HDFS-10817 Project: Hadoop HDFS Issue Type: Improveme

[jira] [Updated] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10814: --- Fix Version/s: (was: 3.0.0-alpha1) 3.0.0-alpha2 > Add assertion for getNumEncry

[jira] [Updated] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2016-08-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-10816: --- Attachment: HDFS-10816.001.patch Attaching patch to stop the replication monitor in the @Before method

[jira] [Commented] (HDFS-10814) Add assertion for getNumEncryptionZones when no EZ is created

2016-08-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15449389#comment-15449389 ] Zhe Zhang commented on HDFS-10814: -- Thanks Andrew for taking care of this. > Add asserti

  1   2   >