[jira] [Created] (HDFS-10669) error while creating collection in solr

2016-07-20 Thread SHIVADEEP GUNDOJU (JIRA)
SHIVADEEP GUNDOJU created HDFS-10669: Summary: error while creating collection in solr Key: HDFS-10669 URL: https://issues.apache.org/jira/browse/HDFS-10669 Project: Hadoop HDFS Issue Typ

[jira] [Updated] (HDFS-10642) Fix intermittently failing UT TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas

2016-07-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10642: - Issue Type: Sub-task (was: Bug) Parent: HDFS-10666 > Fix intermittently failing UT > Tes

[jira] [Assigned] (HDFS-10667) Report more accurate info about data corruption location

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-10667: - Assignee: Yuanbo Liu > Report more accurate info about data corruption location > ---

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-10652: - Attachment: HDFS-10652.004.patch v3 patch was looking good. Just updated the same with simple chec

[jira] [Work started] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

2016-07-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10666 started by Mingliang Liu. > Über-jira: Unit tests should not use fixed sleep interval to wait for > condit

[jira] [Updated] (HDFS-10666) Über-jira: Unit tests should not use fixed sleep interval to wait for conditions

2016-07-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10666: - Summary: Über-jira: Unit tests should not use fixed sleep interval to wait for conditions (was: Ü

[jira] [Updated] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10668: - Status: Patch Available (was: Open) > Fix intermittently failing UT TestDataNodeMXBean#testDataNo

[jira] [Updated] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10668: - Attachment: HDFS-10668.000.patch [~brahmareddy], do you want to have a look? Thanks. > Fix interm

[jira] [Created] (HDFS-10668) Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount

2016-07-20 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10668: Summary: Fix intermittently failing UT TestDataNodeMXBean#testDataNodeMXBeanBlockCount Key: HDFS-10668 URL: https://issues.apache.org/jira/browse/HDFS-10668 Project:

[jira] [Created] (HDFS-10667) Report more accurate info about data corruption location

2016-07-20 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-10667: Summary: Report more accurate info about data corruption location Key: HDFS-10667 URL: https://issues.apache.org/jira/browse/HDFS-10667 Project: Hadoop HDFS

[jira] [Created] (HDFS-10666) Über-jira: Unit tests should not depend on nondeterministic behavior using fixed sleep interval

2016-07-20 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-10666: Summary: Über-jira: Unit tests should not depend on nondeterministic behavior using fixed sleep interval Key: HDFS-10666 URL: https://issues.apache.org/jira/browse/HDFS-10666

[jira] [Resolved] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-10587. -- Resolution: Duplicate Fix Version/s: 2.7.1, 2.6.4 Closing this jira as duplicate of HDFS-

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387219#comment-15387219 ] Hadoop QA commented on HDFS-10652: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386887#comment-15386887 ] John Zhuge edited comment on HDFS-6962 at 7/21/16 5:41 AM: --- Thank

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387207#comment-15387207 ] Yuanbo Liu commented on HDFS-10645: --- uploaded v4 patch > Make block report size as a me

[jira] [Updated] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10645: -- Attachment: HDFS-10645.004.patch > Make block report size as a metric and add this metric to datanode we

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387179#comment-15387179 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386792#comment-15386792 ] Yongjun Zhang edited comment on HDFS-10652 at 7/21/16 5:12 AM: -

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387160#comment-15387160 ] Hadoop QA commented on HDFS-10225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387155#comment-15387155 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387153#comment-15387153 ] Hadoop QA commented on HDFS-10660: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387129#comment-15387129 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387094#comment-15387094 ] Hadoop QA commented on HDFS-10654: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387083#comment-15387083 ] Yongjun Zhang commented on HDFS-10587: -- Thanks for your reply [~xupener]. Yes, HDFS

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387066#comment-15387066 ] Hadoop QA commented on HDFS-10519: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387057#comment-15387057 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10651: - Status: Patch Available (was: Open) Re-submit the patch to trigger the building. > Clean up some configu

[jira] [Updated] (HDFS-10651) Clean up some configuration related codes about legacy block reader

2016-07-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10651: - Status: Open (was: Patch Available) > Clean up some configuration related codes about legacy block reader

[jira] [Commented] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387045#comment-15387045 ] xupeng commented on HDFS-10587: --- Hi [~yzhangal] [~vinayrpet]: Sorry for the late reply, I c

[jira] [Comment Edited] (HDFS-10587) Incorrect offset/length calculation in pipeline recovery causes block corruption

2016-07-20 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387045#comment-15387045 ] xupeng edited comment on HDFS-10587 at 7/21/16 2:52 AM: Hi [~yzhan

[jira] [Commented] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387042#comment-15387042 ] Yiqun Lin commented on HDFS-10663: -- Thanks [~shahrs87] for reporting this. I found anther

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Attachment: HDFS-10660-01.patch > Expose storage policy apis via HDFSAdmin interface > -

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Target Version/s: 2.9.0 (was: 3.0.0-alpha2) > Expose storage policy apis via HDFSAdmin interface >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387019#comment-15387019 ] Yuanbo Liu commented on HDFS-10645: --- [~ajisakaa] Thanks for your good guidance. I will c

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-07-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386985#comment-15386985 ] Yiqun Lin commented on HDFS-10625: -- Hi, [~shahrs87], this jira is similar to HDFS-10626.

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-07-20 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8668: Assignee: SammiChen (was: Kai Zheng) > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386953#comment-15386953 ] Hadoop QA commented on HDFS-10645: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386946#comment-15386946 ] Hadoop QA commented on HDFS-10654: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-07-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.003.patch > Modifications to remove the assumption that FsVolumes

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.012.patch > BlockReport retransmissions may lead to storage

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386922#comment-15386922 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Thanks for the review [~liuml

[jira] [Commented] (HDFS-10225) DataNode hot swap drives should recognize storage type tags.

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386911#comment-15386911 ] Hadoop QA commented on HDFS-10225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Jiayi Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiayi Zhou updated HDFS-10519: -- Attachment: HDFS-10519.009.patch Fix some problems according to Andrew's recent comment. > Add a config

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386887#comment-15386887 ] John Zhuge commented on HDFS-6962: -- Thanks [~eddyxu] for the review! Great comments. I wil

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386863#comment-15386863 ] Jing Zhao commented on HDFS-10659: -- I think we do not need to manually recreate the "curr

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386845#comment-15386845 ] Konstantin Shvachko commented on HDFS-10301: As I commented earlier I am not i

[jira] [Commented] (HDFS-10654) Move building of httpfs dependency analysis under "docs" profile

2016-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386843#comment-15386843 ] Aaron T. Myers commented on HDFS-10654: --- Patch looks good to me. +1 pending Jenkins.

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-07-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10659: -- Description: In my environment I am seeing {{Namenodes}} crashing down after majority of {{Journalnodes

[jira] [Created] (HDFS-10665) Provide a way to add a new Journalnode to an existing quorum

2016-07-20 Thread Amit Anand (JIRA)
Amit Anand created HDFS-10665: - Summary: Provide a way to add a new Journalnode to an existing quorum Key: HDFS-10665 URL: https://issues.apache.org/jira/browse/HDFS-10665 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-10519) Add a configuration option to enable in-progress edit log tailing

2016-07-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386804#comment-15386804 ] Andrew Wang commented on HDFS-10519: Thanks for revving Jiayi. Overall looks good, mos

[jira] [Comment Edited] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386792#comment-15386792 ] Yongjun Zhang edited comment on HDFS-10652 at 7/20/16 11:29 PM:

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.003.patch > Add a unit test for HDFS-4660 > - >

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: (was: HDFS-10652.003.patch) > Add a unit test for HDFS-4660 >

[jira] [Updated] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10652: - Attachment: HDFS-10652.003.patch > Add a unit test for HDFS-4660 > - >

[jira] [Commented] (HDFS-10652) Add a unit test for HDFS-4660

2016-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386792#comment-15386792 ] Yongjun Zhang commented on HDFS-10652: -- Thanks a lot for the updated rev [~vinayrpet]

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386791#comment-15386791 ] Arpit Agarwal commented on HDFS-10664: -- Yeah I have come across this too and it is a

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386782#comment-15386782 ] Andrew Wang commented on HDFS-10301: My understanding of PB is that we have a fixed 4

[jira] [Commented] (HDFS-10584) Allow long-running Mover tool to login with keytab

2016-07-20 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386773#comment-15386773 ] Zhe Zhang commented on HDFS-10584: -- Thanks Rakesh. The patch looks good overall (pretty m

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386767#comment-15386767 ] Lei (Eddy) Xu commented on HDFS-6962: - Hi, [~jzhuge] Thanks for providing the patch: *

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386763#comment-15386763 ] Akira Ajisaka commented on HDFS-10645: -- {code} // need to keep maxDataLength up-t

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386756#comment-15386756 ] Rakesh R commented on HDFS-10660: - Test case failure is unrelated to the patch, please ign

[jira] [Commented] (HDFS-10645) Make block report size as a metric and add this metric to datanode web ui

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386748#comment-15386748 ] Akira Ajisaka commented on HDFS-10645: -- Thank you for the update. # blockReportSizes

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386747#comment-15386747 ] Hadoop QA commented on HDFS-10660: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386399#comment-15386399 ] John Zhuge edited comment on HDFS-6962 at 7/20/16 10:40 PM: [~c

[jira] [Commented] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386708#comment-15386708 ] Hadoop QA commented on HDFS-10649: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386702#comment-15386702 ] Konstantin Shvachko commented on HDFS-10301: My general approach to protobuf s

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386697#comment-15386697 ] Hadoop QA commented on HDFS-6962: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386685#comment-15386685 ] Chris Nauroth commented on HDFS-10664: -- [~aanand001c], thank you for filing this. I

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386686#comment-15386686 ] Hadoop QA commented on HDFS-10287: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386656#comment-15386656 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Amit Anand (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Anand updated HDFS-10664: -- Description: After a cluster is upgraded I see a mismatch in {{layoutVersion}} between NN VERSION file

[jira] [Created] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2016-07-20 Thread Amit Anand (JIRA)
Amit Anand created HDFS-10664: - Summary: layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade Key: HDFS-10664 URL: https://issues.apache.org/jira/browse/HDFS-10664

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386645#comment-15386645 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386644#comment-15386644 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Status: Open (was: Patch Available) I am canceling patch available, because Jenkins i

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386538#comment-15386538 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386547#comment-15386547 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10625) VolumeScanner to report why a block is found bad

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386477#comment-15386477 ] Rushabh S Shah commented on HDFS-10625: --- [~yzhangal] [~jojochuang]: any further comm

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Status: Patch Available (was: Open) > Optimize UTF8 string/byte conversions > ---

[jira] [Updated] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10662: --- Attachment: HDFS-10662.patch > Optimize UTF8 string/byte conversions > ---

[jira] [Commented] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386440#comment-15386440 ] Chen Liang commented on HDFS-10649: --- Did not notice how applyUMask was implemented in pa

[jira] [Updated] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10649: -- Attachment: HDFS-10649.002.patch > Remove unused PermissionStatus#applyUMask > -

[jira] [Commented] (HDFS-10425) Clean up NNStorage and TestSaveNamespace

2016-07-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386406#comment-15386406 ] Hudson commented on HDFS-10425: --- SUCCESS: Integrated in Hadoop-trunk-Commit #10126 (See [ht

[jira] [Commented] (HDFS-10658) Reduce JsonFactory instance allocation in StartupProgressServlet

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386398#comment-15386398 ] Hadoop QA commented on HDFS-10658: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: HDFS-6962.007.patch [~cnauroth] and [~eddyxu] Please review patch 007. Diff from 006: * Add CL

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10287: - Priority: Minor (was: Trivial) > MiniDFSCluster should implement AutoCloseable >

[jira] [Updated] (HDFS-10616) Improve performance of path handling

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10616: --- Attachment: 2.6-2.7.1-heap.png Here's an illustration how the GC characteristics on a moderated sized

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386388#comment-15386388 ] Akira Ajisaka commented on HDFS-10287: -- Hi [~boky01], would you rebase the patch for

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Status: Patch Available (was: Open) > Expose storage policy apis via HDFSAdmin interface >

[jira] [Commented] (HDFS-10661) Make MiniDFSCluster AutoCloseable

2016-07-20 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386377#comment-15386377 ] Akira Ajisaka commented on HDFS-10661: -- Thanks [~jzhuge] for the information and clos

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Description: I was chasing a bug where the namenode didn't declare a datanode dead even when th

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Description: I was chasing a bug where the namenode didn't declare a datanode dead even when th

[jira] [Commented] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386374#comment-15386374 ] Rakesh R commented on HDFS-10660: - Attached patch to support storage policy apis in {{Hdfs

[jira] [Updated] (HDFS-10663) Comparison of two System.nanoTime methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10663: -- Summary: Comparison of two System.nanoTime methods return values are against standard java recoe

[jira] [Resolved] (HDFS-10661) Make MiniDFSCluster AutoCloseable

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10661. --- Resolution: Duplicate [~ajisakaa] Looks like a dup of HDFS-10287. Please re-open if you think otherwi

[jira] [Updated] (HDFS-10660) Expose storage policy apis via HDFSAdmin interface

2016-07-20 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10660: Attachment: HDFS-10660-00.patch > Expose storage policy apis via HDFSAdmin interface > -

[jira] [Created] (HDFS-10663) Comparison of two System.nanoTimes methods return values are against standard java recoemmendations.

2016-07-20 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-10663: - Summary: Comparison of two System.nanoTimes methods return values are against standard java recoemmendations. Key: HDFS-10663 URL: https://issues.apache.org/jira/browse/HDFS-106

[jira] [Commented] (HDFS-10616) Improve performance of path handling

2016-07-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386358#comment-15386358 ] Daryn Sharp commented on HDFS-10616: I chose 2.9 solely because branch-2 and trunk hav

[jira] [Created] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-07-20 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-10662: -- Summary: Optimize UTF8 string/byte conversions Key: HDFS-10662 URL: https://issues.apache.org/jira/browse/HDFS-10662 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-07-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15386342#comment-15386342 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

  1   2   >