[jira] [Commented] (HDFS-12113) `hadoop fs -setrep` requries huge amount of memory on client side

2017-07-11 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081750#comment-16081750 ] Ruslan Dautkhanov commented on HDFS-12113: -- [~brahmareddy], looks very similar. I

[jira] [Updated] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12116: - Status: Patch Available (was: Open) Ran the patch with dist-test 100 times, did not see test failures. >

[jira] [Updated] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12115: Status: Patch Available (was: Open) > Ozone: SCM: Add queryNode RPC Call >

[jira] [Updated] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12115: Attachment: HDFS-12115-HDFS-7240.001.patch This patch will create a test failure in TestKeys, that i

[jira] [Updated] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12069: --- Attachment: HDFS-12069-HDFS-7240.010.patch > Ozone: Create a general abstraction for metadata store >

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081823#comment-16081823 ] Hadoop QA commented on HDFS-12116: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081775#comment-16081775 ] Weiwei Yang commented on HDFS-12069: Hi [~yuanbo] bq. It seems we can refactor some c

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081833#comment-16081833 ] Hadoop QA commented on HDFS-11957: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11264) [SPS]: Double checks to ensure that SPS/Mover are not running together

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081836#comment-16081836 ] Hadoop QA commented on HDFS-11264: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12109) "fs" java.net.UnknownHostException when HA NameNode is used

2017-07-11 Thread Luigi Di Fraia (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081872#comment-16081872 ] Luigi Di Fraia commented on HDFS-12109: --- It's also probably worth mentioning that I

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081843#comment-16081843 ] Weiwei Yang commented on HDFS-12115: Thanks [~anu], the patch looks good to me. I just

[jira] [Commented] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081926#comment-16081926 ] Hadoop QA commented on HDFS-12069: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12069: --- Attachment: HDFS-12069-HDFS-7240.011.patch > Ozone: Create a general abstraction for metadata store >

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-07-11 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081949#comment-16081949 ] Brahma Reddy Battula commented on HDFS-11741: - [~jojochuang] nice finding. As

[jira] [Work started] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-11 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12117 started by Wellington Chevreuil. --- > HttpFS does not seem to support SNAPSHOT related methods for WebH

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16081997#comment-16081997 ] Hadoop QA commented on HDFS-12115: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-11 Thread Wellington Chevreuil (JIRA)
Wellington Chevreuil created HDFS-12117: --- Summary: HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface Key: HDFS-12117 URL: https://issues.apache.org/jira/browse/HDFS-12117

[jira] [Commented] (HDFS-12069) Ozone: Create a general abstraction for metadata store

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082056#comment-16082056 ] Hadoop QA commented on HDFS-12069: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12118: Summary: Ozone: Ozone shell: Add more testing for volume shell commands Key: HDFS-12118 URL: https://issues.apache.org/jira/browse/HDFS-12118 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12118: - Attachment: HDFS-12118-HDFS-7240.001.patch > Ozone: Ozone shell: Add more testing for volume shell command

[jira] [Updated] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12118: - Status: Patch Available (was: Open) > Ozone: Ozone shell: Add more testing for volume shell commands > --

[jira] [Commented] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082130#comment-16082130 ] Yiqun Lin commented on HDFS-12118: -- Attach the initial patch. Found one bug when I worked

[jira] [Created] (HDFS-12119) Inconsistent "Number of Under-Replicated Blocks" shown on HDFS web UI and fsck report

2017-07-11 Thread liuyiyang (JIRA)
liuyiyang created HDFS-12119: Summary: Inconsistent "Number of Under-Replicated Blocks" shown on HDFS web UI and fsck report Key: HDFS-12119 URL: https://issues.apache.org/jira/browse/HDFS-12119 Project:

[jira] [Updated] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12118: - Description: Currently there are missing enough testings to cover all the ozone command. Now we have to t

[jira] [Updated] (HDFS-12085) Reconfigure namenode heartbeat interval fails if the interval was set with time unit

2017-07-11 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12085: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status: Resolved

[jira] [Commented] (HDFS-12085) Reconfigure namenode heartbeat interval fails if the interval was set with time unit

2017-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082167#comment-16082167 ] Hudson commented on HDFS-12085: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-12120) Use new block for pre-RollingUpgrade files` append requests

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082172#comment-16082172 ] Vinayakumar B commented on HDFS-12120: -- Idea is : 1. On RU-prepare command, NameNode

[jira] [Created] (HDFS-12120) Use new block for pre-RollingUpgrade files` append requests

2017-07-11 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-12120: Summary: Use new block for pre-RollingUpgrade files` append requests Key: HDFS-12120 URL: https://issues.apache.org/jira/browse/HDFS-12120 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082220#comment-16082220 ] Hadoop QA commented on HDFS-12118: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12026) libhdfs++: Fix compilation errors and warnings when compiling with Clang

2017-07-11 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-12026: - Attachment: HDFS-12026.HDFS-8707.007.patch In this patch I fixed the absolute paths to compilers a

[jira] [Commented] (HDFS-12026) libhdfs++: Fix compilation errors and warnings when compiling with Clang

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082269#comment-16082269 ] Hadoop QA commented on HDFS-12026: -- (!) A patch to the testing environment has been detec

[jira] [Resolved] (HDFS-11944) TestAclsEndToEnd#testCreateEncryptionZone failing very frequently.

2017-07-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah resolved HDFS-11944. --- Resolution: Invalid Release Note: It was not a flaky test. Fixed it via HADOOP-14563 >

[jira] [Updated] (HDFS-12121) Audit logging of unsuccessful namesystem calls should not be done while holding fslock.

2017-07-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12121: -- Summary: Audit logging of unsuccessful namesystem calls should not be done while holding fslock.

[jira] [Updated] (HDFS-12121) Audit logging of unsuccessful namesystem calls should not be done while holding fslock.

2017-07-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12121: -- Description: Currently we are audit logging the unsuccessful namesystem calls while holding fsl

[jira] [Updated] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12116: - Attachment: HDFS-12116.02.patch > BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fa

[jira] [Commented] (HDFS-12026) libhdfs++: Fix compilation errors and warnings when compiling with Clang

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082431#comment-16082431 ] Hadoop QA commented on HDFS-12026: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12120) Use new block for pre-RollingUpgrade files' append requests

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12120: - Summary: Use new block for pre-RollingUpgrade files' append requests (was: Use new block for pre-

[jira] [Updated] (HDFS-12120) Use new block for pre-RollingUpgrade files` append requests

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12120: - Attachment: HDFS-12120-01.patch Attached the initial patch. Please review. If the approach is fin

[jira] [Assigned] (HDFS-12120) Use new block for pre-RollingUpgrade files` append requests

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HDFS-12120: Assignee: Vinayakumar B > Use new block for pre-RollingUpgrade files` append requests > ---

[jira] [Updated] (HDFS-12120) Use new block for pre-RollingUpgrade files` append requests

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-12120: - Status: Patch Available (was: Open) > Use new block for pre-RollingUpgrade files` append requests

[jira] [Updated] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11915: - Attachment: HDFS-11915-branch-2-01.patch > Sync rbw dir on the first hsync() to avoid file lost on

[jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-07-11 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082488#comment-16082488 ] Vinayakumar B commented on HDFS-11915: -- Attached patch for branch-2 > Sync rbw dir o

[jira] [Commented] (HDFS-12112) TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE

2017-07-11 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082500#comment-16082500 ] Kuhu Shukla commented on HDFS-12112: Thanks [~jojochuang] for the JIRA. The patch look

[jira] [Created] (HDFS-12122) TestEditLogTailer is flaky

2017-07-11 Thread John Zhuge (JIRA)
John Zhuge created HDFS-12122: - Summary: TestEditLogTailer is flaky Key: HDFS-12122 URL: https://issues.apache.org/jira/browse/HDFS-12122 Project: Hadoop HDFS Issue Type: Test Component

[jira] [Commented] (HDFS-12115) Ozone: SCM: Add queryNode RPC Call

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082516#comment-16082516 ] Anu Engineer commented on HDFS-12115: - bq. For example, if a node is HEALTHY, can it

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-07-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082507#comment-16082507 ] John Zhuge commented on HDFS-11957: --- TestEditLogTailer failure is unrelated. It also pas

[jira] [Commented] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082510#comment-16082510 ] Anu Engineer commented on HDFS-11922: - I think states might be a good idea .. let us c

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082656#comment-16082656 ] Anu Engineer commented on HDFS-12098: - [~cheersyang] Thanks for reporting this and pos

[jira] [Resolved] (HDFS-12121) Audit logging of unsuccessful namesystem calls should not be done while holding fslock.

2017-07-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah resolved HDFS-12121. --- Resolution: Duplicate Dup of HDFS-11246 > Audit logging of unsuccessful namesystem calls shou

[jira] [Created] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-11 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12123: - Summary: Ozone: OzoneClient: Abstraction of OzoneClient and default implementation Key: HDFS-12123 URL: https://issues.apache.org/jira/browse/HDFS-12123 Project: Hadoop HDF

[jira] [Work started] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-11 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12123 started by Nandakumar. - > Ozone: OzoneClient: Abstraction of OzoneClient and default implementation > -

[jira] [Updated] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-11 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12123: -- Description: {{OzoneClient}} interface defines all the client operations supported by Ozone. {{OzoneCli

[jira] [Commented] (HDFS-12120) Use new block for pre-RollingUpgrade files' append requests

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082671#comment-16082671 ] Hadoop QA commented on HDFS-12120: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-11 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12123: -- Attachment: HDFS-12123-HDFS-7240.000.patch > Ozone: OzoneClient: Abstraction of OzoneClient and default

[jira] [Commented] (HDFS-12123) Ozone: OzoneClient: Abstraction of OzoneClient and default implementation

2017-07-11 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082675#comment-16082675 ] Nandakumar commented on HDFS-12123: --- Initial version of patch uploaded, please review. T

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082645#comment-16082645 ] Hadoop QA commented on HDFS-12116: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12116: - Description: This seems to be long-standing, but the failure rate (~10%) is slightly higher in dist-test

[jira] [Commented] (HDFS-12116) BlockReportTestBase#blockReport_08 and #blockReport_08 intermittently fail

2017-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082715#comment-16082715 ] Xiao Chen commented on HDFS-12116: -- Findbugs are extant, failed tests passed locally. Tes

[jira] [Updated] (HDFS-12114) Consistent HttpFS property names

2017-07-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12114: -- Summary: Consistent HttpFS property names (was: Ensure correct HttpFS property names) > Consistent Htt

[jira] [Updated] (HDFS-12052) Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS

2017-07-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12052: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12118) Ozone: Ozone shell: Add more testing for volume shell commands

2017-07-11 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082712#comment-16082712 ] Chen Liang commented on HDFS-12118: --- Thanks [~linyiqun] for working on this! We do need

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082734#comment-16082734 ] Bharat Viswanadham commented on HDFS-0: --- In the test setup, the cacheManinpu

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Attachment: HADOOP-0.02.PATCH > Hardcoded BLOCK SIZE value of 4096 is not appropriat

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Status: Patch Available (was: Open) > Hardcoded BLOCK SIZE value of 4096 is not appropr

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Status: Open (was: Patch Available) > Hardcoded BLOCK SIZE value of 4096 is not appropr

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Attachment: HDFS-0.02.PATCH > Hardcoded BLOCK SIZE value of 4096 is not appropriate

[jira] [Commented] (HDFS-12052) Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS

2017-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082754#comment-16082754 ] Hudson commented on HDFS-12052: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12114) Consistent HttpFS property names

2017-07-11 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12114: -- Attachment: HDFS-12114.002.patch Patch 002 * Rebase > Consistent HttpFS property names > --

[jira] [Resolved] (HDFS-9590) NPE in Storage$StorageDirectory#unlock()

2017-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen resolved HDFS-9590. - Resolution: Cannot Reproduce Haven't seen this since, closing... > NPE in Storage$StorageDirectory#unlock(

[jira] [Commented] (HDFS-12114) Consistent HttpFS property names

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082783#comment-16082783 ] Hadoop QA commented on HDFS-12114: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Attachment: (was: HADOOP-0.02.PATCH) > Hardcoded BLOCK SIZE value of 4096 is not

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-07-11 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082748#comment-16082748 ] Kihwal Lee commented on HDFS-5042: -- We are seeing significant performance degradation in 2

[jira] [Updated] (HDFS-8028) TestNNHandlesBlockReportPerStorage/TestNNHandlesCombinedBlockReport Failed after patched HDFS-7704

2017-07-11 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8028: Resolution: Duplicate Status: Resolved (was: Patch Available) I'm resolving this as a dup given [~re

[jira] [Created] (HDFS-12121) Audit logging of unsuccessful should not be done while holding fslock.

2017-07-11 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12121: - Summary: Audit logging of unsuccessful should not be done while holding fslock. Key: HDFS-12121 URL: https://issues.apache.org/jira/browse/HDFS-12121 Project: Hadoo

[jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082849#comment-16082849 ] Hadoop QA commented on HDFS-11915: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Attachment: (was: HDFS-0.02.PATCH) > Hardcoded BLOCK SIZE value of 4096 is not a

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-07-11 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082835#comment-16082835 ] Tsz Wo Nicholas Sze commented on HDFS-6874: --- Thanks for the update. Could you al

[jira] [Comment Edited] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082856#comment-16082856 ] Bharat Viswanadham edited comment on HDFS-0 at 7/11/17 7:50 PM:

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Attachment: HDFS-0.02.patch > Hardcoded BLOCK SIZE value of 4096 is not appropriate

[jira] [Issue Comment Deleted] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Comment: was deleted (was: In the test setup, the cacheManinpulator is set to NoMlockCa

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082856#comment-16082856 ] Bharat Viswanadham commented on HDFS-0: --- Added the changes related to HDFS-6

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Status: Open (was: Patch Available) > Hardcoded BLOCK SIZE value of 4096 is not appropr

[jira] [Updated] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-0: -- Status: Patch Available (was: Open) > Hardcoded BLOCK SIZE value of 4096 is not appropr

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082991#comment-16082991 ] Hadoop QA commented on HDFS-0: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-6515) testPageRounder (org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache)

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16082999#comment-16082999 ] Hadoop QA commented on HDFS-6515: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-12124) Namenode should throw a RetryStartFileException exception instead of making a synchronous call to kms incase of cache miss.

2017-07-11 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12124: - Summary: Namenode should throw a RetryStartFileException exception instead of making a synchronous call to kms incase of cache miss. Key: HDFS-12124 URL: https://issues.apache.o

[jira] [Commented] (HDFS-12114) Consistent HttpFS property names

2017-07-11 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083066#comment-16083066 ] Ravi Prakash commented on HDFS-12114: - Thanks John! LGTM. +1. > Consistent HttpFS pro

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083067#comment-16083067 ] Hadoop QA commented on HDFS-0: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083075#comment-16083075 ] Hadoop QA commented on HDFS-0: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083100#comment-16083100 ] Allen Wittenauer commented on HDFS-0: - {code} private static final long BLOCK_

[jira] [Updated] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11741: --- Fix Version/s: 2.7.4 > Long running balancer may fail due to expired DataEncryptionKey > -

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083229#comment-16083229 ] Anu Engineer commented on HDFS-12098: - @Weiwei yang, Can you please share your repro s

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-07-11 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083223#comment-16083223 ] Wei-Chiu Chuang commented on HDFS-11741: Good point. Thanks for reminder. Pushed

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083232#comment-16083232 ] Anu Engineer commented on HDFS-12098: - One big difference is that fact that I have 100

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12098: Attachment: disabled-scm-test.patch This is the test that I am using to simulate the case discussed

[jira] [Updated] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-11 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12098: Attachment: Screen Shot 2017-07-11 at 4.58.08 PM.png > Ozone: Datanode is unable to register with sc

[jira] [Commented] (HDFS-12098) Ozone: Datanode is unable to register with scm if scm starts later

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083237#comment-16083237 ] Hadoop QA commented on HDFS-12098: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11110) Hardcoded BLOCK SIZE value of 4096 is not appropriate for PowerPC

2017-07-11 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083236#comment-16083236 ] Bharat Viswanadham commented on HDFS-0: --- Hi Allen, Below is the code for ge

[jira] [Commented] (HDFS-11502) dn.js set datanode UI to window.location.hostname, it should use jmx bean property to setup hostname

2017-07-11 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083254#comment-16083254 ] Xiaoyu Yao commented on HDFS-11502: --- Thanks [~jeffreyr97] and [~yuanbo] for working on t

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083309#comment-16083309 ] Weiwei Yang commented on HDFS-6874: --- Hi [~szetszwo] Sure, I just added the test to verif

  1   2   >