[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141239#comment-16141239 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141136#comment-16141136 ] Hadoop QA commented on HDFS-12353: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12317) HDFS metrics render error in the page of git respository

2017-08-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141118#comment-16141118 ] Yiqun Lin commented on HDFS-12317: -- Hi [~ajisakaa], could you provide the review if you get a chance?

[jira] [Commented] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141106#comment-16141106 ] Yiqun Lin commented on HDFS-12352: -- Thanks for the backport work of HDFS-11530, [~vagarychen]. Patch

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141098#comment-16141098 ] Hadoop QA commented on HDFS-12191: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141095#comment-16141095 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-08-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.07.patch Rebase 06 for discussion. Needs more tests, cleanup, etc. but the

[jira] [Assigned] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang reassigned HDFS-12353: Assignee: steven-wugang > Modify Dfsuse percent of dfsadmin report inconsistent with

[jira] [Updated] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12353: - Status: Patch Available (was: Open) > Modify Dfsuse percent of dfsadmin report inconsistent with

[jira] [Updated] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12353: - Attachment: HDFS-12353.patch > Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse

[jira] [Issue Comment Deleted] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12353: - Comment: was deleted (was: use command "hdfs dfsadmin -report",as follows: [hdfs@zhd2-3 sbin]$

[jira] [Updated] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] steven-wugang updated HDFS-12353: - Description: use command "hdfs dfsadmin -report",as follows: [hdfs@zhd2-3 sbin]$ hdfs dfsadmin

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141084#comment-16141084 ] steven-wugang commented on HDFS-12353: -- use command "hdfs dfsadmin -report",as follows: [hdfs@zhd2-3

[jira] [Created] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-08-24 Thread steven-wugang (JIRA)
steven-wugang created HDFS-12353: Summary: Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports. Key: HDFS-12353 URL: https://issues.apache.org/jira/browse/HDFS-12353

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141060#comment-16141060 ] Andrew Wang commented on HDFS-10285: Hi Uma, bq. In fact isSpsRunning API was added just for users to

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141036#comment-16141036 ] Yongjun Zhang commented on HDFS-12191: -- Thanks a lot for the review [~manojg]. Uploaded rev3 to

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141037#comment-16141037 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Attachment: HDFS-12191.003.patch > Provide option to not capture the accessTime change of a file

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-24 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141031#comment-16141031 ] Kai Zheng commented on HDFS-11964: -- In annual leave and vacation, email response will be delayed. >

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-24 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141029#comment-16141029 ] Takanobu Asanuma commented on HDFS-11964: - Thanks for the comment, [~drankye]. No, I'm not using

[jira] [Commented] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140998#comment-16140998 ] Hadoop QA commented on HDFS-12352: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.009.patch Thanks [~anu] for the comments, addressed in v009 patch.

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-08-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Attachment: HDFS-12349.00.patch Attach the patch to fix cases for both no enough data block and

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-08-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Status: Patch Available (was: Open) > Improve log message when it could not alloc enough blocks

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-08-24 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Summary: Improve log message when it could not alloc enough blocks for EC (was: Improve log

[jira] [Commented] (HDFS-11964) RS-6-3-LEGACY has a decoding bug when it is used for pread

2017-08-24 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140915#comment-16140915 ] Kai Zheng commented on HDFS-11964: -- Hi [~tasanuma0829], Thanks for the ping, yes I will give it a review

[jira] [Comment Edited] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140877#comment-16140877 ] Anu Engineer edited comment on HDFS-12321 at 8/24/17 10:53 PM: ---

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140877#comment-16140877 ] Anu Engineer commented on HDFS-12321: - [~vagarychen] This looks fantastic. Thanks for getting this

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.008.patch [~anu] submit v008 patch based on your v007 patch. Now it

[jira] [Comment Edited] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140834#comment-16140834 ] Chen Liang edited comment on HDFS-12352 at 8/24/17 10:15 PM: - I manually fixed

[jira] [Updated] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12352: -- Attachment: HDFS-12352-branch-2.001.patch I manually fixed several conflicts when cherry-picking from

[jira] [Updated] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12352: -- Status: Patch Available (was: Open) > [branch-2] Use HDFS specific network topology to choose datanode

[jira] [Created] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-08-24 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12352: - Summary: [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault Key: HDFS-12352 URL: https://issues.apache.org/jira/browse/HDFS-12352

[jira] [Comment Edited] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-24 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140691#comment-16140691 ] Manoj Govindassamy edited comment on HDFS-12191 at 8/24/17 10:06 PM: -

[jira] [Created] (HDFS-12351) Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document.

2017-08-24 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12351: Summary: Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document. Key: HDFS-12351 URL:

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-08-24 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140691#comment-16140691 ] Manoj Govindassamy commented on HDFS-12191: --- Thanks for working on the patch revision

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12350: Fix Version/s: (was: HDFS-7240) > Support meta tags in configs > >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12350: Affects Version/s: (was: HDFS-7240) > Support meta tags in configs >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12350: Target Version/s: (was: HDFS-7240) > Support meta tags in configs >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12350: Summary: Support meta tags in configs (was: Support meta tags in Ozone configs) > Support meta

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140603#comment-16140603 ] Junping Du commented on HDFS-12319: --- Got it. Thanks [~arpitagarwal] for confirm. I will hold on 2.8.2

[jira] [Commented] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140584#comment-16140584 ] Hadoop QA commented on HDFS-12341: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12350) Support meta tags in Ozone configs

2017-08-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12350: - Description: Proposal is to add domain tag extension to the config so that ozone can use that in

[jira] [Created] (HDFS-12350) Support meta tags in Ozone configs

2017-08-24 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12350: - Summary: Support meta tags in Ozone configs Key: HDFS-12350 URL: https://issues.apache.org/jira/browse/HDFS-12350 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-12349) Improve log message when

2017-08-24 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12349: Summary: Improve log message when Key: HDFS-12349 URL: https://issues.apache.org/jira/browse/HDFS-12349 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140504#comment-16140504 ] Arpit Agarwal commented on HDFS-12319: -- Straightforward fix. +1 for the v2 patch. Thank you for

[jira] [Commented] (HDFS-12345) Scale testing HDFS NameNode with real metadata and workloads

2017-08-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140466#comment-16140466 ] Arpit Agarwal commented on HDFS-12345: -- Nice jira number. :) Looking forward to seeing more about

[jira] [Commented] (HDFS-11577) Combine the old and the new chooseRandom for better performance

2017-08-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140456#comment-16140456 ] Arpit Agarwal commented on HDFS-11577: -- Committed to branch-2. Thanks for the continued work on these

[jira] [Updated] (HDFS-11577) Combine the old and the new chooseRandom for better performance

2017-08-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11577: - Fix Version/s: 2.9.0 > Combine the old and the new chooseRandom for better performance >

[jira] [Updated] (HDFS-12346) [branch-2] Combine the old and the new chooseRandom for better performance

2017-08-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12346: - Resolution: Duplicate Status: Resolved (was: Patch Available) I've committed this to

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140449#comment-16140449 ] Anu Engineer commented on HDFS-12321: - bq. the CLI Parser must be able to recognize these two options

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-08-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140437#comment-16140437 ] Chris Douglas commented on HDFS-7878: - bq. There's now a builder API for open/create There isn't a

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140436#comment-16140436 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140425#comment-16140425 ] Anu Engineer commented on HDFS-12341: - +1, this works on my local machine. I will commit this as soon

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-24 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12336: Attachment: HDFS-12336.002.patch Hi [~xiaochen], thanks for reviewing this. I

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-08-24 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140397#comment-16140397 ] Andrew Wang commented on HDFS-7878: --- We still have an outstanding question for Sergey that affects the

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-24 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140388#comment-16140388 ] Manoj Govindassamy commented on HDFS-11912: --- Thanks for your persistent efforts on this

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12280: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-12275) Ozone: Corona: Support for random validation of writes

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140349#comment-16140349 ] Hadoop QA commented on HDFS-12275: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12341: - Attachment: HDFS-12341-HDFS-7240.002.patch patch v2 fixes the build errors > Ozone:

[jira] [Commented] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140324#comment-16140324 ] Hadoop QA commented on HDFS-12341: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-08-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140300#comment-16140300 ] Chris Douglas commented on HDFS-7878: - bq. the "better" calls. Fine by me. If this JIRA only added an

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140281#comment-16140281 ] Anu Engineer commented on HDFS-12280: - +1, I will commit this shortly. Thanks to [~msingh] for

[jira] [Commented] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140202#comment-16140202 ] Hudson commented on HDFS-12344: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12237 (See

[jira] [Updated] (HDFS-12275) Ozone: Corona: Support for random validation of writes

2017-08-24 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12275: -- Attachment: HDFS-12275-HDFS-7240.002.patch patch v002 with findbugs and checkstyle fixes > Ozone:

[jira] [Updated] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-12344: -- Affects Version/s: 3.0.0-beta1 Component/s: fs > LocatedFileStatus regression: no

[jira] [Updated] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-12344: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12341: - Attachment: HDFS-12341-HDFS-7240.001.patch > Ozone: maven dist compilation fails with

[jira] [Updated] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12341: - Status: Patch Available (was: Open) > Ozone: maven dist compilation fails with

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

2017-08-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140074#comment-16140074 ] Koji Noguchi commented on HDFS-12348: - bq. 1) The blocks in the trash can be reduced, if datanode

[jira] [Resolved] (HDFS-6964) NN fails to fix under replication leading to data loss

2017-08-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-6964. -- Resolution: Duplicate > NN fails to fix under replication leading to data loss >

[jira] [Commented] (HDFS-6964) NN fails to fix under replication leading to data loss

2017-08-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140063#comment-16140063 ] Kihwal Lee commented on HDFS-6964: -- I think this is a dupe of HDFS-11960. > NN fails to fix under

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

2017-08-24 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140054#comment-16140054 ] Kihwal Lee commented on HDFS-12348: --- I have two general comments on the issue. 1) The blocks in the

[jira] [Updated] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12341: - Attachment: (was: HDFS-12341-HDFS-7240.001.patch) > Ozone: maven dist compilation

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140008#comment-16140008 ] Steve Loughran commented on HDFS-7878: -- # FS APIs? Pull in [~sanjay.radia] # There's now a builder API

[jira] [Commented] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139971#comment-16139971 ] Ewan Higgs commented on HDFS-12344: --- javac issue is because i introduced a new call to a deprecated

[jira] [Commented] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139960#comment-16139960 ] Hadoop QA commented on HDFS-12344: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139949#comment-16139949 ] Hadoop QA commented on HDFS-12348: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139943#comment-16139943 ] Hadoop QA commented on HDFS-12344: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139929#comment-16139929 ] Hadoop QA commented on HDFS-12084: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12344: -- Attachment: HDFS-12344.002.patch Attaching updated patch based on [~steve_l]'s comments. >

[jira] [Commented] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139889#comment-16139889 ] Hadoop QA commented on HDFS-12280: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12344: -- Status: Patch Available (was: Open) > LocatedFileStatus regression: no longer accepting null

[jira] [Commented] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139883#comment-16139883 ] Steve Loughran commented on HDFS-12344: --- regarding the tests; get rid of the try/catch/fail blocks,

[jira] [Commented] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139881#comment-16139881 ] Steve Loughran commented on HDFS-12344: --- Ewan. hit the "submit patch" button... > LocatedFileStatus

[jira] [Updated] (HDFS-12341) Ozone: maven dist compilation fails with "Duplicate classes found" error

2017-08-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12341: - Attachment: HDFS-12341-HDFS-7240.001.patch The issue seems to be because of the following

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139858#comment-16139858 ] Hadoop QA commented on HDFS-12319: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

2017-08-24 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139847#comment-16139847 ] Vinayakumar B commented on HDFS-12248: -- +1 > SNN will not upload fsimage on IOE and Interrupted

[jira] [Assigned] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-08-24 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-12100: Assignee: Lokesh Jain (was: Mukul Kumar Singh) > Ozone: KSM: Allocate key should

[jira] [Commented] (HDFS-10234) DistCp log output should contain copied and deleted files and directories

2017-08-24 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139841#comment-16139841 ] Yiqun Lin commented on HDFS-10234: -- Thanks for the review, Xiaoyu! Seems this JIRA hasn't been updated

[jira] [Updated] (HDFS-12348) disable removing blocks to trash while rolling upgrade

2017-08-24 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12348: - Attachment: HDFS-12348.003.patch > disable removing blocks to trash while rolling upgrade >

[jira] [Updated] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

2017-08-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12084: Attachment: HDFS-12084-003.patch Uploading the {{trunk}} patch. Updated the

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-24 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139809#comment-16139809 ] legend commented on HDFS-12318: --- Thanks [~jzhuge] for review > Fix IOException condition for openInfo in

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-24 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12280: --- Attachment: HDFS-12280-HDFS-7240.002.patch > Ozone: TestOzoneContainer#testCreateOzoneContainer fails

[jira] [Updated] (HDFS-12280) Ozone: TestOzoneContainer#testCreateOzoneContainer fails

2017-08-24 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12280: --- Attachment: (was: HDFS-12280-HDFS-7240.002.patch) > Ozone:

[jira] [Updated] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

2017-08-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12319: Attachment: HDFS-12319-002.patch [~vinayrpet] thanks for taking look. bq.In Test,

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139751#comment-16139751 ] Hudson commented on HDFS-12318: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12235 (See

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-08-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12318: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12344) LocatedFileStatus regression: no longer accepting null FSPermission

2017-08-24 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12344: -- Attachment: HDFS-12344.001.patch Attaching a failing test and the fix. [~steve_l] and/or

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

2017-08-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139709#comment-16139709 ] Hadoop QA commented on HDFS-12348: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >