[jira] [Commented] (HDFS-11481) hdfs snapshotDiff /.reserved/raw/... fails on snapshottable directories

2018-03-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402259#comment-16402259 ] Yongjun Zhang commented on HDFS-11481: -- Thanks [~mavinmar...@gmail.com]. Would you please share what

[jira] [Updated] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-13284: -- Attachment: HDFS-13284.001.patch > Adjust criteria for

[jira] [Commented] (HDFS-13284) Adjust criteria for LowRedundancyBlocks.QUEUE_VERY_LOW_REDUNDANCY

2018-03-16 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402253#comment-16402253 ] Lukas Majercak commented on HDFS-13284: --- Added patch 001 for fixing checkstyle. Unit test failures

[jira] [Comment Edited] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402244#comment-16402244 ] Ajay Kumar edited comment on HDFS-13055 at 3/16/18 5:43 PM: [~arpitagarwal]

[jira] [Commented] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402244#comment-16402244 ] Ajay Kumar commented on HDFS-13055: --- [~arpitagarwal] thanks for offline discussion. Updated patch v8 to

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402236#comment-16402236 ] Íñigo Goiri commented on HDFS-12886: Committed to trunk, branch-3.1, branch-3.0, branch-2, and

[jira] [Updated] (HDFS-12886) Ignore minReplication for block recovery

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12886: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 3.0.2

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

2018-03-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: HDFS-13055.008.patch > Aggregate usage statistics from datanodes >

[jira] [Commented] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402219#comment-16402219 ] Brahma Reddy Battula commented on HDFS-13299: - Thanks for taking care. > RBF : Fix

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13243: --- Fix Version/s: (was: 3.2.0) > Get CorruptBlock because of calling close and sync in same

[jira] [Updated] (HDFS-13243) Get CorruptBlock because of calling close and sync in same time

2018-03-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-13243: --- Target Version/s: 3.2.0 > Get CorruptBlock because of calling close and sync in same time >

[jira] [Commented] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402197#comment-16402197 ] Plamen Jeliazkov commented on HDFS-12977: - I missed one checkstyle warning and somehow managed to

[jira] [Updated] (HDFS-12977) Add stateId to RPC headers.

2018-03-16 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-12977: Attachment: HDFS_12977.trunk.007.patch > Add stateId to RPC headers. >

[jira] [Commented] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402182#comment-16402182 ] Wei Yan commented on HDFS-13215: Upload [^HDFS-13215.005.patch] to address review comments. > RBF: Move

[jira] [Updated] (HDFS-13215) RBF: Move Router to its own module

2018-03-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated HDFS-13215: --- Attachment: HDFS-13215.005.patch > RBF: Move Router to its own module > -- >

[jira] [Commented] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402156#comment-16402156 ] genericqa commented on HDFS-13298: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13300) Ozone: Remove DatanodeID dependency from HDSL and Ozone

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402148#comment-16402148 ] genericqa commented on HDFS-13300: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13299: --- Resolution: Fixed Status: Resolved (was: Patch Available) > RBF : Fix compilation error in

[jira] [Commented] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402132#comment-16402132 ] Íñigo Goiri commented on HDFS-13299: Thanks [~brahmareddy] for reporting. We caught this in our daily

[jira] [Updated] (HDFS-13224) RBF: Resolvers to support mount points across multiple subclusters

2018-03-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-13224: --- Attachment: HDFS-13224-branch-2.000.patch > RBF: Resolvers to support mount points across multiple

[jira] [Updated] (HDFS-13300) Ozone: Remove DatanodeID dependency from HDSL and Ozone

2018-03-16 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13300: --- Status: Open (was: Patch Available) > Ozone: Remove DatanodeID dependency from HDSL and Ozone >

[jira] [Updated] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-13299: Attachment: HDFS-13299-branch-2-002.patch > RBF : Fix compilation error in branch-2

[jira] [Commented] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401939#comment-16401939 ] genericqa commented on HDFS-13299: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13300) Ozone: Remove DatanodeID dependency from HDSL and Ozone

2018-03-16 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13300: --- Status: Patch Available (was: Open) > Ozone: Remove DatanodeID dependency from HDSL and Ozone >

[jira] [Updated] (HDFS-13300) Ozone: Remove DatanodeID dependency from HDSL and Ozone

2018-03-16 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-13300: --- Attachment: HDFS-13300-HDFS-7240.000.patch > Ozone: Remove DatanodeID dependency from HDSL and Ozone

[jira] [Created] (HDFS-13301) Remove containerPort, ratisPort and ozoneRestPort from DatanodeID and DatanodeIDProto

2018-03-16 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-13301: -- Summary: Remove containerPort, ratisPort and ozoneRestPort from DatanodeID and DatanodeIDProto Key: HDFS-13301 URL: https://issues.apache.org/jira/browse/HDFS-13301

[jira] [Created] (HDFS-13300) Ozone: Remove DatanodeID dependency from HDSL and Ozone

2018-03-16 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-13300: -- Summary: Ozone: Remove DatanodeID dependency from HDSL and Ozone Key: HDFS-13300 URL: https://issues.apache.org/jira/browse/HDFS-13300 Project: Hadoop HDFS

[jira] [Updated] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-13299: Assignee: Brahma Reddy Battula Status: Patch Available (was: Open) > RBF :

[jira] [Updated] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-13299: Attachment: HDFS-13299-branch-2.patch > RBF : Fix compilation error in branch-2

[jira] [Updated] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-13299: Priority: Blocker (was: Major) > RBF : Fix compilation error in branch-2

[jira] [Created] (HDFS-13299) RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver)

2018-03-16 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-13299: --- Summary: RBF : Fix compilation error in branch-2 (TestMultipleDestinationResolver) Key: HDFS-13299 URL: https://issues.apache.org/jira/browse/HDFS-13299

[jira] [Updated] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13298: Status: Patch Available (was: Open) Details of the implementation: 1. hdsl/cblock/ozone

[jira] [Updated] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13298: Attachment: HDFS-13298-HDFS-7240.001.patch > Ozone: Make ozone/hdsl/cblock modules turned off by

[jira] [Comment Edited] (HDFS-13220) Change lastCheckpointTime to use fsimage mostRecentCheckpointTime

2018-03-16 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401743#comment-16401743 ] Shen Yinjie edited comment on HDFS-13220 at 3/16/18 11:05 AM: -- We met the

[jira] [Commented] (HDFS-13220) Change lastCheckpointTime to use fsimage mostRecentCheckpointTime

2018-03-16 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401743#comment-16401743 ] Shen Yinjie commented on HDFS-13220: We met the same problem too..But, I found HDFS-6353 could solve

[jira] [Created] (HDFS-13298) Ozone: Make ozone/hdsl/cblock modules turned off by default

2018-03-16 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-13298: --- Summary: Ozone: Make ozone/hdsl/cblock modules turned off by default Key: HDFS-13298 URL: https://issues.apache.org/jira/browse/HDFS-13298 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13287) TestINodeFile#testGetBlockType results in NPE when run alone

2018-03-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401643#comment-16401643 ] Ewan Higgs commented on HDFS-13287: --- Tested. LGTM. Could also do this in a {{@Before}} function like so

[jira] [Comment Edited] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401584#comment-16401584 ] Yiqun Lin edited comment on HDFS-13250 at 3/16/18 8:24 AM: --- Thanks [~elgoiri]

[jira] [Commented] (HDFS-13250) RBF: Router to manage requests across multiple subclusters

2018-03-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401584#comment-16401584 ] Yiqun Lin commented on HDFS-13250: -- Thanks [~elgoiri] for updating the patch! {quote} I didn't quite get

[jira] [Assigned] (HDFS-11909) Ozone: KSM : Support for simulated file system operations

2018-03-16 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-11909: Assignee: Shashikant Banerjee (was: Mukul Kumar Singh) > Ozone: KSM : Support

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-16 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Attachment: HDFS-13217.003.patch > Log audit event only used last EC policy name when add

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-16 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Status: Patch Available (was: Open) > Log audit event only used last EC policy name when add

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-16 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Attachment: (was: HDFS-13217.003.patch) > Log audit event only used last EC policy name

[jira] [Updated] (HDFS-13217) Log audit event only used last EC policy name when add multiple policies from file

2018-03-16 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-13217: -- Status: Open (was: Patch Available) > Log audit event only used last EC policy name when add

[jira] [Comment Edited] (HDFS-13087) Fix: Snapshots On encryption zones get incorrect EZ settings when encryption zone changes

2018-03-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401516#comment-16401516 ] Xiao Chen edited comment on HDFS-13087 at 3/16/18 7:02 AM: --- Thanks [~GeLiXin]

[jira] [Commented] (HDFS-13087) Fix: Snapshots On encryption zones get incorrect EZ settings when encryption zone changes

2018-03-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401516#comment-16401516 ] Xiao Chen commented on HDFS-13087: -- Thanks [~GeLiXin] for revving. I didn't notice CipherSuite and 

<    1   2