[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268194#comment-16268194 ] Xiaoyu Yao commented on HDFS-9240: -- Thanks for the update [~virajith]. patch v3 LGTM, +1 pending Jenkins.

[jira] [Commented] (HDFS-12833) In Distcp, Delete option not having the proper usage message.

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268192#comment-16268192 ] genericqa commented on HDFS-12833: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12807) Ozone: Expose RockDB stats via JMX for Ozone metadata stores

2017-11-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12807: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Updated] (HDFS-12858) RBF: Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12858: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268141#comment-16268141 ] genericqa commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12858) RBF: Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268117#comment-16268117 ] genericqa commented on HDFS-12858: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12858) RBF: Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268112#comment-16268112 ] Íñigo Goiri commented on HDFS-12858: [~linyiqun], I made this a sub-task of HDFS-12615 to help

[jira] [Updated] (HDFS-12858) RBF: Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12858: --- Summary: RBF: Add router admin commands usage in HDFS commands reference doc (was: Add router admin

[jira] [Updated] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12858: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-12615 > Add router admin commands usage in HDFS

[jira] [Updated] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12858: --- Labels: RBF (was: ) > Add router admin commands usage in HDFS commands reference doc >

[jira] [Commented] (HDFS-12835) RBF: Fix Javadoc parameter errors

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268107#comment-16268107 ] Íñigo Goiri commented on HDFS-12835: Thanks [~ywskycn] for going through this. LGTM +1. > RBF: Fix

[jira] [Updated] (HDFS-12835) RBF: Fix Javadoc parameter errors

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12835: --- Description: Fix the javadoc errors in Router-based federation. > RBF: Fix Javadoc parameter errors >

[jira] [Commented] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268077#comment-16268077 ] Hudson commented on HDFS-12858: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13281 (See

[jira] [Updated] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12858: - Attachment: HDFS-12858-branch-2.001.patch > Add router admin commands usage in HDFS commands reference

[jira] [Commented] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268076#comment-16268076 ] Yiqun Lin commented on HDFS-12858: -- Thanks for the review, [~elgoiri]. Attach the patch for branch-2. >

[jira] [Commented] (HDFS-12807) Ozone: Expose RockDB stats via JMX for Ozone metadata stores

2017-11-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268050#comment-16268050 ] Anu Engineer commented on HDFS-12807: - +1, I have tested this locally and I will commit this shortly.

[jira] [Updated] (HDFS-12861) Track speed in DFSClient

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12861: --- Description: Sometimes we get slow jobs because of the access to HDFS. However, is hard to tell what

[jira] [Created] (HDFS-12861) Track speed in DFSClient

2017-11-27 Thread JIRA
Íñigo Goiri created HDFS-12861: -- Summary: Track speed in DFSClient Key: HDFS-12861 URL: https://issues.apache.org/jira/browse/HDFS-12861 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that

[jira] [Comment Edited] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267952#comment-16267952 ] Virajith Jalaparti edited comment on HDFS-12665 at 11/28/17 1:55 AM: -

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.011.patch Modifying v10 to ensure that the inmemory

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267914#comment-16267914 ] genericqa commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Fix the

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267905#comment-16267905 ] Virajith Jalaparti commented on HDFS-12809: --- Thanks for taking a look [~elgoiri]. Committing v2

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267882#comment-16267882 ] Íñigo Goiri commented on HDFS-12809: The unit test in [^HDFS-12809-HDFS-9806.002.patch] looks good.

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12754: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Lease renewal can hit a deadlock

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267781#comment-16267781 ] Kihwal Lee commented on HDFS-12754: --- I've committed this to trunk, branch-3.0, branch-3.0.0, branch-2,

[jira] [Commented] (HDFS-12835) RBF: Fix Javadoc parameter errors

2017-11-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267780#comment-16267780 ] Wei Yan commented on HDFS-12835: Just fixing some doc errors, so no testcases expected. The hadoop-hdfs

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12754: -- Fix Version/s: 2.8.4 2.9.1 > Lease renewal can hit a deadlock >

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267741#comment-16267741 ] genericqa commented on HDFS-12809: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267734#comment-16267734 ] Kihwal Lee edited comment on HDFS-12754 at 11/27/17 10:55 PM: -- I ran

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12754: -- Fix Version/s: 2.10.0 > Lease renewal can hit a deadlock > - > >

[jira] [Updated] (HDFS-12860) TeraSort failed on erasure coding directory

2017-11-27 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12860: - Description: Running terasort on a cluster with 8 datanodes, 256GB data, using RS-3-2-1024k. The

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267734#comment-16267734 ] Kihwal Lee commented on HDFS-12754: --- I ran {{TestLeaseRecovery2}} *without* the patch and two cases

[jira] [Created] (HDFS-12860) TeraSort failed on erasure coding directory

2017-11-27 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12860: Summary: TeraSort failed on erasure coding directory Key: HDFS-12860 URL: https://issues.apache.org/jira/browse/HDFS-12860 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12836) startTxId could be greater than endTxId when tailing in-progress edit log

2017-11-27 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267719#comment-16267719 ] Chao Sun commented on HDFS-12836: - Doesn't look like the test failures are related. [~jojochuang]: can you

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Patch Available (was: Open) > Use Builder pattern for BlockLocation constructors

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-9240: - Status: Open (was: Patch Available) > Use Builder pattern for BlockLocation constructors

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267681#comment-16267681 ] Virajith Jalaparti commented on HDFS-9240: -- [~xyao], can you take a look at v3? It address your

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that

[jira] [Comment Edited] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267622#comment-16267622 ] Virajith Jalaparti edited comment on HDFS-12665 at 11/27/17 9:44 PM: -

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.010.patch Fixing the remaining checkstyle and findbugs

[jira] [Updated] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12851: --- Release Note: (was: I have committed this. Thanks, Mukul!) I have committed this.

[jira] [Updated] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12851: --- Resolution: Fixed Hadoop Flags: Reviewed Release Note: I have committed

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267605#comment-16267605 ] Virajith Jalaparti commented on HDFS-12809: --- [~elgoiri] - did it in v2 of the patch. Waiting on

[jira] [Commented] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267600#comment-16267600 ] Íñigo Goiri commented on HDFS-12809: I think is fine not checking for a random distribution (overdoing

[jira] [Commented] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-27 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267590#comment-16267590 ] Tsz Wo Nicholas Sze commented on HDFS-12851: +1 the 005 patch looks good. > Ozone: Upgrade to

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267502#comment-16267502 ] genericqa commented on HDFS-12794: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Status: Open (was: Patch Available) > [READ] Fix the randomized selection of locations

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Status: Patch Available (was: Open) > [READ] Fix the randomized selection of locations

[jira] [Updated] (HDFS-12809) [READ] Fix the randomized selection of locations in {{ProvidedBlocksBuilder}}.

2017-11-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12809: -- Attachment: HDFS-12809-HDFS-9806.002.patch Modified patch that fixes the checkstyle

[jira] [Commented] (HDFS-12681) Make HdfsLocatedFileStatus a subtype of LocatedFileStatus

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267230#comment-16267230 ] Íñigo Goiri commented on HDFS-12681: bq. We could deprecate it and advise users to ask for locations

[jira] [Commented] (HDFS-12858) Add router admin commands usage in HDFS commands reference doc

2017-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267227#comment-16267227 ] Íñigo Goiri commented on HDFS-12858: Thanks [~linyiqun] for working on this. LGTM +1. > Add router

[jira] [Commented] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267161#comment-16267161 ] genericqa commented on HDFS-12741: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12857) StoragePolicyAdmin should support schema based path

2017-11-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267108#comment-16267108 ] Arpit Agarwal commented on HDFS-12857: -- +1 pending Jenkins. > StoragePolicyAdmin should support

[jira] [Commented] (HDFS-12478) [WRITE] Command line tools for managing Provided Storage Backup mounts

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267095#comment-16267095 ] genericqa commented on HDFS-12478: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Status: In Progress (was: Patch Available) > Ozone: Use time units in the Ozone configuration

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267055#comment-16267055 ] genericqa commented on HDFS-12594: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267049#comment-16267049 ] genericqa commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266999#comment-16266999 ] Rushabh S Shah commented on HDFS-12832: --- bq. I think if the name is calculated it must be inside the

[jira] [Updated] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12794: --- Attachment: HDFS-12794-HDFS-7240.005.patch Thanks [~anu], for the review comments. As

[jira] [Commented] (HDFS-12832) INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit

2017-11-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266967#comment-16266967 ] Erik Krogen commented on HDFS-12832: I think it is also relevant to point out that HDFS-10674 made

[jira] [Commented] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266917#comment-16266917 ] genericqa commented on HDFS-12859: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-27 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12754: --- Attachment: HDFS-12754-branch-2.patch Adding branch-2 version of the patch with a minor fix to

[jira] [Comment Edited] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266882#comment-16266882 ] Shashikant Banerjee edited comment on HDFS-12741 at 11/27/17 2:41 PM: --

[jira] [Updated] (HDFS-12478) [WRITE] Command line tools for managing Provided Storage Backup mounts

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12478: -- Attachment: HDFS-12478-HDFS-9806.003.patch Attaching updated patch with fixed rebase with new

[jira] [Updated] (HDFS-12741) ADD support for KSM --createObjectStore command

2017-11-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12741: --- Attachment: HDFS-12741-HDFS-7240.002.patch Thanks [~linyiqun], for the review

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: HDFS-12090-Functional-Specification.003.pdf Attaching version of specification with less

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: (was: HDFS-9806 Functional Specification (003).pdf) > Handling writes from HDFS to

[jira] [Updated] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12090: -- Attachment: HDFS-9806 Functional Specification (003).pdf Attaching version of specification which was

[jira] [Comment Edited] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266814#comment-16266814 ] Jianfei Jiang edited comment on HDFS-12859 at 11/27/17 1:39 PM: Thanks

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266818#comment-16266818 ] genericqa commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266814#comment-16266814 ] Jianfei Jiang commented on HDFS-12859: -- Thanks [~brahmareddy], HDFS-9375 actually resolve the issue

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266809#comment-16266809 ] genericqa commented on HDFS-12698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-11-27 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: HDFS-12594.009.patch Thanks [~szetszwo], for the review comments. Patch

[jira] [Commented] (HDFS-12478) [WRITE] Command line tools for managing Provided Storage Backup mounts

2017-11-27 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266758#comment-16266758 ] genericqa commented on HDFS-12478: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12478) [WRITE] Command line tools for managing Provided Storage Backup mounts

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12478: -- Attachment: HDFS-12478-HDFS-9806.002.patch Applying a patch rebased onto HDFS-9806 ({{91258222182}}).

[jira] [Commented] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266746#comment-16266746 ] Brahma Reddy Battula commented on HDFS-12859: - I feel,HDFS-9375 can address your case, where

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Release Note: Add a command "hdfs dfsadmin -resetBalancerBandwidth" to reset balancer bandwidth

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Release Note: patch to add command "hdfs dfsadmin -resetBalancerBandwidth" Status: Patch

[jira] [Updated] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Jianfei Jiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jianfei Jiang updated HDFS-12859: - Attachment: HDFS-12859.patch patch to add command resetBalancerBandwidth > Admin command

[jira] [Created] (HDFS-12859) Admin command resetBalancerBandwidth

2017-11-27 Thread Jianfei Jiang (JIRA)
Jianfei Jiang created HDFS-12859: Summary: Admin command resetBalancerBandwidth Key: HDFS-12859 URL: https://issues.apache.org/jira/browse/HDFS-12859 Project: Hadoop HDFS Issue Type: New

[jira] [Updated] (HDFS-12851) Ozone: Upgrade to latest ratis build

2017-11-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12851: - Attachment: HDFS-12851-HDFS-7240.005.patch Thanks again for the review [~szetszwo], I

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that runs in memory

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.009.patch Attaching a patch that gets rid of more Checkstyle warnings

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Status: Open (was: Patch Available) > [AliasMap] Create a version of the AliasMap that runs in memory

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266546#comment-16266546 ] Elek, Marton commented on HDFS-12698: - Tested this patch during the weekend on a 200 node cluster

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Attachment: HDFS-12698-HDFS-7240.005.patch > Ozone: Use time units in the Ozone configuration

[jira] [Updated] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-11-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12698: Attachment: (was: HDFS-12698.004.patch) > Ozone: Use time units in the Ozone configuration