[jira] [Commented] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-07 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283176#comment-16283176 ] Mukul Kumar Singh commented on HDFS-12890: -- Thanks for the updated patch [~shashikant] 1) In

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283173#comment-16283173 ] Xiao Chen commented on HDFS-12907: -- Thanks for the explanation Daryn. The rage block is what's painful

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-12-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283102#comment-16283102 ] Uma Maheswara Rao G edited comment on HDFS-10285 at 12/8/17 7:35 AM: -

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-12-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283102#comment-16283102 ] Uma Maheswara Rao G commented on HDFS-10285: {quote} Here's a rhetorical question: If managing

[jira] [Commented] (HDFS-12886) Ignore minReplication for block recovery

2017-12-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283101#comment-16283101 ] Daryn Sharp commented on HDFS-12886: Thanks for the ping, will make time to review in the next few

[jira] [Commented] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283086#comment-16283086 ] genericqa commented on HDFS-12875: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12882) Support full open(PathHandle) contract in HDFS

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283079#comment-16283079 ] genericqa commented on HDFS-12882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283065#comment-16283065 ] genericqa commented on HDFS-12893: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283045#comment-16283045 ] genericqa commented on HDFS-12905: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283037#comment-16283037 ] genericqa commented on HDFS-12907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283034#comment-16283034 ] genericqa commented on HDFS-12875: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282860#comment-16282860 ] Rushabh S Shah commented on HDFS-12907: --- Following are the tests that failed. {noformat}

[jira] [Updated] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12874: - Hadoop Flags: Reviewed Status: Patch Available (was: Open) > [READ] Documentation for

[jira] [Updated] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12907: -- Attachment: HDFS-12907.001.patch [~daryn], [~andrew.wang]: can you please review. > Allow

[jira] [Comment Edited] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282860#comment-16282860 ] Rushabh S Shah edited comment on HDFS-12907 at 12/8/17 1:10 AM: Following

[jira] [Updated] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12875: --- Attachment: HDFS-12875.005.patch Cleaned up unit tests. > RBF: Complete logic for -readonly option

[jira] [Commented] (HDFS-12882) Support full open(PathHandle) contract in HDFS

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282831#comment-16282831 ] genericqa commented on HDFS-12882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282935#comment-16282935 ] Íñigo Goiri commented on HDFS-12874: For reference, the outcome

[jira] [Commented] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282924#comment-16282924 ] Íñigo Goiri commented on HDFS-12893: I like this better. For this: {code} if

[jira] [Commented] (HDFS-12882) Support full open(PathHandle) contract in HDFS

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282916#comment-16282916 ] Íñigo Goiri commented on HDFS-12882: The approach in [^HDFS-12882.04.patch] is cleaner. Can we

[jira] [Updated] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12875: --- Attachment: HDFS-12875.004.patch > RBF: Complete logic for -readonly option of dfsrouteradmin add

[jira] [Updated] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12893: -- Attachment: HDFS-12893-HDFS-9806.003.patch > [READ] Support replication of Provided

[jira] [Updated] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12893: -- Status: Open (was: Patch Available) > [READ] Support replication of Provided blocks

[jira] [Updated] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12874: - Resolution: Fixed Status: Resolved (was: Patch Available) I committed this. Thanks

[jira] [Commented] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282904#comment-16282904 ] genericqa commented on HDFS-12874: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12905: - Status: Patch Available (was: Open) > [READ] Handle decommissioning and under-maintenance

[jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282867#comment-16282867 ] genericqa commented on HDFS-11915: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282889#comment-16282889 ] Virajith Jalaparti commented on HDFS-12893: --- [~elgoiri] - patch v3 wraps the choosing of the

[jira] [Updated] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12893: -- Status: Patch Available (was: Open) > [READ] Support replication of Provided blocks

[jira] [Updated] (HDFS-12825) Fsck report shows config key name for min replication issues

2017-12-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12825: -- Summary: Fsck report shows config key name for min replication issues (was: After

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282868#comment-16282868 ] Daryn Sharp commented on HDFS-12907: bq. My understanding is after HDFS-12355 \[...\] , Is this

[jira] [Updated] (HDFS-12825) Fsck report shows config key name for min replication issues

2017-12-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12825: -- Labels: incompatibleChange newbie (was: newbie) > Fsck report shows config key name

[jira] [Commented] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282854#comment-16282854 ] Chris Douglas commented on HDFS-12874: -- +1 I prefer this version. > [READ] Documentation for

[jira] [Assigned] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HDFS-12874: Assignee: Virajith Jalaparti > [READ] Documentation for provided storage >

[jira] [Updated] (HDFS-12882) Support full open(PathHandle) contract in HDFS

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12882: - Attachment: HDFS-12882.04.patch Alternative approach, adding

[jira] [Commented] (HDFS-12893) [READ] Support replication of Provided blocks with non-default topologies.

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282815#comment-16282815 ] Íñigo Goiri commented on HDFS-12893: Can we wrap the functions where we return the regular descriptor

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282559#comment-16282559 ] Rushabh S Shah commented on HDFS-12907: --- bq. On the topic of webhdfs client-side encryption, could

[jira] [Commented] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282801#comment-16282801 ] Íñigo Goiri commented on HDFS-12905: Thanks [~virajith], I personally prefer the approach in

[jira] [Comment Edited] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282794#comment-16282794 ] Virajith Jalaparti edited comment on HDFS-12905 at 12/8/17 12:23 AM: -

[jira] [Commented] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282794#comment-16282794 ] Virajith Jalaparti commented on HDFS-12905: --- A 2nd attempt at this following offline discussions

[jira] [Updated] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12905: -- Attachment: HDFS-12905-HDFS-9806.002.patch > [READ] Handle decommissioning and

[jira] [Updated] (HDFS-12905) [READ] Handle decommissioning and under-maintenance Datanodes with Provided storage.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12905: -- Status: Open (was: Patch Available) > [READ] Handle decommissioning and

[jira] [Commented] (HDFS-11733) TestGetBlocks.getBlocksWithException() ignores datanode and size parameters.

2017-12-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282763#comment-16282763 ] Konstantin Shvachko commented on HDFS-11733: Hi [~yuanbo]. Could you please check if the test

[jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-12-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282669#comment-16282669 ] Wei-Chiu Chuang commented on HDFS-11915: Pushed the patch to trunk. Thanks [~vinayrpet] > Sync

[jira] [Updated] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-12-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11915: --- Fix Version/s: 3.1.0 > Sync rbw dir on the first hsync() to avoid file lost on power failure

[jira] [Updated] (HDFS-12848) [READ] Add a pluggable policy for selecting locations for Provided files.

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12848: --- Description: Add a pluggable policy for selecting locations for Provided files. > [READ] Add a

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282731#comment-16282731 ] Xiao Chen commented on HDFS-12907: -- Thanks Andrew for the ping and Rushabh / Daryn for discussions.

[jira] [Commented] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282730#comment-16282730 ] Íñigo Goiri commented on HDFS-12875: I need to fix: * TestMountTableResolver * TestRouterMountTable

[jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282695#comment-16282695 ] Hudson commented on HDFS-11915: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13343 (See

[jira] [Updated] (HDFS-12882) Support full open(PathHandle) contract in HDFS

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12882: - Attachment: HDFS-12882.03.patch This adds a separate flag to {{getFileInfo}} that (eventually)

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282676#comment-16282676 ] genericqa commented on HDFS-12907: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12907: -- Status: Patch Available (was: Open) > Allow read-only access to reserved raw for

[jira] [Commented] (HDFS-11915) Sync rbw dir on the first hsync() to avoid file lost on power failure

2017-12-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282648#comment-16282648 ] Wei-Chiu Chuang commented on HDFS-11915: The patch for trunk is good +1. Will commit the patch

[jira] [Commented] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282641#comment-16282641 ] genericqa commented on HDFS-12875: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282607#comment-16282607 ] genericqa commented on HDFS-12818: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12848) [READ] Add a pluggable policy for selecting locations for Provided files.

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12848: -- Parent Issue: HDFS-12090 (was: HDFS-9806) > [READ] Add a pluggable policy for

[jira] [Updated] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12903: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Fix closing

[jira] [Assigned] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-12903: - Assignee: Virajith Jalaparti > [READ] Fix closing streams in ImageWriter >

[jira] [Updated] (HDFS-12874) [READ] Documentation for provided storage

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12874: -- Attachment: HDFS-12874-HDFS-9806.01.patch Modified documentation attached

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-07 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282620#comment-16282620 ] Virajith Jalaparti commented on HDFS-12903: --- Thanks [~elgoiri] and [~chris.douglas]. Committed

[jira] [Commented] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282586#comment-16282586 ] genericqa commented on HDFS-12890: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282583#comment-16282583 ] Rushabh S Shah commented on HDFS-12907: --- HDFS-12355 is tracking all the efforts for adding EZ

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282579#comment-16282579 ] Andrew Wang commented on HDFS-12907: Solving this for WebHdfsFileSystem is a lot more tractable than

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282501#comment-16282501 ] Íñigo Goiri commented on HDFS-12903: Yetus doesn't show the FindBug even in HDFS-9806. I think this

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282487#comment-16282487 ] Andrew Wang commented on HDFS-12907: I think that would work, though of course I'd prefer not to open

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-12-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282441#comment-16282441 ] Andrew Wang commented on HDFS-7240: --- Hi Sanjay, Thanks for writing up that summary. It's clear there's

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282451#comment-16282451 ] Daryn Sharp commented on HDFS-12907: bq. It's so they don't accidentally write data without xattrs or

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-12-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282419#comment-16282419 ] Daryn Sharp commented on HDFS-10285: bq. Im coming at this from the standpoint of supporting

[jira] [Updated] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12875: --- Description: The dfsrouteradmin has an option for readonly mount points but this is not implemented.

[jira] [Commented] (HDFS-12840) Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282421#comment-16282421 ] Hudson commented on HDFS-12840: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13341 (See

[jira] [Updated] (HDFS-12875) RBF: Complete logic for -readonly option of dfsrouteradmin add command

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12875: --- Attachment: HDFS-12875.003.patch > RBF: Complete logic for -readonly option of dfsrouteradmin add

[jira] [Updated] (HDFS-12840) Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog

2017-12-07 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12840: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Release Note: Add

[jira] [Updated] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12907: -- Attachment: HDFS-12907.patch Attaching a simple patch. > Allow read-only access to reserved

[jira] [Commented] (HDFS-12903) [READ] Fix closing streams in ImageWriter

2017-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282355#comment-16282355 ] Chris Douglas commented on HDFS-12903: -- Duh, misread the Yetus output. This did fix the warning. +1

[jira] [Commented] (HDFS-12751) Ozone: SCM: update container allocated size to container db for all the open containers in ContainerStateManager#close

2017-12-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282358#comment-16282358 ] Chen Liang commented on HDFS-12751: --- Thanks [~nandakumar131] for the followup! bq. We do not update

[jira] [Updated] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-07 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-12818: --- Attachment: HDFS-12818.002.patch > Support multiple storages in DataNodeCluster / SimulatedFSDataset

[jira] [Commented] (HDFS-12818) Support multiple storages in DataNodeCluster / SimulatedFSDataset

2017-12-07 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282322#comment-16282322 ] Erik Krogen commented on HDFS-12818: Thanks for looking [~shv]! {{getStorage()}} can never return

[jira] [Commented] (HDFS-12510) RBF: Add security to UI

2017-12-07 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282220#comment-16282220 ] Ajay Kumar commented on HDFS-12510: --- [~elgoiri],[~ywskycn] Thanks for the information. > RBF: Add

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282250#comment-16282250 ] Andrew Wang commented on HDFS-12907: It's so they don't accidentally write data without xattrs or with

[jira] [Updated] (HDFS-12825) Fsck report shows config key name for min replication issues

2017-12-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12825: -- Labels: newbie (was: incompatibleChange newbie) Hadoop Flags: Incompatible

[jira] [Commented] (HDFS-12825) After Block Corrupted, FSCK Report printing the Direct configuration.

2017-12-07 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282239#comment-16282239 ] Manoj Govindassamy commented on HDFS-12825: --- Patch looks good to me. +1. Thanks for working on

[jira] [Updated] (HDFS-12890) Ozone: XceiverClient should have upper bound on async requests

2017-12-07 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12890: --- Attachment: HDFS-12890-HDFS-7240.003.patch Thanks [~msingh], [~anu] for the review

[jira] [Commented] (HDFS-12510) RBF: Add security to UI

2017-12-07 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282162#comment-16282162 ] Wei Yan commented on HDFS-12510: [~ajayydv] I'll post a patch for HDFS-12512 soon. We'll have more details

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282112#comment-16282112 ] genericqa commented on HDFS-9668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6804) race condition between transferring block and appending block causes "Unexpected checksum mismatch exception"

2017-12-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282096#comment-16282096 ] Wei-Chiu Chuang commented on HDFS-6804: --- Sorry for coming to it late. I wasn't aware of the last

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2017-12-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282090#comment-16282090 ] Wei-Chiu Chuang commented on HDFS-9668: --- I am reviewing the patch. It looks like almost ready. Would

[jira] [Commented] (HDFS-12907) Allow read-only access to reserved raw for non-superusers

2017-12-07 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281948#comment-16281948 ] Rushabh S Shah commented on HDFS-12907: --- bq. Allowing non-superusers to easily read the raw bytes

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-12-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281503#comment-16281503 ] Rakesh R edited comment on HDFS-10285 at 12/7/17 1:17 PM: -- Thanks a lot [~anu]

[jira] [Comment Edited] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-12-07 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281811#comment-16281811 ] Wellington Chevreuil edited comment on HDFS-12618 at 12/7/17 1:01 PM: --

[jira] [Comment Edited] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-12-07 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281811#comment-16281811 ] Wellington Chevreuil edited comment on HDFS-12618 at 12/7/17 1:01 PM: --

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-12-07 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281811#comment-16281811 ] Wellington Chevreuil commented on HDFS-12618: - bq. How is

[jira] [Comment Edited] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-12-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281503#comment-16281503 ] Rakesh R edited comment on HDFS-10285 at 12/7/17 11:26 AM: --- Thanks a lot [~anu]

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281696#comment-16281696 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] The new patch is ready and update based on you

[jira] [Updated] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Xiaoqiao updated HDFS-10453: --- Attachment: HDFS-10453-branch-2.7.004.patch attach new patch for branch-2.7 > ReplicationMonitor

[jira] [Work started] (HDFS-12892) TestClusterTopology#testChooseRandom fails intermittently

2017-12-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12892 started by Zsolt Venczel. > TestClusterTopology#testChooseRandom fails intermittently >

[jira] [Commented] (HDFS-12891) TestDNFencingWithReplication.testFencingStress: java.lang.AssertionError

2017-12-07 Thread Zsolt Venczel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281575#comment-16281575 ] Zsolt Venczel commented on HDFS-12891: -- * I have double checked the failing unit tests and they seem

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread He Xiaoqiao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281571#comment-16281571 ] He Xiaoqiao commented on HDFS-10453: [~Octivian] [~genericqa] Thanks for your comments and tests.

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281548#comment-16281548 ] genericqa commented on HDFS-10453: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12308) Erasure Coding: Provide DistributedFileSystem & DFSClient API to return the effective EC policy on a directory or file, including the replication policy

2017-12-07 Thread chencan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chencan reassigned HDFS-12308: -- Assignee: chencan > Erasure Coding: Provide DistributedFileSystem & DFSClient API to return the >

[jira] [Updated] (HDFS-11576) Block recovery will fail indefinitely if recovery time > heartbeat interval

2017-12-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11576: --- Fix Version/s: 3.0.0 > Block recovery will fail indefinitely if recovery time > heartbeat interval >

  1   2   >