[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931091#comment-15931091 ] Hadoop QA commented on HDFS-11444: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931079#comment-15931079 ] Hadoop QA commented on HDFS-11492: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931074#comment-15931074 ] Hadoop QA commented on HDFS-11444: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931062#comment-15931062 ] Weiwei Yang edited comment on HDFS-11444 at 3/18/17 4:59 AM: -

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11444: --- Attachment: HDFS-11444-HDFS-7240.004.patch > Ozone: Fix datanode ID handling in MiniOzoneCluster > ---

[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931062#comment-15931062 ] Weiwei Yang commented on HDFS-11444: Hello [~anu] Thanks for your quick response! bq

[jira] [Updated] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11492: Status: Patch Available (was: Open) > Ozone: Add the ability to handle sendContainerReport Command

[jira] [Updated] (HDFS-11492) Ozone: Add the ability to handle sendContainerReport Command

2017-03-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11492: Attachment: HDFS-11492-HDFS-7240.001.patch > Ozone: Add the ability to handle sendContainerReport Co

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11444: --- Attachment: HDFS-11444-HDFS-7240.003.patch > Ozone: Fix datanode ID handling in MiniOzoneCluster > ---

[jira] [Commented] (HDFS-10675) Datanode support to read from external stores.

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931015#comment-15931015 ] Hadoop QA commented on HDFS-10675: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931004#comment-15931004 ] Hudson commented on HDFS-11547: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15931003#comment-15931003 ] Hadoop QA commented on HDFS-11545: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11547: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930979#comment-15930979 ] Tsz Wo Nicholas Sze commented on HDFS-11535: Thanks Chen for taking my proposa

[jira] [Commented] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930974#comment-15930974 ] Hadoop QA commented on HDFS-11547: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-17 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Status: Patch Available (was: Open) > Propagate DataNode's slow disks info to the NameNode via

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-17 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545.001.patch > Propagate DataNode's slow disks info to the NameNode via Hear

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930926#comment-15930926 ] Sailesh Mukil commented on HDFS-11529: -- Hadoop QA doesn't seem to track native tests.

[jira] [Commented] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930925#comment-15930925 ] Hadoop QA commented on HDFS-11529: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930911#comment-15930911 ] Arpit Agarwal commented on HDFS-11547: -- +1 pending Jenkins. > Add logs for slow Bloc

[jira] [Updated] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11547: - Attachment: HDFS-11547.000.patch > Add logs for slow BlockReceiver while writing data to disk > --

[jira] [Commented] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930908#comment-15930908 ] Xiaobing Zhou commented on HDFS-11547: -- Posted v0 patch. > Add logs for slow BlockRe

[jira] [Updated] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11547: - Status: Patch Available (was: Open) > Add logs for slow BlockReceiver while writing data to disk

[jira] [Updated] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11529: - Status: Patch Available (was: Open) > libHDFS still does not return appropriate error information

[jira] [Updated] (HDFS-11529) libHDFS still does not return appropriate error information in many cases

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11529: - Attachment: HDFS-11529.000.patch > libHDFS still does not return appropriate error information in

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930906#comment-15930906 ] Chen Liang commented on HDFS-11535: --- Thanks [~szetszwo] for sharing this idea! [~arpita

[jira] [Updated] (HDFS-11547) Add logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11547: - Summary: Add logs for slow BlockReceiver while writing data to disk (was: Restore logs for slow B

[jira] [Commented] (HDFS-10881) Federation State Store Driver API

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930899#comment-15930899 ] Hadoop QA commented on HDFS-10881: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10629) Federation Router

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930891#comment-15930891 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11547) Restore logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11547: - Component/s: datanode > Restore logs for slow BlockReceiver while writing data to disk > -

[jira] [Updated] (HDFS-11547) Restore logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11547: - Labels: 2.9.0 (was: ) > Restore logs for slow BlockReceiver while writing data to disk >

[jira] [Created] (HDFS-11547) Restore logs for slow BlockReceiver while writing data to disk

2017-03-17 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-11547: Summary: Restore logs for slow BlockReceiver while writing data to disk Key: HDFS-11547 URL: https://issues.apache.org/jira/browse/HDFS-11547 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10629) Federation Router

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930886#comment-15930886 ] Hadoop QA commented on HDFS-10629: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11517) Expose slow disks via DataNode JMX

2017-03-17 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930881#comment-15930881 ] Hanisha Koneru commented on HDFS-11517: --- Thank you [~arpitagarwal]. > Expose slow d

[jira] [Commented] (HDFS-11517) Expose slow disks via DataNode JMX

2017-03-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930878#comment-15930878 ] Hudson commented on HDFS-11517: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10629) Federation Router

2017-03-17 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10629: --- Attachment: HDFS-10629-HDFS-10467-009.patch Removing RPC part from the Router for easier review. HDFS-

[jira] [Updated] (HDFS-10629) Federation Router

2017-03-17 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10629: --- Description: Component that routes calls from the clients to the right Namespace. (was: Component tha

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2017-03-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Patch Available (was: Open) > Datanode support to read from external stores. >

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2017-03-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Attachment: HDFS-10675-HDFS-9806.006.patch Updated patch fixing the failing test cases.

[jira] [Updated] (HDFS-10675) Datanode support to read from external stores.

2017-03-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10675: -- Status: Open (was: Patch Available) > Datanode support to read from external stores. >

[jira] [Updated] (HDFS-11517) Expose slow disks via DataNode JMX

2017-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11517: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-10629) Federation Router

2017-03-17 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930856#comment-15930856 ] Inigo Goiri commented on HDFS-10629: Thanks [~subru] for the comment. I'll remove the

[jira] [Created] (HDFS-11546) Federation Router RPC server

2017-03-17 Thread Inigo Goiri (JIRA)
Inigo Goiri created HDFS-11546: -- Summary: Federation Router RPC server Key: HDFS-11546 URL: https://issues.apache.org/jira/browse/HDFS-11546 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11545: - Description: DataNode detects the outliers (slow disks) among all its disk. This information can b

[jira] [Commented] (HDFS-10629) Federation Router

2017-03-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930845#comment-15930845 ] Subru Krishnan commented on HDFS-10629: --- [~jakace], thanks for working on this! I

[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-17 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Description: DataNode detects the outliers (slow disks) among all its disk. This information can

[jira] [Created] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat

2017-03-17 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDFS-11545: - Summary: Propagate DataNode's slow disks info to the NameNode via Heartbeat Key: HDFS-11545 URL: https://issues.apache.org/jira/browse/HDFS-11545 Project: Hadoop HD

[jira] [Commented] (HDFS-11517) Expose slow disks via DataNode JMX

2017-03-17 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930830#comment-15930830 ] Hanisha Koneru commented on HDFS-11517: --- Thank you [~arpitagarwal] for reviewing the

[jira] [Commented] (HDFS-11531) Expose hedged read metrics via libHDFS API

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930820#comment-15930820 ] Sailesh Mukil commented on HDFS-11531: -- Tests have been added to "hadoop-hdfs-native

[jira] [Commented] (HDFS-11531) Expose hedged read metrics via libHDFS API

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930811#comment-15930811 ] Hadoop QA commented on HDFS-11531: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-11517) Expose slow disks via DataNode JMX

2017-03-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15928739#comment-15928739 ] Arpit Agarwal edited comment on HDFS-11517 at 3/17/17 10:01 PM:

[jira] [Updated] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-03-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11430: -- Attachment: HDFS-11430-branch-2.001.patch Post a patch for branch-2 > Separate class InnerNode from cla

[jira] [Updated] (HDFS-10881) Federation State Store Driver API

2017-03-17 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10881: -- Attachment: HDFS-10881-HDFS-10467-008.patch Removing files not directly related to this patch. Minor tw

[jira] [Updated] (HDFS-11531) Expose hedged read metrics via libHDFS API

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11531: - Status: Patch Available (was: In Progress) > Expose hedged read metrics via libHDFS API > ---

[jira] [Updated] (HDFS-11531) Expose hedged read metrics via libHDFS API

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11531: - Attachment: HDFS-11531.001.patch > Expose hedged read metrics via libHDFS API > --

[jira] [Updated] (HDFS-10629) Federation Router

2017-03-17 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kace updated HDFS-10629: -- Attachment: HDFS-10629-HDFS-10467-008.patch Updating core router patch with some improvements: 1) Minor

[jira] [Updated] (HDFS-11531) Expose hedged read metrics via libHDFS API

2017-03-17 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil updated HDFS-11531: - Status: In Progress (was: Patch Available) > Expose hedged read metrics via libHDFS API > ---

[jira] [Commented] (HDFS-11543) Test multiple erasure coding implementations

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930706#comment-15930706 ] Andrew Wang commented on HDFS-11543: Cool, thanks for the details (and especially if y

[jira] [Updated] (HDFS-11543) Test multiple erasure coding implementations

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11543: --- Labels: hdfs-ec-3.0-nice-to-have test (was: test) > Test multiple erasure coding implementations > --

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-03-17 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930687#comment-15930687 ] Ewan Higgs commented on HDFS-9807: -- +1 on all of [~virajith]'s comments. I think the comme

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-03-17 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930679#comment-15930679 ] Virajith Jalaparti commented on HDFS-9807: -- Thanks [~ehiggs], and [~chris.douglas]

[jira] [Commented] (HDFS-11543) Test multiple erasure coding implementations

2017-03-17 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930667#comment-15930667 ] László Bence Nagy commented on HDFS-11543: -- Thanks Andrew, I did not see these.

[jira] [Commented] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930596#comment-15930596 ] James Clampffer commented on HDFS-11544: No tests added because all of these funct

[jira] [Commented] (HDFS-8225) EC client code should not print info log message

2017-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930545#comment-15930545 ] Tsz Wo Nicholas Sze commented on HDFS-8225: --- Sure, I am happy to work on this. >

[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930516#comment-15930516 ] Hadoop QA commented on HDFS-11444: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-17 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930512#comment-15930512 ] Tsz Wo Nicholas Sze commented on HDFS-11535: I propose to use a simple strateg

[jira] [Commented] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-17 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930455#comment-15930455 ] Chen Liang commented on HDFS-11535: --- Thanks [~linyiqun] for the clarification! This appr

[jira] [Updated] (HDFS-11516) Admin command line should print message to stderr in failure case

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11516: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.9.0 Status: Resolv

[jira] [Commented] (HDFS-11516) Admin command line should print message to stderr in failure case

2017-03-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930443#comment-15930443 ] Hudson commented on HDFS-11516: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11541: --- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Call RawErasureEncoder and RawErasureDecoder release() met

[jira] [Commented] (HDFS-11543) Test multiple erasure coding implementations

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930438#comment-15930438 ] Andrew Wang commented on HDFS-11543: Is this related to HDFS-11066 and HDFS-9962? I ag

[jira] [Commented] (HDFS-8225) EC client code should not print info log message

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930409#comment-15930409 ] Andrew Wang commented on HDFS-8225: --- Hi [~szetszwo], do you still plan to work on this JI

[jira] [Assigned] (HDFS-7786) Handle slow writers for DFSStripedOutputStream

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-7786: - Assignee: (was: Keisuke Ogiwara) Unassigning since this JIRA doesn't seem active and someone e

[jira] [Commented] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930384#comment-15930384 ] Hadoop QA commented on HDFS-11544: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-9962) Erasure Coding: need a way to test multiple EC policies

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-9962: - Assignee: (was: Rui Li) > Erasure Coding: need a way to test multiple EC policies > --

[jira] [Assigned] (HDFS-9345) Erasure Coding: create dummy coder and schema

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-9345: - Assignee: (was: Rui Li) > Erasure Coding: create dummy coder and schema >

[jira] [Updated] (HDFS-8201) Refactor the end to end test for stripping file writing and reading

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8201: -- Assignee: (was: Xinwei Qin ) Status: Open (was: Patch Available) Cancelling patch and unassign

[jira] [Updated] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9657: -- Status: Open (was: Patch Available) > Schedule EC tasks at proper time to reduce the impact of recovery

[jira] [Assigned] (HDFS-9657) Schedule EC tasks at proper time to reduce the impact of recovery traffic

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-9657: - Assignee: (was: Li Bo) Unassigning as this JIRA does not seem active, someone else might want

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9342: -- Priority: Critical (was: Major) > Erasure coding: client should update and commit block based on acknowl

[jira] [Assigned] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-9342: - Assignee: (was: Walter Su) Target Version/s: (was: ) Unassigning for tracking pu

[jira] [Updated] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9342: -- Status: Open (was: Patch Available) > Erasure coding: client should update and commit block based on ack

[jira] [Assigned] (HDFS-8672) Erasure Coding: Add EC-related Metrics to NN (seperate striped blocks count from UnderReplicatedBlocks count)

2017-03-17 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-8672: - Assignee: Manoj Govindassamy (was: Walter Su) > Erasure Coding: Add EC-related Metrics to NN (sep

[jira] [Comment Edited] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930302#comment-15930302 ] Anu Engineer edited comment on HDFS-11444 at 3/17/17 5:05 PM: --

[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930302#comment-15930302 ] Anu Engineer commented on HDFS-11444: - [~cheersyang] The changes look excellent. Thank

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11444: --- Attachment: HDFS-11444-HDFS-7240.002.patch > Ozone: Fix datanode ID handling in MiniOzoneCluster > ---

[jira] [Updated] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11544: --- Status: Patch Available (was: Open) > libhdfs++: Improve C API error reporting >

[jira] [Updated] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-17 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-11544: --- Attachment: HDFS-11544.HDFS-8707.000.patch Ready for review > libhdfs++: Improve C API error

[jira] [Created] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-17 Thread James Clampffer (JIRA)
James Clampffer created HDFS-11544: -- Summary: libhdfs++: Improve C API error reporting Key: HDFS-11544 URL: https://issues.apache.org/jira/browse/HDFS-11544 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11543) Test multiple erasure coding implementations

2017-03-17 Thread JIRA
László Bence Nagy created HDFS-11543: Summary: Test multiple erasure coding implementations Key: HDFS-11543 URL: https://issues.apache.org/jira/browse/HDFS-11543 Project: Hadoop HDFS Issu

[jira] [Updated] (HDFS-11542) Fix RawErasureCoderBenchmark decoding operation

2017-03-17 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bence Nagy updated HDFS-11542: - Labels: test (was: ) > Fix RawErasureCoderBenchmark decoding operation >

[jira] [Commented] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930226#comment-15930226 ] Hadoop QA commented on HDFS-11444: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11516) Admin command line should print message to stderr in failure case

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930089#comment-15930089 ] Hadoop QA commented on HDFS-11516: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-11542) Fix RawErasureCoderBenchmark decoding operation

2017-03-17 Thread JIRA
László Bence Nagy created HDFS-11542: Summary: Fix RawErasureCoderBenchmark decoding operation Key: HDFS-11542 URL: https://issues.apache.org/jira/browse/HDFS-11542 Project: Hadoop HDFS I

[jira] [Updated] (HDFS-11444) Ozone: Fix datanode ID handling in MiniOzoneCluster

2017-03-17 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11444: --- Attachment: HDFS-11444-HDFS-7240.001.patch Renamed the patch to target to the feature branch.. > Ozon

[jira] [Updated] (HDFS-11541) Call RawErasureEncoder and RawErasureDecoder release() methods

2017-03-17 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-11541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] László Bence Nagy updated HDFS-11541: - Component/s: (was: native) Summary: Call RawErasureEncoder and RawErasureDecode

[jira] [Commented] (HDFS-11163) Mover should move the file blocks to default storage once policy is unset

2017-03-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929973#comment-15929973 ] Hadoop QA commented on HDFS-11163: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11516) Admin command line should print message to stderr in failure case

2017-03-17 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-11516: -- Attachment: HDFS-11516.03.patch > Admin command line should print message to stderr in failure case > --

[jira] [Created] (HDFS-11541) RawErasureEncoder and RawErasureDecoder release() methods not called

2017-03-17 Thread JIRA
László Bence Nagy created HDFS-11541: Summary: RawErasureEncoder and RawErasureDecoder release() methods not called Key: HDFS-11541 URL: https://issues.apache.org/jira/browse/HDFS-11541 Project: H

[jira] [Commented] (HDFS-11431) hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider

2017-03-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15929757#comment-15929757 ] Steve Loughran commented on HDFS-11431: --- OK. Leave as is for the release and we'll t

  1   2   >