[jira] [Updated] (HDFS-13610) [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync

2018-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13610: --- Attachment: HDFS-13610-HDFS-12943.002.patch > [Edit Tail Fast Path Pt 4] Cleanup: integration test, d

[jira] [Commented] (HDFS-13610) [Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync

2018-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524657#comment-16524657 ] Erik Krogen commented on HDFS-13610: Looking through the test failures, I noticed som

[jira] [Updated] (HDFS-13689) NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode

2018-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13689: --- Labels: (was: ino) > NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode >

[jira] [Updated] (HDFS-13689) NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode

2018-06-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-13689: --- Labels: ino (was: ) > NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode >

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2018-06-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524639#comment-16524639 ] Junping Du commented on HDFS-10664: --- Failed tests are not related to the patch and veri

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524601#comment-16524601 ] genericqa commented on HDDS-194: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Updated] (HDDS-183) Integrate Volumeset, ContainerSet.

2018-06-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-183: Description: This Jira adds following: 1. Use new VolumeSet. 2. build container map from .c

[jira] [Updated] (HDDS-183) Integrate Volumeset, ContainerSet.

2018-06-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-183: Attachment: HDDS-183-HDDS-48.03.patch > Integrate Volumeset, ContainerSet. >

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524597#comment-16524597 ] genericqa commented on HDDS-193: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524570#comment-16524570 ] Xiaoyu Yao commented on HDDS-173: - Thanks [~hanishakoneru] for the update. Patch v3 looks g

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524564#comment-16524564 ] Xiaoyu Yao commented on HDDS-186: - Thanks [~ajayydv] for working on this. The patch v2 look

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524551#comment-16524551 ] genericqa commented on HDDS-195: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524526#comment-16524526 ] Elek, Marton commented on HDDS-195: --- The second version (2nd + whitespace fix = 3rd) is m

[jira] [Updated] (HDDS-187) Command status publisher for datanode

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-187: Description: Currently SCM sends set of commands for DataNode. DataNode executes them via CommandHandler. Thi

[jira] [Updated] (HDDS-187) Command status publisher for datanode

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-187: Summary: Command status publisher for datanode (was: Create over replicated queue) > Command status publish

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-194: -- Attachment: HDDS-194.002.patch > Remove NodePoolManager and node pool handling from SCM > ---

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524487#comment-16524487 ] Elek, Marton commented on HDDS-194: --- Patch is re-uploaded to get more clean view about th

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524486#comment-16524486 ] Elek, Marton commented on HDDS-193: --- Unit test failures should be independent. Re-uploadi

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.004.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.003.patch > Create generic CommandWatcher utility >

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524480#comment-16524480 ] genericqa commented on HDDS-193: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.002.patch > Create generic CommandWatcher utility >

[jira] [Commented] (HDFS-13665) Move RPC response serialization into Server.doResponse

2018-06-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524466#comment-16524466 ] Konstantin Shvachko commented on HDFS-13665: +1 looks good. > Move RPC respo

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524459#comment-16524459 ] genericqa commented on HDFS-12976: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524451#comment-16524451 ] genericqa commented on HDDS-94: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsy

[jira] [Updated] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-196: Status: Open (was: Patch Available) > PipelineManager should choose datanodes based on ContainerPlacementPol

[jira] [Updated] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-196: Status: Patch Available (was: Open) > PipelineManager should choose datanodes based on ContainerPlacementPol

[jira] [Commented] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524440#comment-16524440 ] Konstantin Shvachko commented on HDFS-12976: Hey [~csun]. Took me some time,

[jira] [Updated] (HDFS-12976) Introduce ObserverReadProxyProvider

2018-06-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12976: --- Attachment: HDFS-12976-HDFS-12943.004.patch > Introduce ObserverReadProxyProvider > -

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524430#comment-16524430 ] Anu Engineer commented on HDDS-94: -- +1, the acceptance tests are green in Jenkins, I will c

[jira] [Commented] (HDFS-13643) Implement basic async rpc client

2018-06-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524429#comment-16524429 ] stack commented on HDFS-13643: -- Yeah, we can take a look at [~daryn] stuff when it shows up.

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524385#comment-16524385 ] Sean Busbey commented on HDFS-13702: Why do you think it didn't apply the latest patc

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524376#comment-16524376 ] Todd Lipcon commented on HDFS-13702: Not sure what's up with the above precommit. It

[jira] [Commented] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524361#comment-16524361 ] Wei-Chiu Chuang commented on HDFS-13635: Thanks [~gabor.bota] +1 > Incorrect mes

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524359#comment-16524359 ] genericqa commented on HDFS-13702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524351#comment-16524351 ] Todd Lipcon commented on HDFS-13703: Anyone know if the failed tests are known flakes

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.004.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.003.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524339#comment-16524339 ] genericqa commented on HDFS-13703: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-196: Fix Version/s: 0.2.1 > PipelineManager should choose datanodes based on ContainerPlacementPolicy > -

[jira] [Updated] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-196: Attachment: HDDS-196.001.patch > PipelineManager should choose datanodes based on ContainerPlacementPolicy >

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524333#comment-16524333 ] Elek, Marton commented on HDDS-94: -- Started a new full acceptance test build with the resto

[jira] [Updated] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-94: - Attachment: HDDS-94.005.patch > Change ozone datanode command to start the standalone datanode plugin >

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524328#comment-16524328 ] Elek, Marton commented on HDDS-94: -- OK. I got it. The following line accidentally removed f

[jira] [Commented] (HDDS-94) Change ozone datanode command to start the standalone datanode plugin

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524319#comment-16524319 ] Elek, Marton commented on HDDS-94: -- Thank you very much the update. Unfortunately the ozone

[jira] [Commented] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524317#comment-16524317 ] genericqa commented on HDDS-195: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524312#comment-16524312 ] genericqa commented on HDDS-173: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Updated] (HDFS-13536) [PROVIDED Storage] HA for InMemoryAliasMap

2018-06-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-13536: -- Status: Open (was: Patch Available) > [PROVIDED Storage] HA for InMemoryAliasMap > ---

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Attachment: HDDS-195.001.patch > Create generic CommandWatcher utility >

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Status: Patch Available (was: Open) > Create generic CommandWatcher utility > --

[jira] [Updated] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-195: -- Description: In some cases we need a class which can track the status of the outgoing commands. The com

[jira] [Assigned] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDDS-195: - Assignee: Elek, Marton > Create generic CommandWatcher utility > -

[jira] [Created] (HDDS-196) PipelineManager should choose datanodes based on ContainerPlacementPolicy

2018-06-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-196: --- Summary: PipelineManager should choose datanodes based on ContainerPlacementPolicy Key: HDDS-196 URL: https://issues.apache.org/jira/browse/HDDS-196 Project: Hadoop Distribute

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524270#comment-16524270 ] Sean Busbey commented on HDFS-13702: {quote} I think we should commit this patch, +1,

[jira] [Commented] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524249#comment-16524249 ] genericqa commented on HDDS-194: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Attachment: hdfs-13702.patch > HTrace hooks taking 10-15% CPU in DFS client when disabled > -

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524221#comment-16524221 ] genericqa commented on HDFS-13702: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524182#comment-16524182 ] Todd Lipcon commented on HDFS-13703: BTW would be better if we could entirely avoid a

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: HDDS-173-HDDS-48.003.patch > Refactor Dispatcher and implement Handler for new ContainerI

[jira] [Commented] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524178#comment-16524178 ] Hanisha Koneru commented on HDDS-173: - Thanks for the review [~xyao]. I have addressed

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524176#comment-16524176 ] Todd Lipcon commented on HDFS-13703: Before/after perf stat results from teravalidate

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: (was: HDDS-173-HDDS-48.003.patch) > Refactor Dispatcher and implement Handler for new

[jira] [Updated] (HDDS-173) Refactor Dispatcher and implement Handler for new ContainerIO design

2018-06-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-173: Attachment: HDDS-173-HDDS-48.003.patch > Refactor Dispatcher and implement Handler for new ContainerI

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524156#comment-16524156 ] stack commented on HDFS-13702: -- bq. what do you think? I think we need to be able to tr

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Attachment: hdfs-13702.patch > HTrace hooks taking 10-15% CPU in DFS client when disabled > -

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13703: --- Attachment: hdfs-13703.patch > Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks a

[jira] [Updated] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13703: --- Status: Patch Available (was: Open) > Avoid allocation of CorruptedBlocks hashmap when no corrupted

[jira] [Commented] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524149#comment-16524149 ] Anu Engineer commented on HDFS-13703: - {quote} TeraValidate job by about 10% {quote}

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524147#comment-16524147 ] Todd Lipcon commented on HDFS-13702: Here are some perf results based on a 180GB tera

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Status: Patch Available (was: Open) > HTrace hooks taking 10-15% CPU in DFS client when disabled > -

[jira] [Assigned] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned HDFS-13702: -- Assignee: Todd Lipcon > HTrace hooks taking 10-15% CPU in DFS client when disabled > -

[jira] [Updated] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-13702: --- Attachment: hdfs-13702.patch > HTrace hooks taking 10-15% CPU in DFS client when disabled > -

[jira] [Commented] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524134#comment-16524134 ] genericqa commented on HDDS-193: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Commented] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524130#comment-16524130 ] genericqa commented on HDDS-175: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Su

[jira] [Created] (HDFS-13703) Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit

2018-06-26 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-13703: -- Summary: Avoid allocation of CorruptedBlocks hashmap when no corrupted blocks are hit Key: HDFS-13703 URL: https://issues.apache.org/jira/browse/HDFS-13703 Project: Hadoo

[jira] [Commented] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524128#comment-16524128 ] Todd Lipcon commented on HDFS-13702: Removing all the HTrace stuff from the block rea

[jira] [Commented] (HDFS-13665) Move RPC response serialization into Server.doResponse

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524126#comment-16524126 ] genericqa commented on HDFS-13665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDDS-195) Create generic CommandWatcher utility

2018-06-26 Thread Elek, Marton (JIRA)
Elek, Marton created HDDS-195: - Summary: Create generic CommandWatcher utility Key: HDDS-195 URL: https://issues.apache.org/jira/browse/HDDS-195 Project: Hadoop Distributed Data Store Issue Type:

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-194: -- Status: Patch Available (was: Open) > Remove NodePoolManager and node pool handling from SCM > -

[jira] [Updated] (HDDS-194) Remove NodePoolManager and node pool handling from SCM

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-194: -- Attachment: HDDS-194.001.patch > Remove NodePoolManager and node pool handling from SCM > ---

[jira] [Commented] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524074#comment-16524074 ] genericqa commented on HDFS-13635: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-186) Create under replicated queue

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16524069#comment-16524069 ] genericqa commented on HDDS-186: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (HDFS-13702) HTrace hooks taking 10-15% CPU in DFS client when disabled

2018-06-26 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-13702: -- Summary: HTrace hooks taking 10-15% CPU in DFS client when disabled Key: HDFS-13702 URL: https://issues.apache.org/jira/browse/HDFS-13702 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-13701) Removal of logging guards regressed performance

2018-06-26 Thread Todd Lipcon (JIRA)
Todd Lipcon created HDFS-13701: -- Summary: Removal of logging guards regressed performance Key: HDFS-13701 URL: https://issues.apache.org/jira/browse/HDFS-13701 Project: Hadoop HDFS Issue Type: B

[jira] [Comment Edited] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523946#comment-16523946 ] Ajay Kumar edited comment on HDDS-175 at 6/26/18 5:15 PM: -- [~nanda

[jira] [Commented] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523972#comment-16523972 ] Gabor Bota commented on HDFS-13635: --- Since all places that could throw ReplicaNotFoundE

[jira] [Updated] (HDFS-13635) Incorrect message when block is not found

2018-06-26 Thread Gabor Bota (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Bota updated HDFS-13635: -- Attachment: HDFS-13635.003.patch > Incorrect message when block is not found >

[jira] [Updated] (HDDS-186) Create under replicated queue

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-186: Attachment: HDDS-186.02.patch > Create under replicated queue > - > >

[jira] [Commented] (HDDS-167) Rename KeySpaceManager to OzoneManager

2018-06-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523966#comment-16523966 ] Arpit Agarwal commented on HDDS-167: v05 - rebase to trunk, fix more acceptance tests.

[jira] [Updated] (HDDS-167) Rename KeySpaceManager to OzoneManager

2018-06-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-167: --- Attachment: HDDS-167.05.patch > Rename KeySpaceManager to OzoneManager > --

[jira] [Comment Edited] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523946#comment-16523946 ] Ajay Kumar edited comment on HDDS-175 at 6/26/18 4:35 PM: -- [~nanda

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Status: Patch Available (was: Open) > Make Datanode heartbeat dispatcher in SCM event based > --

[jira] [Updated] (HDFS-13665) Move RPC response serialization into Server.doResponse

2018-06-26 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-13665: Attachment: HDFS-13665-HDFS-12943.001.patch > Move RPC response serialization into Server.d

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Attachment: HDDS-193.002.patch > Make Datanode heartbeat dispatcher in SCM event based >

[jira] [Commented] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523946#comment-16523946 ] Ajay Kumar commented on HDDS-175: - [~nandakumar131] thanks for review, Patch v7 removes dnL

[jira] [Updated] (HDDS-175) Refactor ContainerInfo to remove Pipeline object from it

2018-06-26 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDDS-175: Attachment: HDDS-175.07.patch > Refactor ContainerInfo to remove Pipeline object from it > -

[jira] [Commented] (HDFS-10664) layoutVersion mismatch between Namenode VERSION file and Journalnode VERSION file after cluster upgrade

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523900#comment-16523900 ] genericqa commented on HDFS-10664: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDDS-193) Make Datanode heartbeat dispatcher in SCM event based

2018-06-26 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDDS-193: -- Status: Open (was: Patch Available) > Make Datanode heartbeat dispatcher in SCM event based > --

[jira] [Commented] (HDFS-13700) The process of loading image can be done in a pipeline model

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523841#comment-16523841 ] genericqa commented on HDFS-13700: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-13697) EDEK decrypt fails due to proxy user being lost because of empty AccessControllerContext

2018-06-26 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523824#comment-16523824 ] genericqa commented on HDFS-13697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

  1   2   >