[jira] [Commented] (HDFS-14944) ec admin such as : -enablePolicy should support multi federation namespace not only the default namespace in core-site.xml

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963711#comment-16963711 ] Ayush Saxena commented on HDFS-14944: - Using generic options you can specify -fs name

[jira] [Created] (HDFS-14945) Revise PacketResponder's log.

2019-10-31 Thread Xudong Cao (Jira)
Xudong Cao created HDFS-14945: - Summary: Revise PacketResponder's log. Key: HDFS-14945 URL: https://issues.apache.org/jira/browse/HDFS-14945 Project: Hadoop HDFS Issue Type: Bug Compone

[jira] [Assigned] (HDFS-14945) Revise PacketResponder's log.

2019-10-31 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao reassigned HDFS-14945: - Assignee: Xudong Cao > Revise PacketResponder's log. > - > >

[jira] [Updated] (HDFS-14945) Revise PacketResponder's log.

2019-10-31 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao updated HDFS-14945: -- Attachment: HDFS-14945.000.patch > Revise PacketResponder's log. > - > >

[jira] [Updated] (HDFS-14945) Revise PacketResponder's log.

2019-10-31 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao updated HDFS-14945: -- Attachment: (was: HDFS-14945.000.patch) > Revise PacketResponder's log. > -

[jira] [Updated] (HDFS-14945) Revise PacketResponder's log.

2019-10-31 Thread Xudong Cao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xudong Cao updated HDFS-14945: -- Attachment: HDFS-14945.000.patch Status: Patch Available (was: Open) > Revise PacketResponder'

[jira] [Created] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
Fei Hui created HDFS-14946: -- Summary: Erasure Coding: Block recovery failed during decommissioning Key: HDFS-14946 URL: https://issues.apache.org/jira/browse/HDFS-14946 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963727#comment-16963727 ] Sammi Chen commented on HDDS-2376: -- Hi [~msingh] and [~hanishakoneru], I don't find any

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Environment: (was: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No en

[jira] [Assigned] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui reassigned HDFS-14946: -- Assignee: Fei Hui > Erasure Coding: Block recovery failed during decommissioning > ---

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Description: DataNode logs as follow {quote} org.apache.hadoop.HadoopIllegalArgumentException: No enough vali

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Affects Version/s: 3.0.3 3.2.1 3.1.3 > Erasure Coding: Block re

[jira] [Commented] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963733#comment-16963733 ] Fei Hui commented on HDFS-14946: UT depends on part code of HDFS-14920 Upload the patch l

[jira] [Updated] (HDFS-14946) Erasure Coding: Block recovery failed during decommissioning

2019-10-31 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Hui updated HDFS-14946: --- Issue Type: Bug (was: Improvement) > Erasure Coding: Block recovery failed during decommissioning >

[jira] [Commented] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963741#comment-16963741 ] Lisheng Sun commented on HDFS-14896: hi [~ayushtkn] [~sodonnell] Thanks you for payin

[jira] [Commented] (HDFS-14944) ec admin such as : -enablePolicy should support multi federation namespace not only the default namespace in core-site.xml

2019-10-31 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963747#comment-16963747 ] zhuqi commented on HDFS-14944: -- Hi [~ayushtkn]  We can add -fs to support dynamic define of

[jira] [Assigned] (HDDS-2383) Closing open container via SCMCli throws exception

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2383: --- Assignee: Nanda kumar > Closing open container via SCMCli throws exception >

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963796#comment-16963796 ] Marton Elek commented on HDDS-2372: --- cc: [~msingh] > Datanode pipeline is failing with

[jira] [Comment Edited] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963796#comment-16963796 ] Mukul Kumar Singh edited comment on HDDS-2372 at 10/31/19 9:21 AM: -

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963813#comment-16963813 ] Shashikant Banerjee commented on HDDS-2372: --- Thanks [~elek] . I do agree that, t

[jira] [Commented] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963815#comment-16963815 ] Shashikant Banerjee commented on HDDS-2372: --- [~szetszwo], to answer your questio

[jira] [Comment Edited] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963813#comment-16963813 ] Shashikant Banerjee edited comment on HDDS-2372 at 10/31/19 9:52 AM: ---

[jira] [Created] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Shashikant Banerjee (Jira)
Shashikant Banerjee created HDDS-2388: - Summary: Teragen test failure due to OM exception Key: HDDS-2388 URL: https://issues.apache.org/jira/browse/HDDS-2388 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963831#comment-16963831 ] Shashikant Banerjee commented on HDDS-2388: --- cc - [~bharat] > Teragen test fail

[jira] [Commented] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963835#comment-16963835 ] Istvan Fajth commented on HDDS-2376: Hi [~Sammi], I have run into a similar exception

[jira] [Comment Edited] (HDDS-2376) Fail to read data through XceiverClientGrpc

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963835#comment-16963835 ] Istvan Fajth edited comment on HDDS-2376 at 10/31/19 10:08 AM: -

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-31 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963836#comment-16963836 ] Jinglun commented on HDFS-14908: Hi [~elgoiri], would your like to have a look at the v03

[jira] [Commented] (HDFS-14945) Revise PacketResponder's log.

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963846#comment-16963846 ] Hadoop QA commented on HDFS-14945: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Resolved] (HDDS-2331) Client OOME due to buffer retention

2019-10-31 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-2331. Resolution: Fixed Thanks [~szetszwo] and [~shashikant] for related fixes. > Client OOME due

[jira] [Commented] (HDFS-14896) Make MIN_BLOCKS_FOR_WRITE configurable

2019-10-31 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963862#comment-16963862 ] Stephen O'Donnell commented on HDFS-14896: -- I am not sure allocating more blocks

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: image-2019-10-31-18-56-56-177.png > Multipart upload report errors while writing to ozone Ratis pi

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963875#comment-16963875 ] Li Cheng commented on HDDS-2356: I tried multiprocessing in python to fetch data locally a

[jira] [Commented] (HDFS-14943) RBF: Add Namespace to the Overview page in the Web UI

2019-10-31 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963879#comment-16963879 ] hemanthboyina commented on HDFS-14943: -- can we get the namespace field from Federati

[jira] [Commented] (HDFS-14891) RBF: namenode links in NameFederation Health page (federationhealth.html) cannot use https scheme

2019-10-31 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963882#comment-16963882 ] Takanobu Asanuma commented on HDFS-14891: - Thanks for update the patch, [~risyome

[jira] [Commented] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963934#comment-16963934 ] Marton Elek commented on HDDS-2370: --- It was an early idea to make it easier to run Ozone

[jira] [Comment Edited] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963934#comment-16963934 ] Marton Elek edited comment on HDDS-2370 at 10/31/19 12:15 PM: --

[jira] [Created] (HDFS-14947) infrequent data loss due to rename functionality breaking

2019-10-31 Thread abhishek sahani (Jira)
abhishek sahani created HDFS-14947: -- Summary: infrequent data loss due to rename functionality breaking Key: HDFS-14947 URL: https://issues.apache.org/jira/browse/HDFS-14947 Project: Hadoop HDFS

[jira] [Resolved] (HDDS-2348) remove log4j properties for org.apache.hadoop.ozone

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2348. --- Fix Version/s: 0.5.0 Resolution: Fixed > remove log4j properties for org.apache.hadoop.ozone >

[jira] [Work logged] (HDDS-2348) remove log4j properties for org.apache.hadoop.ozone

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2348?focusedWorklogId=336754&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336754 ] ASF GitHub Bot logged work on HDDS-2348: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14947) infrequent data loss due to rename functionality breaking

2019-10-31 Thread abhishek sahani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] abhishek sahani updated HDFS-14947: --- Description: We are facing an issue where data is getting lost from hdfs during rename , in

[jira] [Updated] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek updated HDDS-2208: -- Fix Version/s: 0.5.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Prop

[jira] [Work logged] (HDDS-2208) Propagate System Exceptions from OM transaction apply phase

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2208?focusedWorklogId=336758&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336758 ] ASF GitHub Bot logged work on HDDS-2208: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-2372) Datanode pipeline is failing with NoSuchFileException

2019-10-31 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee reassigned HDDS-2372: - Assignee: Shashikant Banerjee > Datanode pipeline is failing with NoSuchFileExcep

[jira] [Assigned] (HDDS-2389) add toStateMachineLogEntryString provider in Ozone's ContainerStateMachine

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDDS-2389: --- Assignee: Mukul Kumar Singh > add toStateMachineLogEntryString provider in Ozone's Co

[jira] [Created] (HDDS-2389) add toStateMachineLogEntryString provider in Ozone's ContainerStateMachine

2019-10-31 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-2389: --- Summary: add toStateMachineLogEntryString provider in Ozone's ContainerStateMachine Key: HDDS-2389 URL: https://issues.apache.org/jira/browse/HDDS-2389 Project:

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16963991#comment-16963991 ] Mukul Kumar Singh commented on HDDS-2356: - Hi [~timmylicheng], the following error

[jira] [Commented] (HDDS-2364) Add a OM metrics to find the false positive rate for the keyMayExist

2019-10-31 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964000#comment-16964000 ] Mukul Kumar Singh commented on HDDS-2364: - I had a cursory look at the patch and i

[jira] [Assigned] (HDDS-2390) SCMSecurityClient and mixing of abstraction layers

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDDS-2390: -- Assignee: Istvan Fajth > SCMSecurityClient and mixing of abstraction layers > -

[jira] [Created] (HDDS-2390) SCMSecurityClient and mixing of abstraction layers

2019-10-31 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2390: -- Summary: SCMSecurityClient and mixing of abstraction layers Key: HDDS-2390 URL: https://issues.apache.org/jira/browse/HDDS-2390 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDDS-2390) SCMSecurityClient and mixing of abstraction layers

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964025#comment-16964025 ] Istvan Fajth commented on HDDS-2390: I am working on a PR for this one and I will publ

[jira] [Created] (HDDS-2391) Consolidate XCeiverClientManager instantiation

2019-10-31 Thread Istvan Fajth (Jira)
Istvan Fajth created HDDS-2391: -- Summary: Consolidate XCeiverClientManager instantiation Key: HDDS-2391 URL: https://issues.apache.org/jira/browse/HDDS-2391 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14940) HDFS Balancer : getBalancerBandwidth displaying wrong values for the maximum network bandwidth used by the datanode while network bandwidth set with values as 104857600

2019-10-31 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964032#comment-16964032 ] Kihwal Lee commented on HDFS-14940: --- This is per-datanode bandwidth setting. There shou

[jira] [Assigned] (HDDS-2391) Consolidate XCeiverClientManager instantiation

2019-10-31 Thread Istvan Fajth (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth reassigned HDDS-2391: -- Assignee: Istvan Fajth > Consolidate XCeiverClientManager instantiation > -

[jira] [Resolved] (HDDS-2219) Move all the ozone dist scripts/configs to one location

2019-10-31 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-2219. --- Fix Version/s: 0.5.0 Resolution: Fixed > Move all the ozone dist scripts/configs to one locatio

[jira] [Work logged] (HDDS-2219) Move all the ozone dist scripts/configs to one location

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2219?focusedWorklogId=336786&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336786 ] ASF GitHub Bot logged work on HDDS-2219: Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-5441) Wrong use of catalina opts in httpfs.sh

2019-10-31 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-5441. -- Resolution: Won't Fix It moved on to Jetty. No longer relevant. > Wrong use of catalina opts in httpfs.

[jira] [Created] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Kihwal Lee (Jira)
Kihwal Lee created HDFS-14948: - Summary: Improve HttpFS Server Key: HDFS-14948 URL: https://issues.apache.org/jira/browse/HDFS-14948 Project: Hadoop HDFS Issue Type: Improvement Compone

[jira] [Updated] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Kihwal Lee (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-14948: -- Description: We see increasing use of HttpFS as a compatibility bridge and also as a bridge between dif

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964079#comment-16964079 ] Hadoop QA commented on HDFS-6874: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964138#comment-16964138 ] Li Cheng commented on HDDS-2356: [~msingh] I check OM audit log and it looks like this one

[jira] [Assigned] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Ahmed Hussein (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein reassigned HDFS-14948: Assignee: Ahmed Hussein > Improve HttpFS Server > - > >

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964156#comment-16964156 ] Bharat Viswanadham commented on HDDS-2356: -- {quote} What are you looking for in a

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964156#comment-16964156 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/31/19 3:53 PM:

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964156#comment-16964156 ] Bharat Viswanadham edited comment on HDDS-2356 at 10/31/19 3:55 PM:

[jira] [Created] (HDFS-14949) HttpFS does not support getServerDefaults()

2019-10-31 Thread Kihwal Lee (Jira)
Kihwal Lee created HDFS-14949: - Summary: HttpFS does not support getServerDefaults() Key: HDFS-14949 URL: https://issues.apache.org/jira/browse/HDFS-14949 Project: Hadoop HDFS Issue Type: Improve

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani updated HDFS-14884: Attachment: HDFS-14884-branch-2.001.patch > Add sanity check that zone key equals feinfo key while

[jira] [Commented] (HDFS-14891) RBF: namenode links in NameFederation Health page (federationhealth.html) cannot use https scheme

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964200#comment-16964200 ] Íñigo Goiri commented on HDFS-14891: [~risyomei], I am referring to: {code} 52 /

[jira] [Reopened] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani reopened HDFS-14884: - Assignee: Yuval Degani (was: Mukul Kumar Singh) Submitting a revised patch for branch-2 > Add

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani updated HDFS-14884: Attachment: (was: HDFS-14884-branch-2.001.patch) > Add sanity check that zone key equals feinfo

[jira] [Updated] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Yuval Degani (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Degani updated HDFS-14884: Attachment: HDFS-14884-branch-2.001.patch Fix Version/s: 2.11.0 Target Version/s

[jira] [Commented] (HDFS-14943) RBF: Add Namespace to the Overview page in the Web UI

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964205#comment-16964205 ] Íñigo Goiri commented on HDFS-14943: After checking, the current Router does not have

[jira] [Commented] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964209#comment-16964209 ] Íñigo Goiri commented on HDFS-14908: Let's go with v03 then. We should add a javadoc

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964212#comment-16964212 ] Íñigo Goiri commented on HDFS-14938: Maybe we should add the new test code to a separ

[jira] [Work logged] (HDDS-2293) Create a new CONTRIBUTION.md for the new repository

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2293?focusedWorklogId=336953&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336953 ] ASF GitHub Bot logged work on HDDS-2293: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-2293) Create a new CONTRIBUTION.md for the new repository

2019-10-31 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-2293. - Fix Version/s: 0.5.0 Resolution: Fixed Thank you all for reviews and [~elek] for th

[jira] [Work logged] (HDDS-2380) Use the Table.isExist API instead of get() call while checking for presence of key.

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2380?focusedWorklogId=336965&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336965 ] ASF GitHub Bot logged work on HDDS-2380: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14284) RBF: Log Router identifier when reporting exceptions

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964271#comment-16964271 ] Ayush Saxena commented on HDFS-14284: - Thanx [~hemanthboyina] for the patch. As I sai

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964283#comment-16964283 ] Ayush Saxena commented on HDFS-14936: - Committed to trunk. Thanx [~leosun08] for the

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964286#comment-16964286 ] Ayush Saxena commented on HDFS-14920: - Thanx [~ferhui] for the patch. v005 LGTM +1 >

[jira] [Updated] (HDDS-2386) Implement incremental ChunkBuffer

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2386: - Attachment: o2386_20191031b.patch > Implement incremental ChunkBuffer > -

[jira] [Commented] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964296#comment-16964296 ] Anu Engineer commented on HDDS-2370: Yeap, I am fine with removing it. I don't think w

[jira] [Commented] (HDDS-2386) Implement incremental ChunkBuffer

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964298#comment-16964298 ] Tsz-wo Sze commented on HDDS-2386: -- o2386_20191031b.patch: fixes test failures. > Implem

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964297#comment-16964297 ] Bharat Viswanadham commented on HDDS-2388: -- If WAL has been cleared, then we get

[jira] [Updated] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2375: - Description: In HDDS-2331, we found that Ozone client allocates a ByteBuffer with chunk size (e.g. 16MB )

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964301#comment-16964301 ] Hudson commented on HDFS-14936: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Updated] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14920: Fix Version/s: 3.2.2 3.1.4 3.3.0 Hadoop Flags: Reviewed

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=336991&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336991 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=336990&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336990 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Resolved] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1847. Fix Version/s: 0.5.0 Resolution: Fixed I have committed this patch to the master branch. >

[jira] [Updated] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14936: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolve

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964315#comment-16964315 ] Hudson commented on HDFS-14920: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Assigned] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDDS-2384: -- Assignee: Anu Engineer > Large chunks during write can have memory pressure on DN with multiple

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964345#comment-16964345 ] Hadoop QA commented on HDFS-14884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964348#comment-16964348 ] Anu Engineer commented on HDDS-2384: Thank you for flagging this issue. I think this i

[jira] [Commented] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964354#comment-16964354 ] Wei-Chiu Chuang commented on HDFS-14948: [~smeng] and other contributors added a

[jira] [Created] (HDDS-2392) Fix TestScmSafeMode#testSCMSafeModeRestrictedOp

2019-10-31 Thread Hanisha Koneru (Jira)
Hanisha Koneru created HDDS-2392: Summary: Fix TestScmSafeMode#testSCMSafeModeRestrictedOp Key: HDDS-2392 URL: https://issues.apache.org/jira/browse/HDDS-2392 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-2392) Fix TestScmSafeMode#testSCMSafeModeRestrictedOp

2019-10-31 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-2392: - Description: After ratis upgrade (HDDS-2340), TestScmSafeMode#testSCMSafeModeRestrictedOp fails a

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964374#comment-16964374 ] Siyao Meng commented on HDDS-1847: -- Looks like this commit breaks {{TestKeyManagerImpl}}

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964390#comment-16964390 ] Anu Engineer commented on HDDS-1847: interesting, [~chris.t...@gmail.com] can you plea

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon Gao updated HDFS-14927: Attachment: HDFS-14927.008.patch > RBF: Add metrics for async callers thread pool > ---

  1   2   >