[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964627#comment-16964627 ] Surendra Singh Lilhore commented on HDFS-14768: --- [~gjhkael], we appreciate your hard work

[jira] [Comment Edited] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964625#comment-16964625 ] Surendra Singh Lilhore edited comment on HDFS-14768 at 11/1/19 5:51 AM:

[jira] [Commented] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964625#comment-16964625 ] Surendra Singh Lilhore commented on HDFS-14768: --- [~gjhkael] why you think it is not a

[jira] [Reopened] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore reopened HDFS-14768: --- > EC : Busy DN replica should be consider in live replica check. >

[jira] [Updated] (HDFS-14950) missing libhdfspp libs in dist-package

2019-10-31 Thread Yuan Zhou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhou updated HDFS-14950: - Attachment: fix_libhdfspp_lib.patch Status: Patch Available (was: Open) > missing libhdfspp

[jira] [Updated] (HDFS-14950) missing libhdfspp libs in dist-package

2019-10-31 Thread Yuan Zhou (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Zhou updated HDFS-14950: - Attachment: (was: fix_libhdfspp_lib.patch) > missing libhdfspp libs in dist-package >

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964617#comment-16964617 ] Hadoop QA commented on HDFS-14938: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964598#comment-16964598 ] Leon Gao commented on HDFS-14927: - Thanks [~inigoiri] and [~ayushtkn] for the review ^ > RBF: Add

[jira] [Resolved] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-31 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-2311. - Fix Version/s: 0.5.0 Resolution: Fixed [~bharat] Thank you for flagging this issue

[jira] [Work logged] (HDDS-2311) Fix logic of RetryPolicy in OzoneClientSideTranslatorPB

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2311?focusedWorklogId=337179=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337179 ] ASF GitHub Bot logged work on HDDS-2311: Author: ASF GitHub Bot

[jira] [Assigned] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-2397: Assignee: Bharat Viswanadham > Fix calling cleanup for few missing tables in OM >

[jira] [Work logged] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?focusedWorklogId=337178=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337178 ] ASF GitHub Bot logged work on HDDS-2397: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2397: - Labels: pull-request-available (was: ) > Fix calling cleanup for few missing tables in OM >

[jira] [Created] (HDDS-2397) Fix calling cleanup for few missing tables in OM

2019-10-31 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2397: Summary: Fix calling cleanup for few missing tables in OM Key: HDDS-2397 URL: https://issues.apache.org/jira/browse/HDDS-2397 Project: Hadoop Distributed Data

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964591#comment-16964591 ] Hadoop QA commented on HDFS-14937: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2356: - Comment: was deleted (was: Has the above error caused crash in OM? If so, can you share

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964586#comment-16964586 ] Bharat Viswanadham commented on HDDS-2356: -- Has the above error caused crash in OM? If so, can

[jira] [Commented] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964585#comment-16964585 ] Bharat Viswanadham commented on HDDS-2395: -- Hi [~timmylicheng] Exclude List is fixed as part of

[jira] [Updated] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-12943: - Release Note: Observer is a new type of a NameNode in addition to Active and Standby Nodes in

[jira] [Resolved] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-2363. -- Resolution: Fixed > Failed to create Ratis container > > >

[jira] [Updated] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Fix Version/s: 0.5.0 > Failed to create Ratis container > > >

[jira] [Commented] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964579#comment-16964579 ] Hudson commented on HDFS-12943: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17592 (See

[jira] [Created] (HDFS-14950) missing libhdfspp libs in dist-package

2019-10-31 Thread Yuan Zhou (Jira)
Yuan Zhou created HDFS-14950: Summary: missing libhdfspp libs in dist-package Key: HDFS-14950 URL: https://issues.apache.org/jira/browse/HDFS-14950 Project: Hadoop HDFS Issue Type: Bug

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554 ] Li Cheng edited comment on HDDS-2356 at 11/1/19 3:45 AM: - Also see a core dump in

[jira] [Commented] (HDDS-2396) OM rocksdb core dump during writing

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964578#comment-16964578 ] Li Cheng commented on HDDS-2396: Attached the entire log for the core dump. Will try to turn on ulimit and

[jira] [Updated] (HDDS-2396) OM rocksdb core dump during writing

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2396: --- Attachment: hs_err_pid9340.log > OM rocksdb core dump during writing > --- >

[jira] [Created] (HDDS-2396) OM rocksdb core dump during writing

2019-10-31 Thread Li Cheng (Jira)
Li Cheng created HDDS-2396: -- Summary: OM rocksdb core dump during writing Key: HDDS-2396 URL: https://issues.apache.org/jira/browse/HDDS-2396 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Commented] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964573#comment-16964573 ] Li Cheng commented on HDDS-2395: Also please note the exclude list issue.   2019-11-01 11:25:24,047

[jira] [Updated] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-31 Thread xuzq (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuzq updated HDFS-14937: Attachment: HDFS-14937-trunk-002.patch > [SBN read] ObserverReadProxyProvider should throw InterruptException >

[jira] [Commented] (HDFS-14937) [SBN read] ObserverReadProxyProvider should throw InterruptException

2019-10-31 Thread xuzq (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964560#comment-16964560 ] xuzq commented on HDFS-14937: - Thanks [~xkrogen] [~vagarychen] for the comment. RetryInvocationHandler use 

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964554#comment-16964554 ] Li Cheng commented on HDDS-2356: Also see a core dump in rocksdb during last night's testing. Please check

[jira] [Updated] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng updated HDDS-2356: --- Attachment: hs_err_pid9340.log > Multipart upload report errors while writing to ozone Ratis pipeline >

[jira] [Updated] (HDDS-2363) Failed to create Ratis container

2019-10-31 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-2363: - Summary: Failed to create Ratis container (was: Fail to create Ratis container) > Failed to create

[jira] [Work logged] (HDDS-2363) Fail to create Ratis container

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2363?focusedWorklogId=337145=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337145 ] ASF GitHub Bot logged work on HDDS-2363: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14942) Change Log Level to warn in JournalNodeSyncer#syncWithJournalAtIndex

2019-10-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964535#comment-16964535 ] Lisheng Sun commented on HDFS-14942: hi [~weichiu] [~elgoiri] [~ayushtkn] Could you mind review this

[jira] [Commented] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964530#comment-16964530 ] Lisheng Sun commented on HDFS-14938: Thanks [~elgoiri] for your comments. I add a javadoc and ut for

[jira] [Updated] (HDFS-14938) Add check if excludedNodes contain scope in DFSNetworkTopology#chooseRandomWithStorageType()

2019-10-31 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-14938: --- Attachment: HDFS-14938.004.patch > Add check if excludedNodes contain scope in >

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964502#comment-16964502 ] Íñigo Goiri commented on HDFS-14927: +1 on [^HDFS-14927.009.patch]. > RBF: Add metrics for async

[jira] [Updated] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2395: - Issue Type: Bug (was: Task) > Handle Ozone S3 completeMPU to match with aws s3 behavior.

[jira] [Commented] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964482#comment-16964482 ] Bharat Viswanadham commented on HDDS-2356: -- Opened HDDS-2359 to handle CompleteMPU error cases.

[jira] [Comment Edited] (HDDS-2356) Multipart upload report errors while writing to ozone Ratis pipeline

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964482#comment-16964482 ] Bharat Viswanadham edited comment on HDDS-2356 at 11/1/19 12:41 AM:

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964476#comment-16964476 ] Konstantin Shvachko commented on HDFS-14720: Does it need a unit test? > DataNode shouldn't

[jira] [Updated] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12943: --- Release Note: Observer is a new type of a NameNode in addition to Active and Standby

[jira] [Updated] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12943: --- Release Note: Observer is a new type of a NameNode in addition to Active and Standby

[jira] [Resolved] (HDFS-12943) Consistent Reads from Standby Node

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-12943. Fix Version/s: 2.10.0 3.2.2 3.1.4

[jira] [Resolved] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh resolved HDFS-14768. -- Resolution: Not A Problem > EC : Busy DN replica should be consider in live replica check. >

[jira] [Reopened] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh reopened HDFS-14768: -- > EC : Busy DN replica should be consider in live replica check. >

[jira] [Resolved] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh resolved HDFS-14768. -- Resolution: Abandoned > EC : Busy DN replica should be consider in live replica check. >

[jira] [Updated] (HDFS-14768) EC : Busy DN replica should be consider in live replica check.

2019-10-31 Thread guojh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guojh updated HDFS-14768: - Status: Open (was: Patch Available) > EC : Busy DN replica should be consider in live replica check. >

[jira] [Commented] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-31 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964461#comment-16964461 ] Xiaoyu Yao commented on HDDS-2321: -- {quote}Since SCM has the root cert, it might be intresting if it send

[jira] [Updated] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-31 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-2321: - Status: Patch Available (was: Open) > Ozone Block Token verify should not apply to all datanode cmd >

[jira] [Work logged] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?focusedWorklogId=337100=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337100 ] ASF GitHub Bot logged work on HDDS-2321: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2321) Ozone Block Token verify should not apply to all datanode cmd

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2321: - Labels: pull-request-available (was: ) > Ozone Block Token verify should not apply to all

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=337099=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337099 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964455#comment-16964455 ] Wei-Chiu Chuang commented on HDFS-14794: reportBadBlock is initiated by client or DataNode when

[jira] [Comment Edited] (HDFS-14794) [SBN read] reportBadBlock is rejected by Observer.

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964455#comment-16964455 ] Wei-Chiu Chuang edited comment on HDFS-14794 at 10/31/19 11:41 PM: ---

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964451#comment-16964451 ] Hadoop QA commented on HDFS-14927: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964450#comment-16964450 ] Wei-Chiu Chuang commented on HDFS-14720: BTW I think the fix is correct. +1 from me. > DataNode

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964443#comment-16964443 ] Wei-Chiu Chuang commented on HDFS-14720: I don't think this fix is relevant to HDFS-14794. This

[jira] [Commented] (HDFS-14720) DataNode shouldn't report block as bad block if the block length is Long.MAX_VALUE.

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964438#comment-16964438 ] Konstantin Shvachko commented on HDFS-14720: Hey guys, could you explain how this fixes the

[jira] [Updated] (HDDS-2395) Handle Ozone S3 completeMPU to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-2395: - Summary: Handle Ozone S3 completeMPU to match with aws s3 behavior. (was: Handle

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964434#comment-16964434 ] Aravindan Vijayan commented on HDDS-2388: - [~shashikant] Is the OM crashing due to this error?

[jira] [Commented] (HDDS-2364) Add a OM metrics to find the false positive rate for the keyMayExist

2019-10-31 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964433#comment-16964433 ] Aravindan Vijayan commented on HDDS-2364: - [~msingh] Thanks for the review. I will raise follow up

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964431#comment-16964431 ] Hadoop QA commented on HDFS-14927: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Work logged] (HDDS-2395) Handle completeMPU scenarios to match with aws s3 behavior.

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?focusedWorklogId=337084=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-337084 ] ASF GitHub Bot logged work on HDDS-2395: Author: ASF GitHub Bot

[jira] [Updated] (HDDS-2395) Handle completeMPU scenarios to match with aws s3 behavior.

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-2395: - Labels: pull-request-available (was: ) > Handle completeMPU scenarios to match with aws s3

[jira] [Created] (HDDS-2395) Handle completeMPU scenarios to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-2395: Summary: Handle completeMPU scenarios to match with aws s3 behavior. Key: HDDS-2395 URL: https://issues.apache.org/jira/browse/HDDS-2395 Project: Hadoop

[jira] [Assigned] (HDDS-2395) Handle completeMPU scenarios to match with aws s3 behavior.

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-2395: Assignee: Bharat Viswanadham > Handle completeMPU scenarios to match with aws s3

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon Gao updated HDFS-14927: Attachment: HDFS-14927.009.patch > RBF: Add metrics for async callers thread pool >

[jira] [Created] (HDDS-2394) Ozone allows bucket name with underscore to be created but throws an error during put key operation

2019-10-31 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-2394: Summary: Ozone allows bucket name with underscore to be created but throws an error during put key operation Key: HDDS-2394 URL:

[jira] [Assigned] (HDDS-2393) HDDS-1847 broke some unit tests

2019-10-31 Thread Chris Teoh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Teoh reassigned HDDS-2393: Assignee: Chris Teoh Description: Siyao Meng commented on HDDS-1847:

[jira] [Assigned] (HDFS-13689) NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode

2019-10-31 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen reassigned HDFS-13689: -- Assignee: (was: Erik Krogen) > NameNodeRpcServer getEditsFromTxid assumes it is run on

[jira] [Created] (HDDS-2393) HDDS-1847 broke some unit tests

2019-10-31 Thread Chris Teoh (Jira)
Chris Teoh created HDDS-2393: Summary: HDDS-1847 broke some unit tests Key: HDDS-2393 URL: https://issues.apache.org/jira/browse/HDDS-2393 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Commented] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964407#comment-16964407 ] Íñigo Goiri commented on HDFS-14927: I don't think you need to catch the exception and then throw it.

[jira] [Resolved] (HDFS-14443) Throwing RemoteException in the time of Read Operation

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-14443. Resolution: Not A Problem Resolving as not a problem. Please reopen if its. >

[jira] [Resolved] (HDFS-14020) Emulate Observer node falling far behind the Active

2019-10-31 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-14020. Resolution: Duplicate Resolving as duplicate since HDFS-13873 introduced

[jira] [Updated] (HDFS-14927) RBF: Add metrics for async callers thread pool

2019-10-31 Thread Leon Gao (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon Gao updated HDFS-14927: Attachment: HDFS-14927.008.patch > RBF: Add metrics for async callers thread pool >

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964390#comment-16964390 ] Anu Engineer commented on HDDS-1847: interesting, [~chris.t...@gmail.com] can you please take a look

[jira] [Commented] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964374#comment-16964374 ] Siyao Meng commented on HDDS-1847: -- Looks like this commit breaks {{TestKeyManagerImpl}} in {{setUp()}}

[jira] [Updated] (HDDS-2392) Fix TestScmSafeMode#testSCMSafeModeRestrictedOp

2019-10-31 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-2392: - Description: After ratis upgrade (HDDS-2340), TestScmSafeMode#testSCMSafeModeRestrictedOp fails

[jira] [Created] (HDDS-2392) Fix TestScmSafeMode#testSCMSafeModeRestrictedOp

2019-10-31 Thread Hanisha Koneru (Jira)
Hanisha Koneru created HDDS-2392: Summary: Fix TestScmSafeMode#testSCMSafeModeRestrictedOp Key: HDDS-2392 URL: https://issues.apache.org/jira/browse/HDDS-2392 Project: Hadoop Distributed Data Store

[jira] [Commented] (HDFS-14948) Improve HttpFS Server

2019-10-31 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964354#comment-16964354 ] Wei-Chiu Chuang commented on HDFS-14948: [~smeng] and other contributors added a number of REST

[jira] [Commented] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964348#comment-16964348 ] Anu Engineer commented on HDDS-2384: Thank you for flagging this issue. I think this is a hard to

[jira] [Commented] (HDFS-14884) Add sanity check that zone key equals feinfo key while setting Xattrs

2019-10-31 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964345#comment-16964345 ] Hadoop QA commented on HDFS-14884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDDS-2384) Large chunks during write can have memory pressure on DN with multiple clients

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDDS-2384: -- Assignee: Anu Engineer > Large chunks during write can have memory pressure on DN with

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964315#comment-16964315 ] Hudson commented on HDFS-14920: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17590 (See

[jira] [Updated] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14936: Fix Version/s: 3.3.0 Hadoop Flags: Reviewed Resolution: Fixed Status:

[jira] [Resolved] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1847. Fix Version/s: 0.5.0 Resolution: Fixed I have committed this patch to the master branch. >

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=336990=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336990 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Work logged] (HDDS-1847) Datanode Kerberos principal and keytab config key looks inconsistent

2019-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1847?focusedWorklogId=336991=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-336991 ] ASF GitHub Bot logged work on HDDS-1847: Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-14920: Fix Version/s: 3.2.2 3.1.4 3.3.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDDS-2375) Refactor BlockOutputStream to allow flexible buffering

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2375: - Description: In HDDS-2331, we found that Ozone client allocates a ByteBuffer with chunk size (e.g. 16MB

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964301#comment-16964301 ] Hudson commented on HDFS-14936: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17589 (See

[jira] [Commented] (HDDS-2386) Implement incremental ChunkBuffer

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964298#comment-16964298 ] Tsz-wo Sze commented on HDDS-2386: -- o2386_20191031b.patch: fixes test failures. > Implement incremental

[jira] [Commented] (HDDS-2388) Teragen test failure due to OM exception

2019-10-31 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964297#comment-16964297 ] Bharat Viswanadham commented on HDDS-2388: -- If WAL has been cleared, then we get this error. Not

[jira] [Commented] (HDDS-2370) Remove classpath in RunningWithHDFS.md ozone-hdfs/docker-compose as dir 'ozoneplugin' is not exist anymore

2019-10-31 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964296#comment-16964296 ] Anu Engineer commented on HDDS-2370: Yeap, I am fine with removing it. I don't think we are testing or

[jira] [Updated] (HDDS-2386) Implement incremental ChunkBuffer

2019-10-31 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDDS-2386: - Attachment: o2386_20191031b.patch > Implement incremental ChunkBuffer > -

[jira] [Commented] (HDFS-14920) Erasure Coding: Decommission may hang If one or more datanodes are out of service during decommission

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964286#comment-16964286 ] Ayush Saxena commented on HDFS-14920: - Thanx [~ferhui] for the patch. v005 LGTM +1 > Erasure Coding:

[jira] [Commented] (HDFS-14936) Add getNumOfChildren() for interface InnerNode

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964283#comment-16964283 ] Ayush Saxena commented on HDFS-14936: - Committed to trunk. Thanx [~leosun08] for the contribution

[jira] [Commented] (HDFS-14284) RBF: Log Router identifier when reporting exceptions

2019-10-31 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964271#comment-16964271 ] Ayush Saxena commented on HDFS-14284: - Thanx [~hemanthboyina] for the patch. As I said before, please

  1   2   >