[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Status: Open (was: Patch Available) > Add SM4 encryption method for HDFS > -- >

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111786#comment-17111786 ] Yang Yun commented on HDFS-15280: - Thanks [~hexiaoqiao] for the information.  Yes, add a

[jira] [Comment Edited] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111786#comment-17111786 ] Yang Yun edited comment on HDFS-15280 at 5/20/20, 5:19 AM: --- Tha

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111763#comment-17111763 ] Yang Yun commented on HDFS-15355: - Thanks [~elgoiri] for the review. Updated to HDFS-153

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.010.patch Status: Patch Available (was: Open) > Make the default block stor

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Status: Open (was: Patch Available) > Make the default block storage policy ID configurable >

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111744#comment-17111744 ] Xiaoqiao He commented on HDFS-13183: Hi [~weichiu],[~Jim_Brennan] I am sure the faile

[jira] [Comment Edited] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111728#comment-17111728 ] liuyanyu edited comment on HDFS-15365 at 5/20/20, 3:58 AM: --- As

[jira] [Comment Edited] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111728#comment-17111728 ] liuyanyu edited comment on HDFS-15365 at 5/20/20, 3:56 AM: --- As

[jira] [Commented] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111728#comment-17111728 ] liuyanyu commented on HDFS-15365: - As I check the code, the part marked in the figure sho

[jira] [Updated] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyanyu updated HDFS-15365: Attachment: image-2020-05-20-11-55-34-115.png > [RBF] findMatching method return wrong result > ---

[jira] [Updated] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyanyu updated HDFS-15365: Attachment: (was: image-2020-05-20-11-48-20-257.png) > [RBF] findMatching method return wrong result >

[jira] [Commented] (HDFS-15168) ABFS driver enhancement - Allow customizable translation from AAD SPNs and security groups to Linux user and group

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111725#comment-17111725 ] Hadoop QA commented on HDFS-15168: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuyanyu updated HDFS-15365: Attachment: image-2020-05-20-11-48-20-257.png > [RBF] findMatching method return wrong result > ---

[jira] [Created] (HDFS-15365) [RBF] findMatching method return wrong result

2020-05-19 Thread liuyanyu (Jira)
liuyanyu created HDFS-15365: --- Summary: [RBF] findMatching method return wrong result Key: HDFS-15365 URL: https://issues.apache.org/jira/browse/HDFS-15365 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111722#comment-17111722 ] Xiaoqiao He commented on HDFS-15280: Thanks [~weichiu] involve me here. [~hadoop_yang

[jira] [Updated] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Description: SM4 (formerly SMS4)is a block cipher used in the Chinese National Standard for Wireless LAN WAPI (W

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111720#comment-17111720 ] zZtai commented on HDFS-15098: -- [~Andrea_Julianos_one] I think it's because the  default val

[jira] [Issue Comment Deleted] (HDFS-15098) Add SM4 encryption method for HDFS

2020-05-19 Thread zZtai (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zZtai updated HDFS-15098: - Comment: was deleted (was: add test cases) > Add SM4 encryption method for HDFS > --

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111707#comment-17111707 ] Xiaoqiao He commented on HDFS-13183: Thanks [~weichiu] and [~Jim_Brennan] for your re

[jira] [Commented] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-19 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111704#comment-17111704 ] Yiqun Lin commented on HDFS-15346: -- Hi [~LiJinglun], HDFS-15340 is merged now.  I sugge

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111703#comment-17111703 ] Hudson commented on HDFS-15340: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Updated] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15340: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved (wa

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111701#comment-17111701 ] Yiqun Lin commented on HDFS-15340: -- [~ayushtkn], [~elgoiri], thanks for your confirmatio

[jira] [Commented] (HDFS-15221) Add checking of effective filesystem during initializing storage locations

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111641#comment-17111641 ] Wei-Chiu Chuang commented on HDFS-15221: Kicking off a rebuild: https://builds.ap

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111628#comment-17111628 ] Wei-Chiu Chuang commented on HDFS-13183: Thanks Jim [~hexiaoqiao] how do you thi

[jira] [Updated] (HDFS-9376) TestSeveralNameNodes fails occasionally

2020-05-19 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9376: --- Fix Version/s: 2.10.1 > TestSeveralNameNodes fails occasionally >

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2020-05-19 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111617#comment-17111617 ] Masatake Iwasaki commented on HDFS-9376: Thanks for pinging me [~Jim_Brennan]. I c

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111586#comment-17111586 ] Jim Brennan commented on HDFS-13183: More importantly, because it will never return N

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111582#comment-17111582 ] Jim Brennan commented on HDFS-14960: I believe this failure is actually due to HDFS-1

[jira] [Commented] (HDFS-13183) Standby NameNode process getBlocks request to reduce Active load

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111578#comment-17111578 ] Jim Brennan commented on HDFS-13183: [~weichiu], [~hexiaoqiao], I believe this change

[jira] [Updated] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

2020-05-19 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15293: --- Fix Version/s: 3.4.0 Hey [~vagarychen] trunk is actually 3.4 now. Adding to Fix Versi

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111555#comment-17111555 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15160) ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock

2020-05-19 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111480#comment-17111480 ] Stephen O'Donnell commented on HDFS-15160: -- [~zhuqi] I was wondering if you are

[jira] [Updated] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

2020-05-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated HDFS-15259: Resolution: Won't Fix Status: Resolved (was: Patch Available) > Reduce useless log information in

[jira] [Commented] (HDFS-15364) Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111469#comment-17111469 ] Hadoop QA commented on HDFS-15364: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15280) Datanode delay random time to report block if BlockManager is busy

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111459#comment-17111459 ] Wei-Chiu Chuang commented on HDFS-15280: This is basically creating a random back

[jira] [Commented] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

2020-05-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111456#comment-17111456 ] Chao Sun commented on HDFS-15259: - Yup. I think it is a won't fix. > Reduce useless log

[jira] [Commented] (HDFS-15259) Reduce useless log information in FSNamesystemAuditLogger

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111453#comment-17111453 ] Wei-Chiu Chuang commented on HDFS-15259: Are we in agreement this is a won't fix?

[jira] [Updated] (HDFS-14627) Improvements to make slow archive storage works on HDFS

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-14627: --- Issue Type: New Feature (was: Improvement) > Improvements to make slow archive storage works

[jira] [Commented] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111447#comment-17111447 ] Hadoop QA commented on HDFS-15363: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111421#comment-17111421 ] hemanthboyina commented on HDFS-15362: -- thanks [~elgoiri] for the review we call up

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111420#comment-17111420 ] Ayush Saxena commented on HDFS-15288: - Have removed the NPE check, Added static impor

[jira] [Updated] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15288: Attachment: HDFS-15288-03.patch > Add Available Space Rack Fault Tolerant BPP > ---

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111416#comment-17111416 ] Hadoop QA commented on HDFS-15093: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111402#comment-17111402 ] Íñigo Goiri commented on HDFS-15340: +1 on [^HDFS-15340.008.patch]. > RBF: Implemen

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111391#comment-17111391 ] Hadoop QA commented on HDFS-15355: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111386#comment-17111386 ] Íñigo Goiri commented on HDFS-15288: OK, let's keep the 0 to 1 range for consistency;

[jira] [Commented] (HDFS-15362) FileWithSnapshotFeature#updateQuotaAndCollectBlocks should collect all distinct blocks

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111383#comment-17111383 ] Íñigo Goiri commented on HDFS-15362: Thanks [~hemanthboyina] for the patch. In the te

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111373#comment-17111373 ] Hadoop QA commented on HDFS-15093: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111372#comment-17111372 ] Hadoop QA commented on HDFS-12733: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111363#comment-17111363 ] Ayush Saxena commented on HDFS-15359: - Yes, the test verifies two scenarios : *First

[jira] [Commented] (HDFS-15315) IOException on close() when using Erasure Coding

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111359#comment-17111359 ] Wei-Chiu Chuang commented on HDFS-15315: We did not certify HBase on EC at Cloude

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111352#comment-17111352 ] Wei-Chiu Chuang commented on HDFS-15359: What does the test check? Looks to me th

[jira] [Updated] (HDFS-15364) Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Summary: Support sort the output according to the number of occurrences of the opcode for StatisticsEditsVisito

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: HDFS-15364.001.patch > Sort the output according to the number of occurrences of the opcode for >

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: (was: HDFS-15364.001.patch) > Sort the output according to the number of occurrences of the opc

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Open (was: Patch Available) > Sort the output according to the number of occurrences of the opcode for

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Patch Available (was: Open) > Sort the output according to the number of occurrences of the opcode for

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: (was: HDFS-15364.001.patch) > Sort the output according to the number of occurrences of the opc

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: HDFS-15364.001.patch > Sort the output according to the number of occurrences of the opcode for >

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Priority: Minor (was: Major) > Sort the output according to the number of occurrences of the opcode for > Sta

[jira] [Commented] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111318#comment-17111318 ] Hadoop QA commented on HDFS-15364: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111311#comment-17111311 ] bianqi commented on HDFS-15364: --- Initial patch attached. please review. > Sort the output

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Status: Patch Available (was: Open) > Sort the output according to the number of occurrences of the opcode for

[jira] [Updated] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bianqi updated HDFS-15364: -- Attachment: HDFS-15364.001.patch > Sort the output according to the number of occurrences of the opcode for >

[jira] [Created] (HDFS-15364) Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor

2020-05-19 Thread bianqi (Jira)
bianqi created HDFS-15364: - Summary: Sort the output according to the number of occurrences of the opcode for StatisticsEditsVisitor Key: HDFS-15364 URL: https://issues.apache.org/jira/browse/HDFS-15364 Proje

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Attachment: HDFS-15363.001.patch Status: Patch Available (was: Open) > BlockPlacementPol

[jira] [Commented] (HDFS-15340) RBF: Implement BalanceProcedureScheduler basic framework

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111297#comment-17111297 ] Ayush Saxena commented on HDFS-15340: - Thanx [~linyiqun] for holding, I had a quick l

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Attachment: HDFS-15363-testrepro.patch > BlockPlacementPolicyWithNodeGroup should validate initia

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111271#comment-17111271 ] Ayush Saxena commented on HDFS-15288: - Thanx [~elgoiri] for the review. bq. If we ar

[jira] [Commented] (HDFS-9376) TestSeveralNameNodes fails occasionally

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111269#comment-17111269 ] Jim Brennan commented on HDFS-9376: --- [~cnauroth], [~iwasakims], [~kihwal] I know this is

[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111267#comment-17111267 ] Lisheng Sun commented on HDFS-13639:   ||case|| || |Before Case|perf_before_improve_S

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111256#comment-17111256 ] Ayush Saxena commented on HDFS-15093: - Thanx [~elgoiri] for the review. Have added th

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Description: When test the performance of the ShortCircuit Read of the HDFS with YCSB, we find that

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Attachment: HDFS-15093-04.patch > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified > -

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Attachment: (was: image-2020-05-17-23-53-41-115.png) > SlotReleaser is not fast enough >

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111252#comment-17111252 ] Íñigo Goiri commented on HDFS-15355: Thanks [~hadoop_yangyun] for the update, this lo

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111248#comment-17111248 ] Íñigo Goiri commented on HDFS-15093: Let's take care of the checkstyle; usually good

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111247#comment-17111247 ] Íñigo Goiri commented on HDFS-15288: Wow, that conf key length is something :) Is the

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Attachment: HDFS-15093-03.patch > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified > -

[jira] [Commented] (HDFS-14960) TestBalancerWithNodeGroup should not succeed with DFSNetworkTopology

2020-05-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111215#comment-17111215 ] Jim Brennan commented on HDFS-14960: I will investigate and resolve the unit test fai

[jira] [Commented] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1796#comment-1796 ] Yang Yun commented on HDFS-15355: - Updated to HDFS-15355.009.patch for unit test issues.

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Attachment: HDFS-15355.009.patch Status: Patch Available (was: Open) > Make the default block stor

[jira] [Updated] (HDFS-15355) Make the default block storage policy ID configurable

2020-05-19 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15355: Status: Open (was: Patch Available) > Make the default block storage policy ID configurable >

[jira] [Updated] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15363: - Description: BlockPlacementPolicyWithNodeGroup  type casts the initialized  clusterMap  {code:jav

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: (was: HDFS-12733.009.patch) > Option to disable to namenode local edits > ---

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits > --

[jira] [Created] (HDFS-15363) BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology

2020-05-19 Thread hemanthboyina (Jira)
hemanthboyina created HDFS-15363: Summary: BlockPlacementPolicyWithNodeGroup should validate initialized NetworkTopology Key: HDFS-15363 URL: https://issues.apache.org/jira/browse/HDFS-15363 Project:

[jira] [Commented] (HDFS-12288) Fix DataNode's xceiver count calculation

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1777#comment-1777 ] Lisheng Sun commented on HDFS-12288: hi [~elgoiri] Should we commit this patch to tr

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1770#comment-1770 ] Xiaoqiao He commented on HDFS-12733: Hi [~ayushtkn] [~elgoiri], [^HDFS-12733.009.pat

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2020-05-19 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-12733: --- Attachment: HDFS-12733.009.patch > Option to disable to namenode local edits > --

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1734#comment-1734 ] Hadoop QA commented on HDFS-15093: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-15288) Add Available Space Rack Fault Tolerant BPP

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17111098#comment-17111098 ] Hadoop QA commented on HDFS-15288: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lisheng Sun updated HDFS-13639: --- Status: Open (was: Patch Available) > SlotReleaser is not fast enough >

[jira] [Work started] (HDFS-13639) SlotReleaser is not fast enough

2020-05-19 Thread Lisheng Sun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-13639 started by Lisheng Sun. -- > SlotReleaser is not fast enough > --- > >

[jira] [Updated] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15093: Attachment: HDFS-15093-02.patch > RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified > -

[jira] [Commented] (HDFS-15093) RENAME.TO_TRASH is ignored When RENAME.OVERWRITE is specified

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110973#comment-17110973 ] Ayush Saxena commented on HDFS-15093: - Added a quick test, ensuring both options reac

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110958#comment-17110958 ] Ayush Saxena commented on HDFS-15359: - Test failures due to {{java.lang.OutOfMemoryEr

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-05-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17110951#comment-17110951 ] Hadoop QA commented on HDFS-15359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

  1   2   >