[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501145#comment-14501145 ] Yongjun Zhang commented on HDFS-7281: - Hi [~mingma], Thanks for the updated patch, it

[jira] [Commented] (HDFS-8152) Refactoring of lazy persist storage cases

[ https://issues.apache.org/jira/browse/HDFS-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501132#comment-14501132 ] Hadoop QA commented on HDFS-8152: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8163) Using monotonicNow for block report scheduling causes test failures on recently restarted systems

[ https://issues.apache.org/jira/browse/HDFS-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501086#comment-14501086 ] Hadoop QA commented on HDFS-8163: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501082#comment-14501082 ] Ming Ma commented on HDFS-7281: --- For the incompatibility issue Lohit mentioned, if some tools

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501062#comment-14501062 ] Hadoop QA commented on HDFS-7281: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7863) Missing description of parameter fsd in javadoc

[ https://issues.apache.org/jira/browse/HDFS-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501052#comment-14501052 ] Hadoop QA commented on HDFS-7863: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8152) Refactoring of lazy persist storage cases

[ https://issues.apache.org/jira/browse/HDFS-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501046#comment-14501046 ] Arpit Agarwal commented on HDFS-8152: - If you try to run the tests locally they may fai

[jira] [Updated] (HDFS-8152) Refactoring of lazy persist storage cases

[ https://issues.apache.org/jira/browse/HDFS-8152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8152: Attachment: HDFS-8152.03.patch v03 patch to fix the failing test case {{TestScrLazyPersistFiles.test

[jira] [Commented] (HDFS-8169) Move LocatedBlocks and related classes to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501029#comment-14501029 ] Hadoop QA commented on HDFS-8169: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Resolved] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8145. - Resolution: Fixed Fix Version/s: HDFS-7285 I've committed this to the feature branch. Thanks for the

[jira] [Resolved] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7937. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed I've committed this to the fe

[jira] [Updated] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7937: Attachment: HDFS-7937.9.patch The .8 patch looks pretty good to me. +1 Only nits is that maybe we can rename

[jira] [Updated] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8145: -- Hadoop Flags: Reviewed +1 the patch looks good. > Fix the editlog corruption exposed by

[jira] [Resolved] (HDFS-8166) DFSStripedOutputStream should not create empty blocks

[ https://issues.apache.org/jira/browse/HDFS-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8166. - Resolution: Fixed Fix Version/s: HDFS-7285 Thanks Nicholas for the review! I've committed this to th

[jira] [Updated] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8145: Attachment: HDFS-8145.002.patch Thanks for the review, Zhe! Update the patch to address your comments: # I ju

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678.000.patch The patch is not functional yet but demonstrates the idea. [~drankye] I hav

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500966#comment-14500966 ] Zhe Zhang commented on HDFS-7285: - Thanks Nicholas for the consideration! I think we also n

[jira] [Commented] (HDFS-8070) Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500965#comment-14500965 ] Colin Patrick McCabe commented on HDFS-8070: bq. For this patch, do I have to r

[jira] [Updated] (HDFS-8163) Using monotonicNow for block report scheduling causes test failures on recently restarted systems

[ https://issues.apache.org/jira/browse/HDFS-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8163: Attachment: HDFS-8163.03.patch Updated v03 patch to handle negative values and overflows. Split out t

[jira] [Commented] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500958#comment-14500958 ] Zhe Zhang commented on HDFS-8145: - Thanks for the work Jing! The patch looks good overall.

[jira] [Updated] (HDFS-8166) DFSStripedOutputStream should not create empty blocks

[ https://issues.apache.org/jira/browse/HDFS-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8166: -- Hadoop Flags: Reviewed +1 patch looks good. > DFSStripedOutputStream should not create e

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500944#comment-14500944 ] Jakob Homan commented on HDFS-8155: --- bq. I agree when an initial authentication like Kerb

[jira] [Updated] (HDFS-8166) DFSStripedOutputStream should not create empty blocks

[ https://issues.apache.org/jira/browse/HDFS-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8166: Attachment: HDFS-8166.000.patch The 000 patch includes: # Fix {{DFSStripedOutputStream}} to avoid creating em

[jira] [Updated] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7281: -- Attachment: HDFS-7281-3.patch Thanks, [~yzhangal]. Here is the rebased patch. > Missing block is marked as corru

[jira] [Updated] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8145: Description: {{TestAddStripedBlocks}} failed with some editlog corruption. Did some debugging, I can see at

[jira] [Reopened] (HDFS-8166) DFSStripedOutputStream should not create empty blocks

[ https://issues.apache.org/jira/browse/HDFS-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-8166: - Assignee: Jing Zhao (was: Tsz Wo Nicholas Sze) Reopen the jira. We will separate out the fix for DFSStri

[jira] [Updated] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8145: Attachment: HDFS-8145.001.patch Thanks for the review, Nicholas! Update the patch to address the comments. Th

[jira] [Updated] (HDFS-7863) Missing description of parameter fsd in javadoc

[ https://issues.apache.org/jira/browse/HDFS-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7863: --- Attachment: HDFS-7863-005.patch > Missing description of parameter fsd in javadoc > --

[jira] [Commented] (HDFS-7937) Erasure Coding: INodeFile quota computation unit tests

[ https://issues.apache.org/jira/browse/HDFS-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500889#comment-14500889 ] Jing Zhao commented on HDFS-7937: - Thanks Kai for updating the patch! I will review the pat

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500882#comment-14500882 ] Kai Zheng commented on HDFS-8156: - Thanks [~szetszwo] for the good review. bq.Should chunkS

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500869#comment-14500869 ] Kai Zheng commented on HDFS-8155: - Hey [~wheat9], Thanks for your comment about the two ca

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500861#comment-14500861 ] Hadoop QA commented on HDFS-7281: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500845#comment-14500845 ] Kai Zheng commented on HDFS-8155: - bq. I'm interested in the client and non-Namenode WebHDF

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500844#comment-14500844 ] Yongjun Zhang commented on HDFS-7281: - HI [~lohit], Thanks for your comments. Format-w

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500840#comment-14500840 ] Xiaoyu Yao commented on HDFS-8179: -- Previously, we compare Time.now() - 0 against SERVER_D

[jira] [Updated] (HDFS-8155) Support OAuth2 in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8155: Summary: Support OAuth2 in WebHDFS (was: Support OAuth2 authentication in WebHDFS) > Support OAuth2 in WebH

[jira] [Commented] (HDFS-8155) Support OAuth2 authentication in WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-8155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500828#comment-14500828 ] Kai Zheng commented on HDFS-8155: - Hi [~jghoman], bq.We should amend the WebHDFS spec to su

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8179: Target Version/s: 2.7.1 > DFSClient#getServerDefaults returns null within 1 hour of system start > --

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8179: Priority: Blocker (was: Major) > DFSClient#getServerDefaults returns null within 1 hour of system st

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of system start

[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8179: Summary: DFSClient#getServerDefaults returns null within 1 hour of system start (was: DFSClient#getS

[jira] [Commented] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500791#comment-14500791 ] Hadoop QA commented on HDFS-7758: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8147) Mover should not select the DN storage as target where already same replica exists.

[ https://issues.apache.org/jira/browse/HDFS-8147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500782#comment-14500782 ] Tsz Wo Nicholas Sze commented on HDFS-8147: --- I think the problem is that when the

[jira] [Commented] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of NN start

[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500770#comment-14500770 ] Xiaoyu Yao commented on HDFS-8179: -- This is a bug in DFSClient#getServerDefaults(). There

[jira] [Created] (HDFS-8179) DFSClient#getServerDefaults returns within 1 hour of NN start

Xiaoyu Yao created HDFS-8179: Summary: DFSClient#getServerDefaults returns within 1 hour of NN start Key: HDFS-8179 URL: https://issues.apache.org/jira/browse/HDFS-8179 Project: Hadoop HDFS Issu

[jira] [Updated] (HDFS-8179) DFSClient#getServerDefaults returns null within 1 hour of NN start

[ https://issues.apache.org/jira/browse/HDFS-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8179: - Summary: DFSClient#getServerDefaults returns null within 1 hour of NN start (was: DFSClient#getServerDefau

[jira] [Commented] (HDFS-8163) Using monotonicNow for block report scheduling causes test failures on recently restarted systems

[ https://issues.apache.org/jira/browse/HDFS-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500757#comment-14500757 ] Arpit Agarwal commented on HDFS-8163: - While working on more tests I found some more is

[jira] [Commented] (HDFS-8145) Fix the editlog corruption exposed by failed TestAddStripedBlocks

[ https://issues.apache.org/jira/browse/HDFS-8145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500742#comment-14500742 ] Tsz Wo Nicholas Sze commented on HDFS-8145: --- - getCommittedBlock should use block

[jira] [Commented] (HDFS-8169) Move LocatedBlocks and related classes to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500708#comment-14500708 ] Hadoop QA commented on HDFS-8169: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500659#comment-14500659 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- - Why ECSchemaManager needs to store

[jira] [Commented] (HDFS-8043) NPE in MiniDFSCluster teardown

[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500661#comment-14500661 ] Hadoop QA commented on HDFS-8043: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500626#comment-14500626 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- > I had an offline discussion with U

[jira] [Commented] (HDFS-8138) Refine or extend EC command to support all cases

[ https://issues.apache.org/jira/browse/HDFS-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500595#comment-14500595 ] Tsz Wo Nicholas Sze commented on HDFS-8138: --- CODEC is not a good name. How about

[jira] [Commented] (HDFS-8129) Maintain consistent naming for Erasure Coding related classes - EC/ErasureCode

[ https://issues.apache.org/jira/browse/HDFS-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500592#comment-14500592 ] Tsz Wo Nicholas Sze commented on HDFS-8129: --- ErasureCoding* sounds good. For the

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500586#comment-14500586 ] Tsz Wo Nicholas Sze commented on HDFS-8014: --- > ... read locally or remotely data

[jira] [Updated] (HDFS-8059) Erasure coding: move dataBlockNum and parityBlockNum from BlockInfoStriped to INodeFile

[ https://issues.apache.org/jira/browse/HDFS-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8059: -- Parent Issue: HDFS-8031 (was: HDFS-7285) > Erasure coding: move dataBlockNum and parityB

[jira] [Commented] (HDFS-7621) Erasure Coding: update the Balancer/Mover data migration logic

[ https://issues.apache.org/jira/browse/HDFS-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500578#comment-14500578 ] Tsz Wo Nicholas Sze commented on HDFS-7621: --- [~walter.k.su], are you working on t

[jira] [Updated] (HDFS-7344) [umbella] Erasure Coding worker and support in DataNode

[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7344: -- Summary: [umbella] Erasure Coding worker and support in DataNode (was: Erasure Coding wo

[jira] [Updated] (HDFS-7545) [umbella] Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7545: -- Summary: [umbella] Data striping support in HDFS client (was: Data striping support in H

[jira] [Work started] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7672 started by Tsz Wo Nicholas Sze. - > Erasure Coding: handle write failure for stripping coding blocks > ---

[jira] [Commented] (HDFS-7346) Erasure Coding: perform stripping erasure encoding work given block reader and writer

[ https://issues.apache.org/jira/browse/HDFS-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500564#comment-14500564 ] Tsz Wo Nicholas Sze commented on HDFS-7346: --- Oops, this is actually one of the fo

[jira] [Resolved] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

[ https://issues.apache.org/jira/browse/HDFS-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-8172. --- Resolution: Duplicate > Failure handling: DFSStripedOutputStream continues writing with

[jira] [Commented] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

[ https://issues.apache.org/jira/browse/HDFS-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500563#comment-14500563 ] Tsz Wo Nicholas Sze commented on HDFS-8172: --- [~libo-intel], just found that you a

[jira] [Commented] (HDFS-7346) Erasure Coding: perform stripping erasure encoding work given block reader and writer

[ https://issues.apache.org/jira/browse/HDFS-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500558#comment-14500558 ] Tsz Wo Nicholas Sze commented on HDFS-7346: --- [~libo-intel], are you still working

[jira] [Commented] (HDFS-8015) Erasure Coding: local and remote block writer for coding work in DataNode

[ https://issues.apache.org/jira/browse/HDFS-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500552#comment-14500552 ] Tsz Wo Nicholas Sze commented on HDFS-8015: --- [~libo-intel], are you still working

[jira] [Commented] (HDFS-8024) Erasure Coding: ECworker frame, basics, bootstraping and configuration

[ https://issues.apache.org/jira/browse/HDFS-8024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500542#comment-14500542 ] Tsz Wo Nicholas Sze commented on HDFS-8024: --- [~umamaheswararao], are you working

[jira] [Commented] (HDFS-8014) Erasure Coding: local and remote block reader for coding work in DataNode

[ https://issues.apache.org/jira/browse/HDFS-8014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500502#comment-14500502 ] Tsz Wo Nicholas Sze commented on HDFS-8014: --- [~zhz], are you working on this? I b

[jira] [Commented] (HDFS-7348) Erasure Coding: perform stripping erasure decoding/recovery work given block reader and writer

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500497#comment-14500497 ] Tsz Wo Nicholas Sze commented on HDFS-7348: --- [~hitliuyi], are you working on this

[jira] [Commented] (HDFS-7344) Erasure Coding worker and support in DataNode

[ https://issues.apache.org/jira/browse/HDFS-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500488#comment-14500488 ] Tsz Wo Nicholas Sze commented on HDFS-7344: --- > ... The required tasks listed here

[jira] [Commented] (HDFS-7993) Incorrect descriptions in fsck when nodes are decommissioned

[ https://issues.apache.org/jira/browse/HDFS-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500482#comment-14500482 ] Ming Ma commented on HDFS-7993: --- Could the test fail if the node becomes decommissioned right

[jira] [Commented] (HDFS-8019) Erasure Coding: erasure coding chunk buffer allocation and management

[ https://issues.apache.org/jira/browse/HDFS-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500472#comment-14500472 ] Tsz Wo Nicholas Sze commented on HDFS-8019: --- Kai, are you still working on this?

[jira] [Commented] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

[ https://issues.apache.org/jira/browse/HDFS-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500452#comment-14500452 ] Tsz Wo Nicholas Sze commented on HDFS-8172: --- [~libo-intel], have you started work

[jira] [Resolved] (HDFS-8167) BlockManager.addBlockCollectionWithCheck should check if the block is a striped block

[ https://issues.apache.org/jira/browse/HDFS-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8167. - Resolution: Fixed > BlockManager.addBlockCollectionWithCheck should check if the block is a > striped bloc

[jira] [Updated] (HDFS-8167) BlockManager.addBlockCollectionWithCheck should check if the block is a striped block

[ https://issues.apache.org/jira/browse/HDFS-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8167: Attachment: HDFS-8167_002.patch The patch looks good to me. Just one nit that we should combine the if condi

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500447#comment-14500447 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- - Should chunkSize be renamed to "ce

[jira] [Updated] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Description: HDFS-5919 fixes the issue for {{FileJournalManager}}. A similar fix is needed for QJM. > QJM do

[jira] [Created] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

Zhe Zhang created HDFS-8178: --- Summary: QJM doesn't purge empty and corrupt inprogress edits files Key: HDFS-8178 URL: https://issues.apache.org/jira/browse/HDFS-8178 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-8177) When the dfs -appendToFile - / is used concurrently in different process simultaneously pointing to the same hadoop file. It produces a exception statin

[ https://issues.apache.org/jira/browse/HDFS-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8177. - Resolution: Not A Problem Hi [~bharath.r25], HDFS supports single writer at a time for a given file

[jira] [Commented] (HDFS-8156) Add/implement necessary APIs even we just have the system default schema

[ https://issues.apache.org/jira/browse/HDFS-8156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500420#comment-14500420 ] Tsz Wo Nicholas Sze commented on HDFS-8156: --- > ... Regarding the test concern, pl

[jira] [Updated] (HDFS-7758) Retire FsDatasetSpi#getVolumes() and use FsDatasetSpi#getVolumeRefs() instead

[ https://issues.apache.org/jira/browse/HDFS-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7758: Attachment: HDFS-7758.005.patch Updated the patch to address {{TestFsVolumeList}} failure. {{TestLea

[jira] [Updated] (HDFS-8167) BlockManager.addBlockCollectionWithCheck should check if the block is a striped block

[ https://issues.apache.org/jira/browse/HDFS-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8167: -- Component/s: namenode Hadoop Flags: Reviewed +1 the patch looks good. [~zhz], do yo

[jira] [Commented] (HDFS-8146) Protobuf changes for BlockECRecoveryCommand and its fields for making it ready for transfer to DN

[ https://issues.apache.org/jira/browse/HDFS-8146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500380#comment-14500380 ] Zhe Zhang commented on HDFS-8146: - Thanks Uma. Either option looks fine to me. Another po

[jira] [Updated] (HDFS-8169) Move LocatedBlocks and related classes to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8169: - Attachment: HDFS-8169.001.patch > Move LocatedBlocks and related classes to hdfs-client > -

[jira] [Commented] (HDFS-7863) Missing description of parameter fsd in javadoc

[ https://issues.apache.org/jira/browse/HDFS-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500282#comment-14500282 ] Tsuyoshi Ozawa commented on HDFS-7863: -- [~brahmareddy] thank you for updating. I found

[jira] [Commented] (HDFS-8043) NPE in MiniDFSCluster teardown

[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500254#comment-14500254 ] Tsuyoshi Ozawa commented on HDFS-8043: -- [~brahmareddy] thanks for your updating. {code

[jira] [Updated] (HDFS-8043) NPE in MiniDFSCluster teardown

[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated HDFS-8043: - Status: Patch Available (was: Open) > NPE in MiniDFSCluster teardown > ---

[jira] [Commented] (HDFS-8171) Extend BlockSender to support multiple block data source

[ https://issues.apache.org/jira/browse/HDFS-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500197#comment-14500197 ] Zhe Zhang commented on HDFS-8171: - Moving this to HDFS-8031; if necessary we can move it ba

[jira] [Updated] (HDFS-8171) Extend BlockSender to support multiple block data source

[ https://issues.apache.org/jira/browse/HDFS-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8171: Parent Issue: HDFS-8031 (was: HDFS-7285) > Extend BlockSender to support multiple block data source > --

[jira] [Commented] (HDFS-8171) Extend BlockSender to support multiple block data source

[ https://issues.apache.org/jira/browse/HDFS-8171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500195#comment-14500195 ] Zhe Zhang commented on HDFS-8171: - Looks like we can do this as a follow-on? If multiple bl

[jira] [Commented] (HDFS-8172) Failure handling: DFSStripedOutputStream continues writing with enough remaining datanodes

[ https://issues.apache.org/jira/browse/HDFS-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500192#comment-14500192 ] Zhe Zhang commented on HDFS-8172: - This JIRA and HDFS-7672 targets the same issue. [~libo-i

[jira] [Commented] (HDFS-7891) A block placement policy with best rack failure tolerance

[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500165#comment-14500165 ] Zhe Zhang commented on HDFS-7891: - Thanks Walter for the work and Nicholas for the final re

[jira] [Commented] (HDFS-8043) NPE in MiniDFSCluster teardown

[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500120#comment-14500120 ] Brahma Reddy Battula commented on HDFS-8043: [~ozawa] Thanks for taking a look

[jira] [Updated] (HDFS-8043) NPE in MiniDFSCluster teardown

[ https://issues.apache.org/jira/browse/HDFS-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8043: --- Attachment: HDFS-8043-002.patch > NPE in MiniDFSCluster teardown >

[jira] [Commented] (HDFS-7863) Missing description of parameter fsd in javadoc

[ https://issues.apache.org/jira/browse/HDFS-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500091#comment-14500091 ] Hadoop QA commented on HDFS-7863: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-8153) Error Message points to wrong parent directory in case of path component name length error

[ https://issues.apache.org/jira/browse/HDFS-8153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500041#comment-14500041 ] Hudson commented on HDFS-8153: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

[jira] [Commented] (HDFS-8142) DistributedFileSystem encryption zone commands should resolve relative paths

[ https://issues.apache.org/jira/browse/HDFS-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500045#comment-14500045 ] Hudson commented on HDFS-8142: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

[jira] [Commented] (HDFS-8135) Remove the deprecated FSConstants class

[ https://issues.apache.org/jira/browse/HDFS-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500043#comment-14500043 ] Hudson commented on HDFS-8135: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

[jira] [Commented] (HDFS-8082) Separate the client read conf from DFSConfigKeys

[ https://issues.apache.org/jira/browse/HDFS-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500042#comment-14500042 ] Hudson commented on HDFS-8082: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

[jira] [Commented] (HDFS-8165) Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500046#comment-14500046 ] Hudson commented on HDFS-8165: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

[jira] [Commented] (HDFS-6153) Document "fileId" and "childrenNum" fields in the FileStatus Json schema

[ https://issues.apache.org/jira/browse/HDFS-6153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500047#comment-14500047 ] Hudson commented on HDFS-6153: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

[jira] [Commented] (HDFS-7891) A block placement policy with best rack failure tolerance

[ https://issues.apache.org/jira/browse/HDFS-7891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14500049#comment-14500049 ] Hudson commented on HDFS-7891: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2116 (See [htt

  1   2   3   >