[jira] [Commented] (HDFS-3107) HDFS truncate

[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291559#comment-14291559 ] Yi Liu commented on HDFS-3107: -- Thanks [~shv], I find another two things: * DistributedFileSys

[jira] [Updated] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7353: Attachment: HDFS-7353-v4.patch Updated the patch resolving the Javadoc warnings. > Raw Erasure Coder API for

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291614#comment-14291614 ] Hadoop QA commented on HDFS-7353: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7678) Block group reader with decode functionality

Li Bo created HDFS-7678: --- Summary: Block group reader with decode functionality Key: HDFS-7678 URL: https://issues.apache.org/jira/browse/HDFS-7678 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-7678) Block group reader with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7678: Attachment: BlockGroupReader.patch > Block group reader with decode functionality > -

[jira] [Commented] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291695#comment-14291695 ] Steve Loughran commented on HDFS-7665: -- The second of those, {{src/site/markdown/file

[jira] [Commented] (HDFS-7678) Block group reader with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291701#comment-14291701 ] Li Bo commented on HDFS-7678: - This code has not synced with Codec and Namenode code, so I use

[jira] [Created] (HDFS-7679) EC encode/decode framework

Li Bo created HDFS-7679: --- Summary: EC encode/decode framework Key: HDFS-7679 URL: https://issues.apache.org/jira/browse/HDFS-7679 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Li Bo

[jira] [Updated] (HDFS-7679) EC encode/decode framework

[ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7679: Assignee: Li Bo > EC encode/decode framework > -- > > Key: HDFS-7679 >

[jira] [Updated] (HDFS-7679) EC encode/decode framework

[ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7679: Attachment: ECEncodeDecodeFramework.patch > EC encode/decode framework > -- > >

[jira] [Commented] (HDFS-7679) EC encode/decode framework

[ https://issues.apache.org/jira/browse/HDFS-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291712#comment-14291712 ] Li Bo commented on HDFS-7679: - The first patch shows the idea of EC encode/decode framework. St

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291736#comment-14291736 ] Li Bo commented on HDFS-7545: - hi, Zhe Thanks for your patch. I think writing blocks is more e

[jira] [Updated] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-7545: Attachment: clientStriping.patch > Data striping support in HDFS client > > >

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291742#comment-14291742 ] Li Bo commented on HDFS-7545: - The patch is based on HDFS-7679 and HDFS-7678. Zhe's patch is al

[jira] [Commented] (HDFS-7545) Data striping support in HDFS client

[ https://issues.apache.org/jira/browse/HDFS-7545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291744#comment-14291744 ] Li Bo commented on HDFS-7545: - DFSStripeInputStream is base on DFSInputStream. If directly mod

[jira] [Updated] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7677: - Fix Version/s: (was: 2.7.0) Status: Patch Available (was: Open) > DistributedFileSystem#truncate sh

[jira] [Updated] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7677: - Attachment: HDFS-7677.001.patch > DistributedFileSystem#truncate should resolve symlinks >

[jira] [Commented] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291862#comment-14291862 ] Kihwal Lee commented on HDFS-7224: -- I've committed this to branch-2 and trunk. Thanks for

[jira] [Updated] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7224: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-7224) Allow reuse of NN connections via webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291875#comment-14291875 ] Hudson commented on HDFS-7224: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6930 (See [https:

[jira] [Commented] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14291908#comment-14291908 ] Thanh Do commented on HDFS-7577: Hi [~cmccabe]. Could please you take a look at the new pat

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292001#comment-14292001 ] Hadoop QA commented on HDFS-7677: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292174#comment-14292174 ] Zhe Zhang commented on HDFS-7339: - bq. If we enforce block id allocation so that the lower

[jira] [Commented] (HDFS-7659) We should check the new length of truncate can't be a negative value.

[ https://issues.apache.org/jira/browse/HDFS-7659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292210#comment-14292210 ] Konstantin Shvachko commented on HDFS-7659: --- No problem. I was just trying to fin

[jira] [Commented] (HDFS-7666) Datanode blockId layout upgrade threads should be daemon thread

[ https://issues.apache.org/jira/browse/HDFS-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292273#comment-14292273 ] Colin Patrick McCabe commented on HDFS-7666: Hi Rakesh, I'm not sure why we wo

[jira] [Commented] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292280#comment-14292280 ] Konstantin Shvachko commented on HDFS-7665: --- Makes sense. Do you want to implemen

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292298#comment-14292298 ] Konstantin Shvachko commented on HDFS-7677: --- I don't see it in my design, which i

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292295#comment-14292295 ] Tsz Wo Nicholas Sze commented on HDFS-7339: --- > Are you proposing we enforce 4 zer

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292301#comment-14292301 ] Andrew Wang commented on HDFS-7411: --- This is the same testIncludeByRegistrationName failu

[jira] [Commented] (HDFS-7675) Unused member DFSClient.spanReceiverHost

[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292308#comment-14292308 ] Colin Patrick McCabe commented on HDFS-7675: It's not redundant. Calling {{Spa

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292311#comment-14292311 ] Colin Patrick McCabe commented on HDFS-7677: I think we should support this, ju

[jira] [Commented] (HDFS-7676) Fix TestFileTruncate to avoid bug of HDFS-7611

[ https://issues.apache.org/jira/browse/HDFS-7676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292314#comment-14292314 ] Colin Patrick McCabe commented on HDFS-7676: [~shv], are this JIRA and HDFS-765

[jira] [Updated] (HDFS-7312) Update DistCp v1 to optionally not use tmp location

[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Prosser updated HDFS-7312: - Status: Patch Available (was: Open) > Update DistCp v1 to optionally not use tmp location > --

[jira] [Commented] (HDFS-7312) Update DistCp v1 to optionally not use tmp location

[ https://issues.apache.org/jira/browse/HDFS-7312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292324#comment-14292324 ] Hadoop QA commented on HDFS-7312: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (HDFS-7680) Support dataset-specific choice of short circuit implementation

Joe Pallas created HDFS-7680: Summary: Support dataset-specific choice of short circuit implementation Key: HDFS-7680 URL: https://issues.apache.org/jira/browse/HDFS-7680 Project: Hadoop HDFS Is

[jira] [Created] (HDFS-7681) Fix ReplicaInputStream constructor to take InputStreams

Joe Pallas created HDFS-7681: Summary: Fix ReplicaInputStream constructor to take InputStreams Key: HDFS-7681 URL: https://issues.apache.org/jira/browse/HDFS-7681 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7630) TestConnCache hardcode block size without considering native OS

[ https://issues.apache.org/jira/browse/HDFS-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292353#comment-14292353 ] Arpit Agarwal commented on HDFS-7630: - HI [~sam liu], it is hard to review and commit m

[jira] [Created] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

Charles Lamb created HDFS-7682: -- Summary: {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content Key: HDFS-7682 URL: https://issues.apache.org/jira/browse/HDFS-7682

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Attachment: HDFS-7682.000.patch Posting patch for a jenkins run. > {{DistributedFileSystem#getFileChec

[jira] [Updated] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7682: --- Status: Patch Available (was: Open) > {{DistributedFileSystem#getFileChecksum}} of a snapshotted file

[jira] [Resolved] (HDFS-7654) TestFileTruncate#testTruncateEditLogLoad fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-7654. --- Resolution: Duplicate Full story goes like that. At the time of creation this jira was

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292398#comment-14292398 ] Arpit Agarwal commented on HDFS-7584: - Hi [~xyao], thanks for picking up this non-trivi

[jira] [Commented] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292414#comment-14292414 ] Colin Patrick McCabe commented on HDFS-7577: cpuid.h: we need an #error when th

[jira] [Resolved] (HDFS-7341) Add initial snapshot support based on pipeline recovery

[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7341. Resolution: Duplicate Duplicate of HDFS-3107 > Add initial snapshot support based on

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292424#comment-14292424 ] Colin Patrick McCabe commented on HDFS-6673: bq. The whole point of this tool i

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292443#comment-14292443 ] Colin Patrick McCabe commented on HDFS-7648: I agree with Nicholas that we shou

[jira] [Commented] (HDFS-7660) BlockReceiver#close() might be called multiple times, which causes the fsvolume reference being released incorrectly.

[ https://issues.apache.org/jira/browse/HDFS-7660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292445#comment-14292445 ] Colin Patrick McCabe commented on HDFS-7660: Thanks, Lei and Yi. > BlockReceiv

[jira] [Commented] (HDFS-3107) HDFS truncate

[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292447#comment-14292447 ] Tsz Wo Nicholas Sze commented on HDFS-3107: --- Thanks a lot for all the great works

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292454#comment-14292454 ] Jing Zhao commented on HDFS-7611: - Thanks for digging into the issue, [~Byron Wong]! So cu

[jira] [Updated] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7611: Attachment: HDFS-7611.000.patch Upload the patch using the above #2 approach. > deleteSnapshot and delete of

[jira] [Updated] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7411: -- Attachment: hdfs-7411.009.patch Added the @Ignore in this latest patch, no other changes. > Refactor and

[jira] [Updated] (HDFS-7577) Add additional headers that includes need by Windows

[ https://issues.apache.org/jira/browse/HDFS-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thanh Do updated HDFS-7577: --- Attachment: HDFS-7577-branch-HDFS-6994-2.patch Hi [~cmccabe]. Attached is another patch that throws an error if

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292496#comment-14292496 ] Zhe Zhang commented on HDFS-7339: - Thanks for the analysis [~szetszwo]. The basic tradeoff

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292545#comment-14292545 ] Haohui Mai commented on HDFS-6673: -- bq. I think that the point that Andrew is trying to ma

[jira] [Resolved] (HDFS-42) NetUtils.createSocketAddr NPEs if dfs.datanode.ipc.address is not set for a data node

[ https://issues.apache.org/jira/browse/HDFS-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-42. Resolution: Duplicate Fix Version/s: 0.21.0 > NetUtils.createSocketAddr NPEs if dfs.datanode.ipc

[jira] [Commented] (HDFS-42) NetUtils.createSocketAddr NPEs if dfs.datanode.ipc.address is not set for a data node

[ https://issues.apache.org/jira/browse/HDFS-42?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292557#comment-14292557 ] Steve Loughran commented on HDFS-42: HADOOP-5687 duplicated this; it contained the patch

[jira] [Resolved] (HDFS-135) TestEditLog assumes that FSNamesystem.getFSNamesystem().dir is non-null, even after the FSNameSystem is closed

[ https://issues.apache.org/jira/browse/HDFS-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HDFS-135. - Resolution: Cannot Reproduce > TestEditLog assumes that FSNamesystem.getFSNamesystem().dir is non-nu

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292571#comment-14292571 ] Tsz Wo Nicholas Sze commented on HDFS-7339: --- > However, it seems all of them requ

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292580#comment-14292580 ] Zhe Zhang commented on HDFS-7353: - Good work [~drankye]! Please find my comments below: # {

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292582#comment-14292582 ] Zhe Zhang commented on HDFS-7353: - Please also address the Javadoc warnings. > Raw Erasure

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292584#comment-14292584 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- [~zhz], how about using 'erasure' p

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292595#comment-14292595 ] Zhe Zhang commented on HDFS-7339: - bq. It is not true. For a EC-block, the block group obje

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292606#comment-14292606 ] Kai Zheng commented on HDFS-7285: - I'm not an English speaker, but I guess we could also fi

[jira] [Updated] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-5796: -- Attachment: HDFS-5796.3.patch Updating patch with some refactoring. * {{BrowserAuthenticationHandler}} mo

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292614#comment-14292614 ] Tsz Wo Nicholas Sze commented on HDFS-7353: --- Thanks for the update. The new patc

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292617#comment-14292617 ] Lei (Eddy) Xu commented on HDFS-6673: - Thank you so much for the continuous inputs on t

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292620#comment-14292620 ] Kai Zheng commented on HDFS-7285: - I searched the code base and didn't find any existing pa

[jira] [Updated] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7611: Status: Patch Available (was: Open) > deleteSnapshot and delete of a file can leave orphaned blocks in the

[jira] [Updated] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7611: Attachment: HDFS-7611.001.patch > deleteSnapshot and delete of a file can leave orphaned blocks in the > blo

[jira] [Commented] (HDFS-7353) Raw Erasure Coder API for concrete encoding and decoding

[ https://issues.apache.org/jira/browse/HDFS-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292631#comment-14292631 ] Kai Zheng commented on HDFS-7353: - Thanks [~zhz] and [~szetszwo] a lot for your great comme

[jira] [Commented] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292659#comment-14292659 ] Hadoop QA commented on HDFS-7682: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292690#comment-14292690 ] Ming Ma commented on HDFS-7609: --- [~cnauroth], we upgraded from hadoop 2.0.5 to hadoop 2.4, so

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292691#comment-14292691 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- > ... but I guess we could also find

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Target Version/s: 2.7.0 (was: 3.0.0) > Expose truncate API for Web HDFS > > >

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292711#comment-14292711 ] Yi Liu commented on HDFS-7677: -- I mean in the design doc of HDFS-7056. Thanks for your confirm

[jira] [Updated] (HDFS-7680) Support dataset-specific choice of short circuit implementation

[ https://issues.apache.org/jira/browse/HDFS-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Pallas updated HDFS-7680: - Description: As described in HDFS-5194, the current support for short circuit reading is tightly coupled t

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292716#comment-14292716 ] Yi Liu commented on HDFS-7677: -- That's great. So [~shv] and [~cmccabe] please help to take a l

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types (SSD)

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292745#comment-14292745 ] Arpit Agarwal commented on HDFS-7584: - Few more comments to wrap up feedback on API and

[jira] [Commented] (HDFS-7682) {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content

[ https://issues.apache.org/jira/browse/HDFS-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292763#comment-14292763 ] Jing Zhao commented on HDFS-7682: - Thanks for working on this, [~clamb]. One question abo

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292775#comment-14292775 ] Zhe Zhang commented on HDFS-7285: - I created a Google [doc | https://docs.google.com/docum

[jira] [Commented] (HDFS-7411) Refactor and improve decommissioning logic into DecommissionManager

[ https://issues.apache.org/jira/browse/HDFS-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292788#comment-14292788 ] Hadoop QA commented on HDFS-7411: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292822#comment-14292822 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- > I created a Google doc which is ed

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-49: - Status: Open (was: Patch Available) > MiniDFSCluster.stopDataNode will always shut down a node in the cluste

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292825#comment-14292825 ] Ravi Prakash commented on HDFS-49: -- Patch looks good to me however the two test failures sho

[jira] [Updated] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-49: - Status: Patch Available (was: Open) > MiniDFSCluster.stopDataNode will always shut down a node in the cluste

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292833#comment-14292833 ] Arpit Agarwal commented on HDFS-49: --- +1 for the v002 patch. The test failures are almost ce

[jira] [Commented] (HDFS-49) MiniDFSCluster.stopDataNode will always shut down a node in the cluster if a matching name is not found

[ https://issues.apache.org/jira/browse/HDFS-49?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292847#comment-14292847 ] Hadoop QA commented on HDFS-49: --- {color:red}-1 overall{color}. Here are the results of testing

[jira] [Commented] (HDFS-7339) Allocating and persisting block groups in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292864#comment-14292864 ] Jing Zhao commented on HDFS-7339: - bq. Change the hash function so that consecutive IDs wil

[jira] [Commented] (HDFS-3689) Add support for variable length block

[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292877#comment-14292877 ] Tsz Wo Nicholas Sze commented on HDFS-3689: --- - Add an if-statement to check targe

[jira] [Updated] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7584: Summary: Enable Quota Support for Storage Types (was: Enable Quota Support for Storage Types (SSD) )

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292887#comment-14292887 ] Tsz Wo Nicholas Sze commented on HDFS-7285: --- How about io.erasure_code? Intel IS

[jira] [Commented] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292891#comment-14292891 ] Arpit Agarwal commented on HDFS-7584: - [~xyao], considering the size of the patch do yo

[jira] [Comment Edited] (HDFS-7584) Enable Quota Support for Storage Types

[ https://issues.apache.org/jira/browse/HDFS-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292891#comment-14292891 ] Arpit Agarwal edited comment on HDFS-7584 at 1/27/15 2:50 AM: --

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292893#comment-14292893 ] Hadoop QA commented on HDFS-7611: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292894#comment-14292894 ] Kai Zheng commented on HDFS-7285: - It's good to use 'erasure_code' for a c library director

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292899#comment-14292899 ] Kai Zheng commented on HDFS-7285: - The rational to use "erasurecoding" or "erasurecode" is

[jira] [Commented] (HDFS-5796) The file system browser in the namenode UI requires SPNEGO.

[ https://issues.apache.org/jira/browse/HDFS-5796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292904#comment-14292904 ] Hadoop QA commented on HDFS-5796: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: HDFS-7018-pnative.004.patch > Implement C interface for libhdfs3 >

[jira] [Commented] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292915#comment-14292915 ] Zhanwei Wang commented on HDFS-7018: Hi [~cmccabe] In the new patch, 1) simplify the e

[jira] [Updated] (HDFS-7018) Implement C interface for libhdfs3

[ https://issues.apache.org/jira/browse/HDFS-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7018: --- Attachment: HDFS-7018-pnative.004.patch > Implement C interface for libhdfs3 >

  1   2   >