[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

2015-01-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292298#comment-14292298 ] Konstantin Shvachko commented on HDFS-7677: --- I don't see it in my design, which i

[jira] [Resolved] (HDFS-7654) TestFileTruncate#testTruncateEditLogLoad fails intermittently

2015-01-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-7654. --- Resolution: Duplicate Full story goes like that. At the time of creation this jira was

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

2015-01-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293092#comment-14293092 ] Konstantin Shvachko commented on HDFS-7677: --- Looks good. Few minor nits on the te

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293184#comment-14293184 ] Konstantin Shvachko commented on HDFS-7611: --- I like option 2. Minor comments. # {

[jira] [Commented] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293195#comment-14293195 ] Konstantin Shvachko commented on HDFS-7675: --- Thanks for clarifying. I see it as a

[jira] [Commented] (HDFS-7677) DistributedFileSystem#truncate should resolve symlinks

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293996#comment-14293996 ] Konstantin Shvachko commented on HDFS-7677: --- +1 from me too. Don't think this cou

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294095#comment-14294095 ] Konstantin Shvachko commented on HDFS-7611: --- The patch looks good. And it fixes B

[jira] [Commented] (HDFS-7675) Unused member DFSClient.spanReceiverHost

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294231#comment-14294231 ] Konstantin Shvachko commented on HDFS-7675: --- Sounds like you don't need the refer

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294807#comment-14294807 ] Konstantin Shvachko commented on HDFS-7655: --- Hey Yi. I think the test for WebHDFS

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294812#comment-14294812 ] Konstantin Shvachko commented on HDFS-7611: --- Jing, unfortunately I just reproduce

[jira] [Commented] (HDFS-7611) deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart.

2015-01-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295956#comment-14295956 ] Konstantin Shvachko commented on HDFS-7611: --- Jing, I looked closer. That is added

[jira] [Created] (HDFS-7695) Intermittent failures in TestOpenFilesWithSnapshot

2015-01-28 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7695: - Summary: Intermittent failures in TestOpenFilesWithSnapshot Key: HDFS-7695 URL: https://issues.apache.org/jira/browse/HDFS-7695 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7695) Intermittent failures in TestOpenFilesWithSnapshot

2015-01-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295998#comment-14295998 ] Konstantin Shvachko commented on HDFS-7695: --- This was partly investigated under H

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306822#comment-14306822 ] Konstantin Shvachko commented on HDFS-7738: --- Hey Nicholas, agreed more test cases

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306851#comment-14306851 ] Konstantin Shvachko commented on HDFS-7738: --- For truncate tests with HA it shoul

[jira] [Comment Edited] (HDFS-7738) Add more negative tests for truncate

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306822#comment-14306822 ] Konstantin Shvachko edited comment on HDFS-7738 at 2/5/15 7:41 PM: --

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307910#comment-14307910 ] Konstantin Shvachko commented on HDFS-7655: --- Just one nit. - Since you changed in

[jira] [Created] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-05 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7740: - Summary: Test truncate with DataNodes restarting Key: HDFS-7740 URL: https://issues.apache.org/jira/browse/HDFS-7740 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308056#comment-14308056 ] Konstantin Shvachko commented on HDFS-7740: --- Scenario for the test: - Create file

[jira] [Commented] (HDFS-3107) HDFS truncate

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308071#comment-14308071 ] Konstantin Shvachko commented on HDFS-3107: --- Nicholas, you are right we don't hav

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308779#comment-14308779 ] Konstantin Shvachko commented on HDFS-7738: --- # {{RecoverLeaseOp}} should be stati

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309727#comment-14309727 ] Konstantin Shvachko commented on HDFS-7738: --- > it is better to have some random

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309734#comment-14309734 ] Konstantin Shvachko commented on HDFS-7738: --- TestHAAppend fails waiting on checkB

[jira] [Updated] (HDFS-3107) HDFS truncate

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3107: -- Attachment: HDFS_truncate.pdf Attaching new version of the design document. You guys keep

[jira] [Comment Edited] (HDFS-3107) HDFS truncate

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309989#comment-14309989 ] Konstantin Shvachko edited comment on HDFS-3107 at 2/6/15 9:50 PM: --

[jira] [Updated] (HDFS-7341) Add initial snapshot support based on pipeline recovery

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7341: -- Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-3107) > Add initial snaps

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310394#comment-14310394 ] Konstantin Shvachko commented on HDFS-7738: --- # Since you kept TestHAAppend in the

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310900#comment-14310900 ] Konstantin Shvachko commented on HDFS-7738: --- I agree your method of partitioning

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

2015-02-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310962#comment-14310962 ] Konstantin Shvachko commented on HDFS-7058: --- I would do it as in append test. # U

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

2015-02-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311554#comment-14311554 ] Konstantin Shvachko commented on HDFS-7058: --- Dasha, this looks good to me. You sh

[jira] [Commented] (HDFS-7058) Tests for truncate CLI

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312992#comment-14312992 ] Konstantin Shvachko commented on HDFS-7058: --- +1 TestRetryCacheWithHA failure trac

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313262#comment-14313262 ] Konstantin Shvachko commented on HDFS-4114: --- Yes, it is still quite useful for th

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313313#comment-14313313 ] Konstantin Shvachko commented on HDFS-4114: --- BackupNode and CheckpointNode are re

[jira] [Updated] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4114: -- Status: Open (was: Patch Available) > Remove the BackupNode and CheckpointNode from trun

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313349#comment-14313349 ] Konstantin Shvachko commented on HDFS-4114: --- [This probably summarises my view|h

[jira] [Updated] (HDFS-7058) Tests for truncate CLI

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7058: -- Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0 Ha

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313739#comment-14313739 ] Konstantin Shvachko commented on HDFS-4114: --- Glad you are in support of the inter

[jira] [Updated] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7665: -- Attachment: HDFS-7665.patch This are changes to the documentation related to truncate. Al

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7760: -- Attachment: HDFS-7760.patch Yi, I was planning to add this into HDFS-7665, then saw this

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7760: -- Status: Patch Available (was: Open) > Further update user doc for truncate > ---

[jira] [Updated] (HDFS-7665) Add definition of truncate preconditions/postconditions to filesystem specification

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7665: -- Issue Type: Improvement (was: Sub-task) Parent: (was: HDFS-3107) > Add defin

[jira] [Commented] (HDFS-7760) Further update user doc for truncate

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315320#comment-14315320 ] Konstantin Shvachko commented on HDFS-7760: --- I thought it is the definition of {{

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315345#comment-14315345 ] Konstantin Shvachko commented on HDFS-4114: --- [Just in case you missed it|https:/

[jira] [Reopened] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reopened HDFS-7753: --- Assignee: Konstantin Shvachko (was: Rakesh R) Reopening. I think this patch was on t

[jira] [Updated] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7753: -- Attachment: HDFS-7753-02.patch I would rather fix it here than by suppressing the warning

[jira] [Commented] (HDFS-7754) Fix findbugs warning produced by HDFS-7710

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315425#comment-14315425 ] Konstantin Shvachko commented on HDFS-7754: --- I proposed a patch in HDFS-7753. Ple

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315438#comment-14315438 ] Konstantin Shvachko commented on HDFS-4114: --- Indeed, you did in your yesterday co

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7760: -- Attachment: HDFS-7760-02.patch Sorry, you are right, need to add newlength definition as

[jira] [Updated] (HDFS-7753) Fix Multithreaded correctness Warnings in BackupImage.java

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7753: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Statu

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315838#comment-14315838 ] Konstantin Shvachko commented on HDFS-7769: --- This should have been reviewed by a

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7760: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Statu

[jira] [Updated] (HDFS-7760) Document truncate for WebHDFS.

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7760: -- Summary: Document truncate for WebHDFS. (was: Further update user doc for truncate) Ren

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317093#comment-14317093 ] Konstantin Shvachko commented on HDFS-4114: --- Sorry, but I respectfully disagree w

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317268#comment-14317268 ] Konstantin Shvachko commented on HDFS-4114: --- Change methods to public proved to b

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317676#comment-14317676 ] Konstantin Shvachko commented on HDFS-7769: --- Sorry you are referring to a 3-year

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317785#comment-14317785 ] Konstantin Shvachko commented on HDFS-7769: --- The rule has been always clear for m

[jira] [Commented] (HDFS-7656) Expose truncate API for HDFS httpfs

2015-02-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327116#comment-14327116 ] Konstantin Shvachko commented on HDFS-7656: --- Looks good to me, including the {{co

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-19 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328470#comment-14328470 ] Konstantin Shvachko commented on HDFS-7740: --- Hey Yi. The test scenarios sound gre

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329683#comment-14329683 ] Konstantin Shvachko commented on HDFS-7740: --- This actually worked pretty good. On

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-20 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329696#comment-14329696 ] Konstantin Shvachko commented on HDFS-7769: --- [~chris.douglas] you probably have a

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2015-02-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334515#comment-14334515 ] Konstantin Shvachko commented on HDFS-7056: --- Sounds right, Jing. Let me write it

[jira] [Created] (HDFS-7831) Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks().

2015-02-23 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-7831: - Summary: Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks(). Key: HDFS-7831 URL: https://issues.apache.org/jira/browse/HDFS-7831

[jira] [Updated] (HDFS-7831) Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks().

2015-02-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7831: -- Target Version/s: 2.7.0 Affects Version/s: 2.7.0 > Fix the starting index of the loo

[jira] [Commented] (HDFS-7831) Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks().

2015-02-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334535#comment-14334535 ] Konstantin Shvachko commented on HDFS-7831: --- {{binarySearch(diffs, snapshotId)}}

[jira] [Comment Edited] (HDFS-7831) Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks().

2015-02-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334535#comment-14334535 ] Konstantin Shvachko edited comment on HDFS-7831 at 2/24/15 7:34 AM: -

[jira] [Updated] (HDFS-7831) Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks().

2015-02-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7831: -- Attachment: HDFS-7831-01.patch Fixed the starting index for the loop. Also we do not need

[jira] [Updated] (HDFS-7831) Fix the starting index of the loop in FileDiffList.findEarlierSnapshotBlocks().

2015-02-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-7831: -- Assignee: Konstantin Shvachko Status: Patch Available (was: Open) > Fix the starti

[jira] [Commented] (HDFS-7056) Snapshot support for truncate

2015-02-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334562#comment-14334562 ] Konstantin Shvachko commented on HDFS-7056: --- The patch is up for review in HDFS-7

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14337580#comment-14337580 ] Konstantin Shvachko commented on HDFS-7740: --- It could be related to HDFS-7695. I

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340565#comment-14340565 ] Konstantin Shvachko commented on HDFS-7769: --- I did also +1 HDFS-7769. The patch w

[jira] [Commented] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340951#comment-14340951 ] Konstantin Shvachko commented on HDFS-7769: --- I just recommitted this. Thank you N

[jira] [Resolved] (HDFS-7769) TestHDFSCLI create files in hdfs project root dir

2015-02-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-7769. --- Resolution: Fixed Fix Version/s: 2.7.0 > TestHDFSCLI create files in hdfs projec

[jira] [Commented] (HDFS-1348) Improve NameNode reponsiveness while it is checking if datanode decommissions are complete

2015-03-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14343920#comment-14343920 ] Konstantin Shvachko commented on HDFS-1348: --- This is still a valid optimization.

[jira] [Updated] (HDFS-1522) Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constant

2015-03-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1522: -- Target Version/s: 2.7.0 Hey Dongming. Glad you've picked this up. The patch looks good. A

[jira] [Comment Edited] (HDFS-1522) Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constant

2015-03-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346269#comment-14346269 ] Konstantin Shvachko edited comment on HDFS-1522 at 3/4/15 2:35 AM: --

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-03-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347921#comment-14347921 ] Konstantin Shvachko commented on HDFS-7740: --- Yi, do you have any more context on

[jira] [Commented] (HDFS-1522) Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constant

2015-03-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347922#comment-14347922 ] Konstantin Shvachko commented on HDFS-1522: --- +1 on the patch. Test failure is unr

[jira] [Updated] (HDFS-1522) Merge Block.BLOCK_FILE_PREFIX and DataStorage.BLOCK_FILE_PREFIX into one constant

2015-03-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1522: -- Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.7.0

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349330#comment-14349330 ] Konstantin Shvachko commented on HDFS-7886: --- Some previous comments on this [see

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349571#comment-14349571 ] Konstantin Shvachko commented on HDFS-7886: --- I wouldn't rule out HDFS-7695 thoug

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350040#comment-14350040 ] Konstantin Shvachko commented on HDFS-7886: --- I don't think this fixed it. Jenkins

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350686#comment-14350686 ] Konstantin Shvachko commented on HDFS-7886: --- I traced the latest failure with Pla

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350718#comment-14350718 ] Konstantin Shvachko commented on HDFS-7886: --- Forgot to mention 3. We should keep

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351313#comment-14351313 ] Konstantin Shvachko commented on HDFS-7886: --- More things that we've been looking

[jira] [Commented] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

2015-03-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353837#comment-14353837 ] Konstantin Shvachko commented on HDFS-2605: --- Great that you looked at it, Allen.

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354404#comment-14354404 ] Konstantin Shvachko commented on HDFS-7903: --- Plamen, I cannot apply your patch. A

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354411#comment-14354411 ] Konstantin Shvachko commented on HDFS-7886: --- Yi, when DN restarts it sends a bloc

[jira] [Commented] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354413#comment-14354413 ] Konstantin Shvachko commented on HDFS-7007: --- It's been a while, so let me remind

[jira] [Commented] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-09 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354427#comment-14354427 ] Konstantin Shvachko commented on HDFS-7007: --- h3. Possible approaches # My origina

[jira] [Resolved] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-6940. --- Resolution: Won't Fix Fix Version/s: (was: 2.7.0) Closing as won't fix. Plea

[jira] [Commented] (HDFS-7903) Cannot recover block after truncate and delete snapshot

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355641#comment-14355641 ] Konstantin Shvachko commented on HDFS-7903: --- The fix looks good. # One nit to rep

[jira] [Commented] (HDFS-2605) CHANGES.txt has two "Release 0.21.1" sections

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355830#comment-14355830 ] Konstantin Shvachko commented on HDFS-2605: --- +1 Thanks. > CHANGES.txt has two "R

[jira] [Comment Edited] (HDFS-7007) Interfaces to plugin ConsensusNode.

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354427#comment-14354427 ] Konstantin Shvachko edited comment on HDFS-7007 at 3/10/15 11:37 PM:

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356032#comment-14356032 ] Konstantin Shvachko commented on HDFS-7886: --- Thanks for clarifying Yi, I see it n

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

2014-08-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105694#comment-14105694 ] Konstantin Shvachko commented on HDFS-6134: --- Guys, looks like you ignored javac c

[jira] [Commented] (HDFS-6938) Cleanup javac warnings in FSNamesystem.java

2014-08-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14109668#comment-14109668 ] Konstantin Shvachko commented on HDFS-6938: --- +1 looks good. > Cleanup javac warn

[jira] [Created] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-08-25 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-6940: - Summary: Initial refactoring to allow ConsensusNode implementation Key: HDFS-6940 URL: https://issues.apache.org/jira/browse/HDFS-6940 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-08-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-6940: -- Attachment: HDFS-6940.patch Here is the patch. Aaron, what are the reservations? > Init

[jira] [Commented] (HDFS-6469) Coordinated replication of the namespace using ConsensusNode

2014-08-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110057#comment-14110057 ] Konstantin Shvachko commented on HDFS-6469: --- Heads up on further actions. The ide

[jira] [Commented] (HDFS-6940) Initial refactoring to allow ConsensusNode implementation

2014-08-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110081#comment-14110081 ] Konstantin Shvachko commented on HDFS-6940: --- > I'd be much more comfortable with

<    1   2   3   4   5   6   7   8   9   10   >