[jira] [Commented] (HDFS-119) logSync() may block NameNode forever.

2012-04-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13260101#comment-13260101 ] Konstantin Shvachko commented on HDFS-119: -- +1 patch for branch1.0 looks good,

[jira] [Created] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-04 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-3368: - Summary: Missing blocks due to bad DataNodes comming up and down. Key: HDFS-3368 URL: https://issues.apache.org/jira/browse/HDFS-3368 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Description: All replicas of a block can be removed if bad DataNodes come up and

[jira] [Issue Comment Edited] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13268191#comment-13268191 ] Konstantin Shvachko edited comment on HDFS-3368 at 5/4/12 8:20 AM:

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Attachment: blockDeletePolicy.patch I am working on a unit test. This is for a preview

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Attachment: blockDeletePolicy.patch I end up using 4 as a multiplier for

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Attachment: blockDeletePolicy-0.22.patch Missing blocks due to bad DataNodes

[jira] [Updated] (HDFS-3368) Missing blocks due to bad DataNodes comming up and down.

2012-05-10 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3368: -- Target Version/s: 0.22.1, 2.0.0, 3.0.0 (was: 3.0.0, 2.0.0, 0.22.1)

[jira] [Assigned] (HDFS-3981) access time is set without holding writelock in FSNamesystem

2012-09-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko reassigned HDFS-3981: - Assignee: Xiaobo Peng access time is set without holding writelock in

[jira] [Updated] (HDFS-3981) access time is set without holding writelock in FSNamesystem

2012-09-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3981: -- Description: Incorrect condition in {{FSNamesystem.getBlockLocatoins()}} can lead

[jira] [Commented] (HDFS-3981) access time is set without holding writelock in FSNamesystem

2012-09-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13464506#comment-13464506 ] Konstantin Shvachko commented on HDFS-3981: --- If now inode.getAccessTime() +

[jira] [Commented] (HDFS-3981) access time is set without holding writelock in FSNamesystem

2012-09-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13464515#comment-13464515 ] Konstantin Shvachko commented on HDFS-3981: --- Xiaobo, you are right this seems to

[jira] [Commented] (HDFS-2064) Warm HA NameNode going Hot

2012-10-17 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13478637#comment-13478637 ] Konstantin Shvachko commented on HDFS-2064: --- I think this jira still makes sense.

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486679#comment-13486679 ] Konstantin Shvachko commented on HDFS-3960: --- Would it be useful to pass file

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486689#comment-13486689 ] Konstantin Shvachko commented on HDFS-2802: --- What if we think about snapshots in

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13486723#comment-13486723 ] Konstantin Shvachko commented on HDFS-4114: --- Yes I do use BackupNode. -1 on this

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13487023#comment-13487023 ] Konstantin Shvachko commented on HDFS-2802: --- By rolling version on demand I just

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13487033#comment-13487033 ] Konstantin Shvachko commented on HDFS-3960: --- The document proposes to add new

[jira] [Commented] (HDFS-3960) Snapshot of Being Written Files

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13487085#comment-13487085 ] Konstantin Shvachko commented on HDFS-3960: --- More strongly I consider it a bug

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13487547#comment-13487547 ] Konstantin Shvachko commented on HDFS-2802: --- I propose to divide this discussion

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-10-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13488112#comment-13488112 ] Konstantin Shvachko commented on HDFS-2802: --- After looking at many other file

[jira] [Commented] (HDFS-4114) Remove the CheckpointNode

2012-11-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489318#comment-13489318 ] Konstantin Shvachko commented on HDFS-4114: --- I'll re-purpose this jira to just

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-11-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489599#comment-13489599 ] Konstantin Shvachko commented on HDFS-2802: --- Sure date+timestamp sounds good as

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-11-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489632#comment-13489632 ] Konstantin Shvachko commented on HDFS-2802: --- Agreed s is taken. Let's pick

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-11-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489643#comment-13489643 ] Konstantin Shvachko commented on HDFS-2802: --- Thanks for posting meeting notes.

[jira] [Comment Edited] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-11-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13489643#comment-13489643 ] Konstantin Shvachko edited comment on HDFS-2802 at 11/2/12 6:49 PM:

[jira] [Commented] (HDFS-4114) Deprecate the BackupNode and CheckpointNode in 2.0

2012-11-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13490406#comment-13490406 ] Konstantin Shvachko commented on HDFS-4114: --- Your argument about efficiency

[jira] [Commented] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13490865#comment-13490865 ] Konstantin Shvachko commented on HDFS-4138: --- Kihwal, this is not deterministic,

[jira] [Updated] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4138: -- Attachment: hdfs-4138.patch Kihwal, your analysis of the problem is absolutely correct.

[jira] [Commented] (HDFS-4114) Deprecate the BackupNode and CheckpointNode in 2.0

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13491297#comment-13491297 ] Konstantin Shvachko commented on HDFS-4114: --- The BackupNode hasn't been touched

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13491307#comment-13491307 ] Konstantin Shvachko commented on HDFS-2802: --- We still need to solve 2 API

[jira] [Updated] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4138: -- Attachment: hdfs-4138.patch BackupNode startup fails due to uninitialized edit log

[jira] [Commented] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13491929#comment-13491929 ] Konstantin Shvachko commented on HDFS-4138: --- I am on trunk, so don't need to

[jira] [Commented] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13492168#comment-13492168 ] Konstantin Shvachko commented on HDFS-4138: --- After examining more the current

[jira] [Updated] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-06 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4138: -- Attachment: (was: hdfs-4138.patch) BackupNode startup fails due to

[jira] [Commented] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13492519#comment-13492519 ] Konstantin Shvachko commented on HDFS-4138: --- +1. Looks good. Targeting this

[jira] [Commented] (HDFS-4138) BackupNode startup fails due to uninitialized edit log

2012-11-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13492634#comment-13492634 ] Konstantin Shvachko commented on HDFS-4138: --- I committed this to trunk and

[jira] [Updated] (HDFS-2064) Warm HA NameNode going Hot

2012-11-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-2064: -- Attachment: failover-v-0.22.patch Latest patch for branch 0.22. The previous one got

[jira] [Created] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-12 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4179: - Summary: BackupNode: allow reads, fix checkpointing, safeMode Key: HDFS-4179 URL: https://issues.apache.org/jira/browse/HDFS-4179 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4179: -- Attachment: BNAllowReads.patch The patch - makes BN accept read commands, but not CN.

[jira] [Updated] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4179: -- Status: Patch Available (was: Open) BackupNode: allow reads, fix checkpointing,

[jira] [Commented] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13496688#comment-13496688 ] Konstantin Shvachko commented on HDFS-4179: --- Could anybody please review this.

[jira] [Commented] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13498989#comment-13498989 ] Konstantin Shvachko commented on HDFS-4179: --- I plan to commit this over weekend

[jira] [Commented] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499045#comment-13499045 ] Konstantin Shvachko commented on HDFS-4179: --- You were complaining that I am not

[jira] [Commented] (HDFS-4179) BackupNode: allow reads, fix checkpointing, safeMode

2012-11-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13499327#comment-13499327 ] Konstantin Shvachko commented on HDFS-4179: --- I was complaining that the general

[jira] [Commented] (HDFS-4114) Deprecate the BackupNode and CheckpointNode in 2.0

2012-11-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13502283#comment-13502283 ] Konstantin Shvachko commented on HDFS-4114: --- Yes. Please forward them my way.

[jira] [Commented] (HDFS-2802) Support for RW/RO snapshots in HDFS

2012-11-21 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13502633#comment-13502633 ] Konstantin Shvachko commented on HDFS-2802: --- Should we introduce the notion of

[jira] [Commented] (HDFS-4114) Deprecate the BackupNode and CheckpointNode in 2.0

2012-11-22 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13502693#comment-13502693 ] Konstantin Shvachko commented on HDFS-4114: --- Does it make sense to refactor BN

[jira] [Created] (HDFS-4231) Introduce HAState for BackupNode

2012-11-28 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4231: - Summary: Introduce HAState for BackupNode Key: HDFS-4231 URL: https://issues.apache.org/jira/browse/HDFS-4231 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4231) Introduce HAState for BackupNode

2012-11-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13505720#comment-13505720 ] Konstantin Shvachko commented on HDFS-4231: --- BackupNode already has BNHAContext.

[jira] [Updated] (HDFS-4231) Introduce HAState for BackupNode

2012-11-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4231: -- Attachment: BNHAState.patch With this patch I managed to configure DNs connecting to NN

[jira] [Updated] (HDFS-4231) Introduce HAState for BackupNode

2012-11-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4231: -- Status: Patch Available (was: Open) Introduce HAState for BackupNode

[jira] [Updated] (HDFS-4231) Introduce HAState for BackupNode

2012-11-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4231: -- Attachment: BNHAState.patch Fixing failed tests. Introduce HAState

[jira] [Updated] (HDFS-4231) Introduce HAState for BackupNode

2012-12-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4231: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4258) Rename of Being Written Files

2012-12-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13508468#comment-13508468 ] Konstantin Shvachko commented on HDFS-4258: --- Adding INode IDs seems like a very

[jira] [Created] (HDFS-4268) Remove redundant enum NNHAStatusHeartbeat.State

2012-12-04 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4268: - Summary: Remove redundant enum NNHAStatusHeartbeat.State Key: HDFS-4268 URL: https://issues.apache.org/jira/browse/HDFS-4268 Project: Hadoop HDFS

[jira] [Updated] (HDFS-4268) Remove redundant enum NNHAStatusHeartbeat.State

2012-12-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4268: -- Assignee: Konstantin Shvachko Status: Patch Available (was: Open) Remove

[jira] [Updated] (HDFS-4268) Remove redundant enum NNHAStatusHeartbeat.State

2012-12-04 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4268: -- Attachment: heartbeatHAState.patch The patch removes NNHAStatusHeartbeat.State and

[jira] [Updated] (HDFS-4268) Remove redundant enum NNHAStatusHeartbeat.State

2012-12-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4268: -- Attachment: heartbeatHAState.patch Fixed NPE in TestSaveNamespace. And added missing

[jira] [Updated] (HDFS-4268) Remove redundant enum NNHAStatusHeartbeat.State

2012-12-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4268: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3598) WebHDFS: support file concat

2012-12-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530516#comment-13530516 ] Konstantin Shvachko commented on HDFS-3598: --- I think we should add concat() to

[jira] [Commented] (HDFS-4305) Add a configurable limit on number of blocks per file, and min block size

2012-12-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13530538#comment-13530538 ] Konstantin Shvachko commented on HDFS-4305: --- Was it OP_ADD or OP_UPDATE_BLOCKS?

[jira] [Created] (HDFS-4308) addBlock() should persist file blocks once

2012-12-12 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4308: - Summary: addBlock() should persist file blocks once Key: HDFS-4308 URL: https://issues.apache.org/jira/browse/HDFS-4308 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540313#comment-13540313 ] Konstantin Shvachko commented on HDFS-4334: --- Hey guys. This is really great. I

[jira] [Commented] (HDFS-4334) Add a unique id to each INode

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540555#comment-13540555 ] Konstantin Shvachko commented on HDFS-4334: --- I feel the same way. Just have

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540619#comment-13540619 ] Konstantin Shvachko commented on HDFS-4308: --- Right, {{dir.removeBlock()}} is

[jira] [Created] (HDFS-4347) TestBackupNode can go into infinite loop Waiting checkpoint to complete.

2012-12-28 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4347: - Summary: TestBackupNode can go into infinite loop Waiting checkpoint to complete. Key: HDFS-4347 URL: https://issues.apache.org/jira/browse/HDFS-4347

[jira] [Commented] (HDFS-4347) TestBackupNode can go into infinite loop Waiting checkpoint to complete.

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540651#comment-13540651 ] Konstantin Shvachko commented on HDFS-4347: --- In the case {{waitCheckpointDone()}}

[jira] [Commented] (HDFS-4347) TestBackupNode can go into infinite loop Waiting checkpoint to complete.

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540669#comment-13540669 ] Konstantin Shvachko commented on HDFS-4347: --- Yup. +1 from me. See what Jenkins

[jira] [Commented] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13540751#comment-13540751 ] Konstantin Shvachko commented on HDFS-4308: --- +1 addBlock()

[jira] [Updated] (HDFS-4308) addBlock() should persist file blocks once

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4308: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-4347) TestBackupNode can go into infinite loop Waiting checkpoint to complete.

2012-12-28 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4347: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed

[jira] [Created] (HDFS-4349) Test reading files from BackupNode

2012-12-31 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4349: - Summary: Test reading files from BackupNode Key: HDFS-4349 URL: https://issues.apache.org/jira/browse/HDFS-4349 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-4349) Test reading files from BackupNode

2012-12-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4349: -- Attachment: BNCanRead.patch This is a simple test that starts NameNode, BackupNode, and

[jira] [Updated] (HDFS-4349) Test reading files from BackupNode

2012-12-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4349: -- Attachment: BNCanRead-branch2.patch And a version for branch-2. Had to use another

[jira] [Updated] (HDFS-4349) Test reading files from BackupNode

2012-12-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4349: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Release Note: I just committed

[jira] [Updated] (HDFS-4349) Test reading files from BackupNode

2012-12-31 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4349: -- Release Note: (was: I just committed this.) I just committed this.

[jira] [Created] (HDFS-4370) Fix typo Blanacer in DataNode

2013-01-08 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4370: - Summary: Fix typo Blanacer in DataNode Key: HDFS-4370 URL: https://issues.apache.org/jira/browse/HDFS-4370 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4391) TestDataTransferKeepalive fails when tests are executed in a certain order.

2013-01-11 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4391: - Summary: TestDataTransferKeepalive fails when tests are executed in a certain order. Key: HDFS-4391 URL: https://issues.apache.org/jira/browse/HDFS-4391

[jira] [Commented] (HDFS-4391) TestDataTransferKeepalive fails when tests are executed in a certain order.

2013-01-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551741#comment-13551741 ] Konstantin Shvachko commented on HDFS-4391: --- JUnit does not guarantee the order

[jira] [Commented] (HDFS-1245) Plugable block id generation

2013-01-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13551757#comment-13551757 ] Konstantin Shvachko commented on HDFS-1245: --- I would like to resurrect this jira.

[jira] [Updated] (HDFS-1245) Plugable block id generation

2013-01-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1245: -- Attachment: blockIdGenerator.patch Here is the patch that introduces

[jira] [Updated] (HDFS-1245) Plugable block id generation

2013-01-11 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1245: -- Assignee: Konstantin Shvachko (was: Dmytro Molkov) Target Version/s:

[jira] [Commented] (HDFS-1245) Plugable block id generation

2013-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552062#comment-13552062 ] Konstantin Shvachko commented on HDFS-1245: --- Yeh, all versions are affected, so

[jira] [Commented] (HDFS-4391) TestDataTransferKeepalive fails when tests are executed in a certain order.

2013-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552076#comment-13552076 ] Konstantin Shvachko commented on HDFS-4391: --- Yep, that's how I found it in the

[jira] [Updated] (HDFS-1245) Plugable block id generation

2013-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1245: -- Attachment: blockIdGenerator-branch2.patch Here is the patch for branch 2. Just

[jira] [Commented] (HDFS-1245) Plugable block id generation

2013-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13552116#comment-13552116 ] Konstantin Shvachko commented on HDFS-1245: --- This makes the block id generation

[jira] [Updated] (HDFS-1245) Plugable block id generation

2013-01-12 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-1245: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-3598) WebHDFS: support file concat

2013-01-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563153#comment-13563153 ] Konstantin Shvachko commented on HDFS-3598: --- Let me summarise the ideas expressed

[jira] [Commented] (HDFS-3598) WebHDFS: support file concat

2013-01-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13563303#comment-13563303 ] Konstantin Shvachko commented on HDFS-3598: --- YUIC. Agreed and therefore

[jira] [Created] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-01-29 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-4452: - Summary: getAdditionalBlock() can create multiple blocks if the client times out and retries. Key: HDFS-4452 URL: https://issues.apache.org/jira/browse/HDFS-4452

[jira] [Commented] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565738#comment-13565738 ] Konstantin Shvachko commented on HDFS-4452: --- A bit more details.

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Attachment: TestAddBlockRetry.java Here is a simple test I used to catch the race. You

[jira] [Commented] (HDFS-4212) NameNode can't differentiate between a never-created block and a block which is really missing

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565877#comment-13565877 ] Konstantin Shvachko commented on HDFS-4212: --- Brandon. The problem mentioned in

[jira] [Commented] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565891#comment-13565891 ] Konstantin Shvachko commented on HDFS-4452: --- Marked it critical. Saw it happening

[jira] [Commented] (HDFS-4212) NameNode can't differentiate between a never-created block and a block which is really missing

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13565925#comment-13565925 ] Konstantin Shvachko commented on HDFS-4212: --- Actually it is a problem related to

[jira] [Commented] (HDFS-3598) WebHDFS: support file concat

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566102#comment-13566102 ] Konstantin Shvachko commented on HDFS-3598: --- Plamen, looks good except a few nits

[jira] [Updated] (HDFS-3598) WebHDFS: support file concat

2013-01-29 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-3598: -- Resolution: Fixed Fix Version/s: (was: 3.0.0) Release Note: I just

[jira] [Commented] (HDFS-4212) NameNode can't differentiate between a never-created block and a block which is really missing

2013-01-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566815#comment-13566815 ] Konstantin Shvachko commented on HDFS-4212: --- Brandon I checked both issues. They

[jira] [Commented] (HDFS-3598) WebHDFS: support file concat

2013-01-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13566869#comment-13566869 ] Konstantin Shvachko commented on HDFS-3598: --- Alejandro, makes sense. I missed the

<    1   2   3   4   5   6   7   8   9   10   >