[jira] [Created] (HDFS-7902) Expose truncate API for libwebhdfs

2015-03-06 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7902: Summary: Expose truncate API for libwebhdfs Key: HDFS-7902 URL: https://issues.apache.org/jira/browse/HDFS-7902 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-7838) Expose truncate API for libhdfs

2015-03-06 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7838: - Attachment: HDFS-7838.002.patch Thanks Colin for review, update the patch to address your comments. {quote} Also,

[jira] [Commented] (HDFS-7844) Create an off-heap hash table implementation

2015-03-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350062#comment-14350062 ] Yi Liu commented on HDFS-7844: -- Thanks [~cmccabe] for the nice work, it's cool and pretty good

[jira] [Commented] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350064#comment-14350064 ] Yi Liu commented on HDFS-7886: -- Thanks Plamen for working on it. We should trigger block

[jira] [Created] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-04 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7886: Summary: TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes Key: HDFS-7886 URL: https://issues.apache.org/jira/browse/HDFS-7886 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-7886) TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

2015-03-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7886: Assignee: Yi Liu TestFileTruncate#testTruncateWithDataNodesRestart runs timeout sometimes

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-03-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347939#comment-14347939 ] Yi Liu commented on HDFS-7740: -- I create HDFS-7886, thanks. Test truncate with DataNodes

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-03-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14347934#comment-14347934 ] Yi Liu commented on HDFS-7740: -- [~shv], let's create a JIRA to track it. Test truncate with

[jira] [Updated] (HDFS-7838) Expose truncate API for libhdfs

2015-03-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7838: - Status: Patch Available (was: Open) Expose truncate API for libhdfs ---

[jira] [Updated] (HDFS-7838) Expose truncate API for libhdfs

2015-03-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7838: - Attachment: HDFS-7838.001.patch Expose truncate API for libhdfs ---

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344735#comment-14344735 ] Yi Liu commented on HDFS-7836: -- Good proposal, Colin and Charles. {quote} Reduce lock

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-03-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344742#comment-14344742 ] Yi Liu commented on HDFS-7836: -- {quote} Charles Lamb is going to be around on 3/10, 3/11, and

[jira] [Updated] (HDFS-7371) Loading predefined EC schemas from configuration

2015-03-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7371: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) Loading predefined EC schemas from

[jira] [Commented] (HDFS-7871) NameNodeEditLogRoller can keep printing Swallowing exception message

2015-03-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344207#comment-14344207 ] Yi Liu commented on HDFS-7871: -- +1, make sense. NameNodeEditLogRoller can keep printing

[jira] [Comment Edited] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14339006#comment-14339006 ] Yi Liu edited comment on HDFS-7285 at 2/28/15 1:36 AM: --- We had

[jira] [Updated] (HDFS-7699) Erasure Codec API covering the essential aspects for an erasure code

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7699: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) Erasure Codec API covering the essential

[jira] [Updated] (HDFS-7662) Erasure Coder API for encoding and decoding of block group

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7662: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) Erasure Coder API for encoding and

[jira] [Updated] (HDFS-7664) Reed-Solomon ErasureCoder

2015-02-27 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7664: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7285) Reed-Solomon ErasureCoder

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337559#comment-14337559 ] Yi Liu commented on HDFS-7740: -- Sure, let me take a look. Test truncate with DataNodes

[jira] [Comment Edited] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337715#comment-14337715 ] Yi Liu edited comment on HDFS-7740 at 2/26/15 2:21 AM: --- Seems it's

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-25 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337715#comment-14337715 ] Yi Liu commented on HDFS-7740: -- Seems it's not the same reason as HDFS-7695 where NN restarts

[jira] [Created] (HDFS-7838) Expose truncate API for libhdfs

2015-02-24 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7838: Summary: Expose truncate API for libhdfs Key: HDFS-7838 URL: https://issues.apache.org/jira/browse/HDFS-7838 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions:

[jira] [Commented] (HDFS-7495) Remove updatePosition argument from DFSInputStream#getBlockAt()

2015-02-24 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335809#comment-14335809 ] Yi Liu commented on HDFS-7495: -- Good catch. +1 for the latest patch. Thanks Ted and Colin.

[jira] [Comment Edited] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328679#comment-14328679 ] Yi Liu edited comment on HDFS-7740 at 2/20/15 8:35 AM: --- Thanks [~shv]

[jira] [Comment Edited] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328679#comment-14328679 ] Yi Liu edited comment on HDFS-7740 at 2/20/15 8:47 AM: --- Thanks [~shv]

[jira] [Updated] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7740: - Attachment: HDFS-7740.002.patch [~shv], since we use 3 datanodes in {{TestFileTruncate}}, how about we still keep

[jira] [Comment Edited] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328679#comment-14328679 ] Yi Liu edited comment on HDFS-7740 at 2/20/15 9:14 AM: --- Thanks [~shv]

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328679#comment-14328679 ] Yi Liu commented on HDFS-7740: -- Thanks [~shv] for your comments. I will address them later,

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14330055#comment-14330055 ] Yi Liu commented on HDFS-7740: -- Thanks [~shv] for you review, your suggestion about

[jira] [Updated] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7740: - Attachment: HDFS-7740.003.patch Test truncate with DataNodes restarting ---

[jira] [Updated] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-20 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7740: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Update the patch

[jira] [Updated] (HDFS-7656) Expose truncate API for HDFS httpfs

2015-02-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7656: - Resolution: Fixed Fix Version/s: (was: 3.0.0) 2.7.0 Target Version/s:

[jira] [Updated] (HDFS-7656) Expose truncate API for HDFS httpfs

2015-02-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7656: - Attachment: HDFS-7656.001.patch Expose truncate API for HDFS httpfs ---

[jira] [Updated] (HDFS-7656) Expose truncate API for HDFS httpfs

2015-02-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7656: - Status: Patch Available (was: Open) Expose truncate API for HDFS httpfs ---

[jira] [Updated] (HDFS-7798) Checkpointing failure caused by shared KerberosAuthenticator

2015-02-17 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7798: - Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7740: - Attachment: HDFS-7740.001.patch Test truncate with DataNodes restarting ---

[jira] [Updated] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7740: - Status: Patch Available (was: Open) Test truncate with DataNodes restarting

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323712#comment-14323712 ] Yi Liu commented on HDFS-7740: -- Sorry for the late update. Add tests for the above 4

[jira] [Comment Edited] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14323712#comment-14323712 ] Yi Liu edited comment on HDFS-7740 at 2/17/15 6:32 AM: --- Sorry for the

[jira] [Commented] (HDFS-7798) Checkpointing failure caused by shared KerberosAuthenticator

2015-02-15 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14322279#comment-14322279 ] Yi Liu commented on HDFS-7798: -- Yes, {{KerberosAuthenticator}} is not thread-safe, we need to

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317360#comment-14317360 ] Yi Liu commented on HDFS-7761: -- Thanks [~arpitagarwal] for taking a look. {quote} I did take

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317300#comment-14317300 ] Yi Liu commented on HDFS-7761: -- Hi [~arpitagarwal], would you like to help review? Since you

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317561#comment-14317561 ] Yi Liu commented on HDFS-7694: -- +1 pending Jenkins. Thanks Colin. FSDataInputStream should

[jira] [Commented] (HDFS-7760) Further update user doc for truncate

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316139#comment-14316139 ] Yi Liu commented on HDFS-7760: -- +1, Thanks [~shv] Further update user doc for truncate

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-11 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317545#comment-14317545 ] Yi Liu commented on HDFS-7761: -- Thanks [~arpitagarwal] for the review, will commit it shortly.

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14314226#comment-14314226 ] Yi Liu commented on HDFS-7647: -- Sorry for coming late, I took a look at this patch again when

[jira] [Commented] (HDFS-7760) Further update user doc for truncate

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315257#comment-14315257 ] Yi Liu commented on HDFS-7760: -- Sure, thanks [~shv]. The patch looks good, just one comment:

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7760: - Assignee: Konstantin Shvachko (was: Yi Liu) Further update user doc for truncate

[jira] [Commented] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315310#comment-14315310 ] Yi Liu commented on HDFS-7761: -- The test timeout is unrelated, it can pass in my local

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315334#comment-14315334 ] Yi Liu commented on HDFS-7694: -- The latest patch looks good to me, thanks Colin. One comment:

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Attachment: HDFS-7761.002.patch The patch 001 has some issue, update the patch to fix it. In HDFS-7647, no need

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-10 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Description: # The usage of following two variables is unnecessary. We can remove them to make code a bit brief.

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Description: The usage of following two variables is unnecessary. We can remove them to make code a bit brief.

[jira] [Created] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-09 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7761: Summary: cleanup unnecssary code logic in LocatedBlock Key: HDFS-7761 URL: https://issues.apache.org/jira/browse/HDFS-7761 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

2015-02-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313419#comment-14313419 ] Yi Liu commented on HDFS-7756: -- The findbugs is not related, will commit it later. Thanks Ted

[jira] [Created] (HDFS-7760) Further update user doc for truncate

2015-02-09 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7760: Summary: Further update user doc for truncate Key: HDFS-7760 URL: https://issues.apache.org/jira/browse/HDFS-7760 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-7760) Further update user doc for truncate

2015-02-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7760: - Fix Version/s: (was: 2.7.0) Further update user doc for truncate

[jira] [Updated] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

2015-02-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7756: - Issue Type: Bug (was: Task) Restore method signature for LocatedBlock#getLocations()

[jira] [Updated] (HDFS-7756) Restore method signature for LocatedBlock#getLocations()

2015-02-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7756: - Resolution: Fixed Fix Version/s: 2.7.0 Target Version/s: 2.7.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-7761) cleanup unnecssary code logic in LocatedBlock

2015-02-09 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7761: - Status: Patch Available (was: Open) cleanup unnecssary code logic in LocatedBlock

[jira] [Assigned] (HDFS-7747) Add a truncate test with cached data

2015-02-07 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7747: Assignee: Yi Liu Add a truncate test with cached data -

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306803#comment-14306803 ] Yi Liu commented on HDFS-7698: -- Thanks Colin for the patch. It looks good to me, just few

[jira] [Commented] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308737#comment-14308737 ] Yi Liu commented on HDFS-7740: -- I will update the patch to cover these test scenarios, thanks

[jira] [Commented] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308768#comment-14308768 ] Yi Liu commented on HDFS-7741: -- Thanks Colin for review. Remove unnecessary synchronized in

[jira] [Updated] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7741: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Attachment: (was: HDFS-7655.003.patch) Expose truncate API for Web HDFS

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Attachment: HDFS-7655.003.patch Expose truncate API for Web HDFS

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Attachment: HDFS-7655.003.patch Update the patch Expose truncate API for Web HDFS

[jira] [Comment Edited] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14307245#comment-14307245 ] Yi Liu edited comment on HDFS-7655 at 2/5/15 2:20 PM: -- Update the

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Attachment: HDFS-7655.004.patch Update the patch to break the line. The test failures are not related, will

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308332#comment-14308332 ] Yi Liu commented on HDFS-7698: -- +1, Thanks Colin for updating the patch. Fix locking on HDFS

[jira] [Updated] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7655: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7698: - Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Assigned] (HDFS-7740) Test truncate with DataNodes restarting

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7740: Assignee: Yi Liu Test truncate with DataNodes restarting ---

[jira] [Created] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-05 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7741: Summary: Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream Key: HDFS-7741 URL: https://issues.apache.org/jira/browse/HDFS-7741 Project: Hadoop HDFS

[jira] [Commented] (HDFS-7698) Fix locking on HDFS read statistics and add a method for clearing them.

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308414#comment-14308414 ] Yi Liu commented on HDFS-7698: -- Hi Colin, I find the {{synchronized}} for

[jira] [Updated] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7741: - Status: Patch Available (was: Open) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

[jira] [Updated] (HDFS-7741) Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7741: - Attachment: HDFS-7741.001.patch Remove unnecessary synchronized in FSDataInputStream and HdfsDataInputStream

[jira] [Commented] (HDFS-7694) FSDataInputStream should support unbuffer

2015-02-05 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308531#comment-14308531 ] Yi Liu commented on HDFS-7694: -- Hi Colin, could you please re-base the patch? One question, in

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306295#comment-14306295 ] Yi Liu commented on HDFS-7734: -- Thanks for Andrew, Kihwal and Arpit 's reviews and comments.

[jira] [Commented] (HDFS-7655) Expose truncate API for Web HDFS

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306302#comment-14306302 ] Yi Liu commented on HDFS-7655: -- Thanks [~shv] for review too. Will update the patch to address

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306558#comment-14306558 ] Yi Liu commented on HDFS-7738: -- I notice the patch distinguishes recover lease exception

[jira] [Updated] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7734: - Attachment: HDFS-7734.002.patch Class cast exception in NameNode#main -

[jira] [Updated] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7734: - Attachment: (was: HDFS-7734.002.patch) Class cast exception in NameNode#main

[jira] [Updated] (HDFS-7734) Class cast exception in NameNode#main

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7734: - Attachment: HDFS-7734.002.patch Update the patch to keep methods in SignalLogger. Class cast exception in

[jira] [Comment Edited] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306558#comment-14306558 ] Yi Liu edited comment on HDFS-7738 at 2/5/15 3:12 AM: -- I notice the

[jira] [Commented] (HDFS-7738) Add more negative tests for truncate

2015-02-04 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306573#comment-14306573 ] Yi Liu commented on HDFS-7738: -- {quote} I rather keep this patch simple. Sounds good? {quote}

[jira] [Comment Edited] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304587#comment-14304587 ] Yi Liu edited comment on HDFS-7734 at 2/4/15 3:32 AM: -- I also just run

[jira] [Updated] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7734: - Attachment: HDFS-7734.001.patch Class cast exception in NameNode#main -

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304587#comment-14304587 ] Yi Liu commented on HDFS-7734: -- I also just run last hadoop trunk code for some tests and find

[jira] [Updated] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7734: - Status: Patch Available (was: Open) Class cast exception in NameNode#main -

[jira] [Commented] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304591#comment-14304591 ] Yi Liu commented on HDFS-7734: -- Attach the patch. {{LogAdapter}} is used internally, so I only

[jira] [Comment Edited] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14304591#comment-14304591 ] Yi Liu edited comment on HDFS-7734 at 2/4/15 3:31 AM: -- Attach the

[jira] [Assigned] (HDFS-7734) Class cast exception in NameNode#main

2015-02-03 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu reassigned HDFS-7734: Assignee: Yi Liu Class cast exception in NameNode#main -

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302550#comment-14302550 ] Yi Liu commented on HDFS-7285: -- {quote} The number of block groups is actually unrelated to

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302560#comment-14302560 ] Yi Liu commented on HDFS-7285: -- {quote} Small strip cell size for small files in a zone, and

[jira] [Comment Edited] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302550#comment-14302550 ] Yi Liu edited comment on HDFS-7285 at 2/3/15 12:37 AM: --- {quote} The

[jira] [Comment Edited] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302560#comment-14302560 ] Yi Liu edited comment on HDFS-7285 at 2/3/15 12:39 AM: --- {quote} Small

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-02-02 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14302598#comment-14302598 ] Yi Liu commented on HDFS-7285: -- {quote} Yes we have EC zones, each zone actually represents a

<    3   4   5   6   7   8   9   10   11   12   >