[jira] Updated: (HDFS-645) Namenode does not leave safe mode even if all blocks are available

[ https://issues.apache.org/jira/browse/HDFS-645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-645: Status: Patch Available (was: Open) Namenode does not leave safe mode even if all blocks are available

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771012#action_12771012 ] Raghu Angadi commented on HDFS-732: --- 0.20 seems to be setting 'closed' to true inside a

[jira] Commented: (HDFS-706) Intermittent failures in TestFiHFlush

[ https://issues.apache.org/jira/browse/HDFS-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771013#action_12771013 ] Konstantin Boudnik commented on HDFS-706: - I assume you see this one as a result of

[jira] Updated: (HDFS-737) Improvement in metasave output

[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-737: -- Fix Version/s: 0.22.0 Status: Patch Available (was: Open) HDFS-737.2.patch

[jira] Commented: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771046#action_12771046 ] Tsz Wo (Nicholas), SZE commented on HDFS-691: - {code} //DFSClient.DFSInputStream

[jira] Commented: (HDFS-740) rm and rmr can accidently delete user's data

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771084#action_12771084 ] gary murry commented on HDFS-740: - Steps to Reproduce: 1) Make sure fs.trash.interval in

[jira] Created: (HDFS-740) rm and rmr can accidently delete user's data

rm and rmr can accidently delete user's data Key: HDFS-740 URL: https://issues.apache.org/jira/browse/HDFS-740 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.20.1

[jira] Commented: (HDFS-737) Improvement in metasave output

[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771085#action_12771085 ] Hadoop QA commented on HDFS-737: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771097#action_12771097 ] Christian Kunz commented on HDFS-732: - Hairong, of course, you are right in technical

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771100#action_12771100 ] Tsz Wo (Nicholas), SZE commented on HDFS-732: - But from our client application's

[jira] Updated: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-691: Attachment: h691_20091028.patch h691_20091028.patch: check limit before return. No

[jira] Updated: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-691: Status: Patch Available (was: Open) Limitation on java.io.InputStream.available()

[jira] Assigned: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao reassigned HDFS-611: --- Assignee: Zheng Shao (was: dhruba borthakur) Heartbeats times from Datanodes increase when there are

[jira] Updated: (HDFS-740) rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gary murry updated HDFS-740: Summary: rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are

[jira] Commented: (HDFS-222) Support for concatenating of files into a single file

[ https://issues.apache.org/jira/browse/HDFS-222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771110#action_12771110 ] Hairong Kuang commented on HDFS-222: +1 The patch looks good. Support for concatenating

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771113#action_12771113 ] dhruba borthakur commented on HDFS-732: --- If a DFSOutputStraem.close() returned error,

[jira] Updated: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-732: Component/s: (was: name-node) hdfs client Since HADOOP-4760 was

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771120#action_12771120 ] Hairong Kuang commented on HDFS-732: I do not think the change made in HADOOP-4760 was

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.branch-19.patch This patch adds a new class BlockFileDeleter, which delete block files

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771133#action_12771133 ] Tsz Wo (Nicholas), SZE commented on HDFS-732: - This idea actually was

[jira] Updated: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-732: Attachment: h732_20091028_0.20.patch h732_20091028_0.20.patch: fix 0.20 by the codes

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.trunk.patch Heartbeats times from Datanodes increase when there are plenty of blocks

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.branch-20.patch Heartbeats times from Datanodes increase when there are plenty of

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771153#action_12771153 ] Zheng Shao commented on HDFS-611: - Tested on a 4-node hadoop-0.19 cluster. We are able to

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Fix Version/s: 0.22.0 0.21.0 0.20.2 Affects Version/s:

[jira] Commented: (HDFS-740) rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771156#action_12771156 ] Robert Chansler commented on HDFS-740: -- Duplicate of HDFS-677? rm and rmr fail to

[jira] Updated: (HDFS-736) commitBlockSynchronization() should directly update block GS and length.

[ https://issues.apache.org/jira/browse/HDFS-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-736: - Attachment: commitBlockSync.patch This patch updates the block in place.

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771163#action_12771163 ] dhruba borthakur commented on HDFS-611: --- I looked at the version for trunk. The call

[jira] Updated: (HDFS-736) commitBlockSynchronization() should directly update block GS and length.

[ https://issues.apache.org/jira/browse/HDFS-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-736: - Status: Patch Available (was: Open) commitBlockSynchronization() should directly update

[jira] Commented: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771166#action_12771166 ] Suresh Srinivas commented on HDFS-691: -- +1 for the patch. Limitation on

[jira] Commented: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771177#action_12771177 ] Hadoop QA commented on HDFS-691: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-740) rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771180#action_12771180 ] gary murry commented on HDFS-740: - Yea, I think Rob is right. It turns out the build I am

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771181#action_12771181 ] Zheng Shao commented on HDFS-611: - There are 3 approaches: A1. Decrement the dfs usage when

[jira] Commented: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771186#action_12771186 ] Hadoop QA commented on HDFS-691: -1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771193#action_12771193 ] Tsz Wo (Nicholas), SZE commented on HDFS-691: - The failure of TestBlockReport was

[jira] Updated: (HDFS-691) Limitation on java.io.InputStream.available()

[ https://issues.apache.org/jira/browse/HDFS-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-691: Resolution: Fixed Fix Version/s: 0.22.0 0.21.0 Hadoop

[jira] Commented: (HDFS-521) Create new tests for pipeline

[ https://issues.apache.org/jira/browse/HDFS-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771197#action_12771197 ] Hairong Kuang commented on HDFS-521: 1. miss testcase pipeline-03. 2. for pipeline-04 and

[jira] Created: (HDFS-741) TestHFlush test doesn't seek() past previously written part of the file

TestHFlush test doesn't seek() past previously written part of the file --- Key: HDFS-741 URL: https://issues.apache.org/jira/browse/HDFS-741 Project: Hadoop HDFS Issue

[jira] Commented: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771207#action_12771207 ] Konstantin Shvachko commented on HDFS-611: -- # Do we still need to send a partial

[jira] Updated: (HDFS-737) Improvement in metasave output

[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-737: -- Status: Patch Available (was: Open) HDFS-737.3.patch is submitted. Improvement in

[jira] Updated: (HDFS-737) Improvement in metasave output

[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-737: -- Attachment: HDFS-737.3.patch Improvement in metasave output

[jira] Updated: (HDFS-741) TestHFlush test doesn't seek() past previously written part of the file

[ https://issues.apache.org/jira/browse/HDFS-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-741: Attachment: HDFS-741.patch This fixes the seek problem. However, two testcases (writing

[jira] Commented: (HDFS-740) rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771213#action_12771213 ] gary murry commented on HDFS-740: - Actually, I take that back. Turns out my code did have

[jira] Commented: (HDFS-741) TestHFlush test doesn't seek() past previously written part of the file

[ https://issues.apache.org/jira/browse/HDFS-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771216#action_12771216 ] Hairong Kuang commented on HDFS-741: Cos, could you please try verifying the whole file

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771218#action_12771218 ] Hairong Kuang commented on HDFS-732: +1. The patch looks good. HDFS files are ending up

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771221#action_12771221 ] dhruba borthakur commented on HDFS-732: --- Hi nicholas, can we put this patch in 0.20.3

[jira] Commented: (HDFS-740) rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771222#action_12771222 ] Jakob Homan commented on HDFS-740: -- It looks like Gary did his test slightly differently: in

[jira] Created: (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list Key: HDFS-742 URL: https://issues.apache.org/jira/browse/HDFS-742

[jira] Commented: (HDFS-645) Namenode does not leave safe mode even if all blocks are available

[ https://issues.apache.org/jira/browse/HDFS-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771224#action_12771224 ] Konstantin Shvachko commented on HDFS-645: -- Zheng, could you please explain what

[jira] Commented: (HDFS-735) TestReadWhileWriting has wrong line termination symbols

[ https://issues.apache.org/jira/browse/HDFS-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771239#action_12771239 ] Hudson commented on HDFS-735: - Integrated in Hdfs-Patch-h2.grid.sp2.yahoo.net #65 (See

[jira] Commented: (HDFS-736) commitBlockSynchronization() should directly update block GS and length.

[ https://issues.apache.org/jira/browse/HDFS-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771238#action_12771238 ] Hadoop QA commented on HDFS-736: +1 overall. Here are the results of testing the latest

[jira] Commented: (HDFS-740) rm and rmr fail to correctly move the user's files to the trash prior to deleting when they are over quota.

[ https://issues.apache.org/jira/browse/HDFS-740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771252#action_12771252 ] Jakob Homan commented on HDFS-740: -- A quick instrumentation of code and Gary able to prove

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Attachment: HDFS-611.trunk.v2.patch Heartbeats times from Datanodes increase when there are plenty of

[jira] Updated: (HDFS-741) TestHFlush test doesn't seek() past previously written part of the file

[ https://issues.apache.org/jira/browse/HDFS-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Boudnik updated HDFS-741: Attachment: HDFS-741.patch With this one it is much more apparent that {{seek()}} is

[jira] Commented: (HDFS-727) bug setting block size hdfsOpenFile

[ https://issues.apache.org/jira/browse/HDFS-727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771264#action_12771264 ] Eli Collins commented on HDFS-727: -- hdfs_test doesn't catch this, I confirmed hdfsOpenFile

[jira] Commented: (HDFS-737) Improvement in metasave output

[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771265#action_12771265 ] Hadoop QA commented on HDFS-737: -1 overall. Here are the results of testing the latest

[jira] Updated: (HDFS-611) Heartbeats times from Datanodes increase when there are plenty of blocks to delete

[ https://issues.apache.org/jira/browse/HDFS-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HDFS-611: Status: Patch Available (was: Open) Heartbeats times from Datanodes increase when there are plenty of