[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828509#action_12828509 ] Hudson commented on HDFS-927: - Integrated in Hadoop-Hdfs-trunk-Commit #183 (See [http://hudson.z

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828504#action_12828504 ] stack commented on HDFS-927: I applied the TRUNK patch. > DFSInputStream retries too many times

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828499#action_12828499 ] Todd Lipcon commented on HDFS-909: -- Failing tests in test-patch are hudson BS per usual > R

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828498#action_12828498 ] Hadoop QA commented on HDFS-909: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-939) libhdfs test is broken

[ https://issues.apache.org/jira/browse/HDFS-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828445#action_12828445 ] Hadoop QA commented on HDFS-939: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-907) Add tests for getBlockLocations and totalLoad metrics.

[ https://issues.apache.org/jira/browse/HDFS-907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828442#action_12828442 ] Hadoop QA commented on HDFS-907: -1 overall. Here are the results of testing the latest atta

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Status: Open (was: Patch Available) > Race condition between rollEditLog or rollFSImage ant FSEditsLog.wri

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Status: Patch Available (was: Open) > Race condition between rollEditLog or rollFSImage ant FSEditsLog.wri

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Attachment: hdfs-909.txt This patch adds a unit test for saveNamespace concurrent with edit ops. There is

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828428#action_12828428 ] Todd Lipcon commented on HDFS-909: -- bq. May be we should synchronize on the EditLogFileOutpu

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828426#action_12828426 ] Konstantin Shvachko commented on HDFS-909: -- Todd: I agree the patch fixes this parti

[jira] Created: (HDFS-940) libhdfs test uses UnixUserGroupInformation

libhdfs test uses UnixUserGroupInformation -- Key: HDFS-940 URL: https://issues.apache.org/jira/browse/HDFS-940 Project: Hadoop HDFS Issue Type: Bug Components: contrib/libhdfs Re

[jira] Updated: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-927: - Attachment: hdfs-927-branch-0.21.txt Patch for branch-0.21. I haven't run this one through the full suite o

[jira] Updated: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-927: - Attachment: hdfs-927-branch0.20.txt Here's a branch-0.20 patch (nee hdfs-127-branch20-redone-v2.txt from HD

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828399#action_12828399 ] Todd Lipcon commented on HDFS-909: -- Konstantin: I think it's pretty much the same race. The

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828398#action_12828398 ] Tsz Wo (Nicholas), SZE commented on HDFS-927: - Same for me. +1 on the patch. >

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828394#action_12828394 ] Konstantin Shvachko commented on HDFS-909: -- Cosmin, thanks for reporting and investi

[jira] Commented: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828393#action_12828393 ] Hadoop QA commented on HDFS-938: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828391#action_12828391 ] stack commented on HDFS-927: .bq This would only be the case if you spanned all three blocks with

[jira] Updated: (HDFS-939) libhdfs test is broken

[ https://issues.apache.org/jira/browse/HDFS-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-939: - Status: Patch Available (was: Open) > libhdfs test is broken > -- > >

[jira] Created: (HDFS-939) libhdfs test is broken

libhdfs test is broken -- Key: HDFS-939 URL: https://issues.apache.org/jira/browse/HDFS-939 Project: Hadoop HDFS Issue Type: Bug Components: contrib/libhdfs Reporter: Eli Collins Assignee

[jira] Updated: (HDFS-939) libhdfs test is broken

[ https://issues.apache.org/jira/browse/HDFS-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-939: - Attachment: hdfs-939-1.patch Patch attached. The test itself fails due to libhdfs using UnixUserGroupInfor

[jira] Updated: (HDFS-907) Add tests for getBlockLocations and totalLoad metrics.

[ https://issues.apache.org/jira/browse/HDFS-907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari updated HDFS-907: -- Status: Patch Available (was: Open) > Add tests for getBlockLocations and totalLoad metrics. > ---

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-938: Hadoop Flags: [Reviewed] +1 This patch does replace calls to getUserName() to getShortUserName() >

[jira] Updated: (HDFS-933) Add createIdentifier() implementation to DelegationTokenSecretManager

[ https://issues.apache.org/jira/browse/HDFS-933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang updated HDFS-933: --- Attachment: h6419-09.patch attaching a new patch that matches the latest Common changes. > Add createIdentifie

[jira] Commented: (HDFS-245) Create symbolic links in HDFS

[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828332#action_12828332 ] Hairong Kuang commented on HDFS-245: Eli, great work! A couple of more comments: 1. INode

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828326#action_12828326 ] Todd Lipcon commented on HDFS-927: -- bq. on a 3 block file, if we hiccupped the first read on

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828324#action_12828324 ] stack commented on HDFS-927: .bq I actually mean "per read per block", i.e. within a singe read,

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-938: - Status: Patch Available (was: Open) submitting patch. > Replace calls to UGI.getUserName() with UGI.getSh

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828320#action_12828320 ] Todd Lipcon commented on HDFS-927: -- Ah, I see what you're saying. So, if you do a read that

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828318#action_12828318 ] Tsz Wo (Nicholas), SZE commented on HDFS-927: - > ... don't you think? I actually

[jira] Created: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

Replace calls to UGI.getUserName() with UGI.getShortUserName() -- Key: HDFS-938 URL: https://issues.apache.org/jira/browse/HDFS-938 Project: Hadoop HDFS Issue Type: Bug Co

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-938: - Attachment: HDFS-938.patch Patch implements changes as described. > Replace calls to UGI.getUserName() wit

[jira] Commented: (HDFS-916) Rewrite DFSOutputStream to use a single thread with NIO

[ https://issues.apache.org/jira/browse/HDFS-916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828287#action_12828287 ] Todd Lipcon commented on HDFS-916: -- Patch is up on HDFS-914 - hopefully we can move quickly

[jira] Commented: (HDFS-937) Port HDFS-101 to branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828258#action_12828258 ] Hairong Kuang commented on HDFS-937: Well then I will port the tests into 0.20 as well.

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828244#action_12828244 ] Todd Lipcon commented on HDFS-927: -- Hey Nicholas. Thanks for taking a look. bq. Should the

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828240#action_12828240 ] Tsz Wo (Nicholas), SZE commented on HDFS-927: - Should the failure count be reset

[jira] Commented: (HDFS-907) Add tests for getBlockLocations and totalLoad metrics.

[ https://issues.apache.org/jira/browse/HDFS-907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828235#action_12828235 ] Konstantin Boudnik commented on HDFS-907: - +1 patch looks good. Since this is for 0.2

[jira] Commented: (HDFS-937) Port HDFS-101 to branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828233#action_12828233 ] Konstantin Boudnik commented on HDFS-937: - I have 0.20 for fault-injection framework

[jira] Commented: (HDFS-937) Port HDFS-101 to branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828229#action_12828229 ] Todd Lipcon commented on HDFS-937: -- Isn't the fault injection framework available in ydist?

[jira] Commented: (HDFS-937) Port HDFS-101 to branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828228#action_12828228 ] Hairong Kuang commented on HDFS-937: HDFS-564 uses the fault injection framework which is

[jira] Commented: (HDFS-937) Port HDFS-101 to branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828227#action_12828227 ] Konstantin Boudnik commented on HDFS-937: - Hairong, it seems like the test for this f

[jira] Updated: (HDFS-937) Port HDFS-101 to branch 0.20

[ https://issues.apache.org/jira/browse/HDFS-937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HDFS-937: --- Attachment: HDFS-101.0.20.patch A patch for review. This patch is very similar to the one submitted to

[jira] Created: (HDFS-937) Port HDFS-101 to branch 0.20

Port HDFS-101 to branch 0.20 Key: HDFS-937 URL: https://issues.apache.org/jira/browse/HDFS-937 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects Versions: 0.20.1 Reporte