[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cosmin Lehene updated HDFS-909: --- Description: closing the edits log file can race with write to edits log file operation resulting in O

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828543#action_12828543 ] Cosmin Lehene commented on HDFS-909: @Konstantin I moved the details to a comment and bro

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828651#action_12828651 ] Konstantin Boudnik commented on HDFS-909: - bq. This patch adds a unit test for saveNa

[jira] Commented: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828740#action_12828740 ] Jakob Homan commented on HDFS-938: -- I can't reproduce the test failures: {noformat}Testsuite

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jakob Homan updated HDFS-938: - Resolution: Fixed Fix Version/s: 0.22.0 Status: Resolved (was: Patch Available) I have c

[jira] Commented: (HDFS-907) Add tests for getBlockLocations and totalLoad metrics.

[ https://issues.apache.org/jira/browse/HDFS-907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828750#action_12828750 ] Ravi Phulari commented on HDFS-907: --- Above test failures (core and contrib) are not relate

[jira] Updated: (HDFS-907) Add tests for getBlockLocations and totalLoad metrics.

[ https://issues.apache.org/jira/browse/HDFS-907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Phulari updated HDFS-907: -- Attachment: HDFS-907-0.20.patch Attaching patch for 0.20 branch. test-patch passed successfully , pasti

[jira] Commented: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828757#action_12828757 ] Hudson commented on HDFS-938: - Integrated in Hadoop-Hdfs-trunk-Commit #184 (See [http://hudson.z

[jira] Created: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

Datanode xceiver protocol should allow reuse of a connection Key: HDFS-941 URL: https://issues.apache.org/jira/browse/HDFS-941 Project: Hadoop HDFS Issue Type: Improvement

[jira] Created: (HDFS-942) Read and write metrics misleading/not helpful

Read and write metrics misleading/not helpful - Key: HDFS-942 URL: https://issues.apache.org/jira/browse/HDFS-942 Project: Hadoop HDFS Issue Type: Bug Reporter: ryan rawson the metric

[jira] Updated: (HDFS-942) Read and write metrics misleading/not helpful

[ https://issues.apache.org/jira/browse/HDFS-942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-942: - Component/s: data-node Affects Version/s: 0.22.0 > Read and write metrics misleading/not helpful

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Status: Open (was: Patch Available) > Race condition between rollEditLog or rollFSImage ant FSEditsLog.wri

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Status: Patch Available (was: Open) > Race condition between rollEditLog or rollFSImage ant FSEditsLog.wri

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Attachment: hdfs-909.txt New patch in junit 4 style > Race condition between rollEditLog or rollFSImage an

[jira] Commented: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828815#action_12828815 ] Tom White commented on HDFS-914: +1 This looks good to me. I agree that this should be commit

[jira] Created: (HDFS-943) Port DFSAdmin to FileContext

Port DFSAdmin to FileContext Key: HDFS-943 URL: https://issues.apache.org/jira/browse/HDFS-943 Project: Hadoop HDFS Issue Type: Task Components: tools Reporter: Eli Collins DFSAdmin curren

[jira] Created: (HDFS-944) FileContext/AFS need to provide the full ClientProtocol interface

FileContext/AFS need to provide the full ClientProtocol interface - Key: HDFS-944 URL: https://issues.apache.org/jira/browse/HDFS-944 Project: Hadoop HDFS Issue Type: New Featur

[jira] Updated: (HDFS-894) DatanodeID.ipcPort is not updated when existing node re-registers

[ https://issues.apache.org/jira/browse/HDFS-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-894: - Attachment: hdfs-894.txt > DatanodeID.ipcPort is not updated when existing node re-registers >

[jira] Updated: (HDFS-894) DatanodeID.ipcPort is not updated when existing node re-registers

[ https://issues.apache.org/jira/browse/HDFS-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-894: - Status: Patch Available (was: Open) > DatanodeID.ipcPort is not updated when existing node re-registers >

[jira] Updated: (HDFS-717) Proposal for exceptions thrown by FileContext and Abstract File System

[ https://issues.apache.org/jira/browse/HDFS-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-717: - Status: Patch Available (was: Open) > Proposal for exceptions thrown by FileContext and Abstract F

[jira] Updated: (HDFS-894) DatanodeID.ipcPort is not updated when existing node re-registers

[ https://issues.apache.org/jira/browse/HDFS-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-894: - Component/s: name-node This should be fixed in all three current branches. As mentioned in the description

[jira] Updated: (HDFS-717) Proposal for exceptions thrown by FileContext and Abstract File System

[ https://issues.apache.org/jira/browse/HDFS-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-717: - Status: Open (was: Patch Available) > Proposal for exceptions thrown by FileContext and Abstract F

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828840#action_12828840 ] Todd Lipcon commented on HDFS-927: -- Ran tests on branch-0.21. Everything passed except two u

[jira] Updated: (HDFS-717) Proposal for exceptions thrown by FileContext and Abstract File System

[ https://issues.apache.org/jira/browse/HDFS-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-717: - Attachment: hdfs-717.patch Updating patch with missing files > Proposal for exceptions thrown by F

[jira] Commented: (HDFS-877) Client-driven block verification not functioning

[ https://issues.apache.org/jira/browse/HDFS-877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828848#action_12828848 ] Todd Lipcon commented on HDFS-877: -- So, any verdict on this for 0.21? We should make a decis

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828849#action_12828849 ] Brian Bockelman commented on HDFS-941: -- >From a site which uses mostly random reads, I v

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828853#action_12828853 ] Konstantin Shvachko commented on HDFS-909: -- Todd I checked the race with -saveNamesp

[jira] Updated: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-909: - Status: Open (was: Patch Available) Canceling patch while I look into this some more. > Race condition be

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828856#action_12828856 ] stack commented on HDFS-927: How we want to run the vote on this? Will i start with 0.20 first?

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828861#action_12828861 ] Konstantin Shvachko commented on HDFS-909: -- > I added a giant comment at the top of

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828879#action_12828879 ] Hadoop QA commented on HDFS-909: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828882#action_12828882 ] Tsz Wo (Nicholas), SZE commented on HDFS-927: - Sure, 0.20 sounds good. > DFSInpu

[jira] Updated: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-528: - Attachment: hdfs-528.txt Updated patch against trunk > Add ability for safemode to wait for a minimum numb

[jira] Updated: (HDFS-528) Add ability for safemode to wait for a minimum number of live datanodes

[ https://issues.apache.org/jira/browse/HDFS-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-528: - Affects Version/s: (was: 0.21.0) 0.22.0 Status: Patch Available (

[jira] Commented: (HDFS-894) DatanodeID.ipcPort is not updated when existing node re-registers

[ https://issues.apache.org/jira/browse/HDFS-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828887#action_12828887 ] Hadoop QA commented on HDFS-894: -1 overall. Here are the results of testing the latest atta

[jira] Commented: (HDFS-894) DatanodeID.ipcPort is not updated when existing node re-registers

[ https://issues.apache.org/jira/browse/HDFS-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828892#action_12828892 ] Todd Lipcon commented on HDFS-894: -- Failed test seems unrelated. > DatanodeID.ipcPort is no

[jira] Commented: (HDFS-927) DFSInputStream retries too many times for new block locations

[ https://issues.apache.org/jira/browse/HDFS-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828897#action_12828897 ] Todd Lipcon commented on HDFS-927: -- Tests passed on branch-0.20. > DFSInputStream retries t

[jira] Commented: (HDFS-941) Datanode xceiver protocol should allow reuse of a connection

[ https://issues.apache.org/jira/browse/HDFS-941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828902#action_12828902 ] stack commented on HDFS-941: I see Brians' +10 and up it +1. > Datanode xceiver protocol should

[jira] Commented: (HDFS-933) Add createIdentifier() implementation to DelegationTokenSecretManager

[ https://issues.apache.org/jira/browse/HDFS-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828905#action_12828905 ] Todd Lipcon commented on HDFS-933: -- Is this going to be committed ASAP? Trunk build's curren

[jira] Commented: (HDFS-933) Add createIdentifier() implementation to DelegationTokenSecretManager

[ https://issues.apache.org/jira/browse/HDFS-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828914#action_12828914 ] Devaraj Das commented on HDFS-933: -- +1 (I also ran tests/findbugs/javadoc manually). I just

[jira] Resolved: (HDFS-933) Add createIdentifier() implementation to DelegationTokenSecretManager

[ https://issues.apache.org/jira/browse/HDFS-933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das resolved HDFS-933. -- Resolution: Fixed Fix Version/s: 0.22.0 Hadoop Flags: [Reviewed] > Add createIdentifier() imp

[jira] Updated: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Booth updated HDFS-918: --- Attachment: hdfs-918-20100203.patch New patch. Streamlined MultiplexedBlockSender, we now have one selector pe

[jira] Updated: (HDFS-245) Create symbolic links in HDFS

[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-245: - Attachment: symlink36-hdfs.patch Hey Hairong, thanks for taking a look! bq. 1. INodeSymlink extends INodeF