[jira] Commented: (HDFS-898) Sequential generation of block ids

2010-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12829998#action_12829998 ] Konstantin Shvachko commented on HDFS-898: -- Yes the birthday problem is similar, but

[jira] Commented: (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2010-02-05 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830136#action_12830136 ] He Yongqiang commented on HDFS-951: --- Throwing exception at future close() and write() is

[jira] Commented: (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830148#action_12830148 ] Todd Lipcon commented on HDFS-951: -- What version are you seeing this issue in? I noticed

[jira] Commented: (HDFS-945) Make NameNode resilient to DoS attacks (malicious or otherwise)

2010-02-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830200#action_12830200 ] Allen Wittenauer commented on HDFS-945: --- QoS (which is really what we're talking about

[jira] Commented: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

2010-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830203#action_12830203 ] Konstantin Shvachko commented on HDFS-914: -- This did not get approval from Hudson

[jira] Commented: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830208#action_12830208 ] Todd Lipcon commented on HDFS-914: -- The failed tests were unrelated - those same errors have

[jira] Updated: (HDFS-935) Real user in delegation token.

2010-02-05 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-935: -- Attachment: HDFS-935.5.patch Real user in delegation token.

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-938: Attachment: contrib.ivy.jackson.patch-1 added eclipse.template/.classpath to include JSON libs

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-938: Attachment: contrib.ivy.jackson.patch-1 Replace calls to UGI.getUserName() with

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-938: Attachment: contrib.ivy.jackson.patch-3 Replace calls to UGI.getUserName() with

[jira] Commented: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830264#action_12830264 ] Boris Shkolnik commented on HDFS-938: - moving ivy configuration stuff to HADOOP-6544

[jira] Commented: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830284#action_12830284 ] Jakob Homan commented on HDFS-938: -- For the 938 backport, looks like you got all the

[jira] Commented: (HDFS-914) Refactor DFSOutputStream and DFSInputStream out of DFSClient

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830298#action_12830298 ] Todd Lipcon commented on HDFS-914: -- The failures seem to be the same as HDFS-615 and

[jira] Commented: (HDFS-833) TestDiskError.testReplicationError fails with locked storage error

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830297#action_12830297 ] Todd Lipcon commented on HDFS-833: -- TestDatanodeBlockScanner failed with this same error

[jira] Created: (HDFS-953) TestBlockReport times out intermittently

2010-02-05 Thread Todd Lipcon (JIRA)
TestBlockReport times out intermittently Key: HDFS-953 URL: https://issues.apache.org/jira/browse/HDFS-953 Project: Hadoop HDFS Issue Type: Test Affects Versions: 0.22.0 Reporter:

[jira] Commented: (HDFS-894) DatanodeID.ipcPort is not updated when existing node re-registers

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830309#action_12830309 ] Todd Lipcon commented on HDFS-894: -- Filed HDFS-953 for the testpatch failure seen above. I

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830313#action_12830313 ] Todd Lipcon commented on HDFS-909: -- I think we're talking about different things. I'm

[jira] Commented: (HDFS-953) TestBlockReport times out intermittently

2010-02-05 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830316#action_12830316 ] Konstantin Boudnik commented on HDFS-953: - Yes, it seems very similar. There's a

[jira] Updated: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Boris Shkolnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boris Shkolnik updated HDFS-938: Attachment: HDFS-938-BP20-2.patch address Jacob comments for HDFS-938-BP20-2.patch. removed

[jira] Commented: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830327#action_12830327 ] Todd Lipcon commented on HDFS-200: -- Hey Dhruba, In the client-side length fetching code,

[jira] Commented: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830334#action_12830334 ] Todd Lipcon commented on HDFS-200: -- Regarding above comment - I suppose it doesn't entirely

[jira] Created: (HDFS-954) There are two security packages in hdfs, should be one

2010-02-05 Thread Jakob Homan (JIRA)
There are two security packages in hdfs, should be one -- Key: HDFS-954 URL: https://issues.apache.org/jira/browse/HDFS-954 Project: Hadoop HDFS Issue Type: Bug Reporter: Jakob

[jira] Commented: (HDFS-938) Replace calls to UGI.getUserName() with UGI.getShortUserName()

2010-02-05 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830350#action_12830350 ] Jakob Homan commented on HDFS-938: -- +1 Replace calls to UGI.getUserName() with

[jira] Updated: (HDFS-898) Sequential generation of block ids

2010-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-898: - Attachment: FreeBlockIds.pdf Here is what I got running the block id freeing tool on some

[jira] Updated: (HDFS-245) Create symbolic links in HDFS

2010-02-05 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-245: - Attachment: symlink38-hdfs.patch Attached patch merges with trunk to resolve with the DFSClient

[jira] Updated: (HDFS-737) Improvement in metasave output

2010-02-05 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-737: - Attachment: HDFS-737.3.rel20.patch Patch for branch 20 attached. Improvement in metasave output

[jira] Commented: (HDFS-909) Race condition between rollEditLog or rollFSImage ant FSEditsLog.write operations corrupts edits log

2010-02-05 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830399#action_12830399 ] Konstantin Shvachko commented on HDFS-909: -- NN is in safe mode, so there shouldn't

[jira] Commented: (HDFS-737) Improvement in metasave output

2010-02-05 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830404#action_12830404 ] Tsz Wo (Nicholas), SZE commented on HDFS-737: - +1 HDFS-737.3.rel20.patch

[jira] Commented: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

2010-02-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830416#action_12830416 ] dhruba borthakur commented on HDFS-200: --- Hi Todd, I think your point of concern deems

[jira] Commented: (HDFS-200) In HDFS, sync() not yet guarantees data available to the new readers

2010-02-05 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830417#action_12830417 ] dhruba borthakur commented on HDFS-200: --- I meant For a HDFS file, only the last block

[jira] Updated: (HDFS-935) Real user in delegation token.

2010-02-05 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-935: -- Attachment: HDFS-935.6.patch Real user in delegation token.

[jira] Commented: (HDFS-935) Real user in delegation token.

2010-02-05 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830435#action_12830435 ] Kan Zhang commented on HDFS-935: +1, pending hudson. Real user in delegation token.

[jira] Commented: (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2010-02-05 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830447#action_12830447 ] He Yongqiang commented on HDFS-951: --- @Todd, The problem was seen in hadoop-0.19.2, not sure

[jira] Commented: (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2010-02-05 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830456#action_12830456 ] Todd Lipcon commented on HDFS-951: -- I'm not quite understanding what you're describing, I

[jira] Commented: (HDFS-935) Real user in delegation token.

2010-02-05 Thread Kan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830460#action_12830460 ] Kan Zhang commented on HDFS-935: See my comments in MAPREDUCE-1464. Real user in delegation

[jira] Commented: (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2010-02-05 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830479#action_12830479 ] He Yongqiang commented on HDFS-951: --- If all of the datanodes fail, the last block is in an

[jira] Commented: (HDFS-951) DFSClient should handle all nodes in a pipeline failed.

2010-02-05 Thread Yajun Dong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12830480#action_12830480 ] Yajun Dong commented on HDFS-951: - Also the file will leave in incomplete/being create state