[jira] Commented: (HADOOP-3462) reduce task failures during shuffling should not count against number of retry attempts

2008-08-17 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623271#action_12623271 ] Amareshwari Sriramadasu commented on HADOOP-3462: - Shall we have maximum a

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-17 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Attachment: patch-3150.txt Sorry. Earlier patch had a findbugs warning. He

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-17 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Status: Patch Available (was: Open) > Move task file promotion into the t

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-17 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Attachment: patch-3150.txt Thanks Ramya for runnning small job benchmark.

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-17 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Status: Open (was: Patch Available) > Move task file promotion into the t

[jira] Commented: (HADOOP-3856) Asynchronous IO Handling in Hadoop and HDFS

2008-08-17 Thread Ankur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623260#action_12623260 ] Ankur commented on HADOOP-3856: --- Looks like work is going to keep me busy this week. So I mi

[jira] Created: (HADOOP-3967) Task Tracker logs show a lot of DiskChecker$DiskErrorException

2008-08-17 Thread Jothi Padmanabhan (JIRA)
Task Tracker logs show a lot of DiskChecker$DiskErrorException -- Key: HADOOP-3967 URL: https://issues.apache.org/jira/browse/HADOOP-3967 Project: Hadoop Core Issue Type: Bug

[jira] Updated: (HADOOP-3514) Reduce seeks during shuffle, by inline crcs

2008-08-17 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan updated HADOOP-3514: -- Attachment: hadoop-3514-v8.patch Patch incorporating review comments > Reduce seeks d

[jira] Updated: (HADOOP-3514) Reduce seeks during shuffle, by inline crcs

2008-08-17 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan updated HADOOP-3514: -- Status: Patch Available (was: Open) > Reduce seeks during shuffle, by inline crcs > -

[jira] Updated: (HADOOP-3514) Reduce seeks during shuffle, by inline crcs

2008-08-17 Thread Jothi Padmanabhan (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jothi Padmanabhan updated HADOOP-3514: -- Status: Open (was: Patch Available) > Reduce seeks during shuffle, by inline crcs > -

[jira] Commented: (HADOOP-3150) Move task file promotion into the task

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623250#action_12623250 ] Ramya R commented on HADOOP-3150: - Tested the patch for small jobs benchmark on 500 nodes

Could anyone tell me How to Compare two Text type?

2008-08-17 Thread Kunsheng Chen
I am modifying wordCount example but having some trouble in comparing two Text type. I tried the method 'equals' in the document but it doesn't work at all. Could anyone give me some example for that ?  Thanks

[jira] Updated: (HADOOP-3719) Chukwa

2008-08-17 Thread Ari Rabkin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ari Rabkin updated HADOOP-3719: --- Attachment: (was: chukwa-0.0.1.tgz) > Chukwa > -- > > Key: HADOOP-3719 >

[jira] Commented: (HADOOP-2560) Processing multiple input splits per mapper task

2008-08-17 Thread eric baldeschwieler (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623239#action_12623239 ] eric baldeschwieler commented on HADOOP-2560: - A few observations: 1) You rea

Re: "Data corruption" when reading file from DFS (version 0.18.0, 0.17.2)

2008-08-17 Thread Thibaut_
Thank you very much! This is indeed true. I have had a wrong interpretation of the read command for a few years now, so I would have never found out. And that error never turned up when running a programm locally. (also other programs) Thanks again! Thibaut Ted Dunning wrote: > > You aren't c

[jira] Updated: (HADOOP-249) Improving Map -> Reduce performance and Task JVM reuse

2008-08-17 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-249: --- Attachment: 249.1.patch Here is an early untested patch (the major missing part is the handling of th

Re: "Data corruption" when reading file from DFS (version 0.18.0, 0.17.2)

2008-08-17 Thread Ted Dunning
You aren't checking to see how much data got read. There is no guarantee that this call will read everything you ask for in just one call. My suspicion is that the return value will show that wrote: > ... > >//AND THIS DOESN0T! >in.read(aaa,0,size); ... > Any id

"Data corruption" when reading file from DFS (version 0.18.0, 0.17.2)

2008-08-17 Thread Thibaut_
Hi, I was finally able to reproduce an error that was driving me crazy for the last few weeks. I get a reproducable data corruption when I'm reading a file from the dfs. Reading the file locally does seem to work fine, also making sure to only read at most 2048 bytes at a time, seems to skip the

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Component/s: (was: test) > Place the new findbugs warnings introduced by the patch in the /tmp directo

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Component/s: test Affects Version/s: (was: 0.18.0) > Place the new findbugs warnings introdu

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Attachment: test-patch0.txt > Place the new findbugs warnings introduced by the patch in the /tmp director

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Attachment: (was: test-patch0.txt) > Place the new findbugs warnings introduced by the patch in the /t

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Attachment: test-patch0.txt > Place the new findbugs warnings introduced by the patch in the /tmp director

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Attachment: (was: test-patch0.txt) > Place the new findbugs warnings introduced by the patch in the /t

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Attachment: test-patch0.txt > Place the new findbugs warnings introduced by the patch in the /tmp director

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Status: Patch Available (was: Open) > Place the new findbugs warnings introduced by the patch in the /tmp

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Status: Patch Available (was: Open) > Place the new findbugs warnings introduced by the patch in the /tmp

[jira] Updated: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya R updated HADOOP-3966: Status: Open (was: Patch Available) > Place the new findbugs warnings introduced by the patch in the /tmp

[jira] Created: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-17 Thread Ramya R (JIRA)
Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run. --- Key: HADOOP-3966 URL: https://issues.apache.org

[jira] Commented: (HADOOP-3941) Extend FileSystem API to return file-checksums/file-digests

2008-08-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623184#action_12623184 ] Doug Cutting commented on HADOOP-3941: -- Sorry, that should have been something like:

[jira] Commented: (HADOOP-3941) Extend FileSystem API to return file-checksums/file-digests

2008-08-17 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623183#action_12623183 ] Doug Cutting commented on HADOOP-3941: -- How about making FileChecksum an abstract cla

[jira] Commented: (HADOOP-3497) File globbing with a PathFilter is too restrictive

2008-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623176#action_12623176 ] Hadoop QA commented on HADOOP-3497: --- -1 overall. Here are the results of testing the la