[jira] Updated: (HADOOP-2790) TaskInProgress.hasSpeculativeTask is very inefficient

2008-02-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2790: -- Status: Open (was: Patch Available) > TaskInProgress.hasSpeculativeTask is very inefficient >

[jira] Updated: (HADOOP-2790) TaskInProgress.hasSpeculativeTask is very inefficient

2008-02-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2790: -- Attachment: 2790-2.patch Resolved conflict with 1985. > TaskInProgress.hasSpeculativeTask is

[jira] Updated: (HADOOP-2790) TaskInProgress.hasSpeculativeTask is very inefficient

2008-02-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2790: -- Status: Patch Available (was: Open) > TaskInProgress.hasSpeculativeTask is very inefficient >

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Status: Patch Available (was: Open) > FileSystem should provide byte ranges for file lo

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Status: Open (was: Patch Available) > FileSystem should provide byte ranges for file lo

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Attachment: HADOOP-2027-10.patch Regenerating against trunk. Tested this patch, applies

[jira] Updated: (HADOOP-1230) Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes

2008-02-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1230: -- Attachment: context-objs.patch Ok, here is a rough cut at a proposed interface for mappers and

[jira] Commented: (HADOOP-2758) Reduce memory copies when data is read from DFS

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573613#action_12573613 ] Hadoop QA commented on HADOOP-2758: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2657) Enhancements to DFSClient to support flushing data at any point in time

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2657: - Attachment: flush4.patch Merged patch with latest trunk. Incorporated Doug's review comm

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed thi.

[jira] Commented: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573609#action_12573609 ] dhruba borthakur commented on HADOOP-2891: -- The bug is demonstrated by unit test

errors when running the wordcount example in eclipse environment

2008-02-28 Thread caoyuzhong
Hi All, I've set up the eclipse environment and built all of hadoop in it successfuly. Then I tried to run the wordcount example in Eclipse but got the following error messages: --- Exception in thread "main" java.lang.RuntimeException: java.io.IOException: No FileSystem for scheme:

[jira] Commented: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573595#action_12573595 ] Hadoop QA commented on HADOOP-2906: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2790) TaskInProgress.hasSpeculativeTask is very inefficient

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573583#action_12573583 ] Hadoop QA commented on HADOOP-2790: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573580#action_12573580 ] Hadoop QA commented on HADOOP-2891: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573578#action_12573578 ] Christian Kunz commented on HADOOP-2907: When we ran into the same problem with #8

[jira] Commented: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573573#action_12573573 ] Hadoop QA commented on HADOOP-2906: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2758) Reduce memory copies when data is read from DFS

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2758: - Attachment: HADOOP-2758.patch fixed findbugs warning. Many thanks to Mukund for running benchm

[jira] Updated: (HADOOP-2758) Reduce memory copies when data is read from DFS

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2758: - Status: Patch Available (was: Open) > Reduce memory copies when data is read from DFS > ---

[jira] Updated: (HADOOP-2758) Reduce memory copies when data is read from DFS

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2758: - Status: Open (was: Patch Available) > Reduce memory copies when data is read from DFS > ---

[jira] Commented: (HADOOP-2916) Refactor src structure, but leave package structure along

2008-02-28 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573565#action_12573565 ] Arun C Murthy commented on HADOOP-2916: --- {quote} src/core - this will contain the co

[jira] Issue Comment Edited: (HADOOP-2915) mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker

2008-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573563#action_12573563 ] szetszwo edited comment on HADOOP-2915 at 2/28/08 6:10 PM: -

[jira] Commented: (HADOOP-2915) mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker

2008-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573563#action_12573563 ] Tsz Wo (Nicholas), SZE commented on HADOOP-2915: This problem is due to Fi

[jira] Created: (HADOOP-2916) Refactor src structure, but leave package structure along

2008-02-28 Thread Sanjay Radia (JIRA)
Refactor src structure, but leave package structure along - Key: HADOOP-2916 URL: https://issues.apache.org/jira/browse/HADOOP-2916 Project: Hadoop Core Issue Type: Sub-task

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573558#action_12573558 ] Raghu Angadi commented on HADOOP-2907: -- > #810 release was a trunk release from Jan 4

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Attachment: (was: patch.2096.2.txt) > output format classes that can write to different files de

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Status: Patch Available (was: Open) > output format classes that can write to different files depen

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573555#action_12573555 ] Christian Kunz commented on HADOOP-2907: #810 release was a trunk release from Jan

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573556#action_12573556 ] Raghu Angadi commented on HADOOP-2907: -- What % of datanodes do you think logged OutO

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Status: Open (was: Patch Available) > output format classes that can write to different files depen

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Attachment: patch.2096.3.txt Incorporate some feedback comments > output format classes that can

[jira] Issue Comment Edited: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573551#action_12573551 ] rangadi edited comment on HADOOP-2907 at 2/28/08 5:38 PM: --- >

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573551#action_12573551 ] Raghu Angadi commented on HADOOP-2907: -- > (my impression is that that release still w

[jira] Issue Comment Edited: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573548#action_12573548 ] ckunz edited comment on HADOOP-2907 at 2/28/08 5:29 PM: - I

[jira] Commented: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573549#action_12573549 ] Hadoop QA commented on HADOOP-2895: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573548#action_12573548 ] Christian Kunz commented on HADOOP-2907: I am not completely convinced that the ch

[jira] Commented: (HADOOP-2912) Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression

2008-02-28 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573545#action_12573545 ] Mahadev konar commented on HADOOP-2912: --- 3. HADOOP-1985. This addresses rack-awarene

[jira] Updated: (HADOOP-2790) TaskInProgress.hasSpeculativeTask is very inefficient

2008-02-28 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2790: -- Status: Patch Available (was: Open) Before the patch, findNewTask took 60s, with the patch it

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573541#action_12573541 ] Raghu Angadi commented on HADOOP-2907: -- Slow reads are same problem as before. It ha

[jira] Updated: (HADOOP-2904) 3 minor fixes in the rpc metrics area.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2904: - Fix Version/s: (was: 0.17.0) 0.16.1 > 3 minor fixes in the rpc me

[jira] Updated: (HADOOP-2903) Data type mismatch exception raised from pushMetric

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2903: - Fix Version/s: (was: 0.17.0) 0.16.1 > Data type mismatch exceptio

[jira] Updated: (HADOOP-2904) 3 minor fixes in the rpc metrics area.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2904: - Fix Version/s: (was: 0.16.1) 0.17.0 > 3 minor fixes in the rpc me

[jira] Updated: (HADOOP-2903) Data type mismatch exception raised from pushMetric

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2903: - Resolution: Fixed Fix Version/s: (was: 0.16.1) 0.17.0

[jira] Updated: (HADOOP-2904) 3 minor fixes in the rpc metrics area.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2904: - Resolution: Fixed Assignee: dhruba borthakur Status: Resolved (was: Patch

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Status: Patch Available (was: Open) > The dfsclient on exit deletes files that are open

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Attachment: abandonFile2.patch This fixes the deadlock introduced by the previous patch.

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573530#action_12573530 ] Christian Kunz commented on HADOOP-2907: Raghu, do you think that the relatively s

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Status: Open (was: Patch Available) This introduces a deadlock that I am going to submi

[jira] Commented: (HADOOP-2886) Track individual RPC metrics.

2008-02-28 Thread girish vaitheeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573527#action_12573527 ] girish vaitheeswaran commented on HADOOP-2886: -- No tests added since this is

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573526#action_12573526 ] Christian Kunz commented on HADOOP-2907: Concerning read speed of map applications

[jira] Commented: (HADOOP-2833) JobClient.submitJob(...) should not use "Dr Who" as a default username

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573525#action_12573525 ] Hadoop QA commented on HADOOP-2833: --- +1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Christian Kunz (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573523#action_12573523 ] Christian Kunz commented on HADOOP-2907: Every map application streams through abo

[jira] Commented: (HADOOP-2903) Data type mismatch exception raised from pushMetric

2008-02-28 Thread girish vaitheeswaran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573517#action_12573517 ] girish vaitheeswaran commented on HADOOP-2903: -- Very minor fix. Does not requ

[jira] Issue Comment Edited: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573496#action_12573496 ] rangadi edited comment on HADOOP-2907 at 2/28/08 3:19 PM: --- C

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573510#action_12573510 ] Raghu Angadi commented on HADOOP-2907: -- Regd buffers, for readers, HADOOP-2578 will r

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Status: Patch Available (was: Open) There was a javac warning in the test class. The new patch fix

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Attachment: (was: patch.2096.1.txt) > output format classes that can write to different files de

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Attachment: patch.2096.2.txt > output format classes that can write to different files depending on

[jira] Updated: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Runping Qi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Runping Qi updated HADOOP-2906: --- Status: Open (was: Patch Available) > output format classes that can write to different files depen

Re: mapreduce does the wrong thing with dfs permissions?

2008-02-28 Thread Andy Li
Thanks, just go ahead and file a JIRA. I have no experience how to file a JIRA. (will read the manual in the future to learn how-to). I'll keep track of this and apply the patch later on. Thanks for taking care of this issue. On Thu, Feb 28, 2008 at 2:32 PM, <[EMAIL PROTECTED]> wrote: > Just h

[jira] Commented: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573504#action_12573504 ] Hadoop QA commented on HADOOP-2027: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573501#action_12573501 ] Hadoop QA commented on HADOOP-2891: --- +1 overall. Here are the results of testing the la

[jira] Assigned: (HADOOP-2912) Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression

2008-02-28 Thread Robert Chansler (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Chansler reassigned HADOOP-2912: --- Assignee: Mahadev konar (was: Robert Chansler) > Unit test fails: org.apache.hadoop

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573496#action_12573496 ] Raghu Angadi commented on HADOOP-2907: -- Christian, What is the read and write patter

Re: mapreduce does the wrong thing with dfs permissions?

2008-02-28 Thread s29752-hadoopdev
Just have created HADOOP-2915. - Original Message From: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]> To: core-dev@hadoop.apache.org Sent: Thursday, February 28, 2008 1:45:28 PM Subject: Re: mapreduce does the wrong thing with dfs permissions? Hi Andy, I can reproduce the problem and I belie

[jira] Created: (HADOOP-2915) mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker

2008-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
mapred output files and directories should be created as the job submitter, not tasktracker or jobtracker - Key: HADOOP-2915 URL: https://issues.apache.org/jir

[jira] Created: (HADOOP-2914) extend DistributedCache to work locally (LocalJobRunner)

2008-02-28 Thread sam rash (JIRA)
extend DistributedCache to work locally (LocalJobRunner) Key: HADOOP-2914 URL: https://issues.apache.org/jira/browse/HADOOP-2914 Project: Hadoop Core Issue Type: Improvement

[jira] Commented: (HADOOP-2912) Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression

2008-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573484#action_12573484 ] Tsz Wo (Nicholas), SZE commented on HADOOP-2912: I cannot reproduce it. I

[jira] Created: (HADOOP-2913) FSDataOutputStream should flush last partial CRC chunk

2008-02-28 Thread dhruba borthakur (JIRA)
FSDataOutputStream should flush last partial CRC chunk -- Key: HADOOP-2913 URL: https://issues.apache.org/jira/browse/HADOOP-2913 Project: Hadoop Core Issue Type: Bug Components:

[jira] Updated: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-28 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2895: Status: Patch Available (was: In Progress) > String for configuring profiling should be c

[jira] Updated: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-28 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2895: Attachment: HADOOP-2895-2.patch Agreed. That was unintentional -- apparently I had IDEA co

[jira] Commented: (HADOOP-2657) Enhancements to DFSClient to support flushing data at any point in time

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573473#action_12573473 ] dhruba borthakur commented on HADOOP-2657: -- I agree with you completely. I was su

[jira] Created: (HADOOP-2912) Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression

2008-02-28 Thread Mukund Madhugiri (JIRA)
Unit test fails: org.apache.hadoop.dfs.TestFsck.testFsck. This is a regression -- Key: HADOOP-2912 URL: https://issues.apache.org/jira/browse/HADOOP-2912 Project: Hadoop Core

[jira] Updated: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-28 Thread Martin Traverso (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Traverso updated HADOOP-2895: Status: In Progress (was: Patch Available) > String for configuring profiling should be c

Re: mapreduce does the wrong thing with dfs permissions?

2008-02-28 Thread s29752-hadoopdev
Hi Andy, I can reproduce the problem and I believe it is a bug. The output directory should be owned by the user submitting the job, not the task tracker account. Do you want to file a jira? or I can do it. Thanks. Nicholas - Original Message From: Andy Li <[EMAIL PROTECTED]> To:

[jira] Commented: (HADOOP-2895) String for configuring profiling should be customizable

2008-02-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573464#action_12573464 ] Chris Douglas commented on HADOOP-2895: --- The patch looks good. A minor nit: reorderi

[jira] Commented: (HADOOP-1967) hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573461#action_12573461 ] Hadoop QA commented on HADOOP-1967: --- +1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2833) JobClient.submitJob(...) should not use "Dr Who" as a default username

2008-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-2833: --- Status: Patch Available (was: Open) > JobClient.submitJob(...) should not u

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Attachment: HADOOP-2027-9.patch Dhurba suggested it would be good to have information ab

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Status: Patch Available (was: Open) making this PA > FileSystem should provide byte ra

[jira] Updated: (HADOOP-2027) FileSystem should provide byte ranges for file locations

2008-02-28 Thread lohit vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lohit vijayarenu updated HADOOP-2027: - Status: Open (was: Patch Available) Uploading new one with comments from dhruba. > Fil

[jira] Commented: (HADOOP-2657) Enhancements to DFSClient to support flushing data at any point in time

2008-02-28 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573441#action_12573441 ] Doug Cutting commented on HADOOP-2657: -- This is a bug in ChecksumFileSystem: if you c

[jira] Commented: (HADOOP-2657) Enhancements to DFSClient to support flushing data at any point in time

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573434#action_12573434 ] dhruba borthakur commented on HADOOP-2657: -- In the current trunk, FSDataOutputStr

[jira] Updated: (HADOOP-2346) DataNode should have timeout on socket writes.

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-2346: - Attachment: HADOOP-2346.patch Updated patch attached. - fixed couple of conflicts HADOOP-1985 -

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Status: Patch Available (was: In Progress) > The dfsclient on exit deletes files that a

[jira] Updated: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-2891: - Status: Open (was: Patch Available) > The dfsclient on exit deletes files that are open

[jira] Work started: (HADOOP-2891) The dfsclient on exit deletes files that are open and not closed.

2008-02-28 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-2891 started by dhruba borthakur. > The dfsclient on exit deletes files that are open and not closed. > --

[jira] Commented: (HADOOP-2809) [HOD] Syslog configuration, syslog-address, does not work in HOD 0.4

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573425#action_12573425 ] Hadoop QA commented on HADOOP-2809: --- -1 overall. Here are the results of testing the la

[jira] Updated: (HADOOP-2833) JobClient.submitJob(...) should not use "Dr Who" as a default username

2008-02-28 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-2833: --- Attachment: 2833_20080228.patch 2833_20080227.patch: UserGroupInformation.ge

Re: hdfsLock

2008-02-28 Thread Raghu Angadi
What do you want to use these locks for? From your question, you seem to be concerned about multiple threads accessing a stream. FileLocks have nothing to do with that. They were meant to be something like 'flock()' system call. Raghu. Ahmad Humayun wrote: Do you any reason why? Is it beca

Re: hdfsLock

2008-02-28 Thread Owen O'Malley
On Feb 28, 2008, at 9:45 AM, Ahmad Humayun wrote: Do you any reason why? Is it because only one thread can write to a specific file in the hdfs at a single timeand multiple simultaneous readers doesn't cause any problem...hence locks make no sense in this situation??? Locks were remov

[jira] Commented: (HADOOP-910) Reduces can do merges for the on-disk map output files in parallel with their copying

2008-02-28 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573416#action_12573416 ] Devaraj Das commented on HADOOP-910: Sorry, this patch conflicts with the just committe

[jira] Commented: (HADOOP-2906) output format classes that can write to different files depending on keys and/or config variable

2008-02-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573398#action_12573398 ] Hadoop QA commented on HADOOP-2906: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573397#action_12573397 ] Raghu Angadi commented on HADOOP-2907: -- DataNode is allowed 1000MB (-Xmx). Top shows

[jira] Commented: (HADOOP-2657) Enhancements to DFSClient to support flushing data at any point in time

2008-02-28 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573396#action_12573396 ] Doug Cutting commented on HADOOP-2657: -- We should change FSOutputStream to implement

[jira] Commented: (HADOOP-2907) dead datanodes because of OutOfMemoryError

2008-02-28 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573389#action_12573389 ] Doug Cutting commented on HADOOP-2907: -- Recall that running out of file handles can a

[jira] Updated: (HADOOP-1967) hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent

2008-02-28 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1967: - Attachment: HADOOP-1967_4.patch Fix javac and javadoc warnings. > hadoop dfs -ls, -get, -mv com

[jira] Updated: (HADOOP-1967) hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent

2008-02-28 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1967: - Status: Patch Available (was: Open) > hadoop dfs -ls, -get, -mv command's source/destination UR

[jira] Updated: (HADOOP-1967) hadoop dfs -ls, -get, -mv command's source/destination URI are inconsistent

2008-02-28 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1967: - Status: Open (was: Patch Available) > hadoop dfs -ls, -get, -mv command's source/destination UR

[jira] Commented: (HADOOP-2911) [HOD] Make the information printed by allocate and info commands less verbose and clearer

2008-02-28 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12573377#action_12573377 ] Nigel Daley commented on HADOOP-2911: - Here are some other typo's that could also be f

  1   2   >