[jira] Commented: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes

2008-08-18 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623579#action_12623579 ] Hemanth Yamijala commented on HADOOP-3759: -- This patch addresses all comments fro

[jira] Updated: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes

2008-08-18 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hemanth Yamijala updated HADOOP-3759: - Attachment: HADOOP-3759.patch > Provide ability to run memory intensive jobs without aff

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623569#action_12623569 ] dhruba borthakur commented on HADOOP-1869: -- Yes, Konstantin, I meant "access time

[jira] Commented: (HADOOP-3150) Move task file promotion into the task

2008-08-18 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623561#action_12623561 ] Amareshwari Sriramadasu commented on HADOOP-3150: - There could be a race c

[jira] Commented: (HADOOP-3918) Improve fuse-dfs error message when classpath not set or set incorrectly

2008-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623560#action_12623560 ] Hadoop QA commented on HADOOP-3918: --- -1 overall. Here are the results of testing the la

Re: OK to remove conf.setCombinerClass(myReduce.class)?

2008-08-18 Thread Ted Dunning
What are the type signatures of InDegreeMap and InDegreeReduce? Remember that the input to your combiner has to be compatible with the output of the mapper and the output of the combiner has to be compatible with the input of the reducer. If the reducer has different types for the input or output

[jira] Commented: (HADOOP-3961) resource estimation works badly in some cases

2008-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623544#action_12623544 ] Hadoop QA commented on HADOOP-3961: --- -1 overall. Here are the results of testing the la

[jira] Commented: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-18 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623543#action_12623543 ] Nigel Daley commented on HADOOP-3966: - +1 on code review. > Place the new findbugs wa

[jira] Commented: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-18 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623542#action_12623542 ] Nigel Daley commented on HADOOP-3966: - 1 correction: although customizable, I believe

[jira] Updated: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3062: -- Attachment: 3062-2.patch Updated based on Nicholas's feedback, i.e. added {{isInfoEnabled}} gu

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623530#action_12623530 ] Konstantin Shvachko commented on HADOOP-1869: - Did you mean files only, direct

[jira] Commented: (HADOOP-3963) libhdfs should never exit on its own but rather return errors to the calling application

2008-08-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623529#action_12623529 ] Hadoop QA commented on HADOOP-3963: --- -1 overall. Here are the results of testing the la

Chukwa, hod, data_join, failmon have no documentation links on the main wiki contrib section

2008-08-18 Thread Pete Wyckoff
I noticed that none of these projects has an entry on http://wiki.apache.org/hadoop/FrontPage in the contrib section and it might be helpful if they did. I don't know if any of them already have a wiki page someplace else. -- pete

[jira] Commented: (HADOOP-3966) Place the new findbugs warnings introduced by the patch in the /tmp directory when "ant test-patch" is run.

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623517#action_12623517 ] Chris Douglas commented on HADOOP-3966: --- bq. It should be available in both .html an

[jira] Commented: (HADOOP-2330) Preallocate transaction log to improve namenode transaction logging performance

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623513#action_12623513 ] dhruba borthakur commented on HADOOP-2330: -- Ok, thanks for the input Hairong. Wil

[jira] Commented: (HADOOP-3918) Improve fuse-dfs error message when classpath not set or set incorrectly

2008-08-18 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623512#action_12623512 ] Pete Wyckoff commented on HADOOP-3918: -- The spirit of the patch is much more like Cra

[jira] Commented: (HADOOP-3860) Compare name-node performance when journaling is performed into local hard-drives or nfs.

2008-08-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623510#action_12623510 ] Konstantin Shvachko commented on HADOOP-3860: - Dhruba, For creates we definite

[jira] Assigned: (HADOOP-3446) The reduce task should not flush the in memory file system before starting the reducer

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HADOOP-3446: - Assignee: Chris Douglas (was: Owen O'Malley) > The reduce task should not flush the in

[jira] Updated: (HADOOP-3446) The reduce task should not flush the in memory file system before starting the reducer

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3446: -- Fix Version/s: 0.19.0 Status: Patch Available (was: Open) > The reduce task should

[jira] Updated: (HADOOP-3446) The reduce task should not flush the in memory file system before starting the reducer

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3446: -- Attachment: 3446-1.patch This passes mapred/hdfs tests and patch validation on my machine and

[jira] Updated: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3062: --- Description: In order to better understand the relationship between hadoop

[jira] Commented: (HADOOP-3866) Improve Hadoop Jobtracker Admin

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623499#action_12623499 ] Owen O'Malley commented on HADOOP-3866: --- Ah, sorry about that. I'm using Mac OS & Fi

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623496#action_12623496 ] dhruba borthakur commented on HADOOP-1869: -- I agree with Konstantin on most count

[jira] Updated: (HADOOP-3921) Clover breaks nightly builds

2008-08-18 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-3921: Summary: Clover breaks nightly builds (was: Nightly builds are broken) > Clover breaks nightly bu

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623489#action_12623489 ] Konstantin Shvachko commented on HADOOP-1869: - I think this proposal is in the

[jira] Commented: (HADOOP-3866) Improve Hadoop Jobtracker Admin

2008-08-18 Thread craig weisenfluh (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623485#action_12623485 ] craig weisenfluh commented on HADOOP-3866: -- hi owen - i am having trouble reprod

[jira] Updated: (HADOOP-1480) pipes should be able to set user counters

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1480: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Availa

[jira] Commented: (HADOOP-3921) Nightly builds are broken

2008-08-18 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623483#action_12623483 ] Nigel Daley commented on HADOOP-3921: - I have disabled clover in the nightly build unt

[jira] Commented: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623482#action_12623482 ] Chris Douglas commented on HADOOP-3062: --- bq. Should we check whether ClientTraceLog

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623481#action_12623481 ] dhruba borthakur commented on HADOOP-1869: -- I agree that HADOOP-3336 does this fr

Re: [VOTE] Hadoop 0.17.2 release candidate 1

2008-08-18 Thread Owen O'Malley
On Aug 12, 2008, at 10:52 PM, Owen O'Malley wrote: I've created Hadoop 0.17.2 rc 1 and uploaded it to: http://people.apache.org/~omalley/hadoop-0.17.2-rc1/ I've run the unit tests and a word count example on Mac OS. +1 With 4 +1's and no -1's, the vote passes. -- Owen

[jira] Commented: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623480#action_12623480 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3062: - Should we check whether

new stable 0.17.2

2008-08-18 Thread Owen O'Malley
Since Yahoo has been running 0.17.2 (minus a few patches), I've changed the stable link the release directory to point to 0.17.2 from 0.16.4. -- Owen

[jira] Updated: (HADOOP-2130) Pipes submit job should be Non-blocking

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2130: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Availa

[jira] Resolved: (HADOOP-3934) Update log4j from 1.2.13 to 1.2.15

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-3934. --- Resolution: Fixed Fix Version/s: (was: 0.18.1) 0.19.0

[jira] Updated: (HADOOP-3958) TestMapRed ignores failures of the test case

2008-08-18 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-3958: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Than

Re: OK to remove conf.setCombinerClass(myReduce.class)?

2008-08-18 Thread Kunsheng Chen
Thanks for your reply. I need to set up different types for output inside Map and Reduce, those methods are inside main method: (InDegreeReduce and InDegreeMap implements the interfaces) conf.setMapOutputKeyClass(Text.class); conf.setMapOutputValueClass(IntWritable.class);

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623475#action_12623475 ] Raghu Angadi commented on HADOOP-1869: -- Doesn't HADOOP-3336 do this already in separa

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623473#action_12623473 ] Joydeep Sen Sarma commented on HADOOP-1869: --- +1. this looks good enough. i am w

[jira] Commented: (HADOOP-3918) Improve fuse-dfs error message when classpath not set or set incorrectly

2008-08-18 Thread Craig Macdonald (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623474#action_12623474 ] Craig Macdonald commented on HADOOP-3918: - Can someone confirm whether the Hadoop

[jira] Updated: (HADOOP-3549) meaningful errno values in libhdfs

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3549: -- Resolution: Fixed Release Note: Permission problems now return EACCES in errno from libhd

[jira] Updated: (HADOOP-3549) meaningful errno values in libhdfs

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3549: -- Fix Version/s: 0.19.0 > meaningful errno values in libhdfs > -

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623471#action_12623471 ] Raghu Angadi commented on HADOOP-1869: -- Most tests seem to indicate amount of data sy

Re: [VOTE] Hadoop 0.17.2 release candidate 1

2008-08-18 Thread Dhruba Borthakur
+1. I have been running most of these patches (not all) for the last month or so. -dhruba On Mon, Aug 18, 2008 at 1:47 PM, Nigel Daley <[EMAIL PROTECTED]> wrote: > +1 based on running some rudimentary tests and manifest checks. Note that I > have *not* run any benchmarks or other end-to-end test

[jira] Issue Comment Edited: (HADOOP-3913) Distcp allows copy even if directory permissions are 000.

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623468#action_12623468 ] szetszwo edited comment on HADOOP-3913 at 8/18/08 2:34 PM: -

[jira] Resolved: (HADOOP-3913) Distcp allows copy even if directory permissions are 000.

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HADOOP-3913. Resolution: Invalid Closing this as invalid. > Distcp allows copy even if

[jira] Commented: (HADOOP-3913) Distcp allows copy even if directory permissions are 000.

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623468#action_12623468 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3913: Just want to clarify that

[jira] Assigned: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur reassigned HADOOP-1869: Assignee: dhruba borthakur > access times of HDFS files >

[jira] Commented: (HADOOP-1869) access times of HDFS files

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623465#action_12623465 ] dhruba borthakur commented on HADOOP-1869: -- I plan on doing the following: 1. Ad

[jira] Updated: (HADOOP-3866) Improve Hadoop Jobtracker Admin

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3866: -- Status: Open (was: Patch Available) This is pretty cool. I noticed however that if I click on

Re: OK to remove conf.setCombinerClass(myReduce.class)?

2008-08-18 Thread Ted Dunning
This doesn't sound right. There are two reasons. First, the combiner is critical for good performance on word count applications. Secondly, having a combiner should not prevent having a different kind of collector. The combiner should just look like the reducer. Why do you think that having th

[jira] Updated: (HADOOP-3957) Fix javac warnings in DistCp and the corresponding tests

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3957: -- Resolution: Fixed Fix Version/s: 0.19.0 Status: Resolved (was: Patch Availab

[jira] Updated: (HADOOP-3957) Fix javac warnings in DistCp and the corresponding tests

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3957: -- Hadoop Flags: [Reviewed] > Fix javac warnings in DistCp and the corresponding tests >

Re: [VOTE] Hadoop 0.17.2 release candidate 1

2008-08-18 Thread Nigel Daley
+1 based on running some rudimentary tests and manifest checks. Note that I have *not* run any benchmarks or other end-to-end tests on this release. Nige On Aug 12, 2008, at 10:52 PM, Owen O'Malley wrote: I've created Hadoop 0.17.2 rc 1 and uploaded it to: http://people.apache.org/~omall

[jira] Commented: (HADOOP-3957) Fix javac warnings in DistCp and the corresponding tests

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623458#action_12623458 ] Chris Douglas commented on HADOOP-3957: --- +1 Looks good > Fix javac warnings in Dist

[jira] Updated: (HADOOP-3746) A fair sharing job scheduler

2008-08-18 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3746: -- Status: Patch Available (was: Open) Resubmitting patch because auto-tester seemed to be broke

[jira] Updated: (HADOOP-3746) A fair sharing job scheduler

2008-08-18 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated HADOOP-3746: -- Status: Open (was: Patch Available) > A fair sharing job scheduler >

[jira] Commented: (HADOOP-3937) Job history may get disabled due to overly long job names

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623455#action_12623455 ] Owen O'Malley commented on HADOOP-3937: --- Until we have HADOOP-3245, it seems reasona

[jira] Updated: (HADOOP-3937) Job history may get disabled due to overly long job names

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3937: -- Status: Open (was: Patch Available) pushing through hudson. > Job history may get disabled d

[jira] Updated: (HADOOP-3937) Job history may get disabled due to overly long job names

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3937: -- Status: Patch Available (was: Open) > Job history may get disabled due to overly long job nam

[jira] Created: (HADOOP-3968) test-libhdfs fails on trunk

2008-08-18 Thread Lohit Vijayarenu (JIRA)
test-libhdfs fails on trunk --- Key: HADOOP-3968 URL: https://issues.apache.org/jira/browse/HADOOP-3968 Project: Hadoop Core Issue Type: Bug Components: dfs, libhdfs Affects Versions: 0.19.0 Env

[jira] Updated: (HADOOP-3941) Extend FileSystem API to return file-checksums/file-digests

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HADOOP-3941: --- Attachment: 3941_20080818.patch 3941_20080818.patch: API change preview - A

OK to remove conf.setCombinerClass(myReduce.class)?

2008-08-18 Thread Kunsheng Chen
Hello, everyone. I am doing  example  WordCount and have to remove conf.setCombinerClass(myReduce.class) in main method in order to have maper and reduce run with different types of output collector.  I am not sure whether it cause the problem for the perfomance.  Please let me know if it do

[jira] Commented: (HADOOP-3150) Move task file promotion into the task

2008-08-18 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623439#action_12623439 ] Devaraj Das commented on HADOOP-3150: - +1. Though I should note that this patch curren

[jira] Assigned: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reassigned HADOOP-3062: - Assignee: Chris Douglas > Need to capture the metrics for the network ios generate by df

[jira] Updated: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks

2008-08-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-3062: -- Status: Patch Available (was: Open) Verified results with a randomwriter/sort run > Need to

[jira] Resolved: (HADOOP-3920) Create a page on the hadoop wiki for contrib/fuse-dfs

2008-08-18 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pete Wyckoff resolved HADOOP-3920. -- Resolution: Fixed Assignee: Pete Wyckoff > Create a page on the hadoop wiki for contrib/

[jira] Commented: (HADOOP-3920) Create a page on the hadoop wiki for contrib/fuse-dfs

2008-08-18 Thread Pete Wyckoff (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623428#action_12623428 ] Pete Wyckoff commented on HADOOP-3920: -- I created: http://wiki.apache.org/hadoop/Moun

[jira] Updated: (HADOOP-3962) Shell command "fs -count" should support paths with different file systsms

2008-08-18 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated HADOOP-3962: -- Resolution: Fixed Fix Version/s: 0.19.0 Hadoop Flags: [Reviewed] Status:

[jira] Commented: (HADOOP-3920) Create a page on the hadoop wiki for contrib/fuse-dfs

2008-08-18 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623420#action_12623420 ] dhruba borthakur commented on HADOOP-3920: -- Most contrib projects have a top-leve

[jira] Updated: (HADOOP-3840) Support pluggable speculative execution

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-3840: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) I propose that we mark

[jira] Commented: (HADOOP-3962) Shell command "fs -count" should support paths with different file systsms

2008-08-18 Thread Mahadev konar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623417#action_12623417 ] Mahadev konar commented on HADOOP-3962: --- +1 .. the patch looks good... > Shell com

[jira] Commented: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623414#action_12623414 ] Owen O'Malley commented on HADOOP-3759: --- I'd suggest that: * ResourceStatus class

[jira] Commented: (HADOOP-3962) Shell command "fs -count" should support paths with different file systsms

2008-08-18 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623412#action_12623412 ] Tsz Wo (Nicholas), SZE commented on HADOOP-3962: The following is the "ant

[jira] Updated: (HADOOP-3644) TestLocalJobControl test gets OutOfMemoryError on 64-bit Java

2008-08-18 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-3644: Fix Version/s: (was: 0.17.2) (was: 0.18.0) "resolved as won't fix" mean

[jira] Updated: (HADOOP-3713) broken symlinks in jobcache when local tasks are done but job is in progress

2008-08-18 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-3713: Fix Version/s: (was: 0.17.2) "resolved as duplicate" means that "fixed version" should not be

SetMapOutputValueClass and SetOutputValueclass

2008-08-18 Thread Kunsheng Chen
I want to set up different class value for Map Output and Reduce Output.   I have some following code in the program: conf. setMapOutputValueClass(IntWritable.class); conf.setOutputValueClass(Text.class);  conf.setMapperClass(myMap.class);  conf.setCombinerClass(myReduce.class);   conf.setReduce

[jira] Issue Comment Edited: (HADOOP-3698) Implement access control for submitting jobs to queues in the JobTracker

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623400#action_12623400 ] owen.omalley edited comment on HADOOP-3698 at 8/18/08 9:40 AM: -

[jira] Commented: (HADOOP-3698) Implement access control for submitting jobs to queues in the JobTracker

2008-08-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623400#action_12623400 ] Owen O'Malley commented on HADOOP-3698: --- I'd suggest keeping the implementation conc

[jira] Commented: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes

2008-08-18 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623384#action_12623384 ] Arun C Murthy commented on HADOOP-3759: --- Minor nit: ResourceStatus should definitely

[jira] Issue Comment Edited: (HADOOP-2062) Standardize long-running, daemon-like, threads in hadoop daemons

2008-08-18 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623364#action_12623364 ] enis edited comment on HADOOP-2062 at 8/18/08 7:59 AM: Why

[jira] Commented: (HADOOP-3934) Update log4j from 1.2.13 to 1.2.15

2008-08-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623348#action_12623348 ] Steve Loughran commented on HADOOP-3934: > Hadoop is built with a non-standard ver

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-18 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Status: Patch Available (was: Open) > Move task file promotion into the t

[jira] Updated: (HADOOP-2165) Augment JobHistory to store tasks' userlogs

2008-08-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HADOOP-2165: Attachment: patch_userlog_1.4.3.txt Attaching a patch. This adds hyperlin

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-18 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Attachment: patch-3150.txt Here is a patch after incorporating review comm

[jira] Updated: (HADOOP-3150) Move task file promotion into the task

2008-08-18 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HADOOP-3150: Status: Open (was: Patch Available) Cancelling patch to incorporate Devar

[jira] Assigned: (HADOOP-2165) Augment JobHistory to store tasks' userlogs

2008-08-18 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned HADOOP-2165: --- Assignee: Vinod Kumar Vavilapalli > Augment JobHistory to store task

Build failed in Hudson: Hadoop-trunk #578

2008-08-18 Thread Apache Hudson Server
See http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/578/changes Changes: [shv] HADOOP-3905. Create generic interfaces for edit log streams. Contributed by Konstantin Shvachko. [rangadi] HADOOP-3933. DataNode sometimes sends up to io.byte.per.checksum bytes more than required to client.

[jira] Commented: (HADOOP-2062) Standardize long-running, daemon-like, threads in hadoop daemons

2008-08-18 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623309#action_12623309 ] Steve Loughran commented on HADOOP-2062: Actually, they are slightly different. Th

[jira] Commented: (HADOOP-3913) Distcp allows copy even if directory permissions are 000.

2008-08-18 Thread Suman Sehgal (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623306#action_12623306 ] Suman Sehgal commented on HADOOP-3913: -- Yeah the distcp operation was carried out by

[jira] Commented: (HADOOP-3759) Provide ability to run memory intensive jobs without affecting other running tasks on the nodes

2008-08-18 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623286#action_12623286 ] Devaraj Das commented on HADOOP-3759: - I am okay with the patch. The one thing i do wa

[jira] Commented: (HADOOP-3698) Implement access control for submitting jobs to queues in the JobTracker

2008-08-18 Thread Hemanth Yamijala (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623283#action_12623283 ] Hemanth Yamijala commented on HADOOP-3698: -- - We could have an implementation on

[jira] Resolved: (HADOOP-2062) Standardize long-running, daemon-like, threads in hadoop daemons

2008-08-18 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enis Soztutar resolved HADOOP-2062. --- Resolution: Duplicate This issue will be fixed at HADOOP-3628. > Standardize long-running,

[jira] Commented: (HADOOP-3949) javadoc warnings: Multiple sources of package comments found for package

2008-08-18 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12623279#action_12623279 ] Amareshwari Sriramadasu commented on HADOOP-3949: - Commons logging warning