[jira] [Commented] (MAPREDUCE-5984) native-task: upgrade lz4 to lastest version

2014-07-22 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069939#comment-14069939 ] Binglin Chang commented on MAPREDUCE-5984: -- bq. but I'm wondering if it's

[jira] [Commented] (MAPREDUCE-2841) Task level native optimization

2014-07-22 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069945#comment-14069945 ] Binglin Chang commented on MAPREDUCE-2841: -- Hi Sean, the test succeed on

[jira] [Created] (MAPREDUCE-5988) Fix dead links to the javadocs of o.a.h.mapreduce.counters

2014-07-22 Thread Akira AJISAKA (JIRA)
Akira AJISAKA created MAPREDUCE-5988: Summary: Fix dead links to the javadocs of o.a.h.mapreduce.counters Key: MAPREDUCE-5988 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5988 Project:

[jira] [Updated] (MAPREDUCE-5988) Fix dead links to the javadocs of o.a.h.mapreduce.counters

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5988: - Attachment: MAPREDUCE-5988.patch Removing {{@InterfaceAudience.Private}} from the

[jira] [Updated] (MAPREDUCE-5988) Fix dead links to the javadocs in mapreduce project

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5988: - Summary: Fix dead links to the javadocs in mapreduce project (was: Fix dead links

[jira] [Updated] (MAPREDUCE-5988) Fix dead links to the javadocs of o.a.h.mapreduce.counters

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5988: - Description: In http://hadoop.apache.org/docs/r2.4.1/api/allclasses-frame.html, some

[jira] [Commented] (MAPREDUCE-5988) Fix dead links to the javadocs in mapreduce project

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070062#comment-14070062 ] Akira AJISAKA commented on MAPREDUCE-5988: -- The below classes are linked, but

[jira] [Updated] (MAPREDUCE-5988) Fix dead links to the javadocs in mapreduce project

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5988: - Description: In http://hadoop.apache.org/docs/r2.4.1/api/allclasses-frame.html, some

[jira] [Updated] (MAPREDUCE-5988) Fix dead links to the javadocs in mapreduce project

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5988: - Attachment: MAPREDUCE-5988.2.patch Removed {{@InterfaceAudience.Private}} from each

[jira] [Updated] (MAPREDUCE-5988) Fix dead links to the javadocs in mapreduce project

2014-07-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated MAPREDUCE-5988: - Target Version/s: 2.6.0 Status: Patch Available (was: Open) Fix dead

[jira] [Commented] (MAPREDUCE-5988) Fix dead links to the javadocs in mapreduce project

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070091#comment-14070091 ] Hadoop QA commented on MAPREDUCE-5988: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070121#comment-14070121 ] Hudson commented on MAPREDUCE-5957: --- FAILURE: Integrated in Hadoop-Yarn-trunk #620

[jira] [Commented] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070123#comment-14070123 ] Hudson commented on MAPREDUCE-5756: --- FAILURE: Integrated in Hadoop-Yarn-trunk #620

[jira] [Created] (MAPREDUCE-5989) Add DeletionService in AM

2014-07-22 Thread Varun Saxena (JIRA)
Varun Saxena created MAPREDUCE-5989: --- Summary: Add DeletionService in AM Key: MAPREDUCE-5989 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5989 Project: Hadoop Map/Reduce Issue

[jira] [Commented] (MAPREDUCE-5989) Add DeletionService in AM

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070246#comment-14070246 ] Jason Lowe commented on MAPREDUCE-5989: --- Is this the same kind of

[jira] [Assigned] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-4841: - Assignee: Jason Lowe (was: Devaraj K) Application Master Retries fail due to

[jira] [Commented] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070247#comment-14070247 ] Jason Lowe commented on MAPREDUCE-4841: --- I believe this has been fixed by

[jira] [Resolved] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

2014-07-22 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved MAPREDUCE-4841. -- Resolution: Fixed It has been fixed by MAPREDUCE-5476, closing it as duplicate of

[jira] [Reopened] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

2014-07-22 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reopened MAPREDUCE-4841: -- Application Master Retries fail due to FileNotFoundException

[jira] [Resolved] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

2014-07-22 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved MAPREDUCE-4841. -- Resolution: Duplicate Application Master Retries fail due to FileNotFoundException

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5963: -- Attachment: MAPREDUCE-5963-v2.1.patch In latest patch, fix the findbug warning.

[jira] [Commented] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070284#comment-14070284 ] Hudson commented on MAPREDUCE-5756: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1812

[jira] [Commented] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070282#comment-14070282 ] Hudson commented on MAPREDUCE-5957: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #1812

[jira] [Commented] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070309#comment-14070309 ] Hadoop QA commented on MAPREDUCE-5963: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070356#comment-14070356 ] Hudson commented on MAPREDUCE-5756: --- SUCCESS: Integrated in Hadoop-Mapreduce-trunk

[jira] [Commented] (MAPREDUCE-5957) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070354#comment-14070354 ] Hudson commented on MAPREDUCE-5957: --- SUCCESS: Integrated in Hadoop-Mapreduce-trunk

[jira] [Resolved] (MAPREDUCE-250) JobTracker should log the scheduling of setup/cleanup task

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-250. Resolution: Fixed Fairly confident this has been fixed. Closing as stale.

[jira] [Updated] (MAPREDUCE-2811) Adding Multiple Reducers implementations.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-2811: Description: Like HADOOP-372, we have a multi format Reducer too. Someone

[jira] [Updated] (MAPREDUCE-126) Job history analysis showing wrong job runtime

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-126: --- Labels: newbie (was: ) Job history analysis showing wrong job runtime

[jira] [Resolved] (MAPREDUCE-126) Job history analysis showing wrong job runtime

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-126. Resolution: Incomplete This code is long gone in 2.x. Closing as stale. Job

[jira] [Resolved] (MAPREDUCE-484) Logos for Hive and JobTracker

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-484. Resolution: Fixed Stale. Closing. Logos for Hive and JobTracker

[jira] [Resolved] (MAPREDUCE-700) Too many copies of job-conf with the jobtracker

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-700. Resolution: Fixed Lots of changes here already. Closing this as stale. Too

[jira] [Resolved] (MAPREDUCE-173) JobConf should also load resources from hdfs (or other filesystems)

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-173. Resolution: Fixed This is almost certainly fixed by now. JobConf should also

[jira] [Resolved] (MAPREDUCE-322) TaskTracker shuold run user tasks nicely in the local machine

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-322. Resolution: Fixed This has been fixed with both cgroups and task level

[jira] [Resolved] (MAPREDUCE-275) Display lost tracker information on the jobtracker webui and persist it across restarts

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-275. Resolution: Won't Fix I'm going to close this as Won't Fix. Display lost

[jira] [Resolved] (MAPREDUCE-156) ProcessTree.destroy() is sleeping for 5 seconds holding the task slot

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-156. Resolution: Won't Fix This is intentional to potentially give time for the

[jira] [Commented] (MAPREDUCE-327) Add explicit remote map count JobTracker metrics

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070734#comment-14070734 ] Allen Wittenauer commented on MAPREDUCE-327: In real-world scenarios, we've

[jira] [Updated] (MAPREDUCE-327) Add explicit remote map count JobTracker metrics

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-327: --- Labels: newbie (was: ) Add explicit remote map count JobTracker metrics

[jira] [Updated] (MAPREDUCE-5990) If output directory can not be created, error message on stdout does not provide any clue.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-5990: Component/s: examples If output directory can not be created, error message

[jira] [Commented] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070737#comment-14070737 ] Jason Lowe commented on MAPREDUCE-5963: --- +1 lgtm. Committing this.

[jira] [Moved] (MAPREDUCE-5990) If output directory can not be created, error message on stdout does not provide any clue.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved HADOOP-5756 to MAPREDUCE-5990: - Affects Version/s: (was: 0.18.3) Issue

[jira] [Updated] (MAPREDUCE-197) add new options to mapred job -list-attempt-ids to dump counters and diagnostic messages

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-197: --- Description: It would be very nice when tracking down tasks that have strange

[jira] [Updated] (MAPREDUCE-197) add new options to mapred job -list-attempt-ids to dump counters and diagnostic messages

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-197: --- Summary: add new options to mapred job -list-attempt-ids to dump counters and

[jira] [Updated] (MAPREDUCE-168) hadoop job -list all should display the code for Killed also.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-168: --- Labels: newbie (was: ) hadoop job -list all should display the code for Killed

[jira] [Updated] (MAPREDUCE-168) mapred job -list all should display the code for Killed also.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-168: --- Description: mapred job -list all shows a legend for the states: PREP, SUCCEEDED,

[jira] [Updated] (MAPREDUCE-197) add new options to hadoop job -list-attempt-ids to dump counters and diagnostic messages

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-197: --- Labels: newbie (was: ) add new options to hadoop job -list-attempt-ids to dump

[jira] [Updated] (MAPREDUCE-168) mapred job -list all should display the code for Killed also.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-168: --- Summary: mapred job -list all should display the code for Killed also. (was:

[jira] [Resolved] (MAPREDUCE-403) ProcessTree can try and kill a null PID

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-403. Resolution: Incomplete I'm going to close this as stale. If this is still an

[jira] [Updated] (MAPREDUCE-403) ProcessTree can try and kill a null PID

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-403: --- Summary: ProcessTree can try and kill a null PID (was: ProcessTree can try and

[jira] [Resolved] (MAPREDUCE-526) Sometimes job does not get removed from scheduler queue after it is killed

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-526. Resolution: Won't Fix Closing this as won't fix. Sometimes job does not get

[jira] [Updated] (MAPREDUCE-635) IllegalArgumentException is thrown if mapred local dir is not writable.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-635: --- Labels: newbie (was: ) IllegalArgumentException is thrown if mapred local dir

[jira] [Commented] (MAPREDUCE-5985) native-task: Fix build on macosx

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070757#comment-14070757 ] Todd Lipcon commented on MAPREDUCE-5985: +1, looks good to me. This also fixed

[jira] [Commented] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070760#comment-14070760 ] Hudson commented on MAPREDUCE-5963: --- FAILURE: Integrated in Hadoop-trunk-Commit

[jira] [Resolved] (MAPREDUCE-257) Preventing node from swapping

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-257. Resolution: Fixed prevent a node from swapping - don't exhaust memory - memory

[jira] [Updated] (MAPREDUCE-5963) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5963: -- Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Hadoop Flags:

[jira] [Resolved] (MAPREDUCE-1283) Support including 3rd party jars supplied in lib/ folder of eclipse project in hadoop jar

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1283. - Resolution: Incomplete Likely stale. Support including 3rd party jars

[jira] [Resolved] (MAPREDUCE-401) du fails on Ubuntu in TestJobHistory

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-401. Resolution: Fixed Likely fixed forever ago. du fails on Ubuntu in

[jira] [Resolved] (MAPREDUCE-111) JobTracker.getSystemDir throws NPE if it is called during intialization

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-111. Resolution: Not a Problem JobTracker.getSystemDir throws NPE if it is called

[jira] [Resolved] (MAPREDUCE-5985) native-task: Fix build on macosx

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-5985. Resolution: Fixed Hadoop Flags: Reviewed native-task: Fix build on macosx

[jira] [Comment Edited] (MAPREDUCE-311) JobClient should use multiple volumes as hadoop.tmp.dir

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070802#comment-14070802 ] Allen Wittenauer edited comment on MAPREDUCE-311 at 7/22/14 8:11 PM:

[jira] [Updated] (MAPREDUCE-1775) Streaming should use hadoop.tmp.dir instead of stream.tmpdir

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated MAPREDUCE-1775: Labels: newbie (was: ) Streaming should use hadoop.tmp.dir instead of

[jira] [Created] (MAPREDUCE-5991) native-task should not run unit tests if native profile is not enabled

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5991: -- Summary: native-task should not run unit tests if native profile is not enabled Key: MAPREDUCE-5991 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5991

[jira] [Commented] (MAPREDUCE-311) JobClient should use multiple volumes as hadoop.tmp.dir

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070802#comment-14070802 ] Allen Wittenauer commented on MAPREDUCE-311: It's likely too late to change

[jira] [Created] (MAPREDUCE-5992) native-task test logs should not write to console

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5992: -- Summary: native-task test logs should not write to console Key: MAPREDUCE-5992 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5992 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-537) Instrument events in the capacity scheduler for collecting metrics information

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-537. Resolution: Incomplete I'm going to close this as stale. Instrument events in

[jira] [Resolved] (MAPREDUCE-528) NPE in jobqueue_details.jsp page if scheduler has not started

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-528. Resolution: Won't Fix NPE in jobqueue_details.jsp page if scheduler has not

[jira] [Created] (MAPREDUCE-5993) native-task: simplify/remove dead code

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5993: -- Summary: native-task: simplify/remove dead code Key: MAPREDUCE-5993 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5993 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-2166) map.input.file is not set

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-2166. - Resolution: Not a Problem map.input.file is not set

[jira] [Resolved] (MAPREDUCE-301) mapred.child.classpath.extension property

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-301. Resolution: Fixed Already fixed via other means.

[jira] [Resolved] (MAPREDUCE-352) Avoid creating JobInProgress objects before Access checks and Queues checks are done in JobTracker submitJob

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-352. Resolution: Incomplete Stale with YAWN. I mean YARN. Avoid creating

[jira] [Commented] (MAPREDUCE-5992) native-task test logs should not write to console

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070843#comment-14070843 ] Todd Lipcon commented on MAPREDUCE-5992: I realized it's not a log4j issue at

[jira] [Resolved] (MAPREDUCE-562) A single slow (but not dead) map TaskTracker impedes MapReduce progress

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-562. Resolution: Incomplete This is still an interesting issue, but at this point, I

[jira] [Created] (MAPREDUCE-5994) native-task: TestBytesUtil fails

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5994: -- Summary: native-task: TestBytesUtil fails Key: MAPREDUCE-5994 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5994 Project: Hadoop Map/Reduce Issue

[jira] [Resolved] (MAPREDUCE-385) pipes does not allow jobconf values containing commas

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-385. Resolution: Won't Fix -jobconf be dead, yo. pipes does not allow jobconf

[jira] [Resolved] (MAPREDUCE-3) Set mapred.child.ulimit automatically to the value of the RAM limits for a job, if they are set

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-3. -- Resolution: Fixed Who sets ulimit anymore? No one. Why? cgroups and /proc-based

[jira] [Resolved] (MAPREDUCE-171) TestJobTrackerRestartWithLostTracker sometimes fails while validating history.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-171. Resolution: Fixed I'm closing this as stale at this point.

[jira] [Resolved] (MAPREDUCE-103) The TaskTracker's shell environment should not be passed to the children.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-103. Resolution: Fixed task-controller/container-executor should have fixed this.

[jira] [Resolved] (MAPREDUCE-459) Elegant decommission of lighty loaded tasktrackers from a map-reduce cluster

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-459. Resolution: Incomplete Me too. Closing. Elegant decommission of lighty loaded

[jira] [Resolved] (MAPREDUCE-442) Ability to re-configure hadoop daemons online

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-442. Resolution: Duplicate I'm going to dupe this to HADOOP-7001, since it's closer

[jira] [Resolved] (MAPREDUCE-388) pipes combiner has a large memory footprint

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-388. Resolution: Incomplete Closing this as stale. pipes combiner has a large

[jira] [Resolved] (MAPREDUCE-441) TestMapReduceJobControl.testJobControlWithKillJob timedout in of the hudson runs

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-441. Resolution: Incomplete Almost certainly stale.

[jira] [Resolved] (MAPREDUCE-653) distcp can support bandwidth limiting

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-653. Resolution: Won't Fix distcpv2 does this now. closing as won't fix. distcp

[jira] [Resolved] (MAPREDUCE-533) Support task preemption in Capacity Scheduler

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-533. Resolution: Duplicate Support task preemption in Capacity Scheduler

[jira] [Resolved] (MAPREDUCE-563) Security features for Map/Reduce

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-563. Resolution: Fixed All your jobs are belong to someone who has a Kerberos

[jira] [Resolved] (MAPREDUCE-564) Provide a way for the client to get the number of currently running maps/reduces

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-564. Resolution: Incomplete Probably stale. See also comments about new API.

[jira] [Resolved] (MAPREDUCE-736) Undefined variable is treated as string.

2014-07-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-736. Resolution: Incomplete Stale? Undefined variable is treated as string.

[jira] [Commented] (MAPREDUCE-1767) Steaming infrastructures should provide statisics about job

2014-07-22 Thread Antonio Piccolboni (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071061#comment-14071061 ] Antonio Piccolboni commented on MAPREDUCE-1767: --- Such as? Steaming

[jira] [Commented] (MAPREDUCE-5979) MR1 FairScheduler zero weight can cause sort failures

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071082#comment-14071082 ] Karthik Kambatla commented on MAPREDUCE-5979: - +1 MR1 FairScheduler zero

[jira] [Updated] (MAPREDUCE-5979) FairScheduler: zero weight can cause sort failures

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5979: Summary: FairScheduler: zero weight can cause sort failures (was: MR1

[jira] [Updated] (MAPREDUCE-5979) FairScheduler: zero weight can cause sort failures

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5979: Resolution: Fixed Fix Version/s: 1.3.0 Hadoop Flags: Reviewed

[jira] [Commented] (MAPREDUCE-5966) MR1 FairScheduler use of custom weight adjuster is not thread safe for comparisons

2014-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071106#comment-14071106 ] Karthik Kambatla commented on MAPREDUCE-5966: - Looks like this patch

[jira] [Commented] (MAPREDUCE-5974) Allow map output collector fallback

2014-07-22 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071174#comment-14071174 ] Chris Douglas commented on MAPREDUCE-5974: -- bq. Doing fallback as the records

[jira] [Created] (MAPREDUCE-5995) native-task: revert changes which expose Text internals

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5995: -- Summary: native-task: revert changes which expose Text internals Key: MAPREDUCE-5995 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5995 Project: Hadoop

[jira] [Assigned] (MAPREDUCE-5994) native-task: TestBytesUtil fails

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned MAPREDUCE-5994: -- Assignee: Todd Lipcon Working on removing the redundant functions here

[jira] [Created] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5996: -- Summary: native-task: Rename system tests into standard directory layout Key: MAPREDUCE-5996 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5996 Project:

[jira] [Commented] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071224#comment-14071224 ] Todd Lipcon commented on MAPREDUCE-5996: There's also a random file called

[jira] [Updated] (MAPREDUCE-5994) native-task: TestBytesUtil fails

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-5994: --- Attachment: mapreduce-5994.txt native-task: TestBytesUtil fails

[jira] [Updated] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated MAPREDUCE-5996: --- Attachment: mapreduce-5996.txt native-task: Rename system tests into standard directory

[jira] [Created] (MAPREDUCE-5997) native-task: Use DirectBufferPool from Hadoop Common

2014-07-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created MAPREDUCE-5997: -- Summary: native-task: Use DirectBufferPool from Hadoop Common Key: MAPREDUCE-5997 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5997 Project: Hadoop

[jira] [Commented] (MAPREDUCE-5974) Allow map output collector fallback

2014-07-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071247#comment-14071247 ] Todd Lipcon commented on MAPREDUCE-5974: In the case of the native collector,

  1   2   >