[jira] [Created] (MAPREDUCE-5997) native-task: Use DirectBufferPool from Hadoop Common

Todd Lipcon created MAPREDUCE-5997: -- Summary: native-task: Use DirectBufferPool from Hadoop Common Key: MAPREDUCE-5997 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5997 Project: Hadoop Map/Red

[jira] [Created] (MAPREDUCE-5996) native-task: Rename system tests into standard directory layout

Todd Lipcon created MAPREDUCE-5996: -- Summary: native-task: Rename system tests into standard directory layout Key: MAPREDUCE-5996 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5996 Project: Ha

[jira] [Created] (MAPREDUCE-5995) native-task: revert changes which expose Text internals

Todd Lipcon created MAPREDUCE-5995: -- Summary: native-task: revert changes which expose Text internals Key: MAPREDUCE-5995 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5995 Project: Hadoop Map/

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

+1 On Tue, Jul 22, 2014 at 3:44 PM, Sandy Ryza wrote: > That policy makes sense to me. We should still label things @Private of > course so that it can be reflected in the documentation. > > -Sandy > > > On Tue, Jul 22, 2014 at 2:54 PM, Karthik Kambatla > wrote: > > > Hi devs > > > > As you m

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

That policy makes sense to me. We should still label things @Private of course so that it can be reflected in the documentation. -Sandy On Tue, Jul 22, 2014 at 2:54 PM, Karthik Kambatla wrote: > Hi devs > > As you might have noticed, we have several classes and methods in them that > are not

[jira] [Resolved] (MAPREDUCE-736) Undefined variable is treated as string.

[ https://issues.apache.org/jira/browse/MAPREDUCE-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-736. Resolution: Incomplete Stale? > Undefined variable is treated as string. >

[jira] [Resolved] (MAPREDUCE-564) Provide a way for the client to get the number of currently running maps/reduces

[ https://issues.apache.org/jira/browse/MAPREDUCE-564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-564. Resolution: Incomplete Probably stale. See also comments about new API. > Prov

[jira] [Resolved] (MAPREDUCE-563) Security features for Map/Reduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-563. Resolution: Fixed All your jobs are belong to someone who has a Kerberos princip

[jira] [Resolved] (MAPREDUCE-533) Support task preemption in Capacity Scheduler

[ https://issues.apache.org/jira/browse/MAPREDUCE-533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-533. Resolution: Duplicate > Support task preemption in Capacity Scheduler >

[jira] [Resolved] (MAPREDUCE-653) distcp can support bandwidth limiting

[ https://issues.apache.org/jira/browse/MAPREDUCE-653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-653. Resolution: Won't Fix distcpv2 does this now. closing as won't fix. > distcp ca

[jira] [Resolved] (MAPREDUCE-441) TestMapReduceJobControl.testJobControlWithKillJob timedout in of the hudson runs

[ https://issues.apache.org/jira/browse/MAPREDUCE-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-441. Resolution: Incomplete Almost certainly stale. > TestMapReduceJobControl.testJo

[DISCUSS] Assume Private-Unstable for classes that are not annotated

Hi devs As you might have noticed, we have several classes and methods in them that are not annotated at all. This is seldom intentional. Avoiding incompatible changes to all these classes can be considerable baggage. I was wondering if we should add an explicit disclaimer in our compatibility gu

[jira] [Resolved] (MAPREDUCE-388) pipes combiner has a large memory footprint

[ https://issues.apache.org/jira/browse/MAPREDUCE-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-388. Resolution: Incomplete Closing this as stale. > pipes combiner has a large memo

[jira] [Resolved] (MAPREDUCE-459) Elegant decommission of lighty loaded tasktrackers from a map-reduce cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-459. Resolution: Incomplete Me too. Closing. > Elegant decommission of lighty loaded

[jira] [Resolved] (MAPREDUCE-442) Ability to re-configure hadoop daemons online

[ https://issues.apache.org/jira/browse/MAPREDUCE-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-442. Resolution: Duplicate I'm going to dupe this to HADOOP-7001, since it's closer t

[jira] [Resolved] (MAPREDUCE-103) The TaskTracker's shell environment should not be passed to the children.

[ https://issues.apache.org/jira/browse/MAPREDUCE-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-103. Resolution: Fixed task-controller/container-executor should have fixed this. Clo

[jira] [Resolved] (MAPREDUCE-171) TestJobTrackerRestartWithLostTracker sometimes fails while validating history.

[ https://issues.apache.org/jira/browse/MAPREDUCE-171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-171. Resolution: Fixed I'm closing this as stale at this point. > TestJobTrackerRest

[jira] [Resolved] (MAPREDUCE-3) Set mapred.child.ulimit automatically to the value of the RAM limits for a job, if they are set

[ https://issues.apache.org/jira/browse/MAPREDUCE-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-3. -- Resolution: Fixed Who sets ulimit anymore? No one. Why? cgroups and /proc-based memory

[jira] [Resolved] (MAPREDUCE-481) Improvements to Global Black-listing of TaskTrackers

[ https://issues.apache.org/jira/browse/MAPREDUCE-481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-481. Resolution: Fixed Closing this out as stale. Blacklisting had a lot more work d

[jira] [Resolved] (MAPREDUCE-643) distcp -pugp error message is not clear when chgrp fail.

[ https://issues.apache.org/jira/browse/MAPREDUCE-643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-643. Resolution: Incomplete Closing this as stale given distcpv2! > distcp -pugp err

[jira] [Resolved] (MAPREDUCE-385) pipes does not allow jobconf values containing commas

[ https://issues.apache.org/jira/browse/MAPREDUCE-385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-385. Resolution: Won't Fix -jobconf be dead, yo. > pipes does not allow jobconf valu

[jira] [Created] (MAPREDUCE-5994) native-task: TestBytesUtil fails

Todd Lipcon created MAPREDUCE-5994: -- Summary: native-task: TestBytesUtil fails Key: MAPREDUCE-5994 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5994 Project: Hadoop Map/Reduce Issue

[jira] [Resolved] (MAPREDUCE-562) A single slow (but not dead) map TaskTracker impedes MapReduce progress

[ https://issues.apache.org/jira/browse/MAPREDUCE-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-562. Resolution: Incomplete This is still an interesting issue, but at this point, I

[jira] [Resolved] (MAPREDUCE-352) Avoid creating JobInProgress objects before Access checks and Queues checks are done in JobTracker submitJob

[ https://issues.apache.org/jira/browse/MAPREDUCE-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-352. Resolution: Incomplete Stale with YAWN. I mean YARN. > Avoid creating JobInPro

[jira] [Resolved] (MAPREDUCE-2166) "map.input.file" is not set

[ https://issues.apache.org/jira/browse/MAPREDUCE-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-2166. - Resolution: Not a Problem > "map.input.file" is not set > ---

[jira] [Created] (MAPREDUCE-5993) native-task: simplify/remove dead code

Todd Lipcon created MAPREDUCE-5993: -- Summary: native-task: simplify/remove dead code Key: MAPREDUCE-5993 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5993 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-301) mapred.child.classpath.extension property

[ https://issues.apache.org/jira/browse/MAPREDUCE-301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-301. Resolution: Fixed Already fixed via other means. > mapred.child.classpath.exten

[jira] [Resolved] (MAPREDUCE-537) Instrument events in the capacity scheduler for collecting metrics information

[ https://issues.apache.org/jira/browse/MAPREDUCE-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-537. Resolution: Incomplete I'm going to close this as stale. > Instrument events in

[jira] [Resolved] (MAPREDUCE-528) NPE in jobqueue_details.jsp page if scheduler has not started

[ https://issues.apache.org/jira/browse/MAPREDUCE-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-528. Resolution: Won't Fix > NPE in jobqueue_details.jsp page if scheduler has not st

[jira] [Created] (MAPREDUCE-5992) native-task test logs should not write to console

Todd Lipcon created MAPREDUCE-5992: -- Summary: native-task test logs should not write to console Key: MAPREDUCE-5992 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5992 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5991) native-task should not run unit tests if native profile is not enabled

Todd Lipcon created MAPREDUCE-5991: -- Summary: native-task should not run unit tests if native profile is not enabled Key: MAPREDUCE-5991 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5991 Proj

Re: [jira] [Resolved] (MAPREDUCE-5975) Fix native-task build on Ubuntu 13.10

Thanks & Regards, Siva Mondeddula 630-267-7953 On Tue, Jul 22, 2014 at 3:10 PM, Todd Lipcon (JIRA) wrote: > > [ > https://issues.apache.org/jira/browse/MAPREDUCE-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel > ] > > Todd Lipcon resolved MAPREDUCE-5975. > --

[jira] [Resolved] (MAPREDUCE-5975) Fix native-task build on Ubuntu 13.10

[ https://issues.apache.org/jira/browse/MAPREDUCE-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-5975. Resolution: Duplicate Binglin fixed this in MAPREDUCE-5985 > Fix native-task build on

[jira] [Resolved] (MAPREDUCE-21) NegativeArraySizeException in reducer with new api

[ https://issues.apache.org/jira/browse/MAPREDUCE-21?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-21. --- Resolution: Fixed This is almost certainly fixed by now. > NegativeArraySizeExcept

[jira] [Resolved] (MAPREDUCE-5985) native-task: Fix build on macosx

[ https://issues.apache.org/jira/browse/MAPREDUCE-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved MAPREDUCE-5985. Resolution: Fixed Hadoop Flags: Reviewed > native-task: Fix build on macosx > ---

[jira] [Resolved] (MAPREDUCE-111) JobTracker.getSystemDir throws NPE if it is called during intialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-111. Resolution: Not a Problem > JobTracker.getSystemDir throws NPE if it is called d

[jira] [Resolved] (MAPREDUCE-401) du fails on Ubuntu in TestJobHistory

[ https://issues.apache.org/jira/browse/MAPREDUCE-401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-401. Resolution: Fixed Likely fixed forever ago. > du fails on Ubuntu in TestJobHist

[jira] [Resolved] (MAPREDUCE-1283) Support including 3rd party jars supplied in lib/ folder of eclipse project in hadoop jar

[ https://issues.apache.org/jira/browse/MAPREDUCE-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-1283. - Resolution: Incomplete Likely stale. > Support including 3rd party jars supp

[jira] [Resolved] (MAPREDUCE-257) Preventing node from swapping

[ https://issues.apache.org/jira/browse/MAPREDUCE-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-257. Resolution: Fixed "prevent a node from swapping" -> "don't exhaust memory" -> "m

[jira] [Resolved] (MAPREDUCE-526) Sometimes job does not get removed from scheduler queue after it is killed

[ https://issues.apache.org/jira/browse/MAPREDUCE-526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-526. Resolution: Won't Fix Closing this as won't fix. > Sometimes job does not get r

[jira] [Resolved] (MAPREDUCE-403) ProcessTree can try and kill a "null" PID

[ https://issues.apache.org/jira/browse/MAPREDUCE-403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-403. Resolution: Incomplete I'm going to close this as stale. If this is still an is

[jira] [Resolved] (MAPREDUCE-156) ProcessTree.destroy() is sleeping for 5 seconds holding the task slot

[ https://issues.apache.org/jira/browse/MAPREDUCE-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-156. Resolution: Won't Fix This is intentional to potentially give time for the proce

[jira] [Resolved] (MAPREDUCE-275) Display lost tracker information on the jobtracker webui and persist it across restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-275. Resolution: Won't Fix I'm going to close this as Won't Fix. > Display lost trac

[jira] [Resolved] (MAPREDUCE-322) TaskTracker shuold run user tasks nicely in the local machine

[ https://issues.apache.org/jira/browse/MAPREDUCE-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-322. Resolution: Fixed This has been fixed with both cgroups and task level niceness.

[jira] [Resolved] (MAPREDUCE-173) JobConf should also load resources from hdfs (or other filesystems)

[ https://issues.apache.org/jira/browse/MAPREDUCE-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-173. Resolution: Fixed This is almost certainly fixed by now. > JobConf should also

[jira] [Resolved] (MAPREDUCE-484) Logos for Hive and JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-484. Resolution: Fixed Stale. Closing. > Logos for Hive and JobTracker > ---

[jira] [Resolved] (MAPREDUCE-700) Too many copies of job-conf with the jobtracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-700. Resolution: Fixed Lots of changes here already. Closing this as stale. > Too ma

[jira] [Resolved] (MAPREDUCE-126) Job history analysis showing wrong job runtime

[ https://issues.apache.org/jira/browse/MAPREDUCE-126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-126. Resolution: Incomplete This code is long gone in 2.x. Closing as stale. > Job h

[jira] [Resolved] (MAPREDUCE-250) JobTracker should log the scheduling of setup/cleanup task

[ https://issues.apache.org/jira/browse/MAPREDUCE-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved MAPREDUCE-250. Resolution: Fixed Fairly confident this has been fixed. Closing as stale. > Job

[jira] [Reopened] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reopened MAPREDUCE-4841: -- > Application Master Retries fail due to FileNotFoundException > --

[jira] [Resolved] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved MAPREDUCE-4841. -- Resolution: Fixed It has been fixed by MAPREDUCE-5476, closing it as duplicate of MAPREDUCE

[jira] [Resolved] (MAPREDUCE-4841) Application Master Retries fail due to FileNotFoundException

[ https://issues.apache.org/jira/browse/MAPREDUCE-4841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved MAPREDUCE-4841. -- Resolution: Duplicate > Application Master Retries fail due to FileNotFoundException >

[jira] [Created] (MAPREDUCE-5989) Add DeletionService in AM

Varun Saxena created MAPREDUCE-5989: --- Summary: Add DeletionService in AM Key: MAPREDUCE-5989 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5989 Project: Hadoop Map/Reduce Issue Type:

[jira] [Created] (MAPREDUCE-5988) Fix dead links to the javadocs of o.a.h.mapreduce.counters

Akira AJISAKA created MAPREDUCE-5988: Summary: Fix dead links to the javadocs of o.a.h.mapreduce.counters Key: MAPREDUCE-5988 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5988 Project: Hado