Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-23 Thread Jason Lowe
I think that's a reasonable proposal as long as we understand it changes the burden from finding all the things that should be marked @Private to finding all the things that should be marked @Public. As Tom Graves pointed out in an earlier discussion about @LimitedPrivate, it may be impossible

[jira] [Created] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

2014-07-18 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5982: - Summary: Task attempts that fail from the ASSIGNED state can disappear Key: MAPREDUCE-5982 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5982 Project

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-27 Thread Jason Lowe
+1 - Verified signatures and digests - Built from source, installed on single-node cluster and ran some sample jobs Jason On 06/21/2014 01:51 AM, Arun C Murthy wrote: Folks, I've created another release candidate (rc1) for hadoop-2.4.1 based on the feedback that I would like to push out.

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-25 Thread Jason Lowe
+1 (binding) - Verified signatures and digests - Deployed binary tarball to a single-node cluster and ran some MR example jobs - Built from source, deployed to a single-node cluster and ran some MR example jobs Jason On 06/19/2014 10:14 AM, Thomas Graves wrote: Hey Everyone, There have bee

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Jason Lowe
+1 (binding) Jason On 06/24/2014 03:53 AM, Arun C Murthy wrote: Folks, As discussed, I'd like to call a vote on changing our by-laws to change release votes from 7 days to 5. I've attached the change to by-laws I'm proposing. Please vote, the vote will the usual period of 7 days. tha

[jira] [Resolved] (MAPREDUCE-5928) Deadlock allocating containers for mappers and reducers

2014-06-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5928. --- Resolution: Duplicate > Deadlock allocating containers for mappers and reduc

[jira] [Resolved] (MAPREDUCE-5927) Getting following error

2014-06-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5927. --- Resolution: Invalid This is a general support question better asked on the u

[jira] [Resolved] (MAPREDUCE-5927) Getting following error

2014-06-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5927. --- Resolution: Fixed > Getting following er

[jira] [Reopened] (MAPREDUCE-5927) Getting following error

2014-06-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5927: --- > Getting following error > --- > > Key: MA

[jira] [Resolved] (MAPREDUCE-5923) org.apache.hadoop.mapred.pipes.TestPipeApplication timeouts intermittently

2014-06-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5923. --- Resolution: Duplicate This is a duplicate of MAPREDUCE-5868

[jira] [Reopened] (MAPREDUCE-5830) HostUtil.getTaskLogUrl is not backwards binary compatible with 2.3

2014-05-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5830: --- Reopening this, as we should address older Hive versions. > HostUtil.getTaskLogUrl is

[jira] [Created] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

2014-05-16 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5891: - Summary: Improved shuffle error handling across NM restarts Key: MAPREDUCE-5891 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5891 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5885) build/test/test.mapred.spill causes release audit warnings

2014-05-15 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5885: - Summary: build/test/test.mapred.spill causes release audit warnings Key: MAPREDUCE-5885 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5885 Project: Hadoop

[jira] [Created] (MAPREDUCE-5888) Failed job leaves hung AM after it unregisters

2014-05-15 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5888: - Summary: Failed job leaves hung AM after it unregisters Key: MAPREDUCE-5888 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5888 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5868) TestPipeApplication causing nightly build to fail

2014-04-29 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5868: - Summary: TestPipeApplication causing nightly build to fail Key: MAPREDUCE-5868 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5868 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4816) JobImpl Invalid event: JOB_TASK_ATTEMPT_COMPLETED at FAILED

2014-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4816. --- Resolution: Duplicate Fixed by MAPREDUCE-4774. > JobImpl Invalid ev

[jira] [Resolved] (MAPREDUCE-4852) Reducer should not signal fetch failures for disk errors on the reducer's side

2014-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4852. --- Resolution: Duplicate This was fixed by MAPREDUCE-5251. > Reducer should not sig

[jira] [Reopened] (MAPREDUCE-3111) Fix log serving in NodeManager

2014-04-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-3111: --- This was fixed by MAPREDUCE-4283, as that patch started using Hamlet's pre method to

[jira] [Resolved] (MAPREDUCE-3111) Fix log serving in NodeManager

2014-04-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-3111. --- Resolution: Duplicate Fixed by MAPREDUCE-4283. > Fix log serving in NodeMana

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Jason Lowe
Here's my late +1, was just finishing up looking at the release. - Verified signatures and digests - Examined LICENSE file - Installed binary distribution, ran some sample MapReduce jobs and examined logs and job history - Built from source Jason On 04/07/2014 03:04 PM, Arun C Murthy wrote:

[jira] [Resolved] (MAPREDUCE-5792) When mapreduce.jobhistory.intermediate-done-dir isn't writable, application fails with generic error

2014-03-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5792. --- Resolution: Duplicate Thanks, Travis. Resolving as a duplicate of YARN-675. > W

[jira] [Created] (MAPREDUCE-5778) JobSummary does not escape newlines in the job name

2014-03-04 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5778: - Summary: JobSummary does not escape newlines in the job name Key: MAPREDUCE-5778 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5778 Project: Hadoop Map

[jira] [Resolved] (MAPREDUCE-5143) TestLineRecordReader was no test case for compressed files

2014-02-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5143. --- Resolution: Duplicate Yes, MAPREDUCE-5656 added a more comprehensive test suite for

[jira] [Resolved] (MAPREDUCE-5764) Potential NullPointerException in YARNRunner.killJob(JobID arg0)

2014-02-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5764. --- Resolution: Duplicate This is a duplicate of MAPREDUCE-5542. > Potent

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-18 Thread Jason Lowe
+1 (binding) - Verified signatures and digests - Built from source with native support - Deployed a single-node cluster and ran some sample jobs Jason On 02/11/2014 08:49 AM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to get released

[jira] [Created] (MAPREDUCE-5758) Reducer local data is not deleted until job completes

2014-02-13 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5758: - Summary: Reducer local data is not deleted until job completes Key: MAPREDUCE-5758 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5758 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5757) ConcurrentModificationException in JobControl.toList

2014-02-13 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5757: - Summary: ConcurrentModificationException in JobControl.toList Key: MAPREDUCE-5757 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5757 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5746) Job diagnostics can implicate wrong task for a failed job

2014-02-07 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5746: - Summary: Job diagnostics can implicate wrong task for a failed job Key: MAPREDUCE-5746 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5746 Project: Hadoop Map

Re: Re-swizzle 2.3

2014-01-29 Thread Jason Lowe
We should hold off commits until that's done, right? On Mon, Jan 27, 2014 at 1:07 PM, Arun C Murthy wrote: Yep, on it as we speak. :) Arun On Jan 27, 2014, at 12:36 PM, Jason Lowe wrote: Thanks, Arun. Are there plans to update the Fix Versions and CHANGES.txt accordingly? The

Re: Re-swizzle 2.3

2014-01-27 Thread Jason Lowe
Thanks, Arun. Are there plans to update the Fix Versions and CHANGES.txt accordingly? There are a lot of JIRAs that are now going to ship in 2.3.0 but the JIRA and CHANGES.txt says they're not fixed until 2.4.0. Jason On 01/27/2014 08:47 AM, Arun C Murthy wrote: Done. I've re-created branc

[jira] [Resolved] (MAPREDUCE-5584) ShuffleHandler becomes unresponsive during gridmix runs and can leak file descriptors

2014-01-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5584. --- Resolution: Duplicate This has been fixed by the addendum patch in HADOOP-9652

[jira] [Resolved] (MAPREDUCE-5730) AM log is truncated

2014-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5730. --- Resolution: Duplicate Fixing this as part of MAPREDUCE-5723. > AM log is trunca

[jira] [Created] (MAPREDUCE-5730) AM log is truncated

2014-01-21 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5730: - Summary: AM log is truncated Key: MAPREDUCE-5730 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5730 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Created] (MAPREDUCE-5727) History server web page can filter without showing filter keyword

2014-01-16 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5727: - Summary: History server web page can filter without showing filter keyword Key: MAPREDUCE-5727 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5727 Project

[jira] [Created] (MAPREDUCE-5717) Task pings are interpreted as task progress

2014-01-10 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5717: - Summary: Task pings are interpreted as task progress Key: MAPREDUCE-5717 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5717 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5686) Found Class org.apache.hadoop.mapreduce.TaskAttemptContext,but interface was excepted

2013-12-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5686. --- Resolution: Invalid As pointed out on the other JIRAs you have filed, _please_ ask these

[jira] [Resolved] (MAPREDUCE-5661) ShuffleHandler using yarn.nodemanager.local-dirs instead of mapreduce.cluster.local.dir

2013-12-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5661. --- Resolution: Not A Problem Closing as shufflehandler should continue to use the yarn

[jira] [Created] (MAPREDUCE-5670) CombineFileRecordReader should report progress when moving to the next file

2013-12-05 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5670: - Summary: CombineFileRecordReader should report progress when moving to the next file Key: MAPREDUCE-5670 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5670

[jira] [Resolved] (MAPREDUCE-5635) FileInputFormat does not specify how the file is split

2013-12-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5635. --- Resolution: Not A Problem Closing this as FileInputFormat is not supposed to specify the

Re: [VOTE] Release Apache Hadoop 0.23.10

2013-12-04 Thread Jason Lowe
+1 (binding) - verified signatures and digests - deployed binary tarball to a single-node cluster and ran some jobs - built from source - deployed source build to a single-node cluster and ran some jobs Jason On 12/03/2013 12:22 AM, Thomas Graves wrote: Hey Everyone, There have been lots of i

[jira] [Resolved] (MAPREDUCE-5668) Exception in thread "main" java.lang.IncompatibleClassChangeError: Found class org.apache.hadoop.mapreduce.JobContext, but interface was expected

2013-12-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5668. --- Resolution: Invalid Closing this as invalid based on the evidence from MAPREDUCE-5667

[jira] [Resolved] (MAPREDUCE-5666) org/apache/hadoop/mapreduce/lib/input/FileInputFormat.java(org/apache/hadoop/mapreduce/lib/input:FileInputFormat.java):cannot find symbol

2013-12-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5666. --- Resolution: Invalid As I mentioned in MAPREDUCE-5668, JIRA is not the avenue to use for

Re: Next releases

2013-11-13 Thread Jason Lowe
I think a lot of confusion comes from the fact that the 2.x line is starting to mature. Before this there wasn't such a big contention of what went into patch vs. minor releases and often the lines were blurred between the two. However now we have significant customers and products starting t

Re: test-patch failing with OOM errors in javah

2013-10-31 Thread Jason Lowe
ly tracked by MAPREDUCE-5481 <https://issues.apache.org/jira/browse/MAPREDUCE-5481> and/or find a way to keep it from escaping during builds. There might be another issue where SocketReader threads can prevent the JVM from shutting down completely in some cases. Jason On 10/31/2013 08:1

Re: test-patch failing with OOM errors in javah

2013-10-31 Thread Jason Lowe
I don't think that OOM error below indicates it needs more heap space, as it's complaining about the ability to create a new native thread. That usually is caused by lack of available virtual address space or hitting process ulimits. What's most likely going on is the jenkins user is hitting

[jira] [Created] (MAPREDUCE-5603) Ability to disable FileInputFormat listLocatedStatus optimization to save client memory

2013-10-30 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5603: - Summary: Ability to disable FileInputFormat listLocatedStatus optimization to save client memory Key: MAPREDUCE-5603 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5603

[jira] [Created] (MAPREDUCE-5584) ShuffleHandler becomes unresponsive during gridmix runs and can leak file descriptors

2013-10-15 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5584: - Summary: ShuffleHandler becomes unresponsive during gridmix runs and can leak file descriptors Key: MAPREDUCE-5584 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5584

[jira] [Created] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

2013-10-14 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5583: - Summary: Ability to limit running map and reduce tasks Key: MAPREDUCE-5583 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5583 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5581) killing jobs which have failed causes log missing

2013-10-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5581. --- Resolution: Duplicate This is a duplicate of MAPREDUCE-5502. > killing jobs which h

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-09 Thread Jason Lowe
+1 (binding) - Verified signatures and checksums - Deployed binary tarball to a single-node cluster and successfully ran sample jobs - Built source, deployed to a single-node cluster and successfully ran sample jobs Jason On 10/07/2013 02:00 AM, Arun C Murthy wrote: Folks, I've created a r

[jira] [Created] (MAPREDUCE-5574) History server returns 500 error on job conf page if user lacks permissions

2013-10-08 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5574: - Summary: History server returns 500 error on job conf page if user lacks permissions Key: MAPREDUCE-5574 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5574

[jira] [Created] (MAPREDUCE-5570) Map task attempt with fetch failure has incorrect attempt finish time

2013-10-07 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5570: - Summary: Map task attempt with fetch failure has incorrect attempt finish time Key: MAPREDUCE-5570 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5570

[jira] [Created] (MAPREDUCE-5543) In-memory map outputs can be leaked after shuffle completes in 0.23

2013-09-26 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5543: - Summary: In-memory map outputs can be leaked after shuffle completes in 0.23 Key: MAPREDUCE-5543 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5543 Project

[jira] [Created] (MAPREDUCE-5542) Killing a job just as it finishes can generate an NPE in client

2013-09-26 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5542: - Summary: Killing a job just as it finishes can generate an NPE in client Key: MAPREDUCE-5542 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5542 Project

[jira] [Created] (MAPREDUCE-5534) Improve job configuration handling when MapReduce deployed via HDFS

2013-09-25 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5534: - Summary: Improve job configuration handling when MapReduce deployed via HDFS Key: MAPREDUCE-5534 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5534 Project

[jira] [Created] (MAPREDUCE-5513) ConcurrentModificationException in JobControl

2013-09-18 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5513: - Summary: ConcurrentModificationException in JobControl Key: MAPREDUCE-5513 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5513 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5503) TestMRJobClient.testJobClient is failing

2013-09-11 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5503: - Summary: TestMRJobClient.testJobClient is failing Key: MAPREDUCE-5503 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5503 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

2013-09-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5475. --- Resolution: Fixed Fix Version/s: 0.23.10 I committed this to trunk, branch-2

[jira] [Created] (MAPREDUCE-5493) In-memory map outputs can be leaked after shuffle completes

2013-09-03 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5493: - Summary: In-memory map outputs can be leaked after shuffle completes Key: MAPREDUCE-5493 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5493 Project: Hadoop

[jira] [Created] (MAPREDUCE-5481) TestUberAM timeout

2013-08-26 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5481: - Summary: TestUberAM timeout Key: MAPREDUCE-5481 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5481 Project: Hadoop Map/Reduce Issue Type: Bug

[jira] [Reopened] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

2013-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5475: --- Reverting this again... With YARN-707 users can see their own jobs again, but other users

[jira] [Resolved] (MAPREDUCE-1577) FileInputFormat in the new mapreduce package to support multi-level/recursive directory listing

2013-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-1577. --- Resolution: Duplicate This has been fixed by MAPREDUCE-3193

[jira] [Resolved] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

2013-08-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5475. --- Resolution: Fixed Hadoop Flags: Reviewed Verified that the original patch works on

[jira] [Reopened] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

2013-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5475: --- Reopening, as this appears to be causing problems on a secure cluster. Getting exceptions

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

2013-08-21 Thread Jason Lowe
+1 (binding) - Verified signatures and checksums - Built source - Deployed single-node cluster and ran some test jobs Jason On 08/16/2013 12:29 AM, Konstantin Boudnik wrote: All, I have created a release candidate (rc1) for hadoop-2.0.6-alpha that I would like to release. This is a stabiliza

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-21 Thread Jason Lowe
+1 (binding) - verified signatures and checksums - built from source - ran some simple jobs on a single-node cluster On 08/15/2013 04:15 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw

[jira] [Created] (MAPREDUCE-5475) MRClientService does not verify ACLs properly

2013-08-21 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5475: - Summary: MRClientService does not verify ACLs properly Key: MAPREDUCE-5475 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5475 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5469) Counters for MRAppMaster

2013-08-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5469. --- Resolution: Duplicate Duplicate of MAPREDUCE-4804. > Counters

[jira] [Created] (MAPREDUCE-5456) TestFetcher.testCopyFromHostExtraBytes is missing

2013-08-12 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5456: - Summary: TestFetcher.testCopyFromHostExtraBytes is missing Key: MAPREDUCE-5456 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5456 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5446) TestJobHistoryEvents and TestJobHistoryParsing have race conditions

2013-08-02 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5446: - Summary: TestJobHistoryEvents and TestJobHistoryParsing have race conditions Key: MAPREDUCE-5446 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5446 Project

[jira] [Created] (MAPREDUCE-5445) MRApp tries to stop services from AsyncDispatcher thread

2013-08-02 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5445: - Summary: MRApp tries to stop services from AsyncDispatcher thread Key: MAPREDUCE-5445 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5445 Project: Hadoop Map

[jira] [Resolved] (MAPREDUCE-5444) MRAppMaster throws InvalidStateTransitonException: Invalid event: JOB_AM_REBOOT at SUCCEEDED

2013-08-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5444. --- Resolution: Invalid bq. I have one point to add here that, immidiately after job is

[jira] [Resolved] (MAPREDUCE-5266) Ability to refresh retention settings on history server

2013-07-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5266. --- Resolution: Fixed Fix Version/s: 2.3.0 3.0.0 Resolving

[jira] [Created] (MAPREDUCE-5430) TestMRApps#testSetClasspathWithArchives is failing

2013-07-29 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5430: - Summary: TestMRApps#testSetClasspathWithArchives is failing Key: MAPREDUCE-5430 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5430 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5428) HistoryFileManager doesn't stop threads when service is stopped

2013-07-29 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5428: - Summary: HistoryFileManager doesn't stop threads when service is stopped Key: MAPREDUCE-5428 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5428 Pr

[jira] [Resolved] (MAPREDUCE-5423) Rare deadlock situation when reducers try to fetch map output

2013-07-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-5423. --- Resolution: Duplicate > Rare deadlock situation when reducers try to fetch

[jira] [Created] (MAPREDUCE-5417) Propagate task settings to AM when job runs in uber mode

2013-07-24 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5417: - Summary: Propagate task settings to AM when job runs in uber mode Key: MAPREDUCE-5417 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5417 Project: Hadoop Map

[jira] [Resolved] (MAPREDUCE-865) harchive: Reduce the number of open calls to _index and _masterindex

2013-07-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-865. -- Resolution: Duplicate After discussing with Koji, closing as a duplicate of MAPREDUCE-2459

[jira] [Reopened] (MAPREDUCE-5399) Large number of map tasks cause slow sort at reduce phase, invariant to amount of data to sort

2013-07-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5399: --- This is a problem in trunk and 2.x. Looking at IFileInputStream, it clearly creates a new

[jira] [Reopened] (MAPREDUCE-5317) Stale files left behind for failed jobs

2013-07-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened MAPREDUCE-5317: --- This is causing some unit tests to hang/fail in hadoop-mapreduce-client-jobclient

Re: [VOTE] Release Apache Hadoop 0.23.9

2013-07-03 Thread Jason Lowe
+1 - Verified checksums and signatures - Booted single-node cluster from binary tarball and ran a few sample jobs - Built source distribution, installed a single-node cluster and ran a few sample jobs Jason On 07/01/2013 12:20 PM, Thomas Graves wrote: I've created a release candidate (RC0) f

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-03 Thread Jason Lowe
I committed MAPREDUCE-5358 to branch-2 but did not commit it to branch-2.1-beta since it wasn't a blocker and Arun was in the middle of cutting the release. Arun, if you feel it's appropriate to put this in branch-2.1-beta feel free to pull it in or let me know. Thanks! Jason On 07/03/2013

[jira] [Created] (MAPREDUCE-5332) Support token-preserving restart of history server

2013-06-19 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5332: - Summary: Support token-preserving restart of history server Key: MAPREDUCE-5332 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5332 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5307) Failure to launch a task leads to missing failed task

2013-06-06 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5307: - Summary: Failure to launch a task leads to missing failed task Key: MAPREDUCE-5307 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5307 Project: Hadoop Map

Re: [VOTE] Release Apache Hadoop 0.23.8

2013-06-04 Thread Jason Lowe
+1 - Verified signatures and checksums - Verified MAPREDUCE-5211 was present in CHANGES.txt and source - Built from source, deployed single-node cluster, ran example jobs Jason On 05/28/2013 11:00 AM, Thomas Graves wrote: I've created a release candidate (RC0) for hadoop-0.23.8 that I would li

[jira] [Resolved] (MAPREDUCE-4235) Killing app can lead to inconsistent app status between RM and HS

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4235. --- Resolution: Not A Problem This is an inherent race between the RM and the AM. The AM

[jira] [Resolved] (MAPREDUCE-4041) TestMapredGroupMappingServiceRefresh unit test failures

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4041. --- Resolution: Not A Problem TestMapredGroupMappingServiceRefresh was removed as part of

[jira] [Resolved] (MAPREDUCE-4042) unit test TestControlledMapReduceJob.testControlledMapReduceJob fails

2013-05-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4042. --- Resolution: Not A Problem No longer an issue since TestControlledMapReduceJob was

[jira] [Created] (MAPREDUCE-5268) Improve history server startup performance

2013-05-22 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5268: - Summary: Improve history server startup performance Key: MAPREDUCE-5268 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5268 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5267) History server should be more robust when cleaning old jobs

2013-05-22 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5267: - Summary: History server should be more robust when cleaning old jobs Key: MAPREDUCE-5267 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5267 Project: Hadoop

[jira] [Created] (MAPREDUCE-5266) Ability to refresh retention settings on history server

2013-05-22 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5266: - Summary: Ability to refresh retention settings on history server Key: MAPREDUCE-5266 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5266 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5265) Ability to refresh super user groups on history server

2013-05-22 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5265: - Summary: Ability to refresh super user groups on history server Key: MAPREDUCE-5265 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5265 Project: Hadoop Map

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-22 Thread Jason Lowe
+1 On 05/17/2013 04:10 PM, Thomas Graves wrote: Hello all, We've had a few critical issues come up in 0.23.7 that I think warrants a 0.23.8 release. The main one is MAPREDUCE-5211. There are a couple of other issues that I want finished up and get in before we spin it. Those include HDFS-3875

[jira] [Created] (MAPREDUCE-5261) TestRMContainerAllocator is exiting and failing the build

2013-05-20 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5261: - Summary: TestRMContainerAllocator is exiting and failing the build Key: MAPREDUCE-5261 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5261 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5257) TestContainerLauncherImpl fails

2013-05-17 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5257: - Summary: TestContainerLauncherImpl fails Key: MAPREDUCE-5257 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5257 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-5251) Reducer should not implicate map attempt if it has insufficient space to fetch map output

2013-05-15 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5251: - Summary: Reducer should not implicate map attempt if it has insufficient space to fetch map output Key: MAPREDUCE-5251 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5251

[jira] [Created] (MAPREDUCE-5211) Reducer intermediate files can collide during merge

2013-05-06 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5211: - Summary: Reducer intermediate files can collide during merge Key: MAPREDUCE-5211 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5211 Project: Hadoop Map

Re: 2.0.4 beta vs 2.0.3

2013-05-06 Thread Jason Lowe
This may be related to MAPREDUCE-5168 . There's a memory leak of sorts in the shuffle if many map outputs end up being merged from disk. Jason On 05/04/2013 06:40 PM, Radim Kolar wrote: After upgrade i am getting out of heap space during s

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-19 Thread Jason Lowe
+1 (binding) - verified signatures and checksums - installed single-node cluster from binaries and ran sample jobs - built and installed single-node cluster from source and ran sample jobs Jason On 04/12/2013 04:56 PM, Arun C Murthy wrote: Folks, I've created a release candidate (RC2) for had

[jira] [Created] (MAPREDUCE-5168) Reducer can OOM during shuffle because on-disk output stream not released

2013-04-18 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5168: - Summary: Reducer can OOM during shuffle because on-disk output stream not released Key: MAPREDUCE-5168 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5168

<    1   2   3   4   >