Re: Heads up: branch-2.1-beta

2013-06-16 Thread Arun C Murthy
On Jun 16, 2013, at 5:39 AM, Arun C Murthy wrote: On Jun 15, 2013, at 8:19 AM, Alejandro Abdelnur wrote: Of the JIRAs in my laundry list for 2.1 the ones I would really want in are YARN-752, MAPREDUCE-5171 YARN-787. I agree YARN-787 needs to go in ASAP is a blocker - I'm looking

[jira] [Created] (MAPREDUCE-5326) Add version to shuffle header

2013-06-16 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5326: Summary: Add version to shuffle header Key: MAPREDUCE-5326 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5326 Project: Hadoop Map/Reduce

Re: Heads up: branch-2.1-beta

2013-06-16 Thread Arun C Murthy
MAPREDUCE-5130? On Sun, Jun 16, 2013 at 7:02 AM, Arun C Murthy a...@hortonworks.com wrote: On Jun 16, 2013, at 5:39 AM, Arun C Murthy wrote: On Jun 15, 2013, at 8:19 AM, Alejandro Abdelnur wrote: Of the JIRAs in my laundry list for 2.1 the ones I would really want in are YARN

[jira] [Resolved] (MAPREDUCE-5184) Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2

2013-06-16 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5184. -- Resolution: Fixed I just committed this. Thanks [~zhijin

Re: Heads up: branch-2.1-beta

2013-06-16 Thread Arun C Murthy
Responses inline: On Jun 16, 2013, at 1:04 PM, Roman Shaposhnik wrote: But there's a bit of bad news too (or at least the news that need to be triaged). At this point I don't know whether the Hadoop code is to blame or the tests/components themselves -- all I know is that these tests passed

Re: Heads up: branch-2.1-beta

2013-06-16 Thread Arun C Murthy
Roman, Is there a chance you can run the tests with the full stack built against branch-2.1-beta and help us know where we are? thanks, Arun On Jun 16, 2013, at 4:50 PM, Arun C Murthy wrote: Responses inline: On Jun 16, 2013, at 1:04 PM, Roman Shaposhnik wrote: But there's a bit

[jira] [Resolved] (MAPREDUCE-5319) Job.xml file does not has 'user.name' property for Hadoop2

2013-06-14 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5319. -- Resolution: Fixed I just committed this. Thanks [~xgong

Re: Heads up: branch-2.1-beta

2013-06-14 Thread Arun C Murthy
As Ramya noted, things are looking good on branch-2.1-beta ATM. Henceforth, can I please ask committers to hold off non-blocker fixes for the final set of tests? thanks, Arun On Jun 4, 2013, at 8:32 AM, Arun C Murthy wrote: Folks, The vast majority of of the planned features and API work

Re: Bringing Hadoop to Fedora

2013-06-11 Thread Arun C Murthy
we figure this would be a good start. Cheers, Tim -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Re: Heads up: branch-2.1-beta

2013-06-06 Thread Arun C Murthy
On Jun 5, 2013, at 11:04 AM, Roman Shaposhnik wrote On the Bigtop side of things, once we have stable Bigtop 0.6.0 platform based on Hadoop 2.0.x codeline we plan to start running the same battery of integration tests on the branch-2.1-beta. We plan to simply file JIRAs if anything gets

Heads up: branch-2.1-beta

2013-06-04 Thread Arun C Murthy
Folks, The vast majority of of the planned features and API work is complete, thanks to everyone who contributed! I've created a branch-2.1-beta branch from which I anticipate I can make the first of our beta releases very shortly. For now the remaining work is to wrap up loose ends i.e.

[jira] [Reopened] (MAPREDUCE-5300) Two function signature changes in filecache.DistributedCache

2013-06-03 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reopened MAPREDUCE-5300: -- Two function signature changes in filecache.DistributedCache

[jira] [Resolved] (MAPREDUCE-5300) Two function signature changes in filecache.DistributedCache

2013-06-03 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5300. -- Resolution: Fixed Hadoop Flags: Incompatible change Re-opened to close

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-02 Thread Arun C Murthy
the release bits and vote; the vote will run for the 3 days, because this is just a version name change. The bits are identical to the ones voted on before in http://s.apache.org/2041move Thanks for your voting Cos -- Alejandro -- Alejandro -- Arun C. Murthy

[jira] [Resolved] (MAPREDUCE-3859) CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs

2013-06-02 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-3859. -- Resolution: Fixed Fix Version/s: (was: 2.1.0-beta) I'm resolving

[jira] [Created] (MAPREDUCE-5290) CLONE - CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs

2013-06-02 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5290: Summary: CLONE - CapacityScheduler incorrectly utilizes extra-resources of queue for high-memory jobs Key: MAPREDUCE-5290 URL: https://issues.apache.org/jira/browse

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-02 Thread Arun C Murthy
I do it in the release branch, so the release source tarball has the date. Arun On Jun 2, 2013, at 6:41 PM, Konstantin Boudnik wrote: On Sun, Jun 02, 2013 at 03:04PM, Arun C Murthy wrote: I record the 'release date' as the one on which the build is created. Not sure what Matt actually does

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-31 Thread Arun C Murthy
forth-language skills do not mislead me. They do mislead you, or I've expressed the point imprecisely. We can take this offline. -C On Thu, May 30, 2013 at 01:48PM, Chris Douglas wrote: On Thu, May 30, 2013 at 10:57 AM, Arun C Murthy a...@hortonworks.com wrote: Why not include MAPREDUCE

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Arun C Murthy
I see you just re-opened MAPREUDCE-4211. Why not include MAPREDUCE-4211 as well rather than create one release per patch? Also, this is the first time we are seeing a four-numbered scheme in Hadoop. Why not call this 2.0.5-alpha? Arun On May 24, 2013, at 8:48 PM, Konstantin Boudnik wrote:

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Arun C Murthy
Sorry, it should be MAPREDUCE-5211 (not MAPREDUCE-4211). thanks, Arun On May 30, 2013, at 10:57 AM, Arun C Murthy wrote: I see you just re-opened MAPREUDCE-4211. Why not include MAPREDUCE-4211 as well rather than create one release per patch? Also, this is the first time we are seeing

Re: MAPREDUCE-5183 PATCH submission

2013-05-23 Thread Arun C Murthy
will try to fix it. Regards Niranjan Singh -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Reopened] (MAPREDUCE-4942) mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1

2013-05-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reopened MAPREDUCE-4942: -- Sigh, I missed this. There are multiple issues with this patch: # It's incompatible

[jira] [Resolved] (MAPREDUCE-5214) Compatibility: Add a deprecated MRAdmin that wraps around RMAdmin

2013-05-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5214. -- Resolution: Won't Fix Compatibility: Add a deprecated MRAdmin that wraps

[jira] [Created] (MAPREDUCE-5223) ant package shouldn't build task-controller by default

2013-05-08 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5223: Summary: ant package shouldn't build task-controller by default Key: MAPREDUCE-5223 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5223 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-5064) TestRumenJobTraces failing on 1.3.x and 1.2

2013-05-06 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5064. -- Resolution: Not A Problem Fixed via an addendum patch to MAPREDUCE-4838

[jira] [Created] (MAPREDUCE-5206) JT can show the same job multiple times in Retired Jobs section

2013-05-03 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5206: Summary: JT can show the same job multiple times in Retired Jobs section Key: MAPREDUCE-5206 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5206

Re: Heads up - 2.0.5-beta

2013-05-02 Thread Arun C Murthy
Konstantin, On May 2, 2013, at 2:08 AM, Konstantin Shvachko wrote: I am arguing against invasive and destructive features proposed for the release. Just to remind here they are again, since the history has been wiped out. # Snapshots # NFS gateway for HDFS # HDFS-347 unix domain socket

Re: Heads up - 2.0.5-beta

2013-05-01 Thread Arun C Murthy
Konstantin, On Apr 30, 2013, at 4:28 PM, Konstantin Shvachko wrote: Hi Arun, I am agnostic about version numbers too, as long as the count goes up. The discussion you are referring to is somewhat outdated, it was talking about 2.0.4-beta, which we already passed. It's very relevant and

Re: Heads up - 2.0.5-beta

2013-05-01 Thread Arun C Murthy
On May 1, 2013, at 4:08 PM, Konstantin Shvachko wrote: On Wed, May 1, 2013 at 1:15 PM, Arun C Murthy a...@hortonworks.com wrote: On Apr 30, 2013, at 4:28 PM, Konstantin Shvachko wrote: If the next release has to be 2.0.5 I would like to make an alternative proposal, which would include

[jira] [Resolved] (MAPREDUCE-5198) Race condition in cleanup during task tracker renint with LinuxTaskController

2013-04-30 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5198. -- Resolution: Fixed Fix Version/s: 1.2.0 I just committed this. Thanks Arpit

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
On Apr 25, 2013, at 6:36 PM, Suresh Srinivas wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: Similarly on HDFS side, can someone please help out by tagging features, bug-fixes, protocol/API changes etc.? This way we can ensure HDFS APIs protocols

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy a...@hortonworks.com wrote: With that in mind, I really want to make a serious push to lock down APIs and wire-protocols for hadoop-2.0.5-beta. Thus, we can confidently support hadoop-2.x

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
Konstantin, On Apr 26, 2013, at 4:34 PM, Konstantin Shvachko wrote: Do you think we can call the version you proposed to release 2.1.0 or 2.1.0-beta? The proposed new features imho do not exactly conform with the idea of dot-dot release, but definitely qualify for a major number change. I

Re: Heads up - 2.0.5-beta

2013-04-26 Thread Arun C Murthy
On Apr 26, 2013, at 12:07 PM, Eli Collins wrote: Arun, Suresh, Mind reviewing the following page Karthik put together on compatibility? http://wiki.apache.org/hadoop/Compatibility Sure. Will do. I just opened https://issues.apache.org/jira/browse/HADOOP-9517 to ensure we capture it for

[jira] [Resolved] (MAPREDUCE-5158) Cleanup required when mapreduce.job.restart.recover is set to false

2013-04-26 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5158. -- Resolution: Fixed Fix Version/s: 1.2.0 I just committed this after running

Heads up - 2.0.5-beta

2013-04-25 Thread Arun C Murthy
by tagging features, bug-fixes, protocol/API changes etc.? This way we can ensure HDFS APIs protocols are locked down too - I'd really appreciate it! thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Created] (MAPREDUCE-5184) Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2

2013-04-25 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5184: Summary: Document MR Binary Compatibility vis-a-vis hadoop-1 and hadoop-2 Key: MAPREDUCE-5184 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5184

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-23 Thread Arun C Murthy
With 15 +1s (8 binding), 1 -0 and no -1s the vote passes. Thanks to all who verified the bits, I'll push them out. thanks, Arun On Apr 12, 2013, at 2:56 PM, Arun C Murthy wrote: Folks, I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would like to release. The RC

Re: [VOTE] Release Apache Hadoop 0.23.7

2013-04-16 Thread Arun C Murthy
will run for the usual 7 days. thanks, Tom Graves -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Re: combiner without reducer

2013-04-15 Thread Arun C Murthy
. do you think that you will ever support that scenario? Its quite common because few hadoop frameworks supports it, but they emulate it in mapper by caching results into memory. -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[VOTE] Release Apache Hadoop 2.0.4-alpha (rc1)

2013-04-12 Thread Arun C Murthy
-rc1/ The RC tag in svn is here: http://svn.apache.org/repos/asf/hadoop/common/tags/release-2.0.4-alpha-rc1 The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-12 Thread Arun C Murthy
their worth by hitting back. - Piet Hein (via Tom White) -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-12 Thread Arun C Murthy
On Apr 13, 2013, at 2:42 AM, Roman Shaposhnik wrote: On Fri, Apr 12, 2013 at 2:09 PM, Arun C Murthy a...@hortonworks.com wrote: Sigh! You are right Andrew - I'll need to back out a patch from branch-2.0.4-alpha and re-generate the release. RC2 needed now. Can you elaborate please? Are you

[VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-12 Thread Arun C Murthy
The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-09 Thread Arun C Murthy
and rest of BigTop community for helping to find a number of integration issues, Ted Yu for co-ordinating on HBase, Alejandro for co-ordinating on Oozie, Vinod/Sid/Alejandro/Xuan/Daryn and rest of devs for quickly jumping and fixing these. -- Arun C. Murthy Hortonworks Inc. http

[jira] [Created] (MAPREDUCE-5131) Provide better handling of job status related apis during JT restart

2013-04-05 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5131: Summary: Provide better handling of job status related apis during JT restart Key: MAPREDUCE-5131 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5131

[jira] [Resolved] (MAPREDUCE-5131) Provide better handling of job status related apis during JT restart

2013-04-05 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5131. -- Resolution: Fixed Fix Version/s: 1.2.0 Thanks for the reviews [~szetszwo

[jira] [Created] (MAPREDUCE-5108) Review support for Binary Compatibility for MR applications via YARN

2013-03-27 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5108: Summary: Review support for Binary Compatibility for MR applications via YARN Key: MAPREDUCE-5108 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5108

[jira] [Created] (MAPREDUCE-5109) Job view-acl should apply to job listing too

2013-03-27 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-5109: Summary: Job view-acl should apply to job listing too Key: MAPREDUCE-5109 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5109 Project: Hadoop Map/Reduce

2.0.4-alpha bug-fix release

2013-02-26 Thread Arun C Murthy
. YARN-429 has details about the issue. Considering this will affect all downstream projects, a new release probably makes sense. Thanks - Sid -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Planning for hadoop-2.0.4-beta

2013-02-15 Thread Arun C Murthy
should help nevertheless. I volunteer to do this for YARN/MapReduce (of course, any help is very much appreciated and I see Vinod has opened YARN-386), and would appreciate some folks stepping up for HDFS (Suresh? Todd?). thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-14 Thread Arun C Murthy
With 18 +1s (8 binding) and no -1s the vote passes. Thanks to all who verified and voted on the release. I'll get the bits out within the next couple of days. thanks, Arun On Feb 6, 2013, at 7:59 PM, Arun C Murthy wrote: Folks, I've created a release candidate (rc0) for hadoop-2.0.3-alpha

Freezing 2.0.3-alpha

2013-02-06 Thread Arun C Murthy
I just created branch-2.0.3-alpha. Committers: please *do not* check-in anything else with a fix-version of 2.0.3-alpha on jira. thanks, Arun

[VOTE] Release hadoop-2.0.3-alpha

2013-02-06 Thread Arun C Murthy
repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Arun -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Re: Release numbering for branch-2 releases

2013-02-04 Thread Arun C Murthy
On Feb 1, 2013, at 2:34 AM, Tom White wrote: Whereas Arun is proposing 2.0.0-alpha, 2.0.1-alpha, 2.0.2-alpha, 2.1.0-alpha, 2.2.0-beta, 2.3.0 and the casual observer might expect there to be a stable 2.0.1 (say) on seeing the existence of 2.0.2-alpha. The first three of these are

Re: Release numbering for branch-2 releases

2013-01-31 Thread Arun C Murthy
Stack, On Jan 30, 2013, at 9:25 PM, Stack wrote: I find the above opaque and written in a cryptic language that I might grok if I spent a day or two running over cited issues trying to make some distillation of the esotericia debated therein. If you want feedback from other than the

[jira] [Created] (MAPREDUCE-4968) Separate MR user apis into a separate module

2013-01-30 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4968: Summary: Separate MR user apis into a separate module Key: MAPREDUCE-4968 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4968 Project: Hadoop Map/Reduce

Re: Release numbering for branch-2 releases

2013-01-30 Thread Arun C Murthy
-version for the intra-cluster protocols) Thanks, Eli On Tue, Jan 29, 2013 at 12:56 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, There has been some discussions about incompatible changes in the hadoop-2.x.x-alpha releases on HADOOP-9070, HADOOP-9151, HADOOP-9192 and few other

Release numbering for branch-2 releases

2013-01-29 Thread Arun C Murthy
Folks, There has been some discussions about incompatible changes in the hadoop-2.x.x-alpha releases on HADOOP-9070, HADOOP-9151, HADOOP-9192 and few other jiras. Frankly, I'm surprised about some of them since the 'alpha' moniker was precisely to harden apis by changing them if necessary,

Re: Release numbering for branch-2 releases

2013-01-29 Thread Arun C Murthy
Thanks Suresh. Adding back other *-dev lists. On Jan 29, 2013, at 1:58 PM, Suresh Srinivas wrote: +1 for a release with all the changes that are committed. That way it carries all the important bug fixes. So, rather than debate more, I had a brief chat with Suresh and Todd. Todd

[jira] [Created] (MAPREDUCE-4943) JobImpl.makeUberDecision needs cleanup

2013-01-15 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4943: Summary: JobImpl.makeUberDecision needs cleanup Key: MAPREDUCE-4943 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4943 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4520) Add experimental support for MR AM to schedule CPUs along-with memory

2013-01-08 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4520. -- Resolution: Fixed Fix Version/s: 2.0.3-alpha I just committed this trivial

[jira] [Created] (MAPREDUCE-4918) Better error message in TrackerDistributedCacheManager.ancestorsHaveExecutePermissions

2013-01-05 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4918: Summary: Better error message in TrackerDistributedCacheManager.ancestorsHaveExecutePermissions Key: MAPREDUCE-4918 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Created] (MAPREDUCE-4916) TestTrackerDistributedCacheManager is flaky due to other badly written tests

2013-01-04 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4916: Summary: TestTrackerDistributedCacheManager is flaky due to other badly written tests Key: MAPREDUCE-4916 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4916

[jira] [Resolved] (MAPREDUCE-4869) TestMapReduceChildJVM fails in branch-trunk-win

2012-12-27 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4869. -- Resolution: Fixed Fix Version/s: trunk-win I just committed this. Thanks

[jira] [Resolved] (MAPREDUCE-4888) NLineInputFormat drops data in 1.1 and beyond

2012-12-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4888. -- Resolution: Fixed Fix Version/s: 1.1.2 I just committed this. Thanks Vinod

[jira] [Resolved] (MAPREDUCE-4891) Pluggable merge at reduce side

2012-12-18 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4891. -- Resolution: Duplicate Duplicate of MAPREDUCE-4808 Pluggable

[jira] [Resolved] (MAPREDUCE-2454) Allow external sorter plugin for MR

2012-12-15 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-2454. -- Resolution: Fixed Fix Version/s: 3.0.0 Thanks Tucu. Closing

[jira] [Resolved] (MAPREDUCE-4812) Create reduce input merger plugin in ReduceTask.java and pass it to Shuffle

2012-12-15 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4812. -- Resolution: Duplicate Fix Version/s: (was: 2.0.3-alpha) For now I'll

[jira] [Created] (MAPREDUCE-4859) TestRecoveryManager fails on branch-1

2012-12-07 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4859: Summary: TestRecoveryManager fails on branch-1 Key: MAPREDUCE-4859 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4859 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4859) TestRecoveryManager fails on branch-1

2012-12-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4859. -- Resolution: Fixed I just committed this. Thanks for the quick check Matt

[jira] [Created] (MAPREDUCE-4854) TestRumenJobTraces is broken in branch-1

2012-12-06 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4854: Summary: TestRumenJobTraces is broken in branch-1 Key: MAPREDUCE-4854 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4854 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4854) TestRumenJobTraces is broken in branch-1

2012-12-06 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4854. -- Resolution: Cannot Reproduce Sorry, looks like an error - looking at wrong branch

[jira] [Created] (MAPREDUCE-4858) TestWebUIAuthorization fails on branch-1

2012-12-06 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4858: Summary: TestWebUIAuthorization fails on branch-1 Key: MAPREDUCE-4858 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4858 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4858) TestWebUIAuthorization fails on branch-1

2012-12-06 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4858. -- Resolution: Fixed Fix Version/s: 1.1.2 Thanks Mahadev Vinod. I committed

[jira] [Created] (MAPREDUCE-4837) Add MR-AM web-services to branch-1

2012-11-30 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4837: Summary: Add MR-AM web-services to branch-1 Key: MAPREDUCE-4837 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4837 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4838) Add extra info to JH files

2012-11-30 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4838: Summary: Add extra info to JH files Key: MAPREDUCE-4838 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4838 Project: Hadoop Map/Reduce Issue

Re: Committing MAPREDUCE-4803

2012-11-18 Thread Arun C Murthy
it? I am not sure about the release number. Can you please update it properly? Thanks. -- Asokan -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Resolved] (MAPREDUCE-4682) TestKillSubProcess TestTaskTrackerMemoryManager fail to compile on trunk due to MAPREDUCE-4253

2012-11-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4682. -- Resolution: Not A Problem Not a problem, I've reverted the original commit

Re: Max Maps for default queues in FairScheduler

2012-10-18 Thread Arun C Murthy
a Nice Day! Lohit -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

Re: Commits breaking compilation of MR 'classic' tests

2012-09-26 Thread Arun C Murthy
Point. I've opened https://issues.apache.org/jira/browse/MAPREDUCE-4687 to track this. On Sep 25, 2012, at 9:33 PM, Eli Collins wrote: How about adding this step to the MR PreCommit jenkins job so it's run as part test-patch? On Tue, Sep 25, 2012 at 7:48 PM, Arun C Murthy

[jira] [Created] (MAPREDUCE-4687) Add compilation of 'classic' MR1 (ant based) to jenkins builds

2012-09-26 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4687: Summary: Add compilation of 'classic' MR1 (ant based) to jenkins builds Key: MAPREDUCE-4687 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4687 Project

Re: Commits breaking compilation of MR 'classic' tests

2012-09-26 Thread Arun C Murthy
to a script, before they disappear entirely. I would much rather see dead code die then be maintained for a few tests that are mostly testing the dead code itself. --Bobby On 9/26/12 9:39 AM, Arun C Murthy a...@hortonworks.com wrote: Point. I've opened https://issues.apache.org/jira/browse

Re: need help submit patch to branch-1

2012-09-26 Thread Arun C Murthy
and upload a patch in MAPREDUCE-4451 hope this can be committed to hadoop 1.1.0 or 1.2.0, so I should commit it to branch-1? However, the qa robot runs against trunk , and complains could not apply the patch Am I doing something wrong? Thanks, Erik -- Arun C. Murthy Hortonworks Inc. http

Re: RM with lost NMs results in massive log of AppAttemptId doesnt exist in cache

2012-09-24 Thread Arun C Murthy
. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Resolved] (MAPREDUCE-4564) Shell timeout mechanism does not work for processes spawned using winutils

2012-09-10 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4564. -- Resolution: Fixed Fix Version/s: 1-win I just committed this. Thanks Bikas

Re: On the topic of task scheduling

2012-09-02 Thread Arun C Murthy
ran there (e.g., something like a per machine prefetch manager?). A per machine task scheduling queue would be needed for this, to determine where a reducer is going/likely to be scheduled. Just my two cents. I'm interested in hearing opinions on this matter. Regards, Vasco -- Arun C. Murthy

[jira] [Resolved] (MAPREDUCE-4613) Scheduling of reduce tasks results in starvation

2012-08-31 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4613. -- Resolution: Duplicate Dup of MAPREDUCE-4299. Thanks Vasco

[jira] [Created] (MAPREDUCE-4603) Allow JobClient to retry job-submission when JT is in safemode

2012-08-29 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4603: Summary: Allow JobClient to retry job-submission when JT is in safemode Key: MAPREDUCE-4603 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4603 Project

[jira] [Created] (MAPREDUCE-4605) Text File Busy errors launching MR tasks

2012-08-29 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4605: Summary: Text File Busy errors launching MR tasks Key: MAPREDUCE-4605 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4605 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4374) Fix child task environment variable config and add support for Windows

2012-08-29 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4374. -- Resolution: Fixed Fix Version/s: 1-win I just committed this. Thanks Chuan

Re: Review MAPREDUCE-4554

2012-08-24 Thread Arun C Murthy
and Regards, Benoy -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Created] (MAPREDUCE-4575) Add an option to drain the JobTracker jobs for upgrades

2012-08-22 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4575: Summary: Add an option to drain the JobTracker jobs for upgrades Key: MAPREDUCE-4575 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4575 Project: Hadoop

Re: killApplication doesn't kill AppMaster

2012-08-22 Thread Arun C Murthy
to KILLING to CONTAINER_CLEANEDUP_AFTER_KILL to DONE. However, the AM is still running and the port is not released. I wonder what's going wrong here. Thanks, Bo -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Resolved] (MAPREDUCE-3410) Capacity scheduler reconfiguration of queues does not work for add sub-queues to an existing queue

2012-08-07 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-3410. -- Resolution: Later For now we should punt on this - this is akin to 'delete queue

[jira] [Created] (MAPREDUCE-4476) Add more unit tests for CPU scheduling in CS

2012-07-24 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4476: Summary: Add more unit tests for CPU scheduling in CS Key: MAPREDUCE-4476 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4476 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4340) Node Manager leaks socket connections connected to Data Node

2012-07-24 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-4340. -- Resolution: Duplicate Duplicate of MAPREDUCE-4323 Node Manager

Re: Need review

2012-07-21 Thread Arun C Murthy
Sure, I'll take a look. I'll ping Bikas who wrote the original too! Thanks Radim! On Jul 20, 2012, at 5:33 AM, Radim Kolar wrote: I need to get review on patch https://issues.apache.org/jira/browse/MAPREDUCE-4275 -- Arun C. Murthy Hortonworks Inc. http://hortonworks.com/

[jira] [Reopened] (MAPREDUCE-4422) YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration

2012-07-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy reopened MAPREDUCE-4422: -- Uh, Harsh/Ahmed, I'm confused... the newly added variable

[jira] [Created] (MAPREDUCE-4439) MAPREDUCE-3451 introduced a bunch of findbugs warnings

2012-07-13 Thread Arun C Murthy (JIRA)
Arun C Murthy created MAPREDUCE-4439: Summary: MAPREDUCE-3451 introduced a bunch of findbugs warnings Key: MAPREDUCE-4439 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4439 Project: Hadoop

<    1   2   3   4   5   >