gt;> def registerWithResourceManager(): ApplicationMasterHelper = {
>>> val req = Records.newRecord(classOf[RegisterApplicationMasterRequest])
>>> req.setApplicationAttemptId(appAttemptId)
>>> // TODO not sure why these are blank- This is how spark does it
>>
I'll bet you are hitting MR-2998.
From the changelog:
MAPREDUCE-2998. Fixed a bug in TaskAttemptImpl which caused it to fork
bin/mapred too many times. Contributed by Vinod K V.
Arun
On Sep 21, 2011, at 9:52 AM, Chris Riccomini wrote:
> Hey Guys,
>
> My ApplicationMaster is being killed
a different fail
> count on each run to generate a different attempt id.
>
> -- Hitesh
>
> On Sep 20, 2011, at 2:35 PM, Chris Riccomini wrote:
>
>> Hey Arun,
>>
>> For sure. Any preferred location?
>>
>> Cheers,
>> Chris
>> _
On Sep 20, 2011, at 5:32 PM, Hitesh Shah wrote:
> Hi Chris
>
> You are right. At the moment, you do need to pass all of them in to your app
> master for it to register. I will file a jira to simplify this to end up with
> something along the lines where the RM implicitly passes such informatio
Feel free to use http://wiki.apache.org/hadoop/WritingYarnApps.
thanks,
Arun
On Sep 20, 2011, at 2:35 PM, Chris Riccomini wrote:
> Hey Arun,
>
> For sure. Any preferred location?
>
> Cheers,
> Chris
> ____
> From: Arun C Murthy [a...
Thanks Chris! We'd love to have you put up a README wiki to log your adventures
for posterity... interested?
On Sep 20, 2011, at 2:20 PM, Chris Riccomini wrote:
> Hey Guys,
>
> Thanks for the help. For the record, this solved the problem:
>
>new ApplicationMasterExecutor(packagePath)
>
As Vinod mentioned, package your dirs so that they untar into the CWD.
If you have a directory structure in your .tgz (e.g. lib.tgz -> lib/foo.jar)
you'll need to set your classpath to be ./foo/*.
hth,
Arun
On Sep 20, 2011, at 10:26 AM, Chris Riccomini wrote:
> Hey All,
>
> I'm trying to us
[
https://issues.apache.org/jira/browse/MAPREDUCE-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2718.
--
Resolution: Not A Problem
> Job fails if AppMaster is kil
[
https://issues.apache.org/jira/browse/MAPREDUCE-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2909.
--
Resolution: Fixed
Assignee: Arun C Murthy
Fixed via MAPREDUCE-2896
On Sep 16, 2011, at 3:25 PM, Todd Lipcon wrote:
> Hey all,
>
> Now that MR2 is in trunk and 0.23, but we're still maintaining it in
> 0.20.20x, what's the correct protocol for fixes when the component no
> longer is used in trunk? Must we contribute patches for trunk as well
> as 20x, if we plan
[
https://issues.apache.org/jira/browse/MAPREDUCE-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-1734.
--
Resolution: Fixed
Thanks Harsh & Matt. I've committed this to 0.20.2
[
https://issues.apache.org/jira/browse/MAPREDUCE-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy reopened MAPREDUCE-1734:
--
Re-open to commit to 0.20.205.
> Un-deprecate the old MapReduce API in the 0
[
https://issues.apache.org/jira/browse/MAPREDUCE-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2941.
--
Resolution: Fixed
Fixed via MAPREDUCE-2953.
> In secure mode RM WebUI shows wr
Saikat,
As Robert pointed out, performance is a primary criterion - maybe you can come
back with benchmarks? Try sorts with >100G data.
Also, MRv2 makes it easy to play with these, you might want to try that.
Arun
On Sep 9, 2011, at 10:34 AM, Saikat Kanjilal wrote:
>
> How about using virt
[
https://issues.apache.org/jira/browse/MAPREDUCE-2958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2958.
--
Resolution: Fixed
Assignee: Arun C Murthy (was: Mahadev konar)
Thanks
Begin forwarded message:
> From: Apache Jenkins Server
> Date: September 8, 2011 7:15:52 PM PDT
> To: mapreduce-dev@hadoop.apache.org
> Subject: Hadoop-Mapreduce-trunk-Commit - Build # 866 - Still Failing
> Reply-To: mapreduce-dev@hadoop.apache.org
>
> See https://builds.apache.org/job/Hadoop-
Guys,
After pushing MAPREDUCE-2908 (thanks Vinod!) all findbugs warnings are gone.
Also, with MAPREDUCE-2942 all tests pass.
From now on, please ensure 'test-patch' returns clean for all your patches.
thanks,
Arun
Gang,
I'm starting to go through the PA queue and review stuff. Unfortunately a lot
of patches have gone stale due to recent merge of MR-279 and code restructuring
for maven. If you guys can rebase I promise to review all I can soon-ish and
commit appropriately. I'll use a fair bar for 0.23 si
Hi Venu,
Please go ahead and provide patches for them - I'll review.
thanks,
Arun
On Sep 5, 2011, at 9:47 PM, Venu Gopala Rao wrote:
> Hi Matt,
>
> The following defects are important defects encountered by us in our
> regular Hadoop usage. We have submitted patches to these defects in th
Components: mrv2, resourcemanager
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Priority: Blocker
Fix For: 0.23.0
In secure mode RM WebUI shows wrong user for application (mapred) although the
RM logs show the right user (me).
--
This message is
, scheduler
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Priority: Trivial
Fix For: 0.23.0
Missing log stmt for app submission fail CS
--
This message is automatically generated by JIRA.
For more information on JIRA, see
+1
On Sep 6, 2011, at 12:13 AM, Amareshwari Sri Ramadasu wrote:
> + Copying common dev.
>
> On 9/6/11 10:58 AM, "Mithun Radhakrishnan"
> wrote:
>
> I'm leaning towards creating a trunk/hadoop-tools/hadoop-distcp (etc.). I'm
> hoping that's going to be acceptable to this forum. This way, movi
> compile-mapred-test:
>[javac] Compiling 209 source files to
> /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduce-project/build/test/mapred/classes
>[javac]
> /home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Commit/trunk/hadoop-mapreduc
[
https://issues.apache.org/jira/browse/MAPREDUCE-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2900.
--
Resolution: Won't Fix
Wontfix per Vinod's comment.
> Replac
[
https://issues.apache.org/jira/browse/MAPREDUCE-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2895.
--
Resolution: Won't Fix
The reason we want AMResponse is to be able to store
-2933
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Components: mrv2, nodemanager, resourcemanager
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Change allocate call to return ContainerStatus for completed containers rather
than
[
https://issues.apache.org/jira/browse/MAPREDUCE-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2191.
--
Resolution: Duplicate
Duplicate of MAPREDUCE-2193 (which has a patch, albeit stale
I've started a wiki to track this, please help keep it up-to-date...
http://wiki.apache.org/hadoop/PoweredByYarn
thanks,
Arun
On Aug 31, 2011, at 7:22 PM, Josh Patterson wrote:
> Do we have a list of all MR2 frameworks being worked on currently
> beyond MPI and Spark?
>
> JP
>
> On Tue, Aug 3
/Reduce
Issue Type: Improvement
Components: jobhistoryserver, mrv2
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
Add a new record to JobHistory to record start time of each instance of AM
--
This message is automatically generated
Those are the two public ones I know of currently...
On Aug 31, 2011, at 7:22 PM, Josh Patterson wrote:
> Do we have a list of all MR2 frameworks being worked on currently
> beyond MPI and Spark?
>
> JP
>
> On Tue, Aug 30, 2011 at 3:04 AM, Milind Bhandarkar (JIRA)
> wrote:
>> Hamster: Hadoop A
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Fix For: 0.23.0
Saw a corner case in container reservations where the node on which the AM is
running was reserved, and hence never fulfilled leaving the application hanging
, mrv2
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
MAPREDUCE-2891 , MAPREDUCE-2897 & MAPREDUCE-2898 added javadocs for core
protocols (i.e. AMRMProtocol, ClientRMProtocol & ContainerManager). Most
'records' also have javadocs
Thanks Vinod!
On Aug 29, 2011, at 12:30 AM, Vinod Kumar Vavilapalli wrote:
> Updated http://wiki.apache.org/hadoop/DevelopingOnTrunkAfter279Merge
> and filed MAPREDUCE-2901.
>
> +Vinod
>
> On Fri, Aug 19, 2011 at 12:22 AM, Alejandro Abdelnur wrote:
>
>> protoc is invoked from an antrun plugin
Issue Type: Sub-task
Components: mrv2, nodemanager
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
Replace ContainerId, Resource in ContainerLaunchContext with Container
--
This message is automatically generated by JIRA.
For more
: Hadoop Map/Reduce
Issue Type: Sub-task
Components: mrv2, resourcemanager
Reporter: Arun C Murthy
We can replace major parts of ApplicationSubmissionContext with a
ContainerLaunchContext.
--
This message is automatically generated by JIRA.
For more information on
Components: documentation, mrv2
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
Track docs for ClientRMProtocol and related apis/records.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http
Components: documentation, mrv2
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
Track docs for ContainerManager and related apis/records.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http
Project: Hadoop Map/Reduce
Issue Type: Sub-task
Components: mrv2
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
Remove all apis other than getters and setters in all
org/apache/hadoop/yarn/api/records/*.
We initially
>
>> Arun
>>
>> On Aug 28, 2011, at 2:22 AM, Tharindu Mathew wrote:
>>
>>> Thanks for the explanation Arun.
>>>
>>> Created a post with the info gathered here, so that it will help someone
>>> else as well:
>>>
Versions: 0.23.0
Reporter: Arun C Murthy
Fix For: 0.23.0
We need to merge AllocateResponse and AMResponse, having them separate serves
no purpose.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software
Reporter: Arun C Murthy
Fix For: 0.23.0
Ticket to track improvements to YARN apis.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
post with the info gathered here, so that it will help someone
> else as well:
> http://tharindu-mathew.blogspot.com/2011/08/building-apache-hadoop-from-source.html
>
>
> On Sun, Aug 28, 2011 at 1:32 PM, Arun C Murthy wrote:
>
>> Mathew,
>>
>> The native code,
: 0.23.0
Reporter: Arun C Murthy
Priority: Blocker
Fix For: 0.23.0
Some api changes before we declare yarn apis as stable:
# FinishApplicationMasterRequest doesn't need to send out 'tracking url'.
# FinishApplicationMasterRequest shouldn&#x
Mathew,
The native code, in this context, is the C executable used to launch the
containers (tasks) by the NodeManager. The short summary of the executable is
that it's a setuid executable used to ensure that the unix process runs as the
actual user who submitted the job, not as the unix user
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Fix For: 0.23.0
We need to add docs for ClientRMProtocol, AMRMProtocol and ContainerManager
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software
: Arun C Murthy
Fix For: 0.23.0
Let's use this jira to track docs for all of MRv2.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Components: documentation, mrv2
Affects Versions: 0.23.0
Reporter: Arun C Murthy
Priority: Critical
Fix For: 0.23.0
We need to add docs for writing new application frameworks, including examples,
javadocs and sample apps.
--
This message is automatically
oject: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Priority: Blocker
Fix For: 0.23.0
mapred-config.sh doesn't look for $HADOOP_COMMON_HOME/libexec/hadoop-config.sh
and thus fails to find it and
Change mrv2 version to be 0.23.0-SNAPSHOT
-
Key: MAPREDUCE-2879
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2879
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Arun C Murthy
ager, resourcemanager
Reporter: Arun C Murthy
It will be very useful for RM and NM to support web-services to export json/xml.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
on, Aug 15, 2011 at 1:24 PM, Arun C Murthy wrote:
>> Thanks Tom.
>>
>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and
>> should be done by tmrw.
>>
>> Also, can you guys please ensure that secure HDFS works after mvn
is done.
>
> thanks
> mahadev
>
> On Aug 17, 2011, at 12:59 PM, Arun C Murthy wrote:
>
>> Thanks for all the positive responses.
>>
>> I think we are good to go.
>>
>> Mahadev and I will 'practise' the merge on a throwaway branch first
Thanks for all the positive responses.
I think we are good to go.
Mahadev and I will 'practise' the merge on a throwaway branch first (right now)
to ensure we don't mess it up, so please don't be surprised to see us do this
'twice'. :)
Arun
On Aug 16, 2011, at 2:14 PM, Mahadev Konar wrote:
>
As someone who spent an inordinate amount of my waking time on this, I'm biased
towards seeing this move forward... *smile*
+1
Arun
On Aug 16, 2011, at 2:14 PM, Mahadev Konar wrote:
> Hi all,
>
> We are excited to let you know that we have MR-279 ready to be merged to
> trunk. I have uploa
#x27;m fine with that. When do you expect to start the vote?
>
> Cheers,
> Tom
>
> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy wrote:
>> Hi Tom,
>>
>> Can I request you to wait on this commit until we merge MR-279? As Vinod
>> pointed out in his m
[
https://issues.apache.org/jira/browse/MAPREDUCE-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2642.
--
Resolution: Fixed
I just committed this. Thanks Josh!
> Fix two bugs in
Hi Tom,
Can I request you to wait on this commit until we merge MR-279? As Vinod
pointed out in his mail to mapreduce-dev@ we are very close to getting the
merge done. We should call a vote asap. By holding off it the mvn patch it will
save us a bit of time - we spent at more than a couple of
MR-279: Bug fixes ported from y-merge
-
Key: MAPREDUCE-2837
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2837
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Arun C Murthy
[
https://issues.apache.org/jira/browse/MAPREDUCE-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2809.
--
Resolution: Won't Fix
Not necessary with MR-279.
> Refactor JobRecover
[
https://issues.apache.org/jira/browse/MAPREDUCE-2689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2689.
--
Resolution: Fixed
Fixed as part of recent RM re-factor
> InvalidStateTransisi
Looks like you don't have autotool chain required to build the native code for
launching containers.
It isn't critical - you can run with the java based DefaultContainerExecutor.
Just pass -P-cbuild to maven to skip building the native code.
Arun
On Aug 9, 2011, at 10:24 PM, Haoyuan Li wrote:
Praveen,
I'm not aware of any devs using eclipse to run MRv2, I haven't tried it myself.
OTOH, if you do get to we are happy to follow your lead, please feel free to
provide us instructions and we can update the README... thanks.
Arun
On Aug 9, 2011, at 7:39 PM, Praveen Sripati wrote:
> Hi,
On Aug 9, 2011, at 9:28 PM, Hyunsik Choi wrote:
> Hi guys,
>
> MRv2 looks very promising for various applications. We have considered
> an application based on Yarn, but this app is required the adaptive
> resource assignment. In other words, this app may need additional
> resources while this a
[
https://issues.apache.org/jira/browse/MAPREDUCE-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2729.
--
Resolution: Fixed
Sorry, some weird issue with my patch d/w.
I just committed
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Fix For: 0.23.0
Add (true) unit tests for CapacityScheduler
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
fixes). I am facing some issues with secuirty
> which should be sorted out by EOD today.
> We should be ready to start the process of merging soon.
>
> thanks
> mahadev
>
> On Jul 12, 2011, at 11:52 PM, Arun C Murthy wrote:
>
>> On Jun 10, 2011, at 11:44 PM, Arun
[
https://issues.apache.org/jira/browse/MAPREDUCE-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2694.
--
Resolution: Not A Problem
I thought more about this... I've spent time on th
: Bug
Components: mrv2
Reporter: Arun C Murthy
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
AM crashing because of invalid TA_CONTAINER_COMPLETED event
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http
Type: Bug
Components: mrv2
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Expired NM's containers aren't being communicated to AM - so the AM needs to
rely on timeouts. We need to fix this.
--
This message is automatically generated by JIRA.
For more info
Murthy
Assignee: Arun C Murthy
Fix For: 0.23.0
Enhance CS to cap concurrently running jobs ala 0.20.203
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Container logs aren't getting cleaned up
Key: MAPREDUCE-2696
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: Arun C M
Issue Type: Bug
Components: mrv2
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Fix For: 0.23.0
Unhealthy nodes (health-script) are still being assigned containers
--
This message is automatically generated by JIRA.
For more information on JIRA
Reporter: Arun C Murthy
Assignee: Sharad Agarwal
- AM sends request asking 4 containers on host H1.
- Asynchronously, host H1 reaches RM and gets assigned 4 containers. RM at this
point, sets the value against H1 to
zero in its aggregate request-table for all apps.
- In the mean-while AM
On Jul 12, 2011, at 11:52 PM, Arun C Murthy wrote:
>
> $ git show 99ab6d89acc2fc722489c317be796c15c3975284
> Vinod - MAPREDUCE-2681. Added env vars (stderr/stdout) for hadoop pipes
>
> We also plan to port HADOOP-6929 to MR-279 (Mahadev).
I was confused about MR-2531 and MR-
On Jul 13, 2011, at 10:31 AM, Eli Collins wrote:
>
> Combining with the MR2 merge makes sense to me.
>
> Aside from o.a.h.m.server, what would be removed? Seems like parts of
> src/contrib no longer apply (eg fs scheduler) and others (gridmix,
> raid) should be able to continue to work.
Good
On Jul 13, 2011, at 12:30 AM, Arun C Murthy wrote:
>
> On Jul 7, 2011, at 9:58 AM, Eli Collins wrote:
>
>>
>> I think #2 makes the most sense. From a developer perspective, MR2 is
>> good stuff, there's no need for us to maintain two implementations in
On Jul 7, 2011, at 9:58 AM, Eli Collins wrote:
>
> I think #2 makes the most sense. From a developer perspective, MR2 is
> good stuff, there's no need for us to maintain two implementations in
> trunk/23 since we're already maintaining MR1 in the current releases.
+1
Anyone feel otherwise?
Ar
[
https://issues.apache.org/jira/browse/MAPREDUCE-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2682.
--
Resolution: Fixed
Hadoop Flags: [Reviewed]
I just committed this. Thanks
Add a -classpath option to bin/mapred
-
Key: MAPREDUCE-2682
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2682
Project: Hadoop Map/Reduce
Issue Type: Improvement
Reporter: Arun C Murthy
On Jun 10, 2011, at 11:44 PM, Arun C Murthy wrote:
> 1. I'd like to get MAPREDUCE-2400 committed to both trunk and MR-279.
> This is a very important patch by Tom which allows to submit jobs to
> both JT and the new RM - thanks Tom!
> 2. Check-in the 'yarn'
Reporter: Arun C Murthy
Assignee: Vinod Kumar Vavilapalli
Fix For: 0.23.0
Change pipes to use env vars for stdout/stderr files, currently they are
hard-coded. This is important for MAPREDUCE-279.
--
This message is automatically generated by JIRA.
For more
Issue Type: Improvement
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Priority: Minor
It'd be very useful to display queue-information for running jobs alongwith
jobid, user, start-time etc.
--
This message is automatically generated by JIRA.
For
Reporter: Arun C Murthy
Assignee: Arun C Murthy
Jira to track very minor and misc. changes to trunk for MR-279
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[
https://issues.apache.org/jira/browse/MAPREDUCE-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2400.
--
Resolution: Fixed
Release Note:
Remove Cluster's dependency on JobTr
s this?
>
> Koji
>
>
> On 7/5/11 9:23 PM, "Arun C Murthy" wrote:
>
>> It's in the works, but lower priority for now. The focus is on scaling &
>> performance currently. It should be easier to add prior to a final cut after
>> the rest of the im
It's in the works, but lower priority for now. The focus is on scaling &
performance currently. It should be easier to add prior to a final cut after
the rest of the important features/fixes go in.
thanks,
Arun
Sent from my iPhone
On Jul 5, 2011, at 1:59 PM, Eli Collins wrote:
> Hey guys,
>
Josh,
Welcome on board. Apache Hadoop is a volunteer driven community project and we
are glad to have you help us. I, personally, look forward to working with you
on NG MR and am excited to see you report issues and fix them!
Arun
On Jul 5, 2011, at 8:34 AM, Josh Wills wrote:
> Hello MR Deve
Jim,
On Jul 1, 2011, at 2:23 PM, Jim Falgout wrote:
> On another note: do you know of any design docs for building an application
> executor using the new resource manager? Just wondering how to get started?
>
Jim, we are in the process of doing a better job with docs etc.
Sharad just gave a
On Jun 14, 2011, at 6:31 PM, Praveen Sripati wrote:
Hi,
I have gone through MapReduce NextGen Blog entries and JIRA and have
the
following queries
There is a single API between the Scheduler and the
ApplicationMaster:
(List newContainers, List
containerStatuses) allocate (List ask,
Another heads up.
Things are going well, we have done scale testing (350 nodes) and
continue to do more.
We think we are nearly ready to merge MR-279 into trunk (yaay!).
A proposal for plan forward:
1. I'd like to get MAPREDUCE-2400 committed to both trunk and MR-279.
This is a very impor
[
https://issues.apache.org/jira/browse/MAPREDUCE-2552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2552.
--
Resolution: Fixed
I just committed this. Thanks Sid!
> MR 279: NPE w
[
https://issues.apache.org/jira/browse/MAPREDUCE-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2551.
--
Resolution: Fixed
I just committed this. Thanks Sid!
> MR 279: Implem
[
https://issues.apache.org/jira/browse/MAPREDUCE-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2533.
--
Resolution: Fixed
I just committed this. Thanks Luke!
> MR-279: Metrics
Folks,
On Mar 21, 2011, Arun C Murthy wrote:
We are very happy to have pushed MR-279 to the MR-279 dev-branch
where we look forward to collaborating with everyone.
This work is only partially complete. We plan to continue its
development in the branch and do so in an aggressive manner - we
[
https://issues.apache.org/jira/browse/MAPREDUCE-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2476.
--
Resolution: Won't Fix
As I mentioned, we shouldn't do this.
I'm ha
[
https://issues.apache.org/jira/browse/MAPREDUCE-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy reopened MAPREDUCE-2429:
--
Sorry, my bad for closing this. Sid is working on porting this to trunk. Thanks
for
Moving to mapreduce-dev@, please use the right list for questions.
On May 3, 2011, at 12:06 AM, Sudharsan Sampath wrote:
Hi,
Could anyone point me to a summary on why this error would occur?
java.lang.Throwable: Child Error
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:471)
Caus
[
https://issues.apache.org/jira/browse/MAPREDUCE-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2434.
--
Resolution: Fixed
Release Note: I just committed this. Thanks Luke!
> MR-
I assume you already did 'mvn clean install assembly:assembly' to install
NextGen MR (more details in README checked-in to the branch). NextGen MR uses
maven for building.
Once you've done that you don't need 'ant' unless you want the old MR framework
(JT/TT). If you do want them you'll need to
[
https://issues.apache.org/jira/browse/MAPREDUCE-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy resolved MAPREDUCE-2429.
--
Resolution: Fixed
Fix Version/s: 0.20.204.0
Release Note: I just
401 - 500 of 598 matches
Mail list logo
