could only be replicated to 0 nodes instead of minReplication exception during job execution

Hello, I am using YARN. I get some exceptions at my namenode and datanode. They are thrown when my Reduce progress gets 67%. Then, reduce phase is restarted from 0% several times, but always restarts at this point. Can someone tell me what I should do? Many thanks! Namenode log: 2013-06-24

Re: How is the memory usage of containers controlled?

container is monitored or controlled? Thank you very much! On 6/21/2013 4:50 PM, Arun C Murthy wrote: Start with LinuxResourceCalculatorPlugin. Arun On Jun 21, 2013, at 1:30 PM, Yuzhang Han yuzhanghan1...@gmail.com wrote: Thank you Arun. I am trying to study how YARN works. Can someone

Re: How is the memory usage of containers controlled?

usage. On Jun 18, 2013, at 12:30 PM, Yuzhang Han yuzhanghan1...@gmail.com mailto:yuzhanghan1...@gmail.com wrote: Hi, I am curious about how YARN containers control their memory usage. Say, I have a MR job, and I configure that every map task should be assigned a 1 GB container, and every reduce

Different container sizes for MR tasks, job does not complete

Hi, I am using MapReduce on YARN. I want to make tasks of the same job run in containers with different sizes. For example: Job1 = Task1, ..., Task8. Task1 := 1280 MB; Task2 to 8 := 1024 MB. To achieve this, I manually call reqEvent.getCapability().setMemory(MEMORY_SIZE) in