Re: Re: tez map task and reduce task stay pending forerver

2015-01-28 Thread r7raul1...@163.com
Hello My cluster mapreduce.map.cpu.vcores setting is 3. r7raul1...@163.com From: Hitesh Shah Date: 2015-01-29 05:36 To: user Subject: Re: tez map task and reduce task stay pending forerver Hello Thanks for tracking down the issue to the vcores setting. Let me dig into that. Some initi

Re: Questions about Tez under the hood

2015-01-28 Thread Hitesh Shah
Answers inline. — Hitesh On Jan 28, 2015, at 3:15 AM, Fabio wrote: > Hi everyone, > I take back this mail since I have a few more questions about Tez. I am > digging into the internal scheduling policy and I'm trying to fully > understand how containers are assigned once Tez receive them from

Re: tez map task and reduce task stay pending forerver

2015-01-28 Thread Hitesh Shah
Hello Thanks for tracking down the issue to the vcores setting. Let me dig into that. Some initial questions: - do you know if YARN has been configured to schedule on both memory and vcores i.e using the DominantResourceScheduler? - I am assuming that the max vcores per container is 1 but

Re: Questions about Tez under the hood

2015-01-28 Thread Fabio
Hi everyone, I take back this mail since I have a few more questions about Tez. I am digging into the internal scheduling policy and I'm trying to fully understand how containers are assigned once Tez receive them from the RM. I am mainly referring to org.apache.tez.dag.app.rm.YarnTaskScheduler