Re: What does JobPriority mean?

2017-11-13 Thread Benson Qiu
Thanks, Sunil! I found your JIRA (YARN-1963 ) that has a really great design doc. On Mon, Nov 13, 2017 at 6:04 PM, Sunil G wrote: > Hi Benson, > > Prior to 2.8 releases, YARN did not support priorities for its > applications.

Re: What does JobPriority mean?

2017-11-13 Thread Sunil G
Hi Benson, Prior to 2.8 releases, YARN did not support priorities for its applications. Currently user can specify priority (higher integer value means higher priority) to its applications so that high priority apps could get resources faster from scheduler (priority is applicable within a leaf

What does JobPriority mean?

2017-11-13 Thread Benson Qiu
I'm having trouble finding documentation for JobPriority (mapreduce.job.priority). > "Changes the priority of the job. Allowed priority values are VERY_HIGH, HIGH, NORMAL, LOW, VERY_LOW" I am using YARN CapacityScheduler, with preemption disabled. What exactly does "low priority" or "high

Re: PendingDeletionBlocks immediately after Namenode failover

2017-11-13 Thread Ravi Prakash
Hi Michael! Thank you for the report. I'm sorry I don't have advice other than the generic advice, like please try a newer version of Hadoop (say Hadoop-2.8.2) . You seem to already know that the BlockManager is the place to look. If you found it to be a legitimate issue which could affect

Re: Problems installing Hadoop on Windows Server 2012 R2

2017-11-13 Thread Bible, Landy
​Pavel, It was years ago, I don't remember the specific version. It was around 2010 or 2011, so whatever was available at the time. I'm not sure it was even 1.x yet. -Landy From: Pavel Drankov Sent: Sunday, November 12, 2017 2:50 AM To: