thank you very much, I have summit the patch, can you help to check the patch ?
fell so cool for making a contribution to apache .
> On Nov 7, 2015, at 02:01, Chris Nauroth wrote:
>
> I filed HADOOP-12557 to track this change. Let's take further discussion
> there.
>
> https://issues.apach
I filed HADOOP-12557 to track this change. Let's take further discussion there.
https://issues.apache.org/jira/browse/HADOOP-12557
Zheng, please feel free to assign this to yourself if you'd like to work on it.
I'd suggest that we add a line in BUILDING.txt after the "Use -Pdocs to
generate..
-
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org
For additional commands, e-mail: user-h...@hadoop.apache.org
The formula for determining the number of concurrently running tasks per node
is:
min (yarn.nodemanager.resource.memory-mb / mapreduce.[map|reduce].memory.mb,
yarn.nodemanager.resource.cpu-vcores / mapreduce.[map|reduce].cpu.vcores) .
For you scenario :
As you told yarn.nodemanager.resou
Can you please copy paste the cluster metrics from RM dashboard.
Its under http://rmhost:port/cluster/cluster
In this page, check under Memory Total vs Memory Used and VCores Total vs
VCores Used
On 6 November 2015 at 18:21, sandeep das wrote:
> HI Laxman,
>
> Thanks for your response. I had al
HI Laxman,
Thanks for your response. I had already configured a very high value
for yarn.nodemanager.resource.cpu-vcores
e.g. 40 but still its not increasing more number of parallel tasks to
execute but if this value is reduced then it runs less number of parallel
tasks.
As of now yarn.nodemanage
Hi Sandeep,
Please configure the following items to the cores and memory per node you
wanted to allocate for Yarn containers.
Their defaults are 8 cores and 8GB. So that's the reason you were stuck at
31 (4nodes * 8cores - 1 AppMaster)
http://hadoop.apache.org/docs/r2.6.0/hadoop-yarn/hadoop-yarn-
May be to naive to ask but How do I check that?
Sometimes there are almost 200 map tasks pending to run but at a time only
31 runs.
On Fri, Nov 6, 2015 at 5:57 PM, Chris Mawata wrote:
> Also check that you have more than 31 blocks to process.
> On Nov 6, 2015 6:54 AM, "sandeep das" wrote:
>
>>
Also check that you have more than 31 blocks to process.
On Nov 6, 2015 6:54 AM, "sandeep das" wrote:
> Hi Varun,
>
> I tried to increase this parameter but it did not increase number of
> parallel tasks but if It is decreased then YARN reduces number of parallel
> tasks. I'm bit puzzled why its
Hi Varun,
I tried to increase this parameter but it did not increase number of
parallel tasks but if It is decreased then YARN reduces number of parallel
tasks. I'm bit puzzled why its not increasing more than 31 tasks even after
its value is increased.
Is there any other configuration as well wh
On Nov 5, 2015 4:56 PM, "Arvind Thakur" wrote:
> Unsubscribe
>
11 matches
Mail list logo
