the above
configuartion.
Date: Sat, 10 Mar 2012 22:31:44 -0700
From: j...@windwardsolutions.com
To: user@mahout.apache.org
Subject: Re: Not all Mapper/Reducer slots are taken when running K-Means
cluster
What's your Hadoop config in terms of the maximum number of reducers?
It's a function
a RAM of 32GB, i think it should be fine to have the above
configuartion.
Date: Sat, 10 Mar 2012 22:31:44 -0700
From: j...@windwardsolutions.com
To: user@mahout.apache.org
Subject: Re: Not all Mapper/Reducer slots are taken when running K-Means
cluster
What's your Hadoop config
Can you run K-means jobs again ( all with the same block size ) and give
same statistics for :
a) only 1 job running
b) 2 jobs running simultaneously
c) 5 jobs running simultaneously
On 10-03-2012 21:08, WangRamon wrote:
Hi All I submit 5 K-Means Jobs simultaneously, my Hadoop cluster have
And to answer the question about KMeans configuration :
Kmeans has two jobs :
1) builClusters : has a reducer and has no limitation on the number of
reducer tasks
2) clusterData : executes if runClustering = true, has no reducer tasks
On 11-03-2012 09:10, Paritosh Ranjan wrote:
Can you run
very quickly, it's
about no more than 18 seconds to finish every reduce task, so maybe that's the
cause? ThanksCheers Ramon
Date: Sun, 11 Mar 2012 09:14:15 +0530
From: pran...@xebia.com
To: user@mahout.apache.org
Subject: Re: Not all Mapper/Reducer slots are taken when running K-Means
Cheers Ramon
Date: Sun, 11 Mar 2012 09:14:15 +0530
From: pran...@xebia.com
To: user@mahout.apache.org
Subject: Re: Not all Mapper/Reducer slots are taken when running K-Means
cluster
And to answer the question about KMeans configuration :
Kmeans has two jobs :
1) builClusters : has
the cause? ThanksCheers Ramon
Date: Sun, 11 Mar 2012 09:14:15 +0530
From: pran...@xebia.com
To: user@mahout.apache.org
Subject: Re: Not all Mapper/Reducer slots are taken when running K-Means
cluster
And to answer the question about KMeans configuration :
Kmeans has two jobs :
1
Mar 2012 22:31:44 -0700
From: j...@windwardsolutions.com
To: user@mahout.apache.org
Subject: Re: Not all Mapper/Reducer slots are taken when running K-Means
cluster
What's your Hadoop config in terms of the maximum number of reducers?
It's a function of your available RAM on each node
