I remember that a good practice is using 1 worker per node, there are
several emails recommending this. It's the best way to use the maximum RAM
available in the cluster i believe.
Bye
--
*José Luis Larroque*
Analista Programador Universitario - Facultad de Informática - UNLP
Desarrollador Jav
HI Ganesh,
Recommendation is to increase the number of nodes with lesser ram size.
Your number of executors depend on the CPU core hence, i would recommend
using 60 GB RAM cpu's with 2 executors each for your use case.
Thanks
Ramesh
On Wed, Feb 22, 2017 at 3:27 PM, Sai Ganesh Muthuraman <
saigan
Hi, I am running a giraph application in the XSEDE comet cluster for graphs of
different sizes. For a graph with 10,000 edges, I used about 8 workers on 2
nodes, each node having 128GB RAM. My input file itself is just about 200KB.
But when I tried to increase the number of workers to 20 or mo
