Is there any way for the master to know about how much message traffic is
there?
In my algo, I have to implement something when there is no msg flowing.
Any ideas are really appreciated..
Regards
Jyoti
The most simple solution is to use an aggregator.
On Mon, Oct 21, 2013 at 3:48 PM, Jyoti Yadav rao.jyoti26ya...@gmail.comwrote:
Is there any way for the master to know about how much message traffic is
there?
In my algo, I have to implement something when there is no msg flowing.
Any ideas
Hey Andro,
I believe the reason you are seeing this error is due to ports being
blocked by iptables. You need to have port 3 open for the master on all
machines in your cluster. You also need to open ports 30001 up to the
number of workers you will be running.
So if you are running 10 workers
Yes, that would be the reason. In addition to the ports for netty, you also
need to accept connections to Zookeeper (e.g. 22181).
On Mon, Oct 21, 2013 at 5:06 PM, Simon McGloin simonmcgl...@gmail.comwrote:
Hey Andro,
I believe the reason you are seeing this error is due to ports being
Hello there!
today I came back from a long vacation from programming with
giraph. I compiled the latest version and I am so lost with the
changes! So, can anybody help me with the following questions?
Q1: Where are all the job.set functions from GiraphJob? Like
job.setVertexClass(),
Hello:
I have a graph of size 2B edges, 200M vertices. I am trying to compute
pagerank of this graph. I have 10 node cluster, 8G memory.
I am unable to run giraph job successfully. My question is more generic:
1. How should one choose right amount of heap space? .. is there a way of
telling
Are you sure the iptables rules were applied to all your servers? If you
run the command
sudo iptables -L
does it show the ports as open?
On Mon, Oct 21, 2013 at 8:16 PM, Andro Bermúdez Serrano
andro.bermu...@gmail.com wrote:
I added this two lines:
iptables -A INPUT -p tcp -m state --state
this is the output of the command in all servers:
Chain INPUT (policy ACCEPT)
target prot opt source destination
ACCEPT tcp -- anywhere anywhere state
NEW tcp dpts:3:30010
ACCEPT tcp -- anywhere anywhere state
NEW
You should try to utilize maximum of your RAM to map tasks. You can do that
by changing the parameters at mapred-site.xml file. add the below
statements to set 6.5 GB of RAM for map tasks
property
namemapred.map.child.java.opts/name
value-Xmx6500m/value
descriptionheap size for map
