OK, got by this problem. It turns out, I built Giraph using the
hadoop_2 profile, and not hadoop_yarn. When I switched to using mvn
-Phadoop_yarn, the problem I was experiencing changed... I now see log
messages showing Girpah connecting to the Yarn ResourceManager on port
8032, which is good. U
Folks:
I'm trying to run the basic ShortestPaths example using Giraph 1.1 on
Hadoop 2.5.2. I'm running in actual cluster model (eg, not
psuedo-distributed) and I can run standard mapreduce jobs OK. But
when I try to run the Giraph example, it seems to hang unless I set
-ca giraph.SplitMast
Are you running with an external ZK, or are you expecting giraph to start
one from you on the master? If the second one is the case (as it seams to
me from the logs), then it won't work. Giraph on Yarn requires you to start
ZK externally, and pass the address to giraph when you start the job.
On
Hi,
I am trying to run Giraph on a Hadoop 0.23 installation, but I am running
in a communication problem. From the log it seems that the workers are not
able to connect to the zookeeper instance on the master.
I am using the option -DuseNetty=true
Any help is appreciated.
Here the error log:
**
Hi Devs,
I was able to get Giraph running on Yarn by creating Yarn specific
configuration programmatically. I think that it's better if we can
have some shell scripts specific to Yarn (or may be modifications to
existing shell scripts), so that we can easily deploy Giraph jobs on
Yarn clusters. Pl
Hi,
I'm trying to get Giraph running on YARN based on TestYarnJob test
case. But having issues with moving required jars to YARN environment.
I'm using single node YARN setup. I can see the job in YARN, but with
following error.
"Error: Could not find or load main class
org.apache.giraph.yarn.Gir
