Re: Help with Giraph on Yarn

Can u run the following command to find container logs and post it here: yarn logs -applicationId application_1415203231170_0002 If u find this error: Could not find or load main class org.apache.giraph.yarn.GiraphApplicationMaster It may just be due to non-availablity of the yarn jars Thank

Re: Help with Giraph on Yarn

Then do you know to solve this error? 14/11/05 10:25:29 ERROR yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED state, diagnostics show: Application application_1415203231170_0002 failed 2 times due to AM Container for appattempt_1415203231170_

Re: Help with Giraph on Yarn

Hi, in the mean time I found the reason why it hangs for long time here: base path checking . It scan all the directory tree starting from current directory, if you run it into your home (and you have a lot of files and directories) it takes ages to complete. I continue to got the same error.

Re: Help with Giraph on Yarn

I run with: hadoop jar giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.0-cdh5.2.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vif org.apache.giraph.io.formats.JsonLongDoubleFloatDoubleVertexInputFormat -vi

Re: Help with Giraph on Yarn

This is my complete logs with the command I run: ale:~ />$HADOOP_INSTALL/bin/hadoop jar /Users/ale/extprj/giraph/giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.1-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputa

Re: Help with Giraph on Yarn

I faced the similar problem where the workflow just hangs. Can u see in ur logs if there is a task with id 0. I made a local fix and I could give u the patch if u see a similar problem and ur workflow is unable to find the zookeeper manager file and repeats the following message: For task xyz, go

Re: Problem running Giraph in local mode (Stuck at MASTER_ZOOKEEPER_ONLY checkWorkers)

Hey ok, I'm not sure but can someone explain why we have a Hadoop 2 profile which is not yarn based? R we expected to run giraph 1.1.0 on Hadoop 2 without yarn? I'm asking this as I have faced some scalability issues with yarn profile in the past so not sure if I should really be trying out the

Re: Help with Giraph on Yarn

Hi, have you seen the hadoop logs? Could you write here how are you running the command? Thanks, Alessandro Il giorno 05/nov/2014, alle ore 18:04, Jing Fan ha scritto: > Yeah, I add -yj option. The result is the same. Still error here. > > On Wed, Nov 5, 2014 at 10:52 AM, Alessandro Negro wr

Re: Help with Giraph on Yarn

Yeah, I add -yj option. The result is the same. Still error here. On Wed, Nov 5, 2014 at 10:52 AM, Alessandro Negro wrote: > Hi Jing, > I’m facing the same problem. Do you check the hadoop logs? In my case I > got: > > Could not find or load main class > org.apache.giraph.yarn.GiraphApplication

Re: Help with Giraph on Yarn

Hi Jing, I’m facing the same problem. Do you check the hadoop logs? In my case I got: Could not find or load main class org.apache.giraph.yarn.GiraphApplicationMaster Moreover I don’t know why my application hang for a long time here: 14/11/05 17:11:17 INFO yarn.YarnUtils: base path checking . A

Help with Giraph on Yarn

Hi, I install the Giraph with Yarn. But when I run the program with following command: hadoop jar giraph-examples/target/giraph-examples-1.1.0-SNAPSHOT-for-hadoop-2.5.0-cdh5.2.0-jar-with-dependencies.jar org.apache.giraph.GiraphRunner org.apache.giraph.examples.SimpleShortestPathsComputation -vi

Re: Graph partitioning and data locality

Thanks to you both and Lukas who answered me directly. The stated issue 908 helps a lot and I will further look into this + physical layout. On 04.11.2014 16:28, Pavan Kumar A wrote: You can also look at https://issues.apache.org/jira/browse/GIRAPH-908 which solves the case where you have a par