Re: Giraph Hadoop 2.2.0 (YARN)

I recently compiled giraph (trunk) with hadoop 2.2.0. The command I used is mvn -Phadoop_yarn -Dhadoop.version=2.2.0 clean compile It compiled fine On Thu, Mar 27, 2014 at 10:49 PM, chadi jaber wrote: > Hello, > > I have tried several commands in order to compile giraph for hadoop 2.2.0 > with

Re: Building Giraph Jar for CDH 4.5

Hi Pascal, Thank you so much. Regards, Agrta Rawat On Thu, Mar 27, 2014 at 7:08 PM, Pascal Jäger wrote: > Hi, > > there's a maven build profile for cdh. > It works with csh 4.5 and hadoop 2.0.0 > > I'm not sure if I get the second question right. > You can use cloudera express installer. > Onc

Help on leveraging Giraph for my Connected Component use case

> Hi > > I am looking for tips on how to leverage Giraph for the use case below. > > I want to connect components where a Node is a Collection of Key-Value pairs > and 2 Nodes have an Edge if they share a Key-Value. > > A classic solution would be to run a Depth First Search algorithm to clus

Graph stats in giraph.

Hi, Does anybody know what "Aggregate sent message message bytes" means in the giraph log file? I'm processing a ~500MB size of graph with 4 worker nodes. While I see "Aggregate sent message message bytes=33120305280" in the output, would a ~500MB graph generate ~30GB messages communication on 4

Out of memory

Hi. I'm trying to run the sample connected components algorithm on a large data set on a cluster, but I get a "java.lang.OutOfMemoryError: Java heap space" error. The cluster has 16 nodes, and each node has 24 cores and 96GB of memory. I'm using Hadoop-2.2.0-cdh5.0.0-beta2 and running Giraph 1.

Giraph Hadoop 2.2.0 (YARN)

Hello, I have tried several commands in order to compile giraph for hadoop 2.2.0 without success . I am wondering if giraph can work with hadoop 2.2.0, if yes how can be compiled (which maven command to use, is there any pom modification to perform). Best Regards,Chadi

Re: Building Giraph Jar for CDH 4.5

Hi, there’s a maven build profile for cdh. It works with csh 4.5 and hadoop 2.0.0 I’m not sure if I get the second question right. You can use cloudera express installer. Once the installer is running on your machine you can select the stuff you like to have installed. (Zookeepr, Hadoop, …) It

Building Giraph Jar for CDH 4.5

Hi Folks, I need to know solutions of following points. 1. is it possible to build Griaph jar file for CDH 4.5 that has hadoop 2.0.0? 2. If yes, How can I install hadoop from CDH 4.5 tar ball for hadoop? can anyone help me... Thanks, Agrta Rawat