Re: [VOTE] Apache Giraph 1.1.0 RC1

I am indeed having some problems. mvn install will fail because the test is opening too many files: Caused by: java.io.FileNotFoundException: /private/var/folders/5b/8yx5dbyn40nbt_70syjs86chgp/T/giraph-hive-1415098102276/metastore_db/seg0/c90.dat (Too many open files in system) at

Re: Graph partitioning and data locality

Hi, answers are inline. On Tue, Nov 4, 2014 at 8:36 AM, Martin Junghanns martin.jungha...@gmx.net wrote: Hi group, I got a question concerning the graph partitioning step. If I understood the code correctly, the graph is distributed to n partitions by using vertexID.hashCode() n. I got

RE: Graph partitioning and data locality

You can also look at https://issues.apache.org/jira/browse/GIRAPH-908which solves the case where you have a partition map and would like graph to be partitioned that way after loading the input. It does not however solve the {do not shuffle data part} From: claudio.marte...@gmail.com Date:

Re: Problem running Giraph in local mode (Stuck at MASTER_ZOOKEEPER_ONLY checkWorkers)

Which profile did you build? I see log statements from GiraphJob class while yarn actually invokes GiraphYarnJob class afaik. I have not tried in local job runner mode so I might be wrong.(FYI, i built it using hadoop_yarn profile) Thanks, Tripti. Sent from my iPhone On 04-Nov-2014, at 9:57

Compiling Giraph 1.1

I'm attempting to build, compile and install Giraph 1.1 on a server running CDH5.1.2. A few weeks ago I successfully compiled it by changing the hadoop_2 profile version to be 2.3.0-cdh5.1.2. I recently did a fresh install and was unable to build, compile and install (perhaps due to the latest

Re: Compiling Giraph 1.1

What's the exact compilation incantation you use? Thanks, Roman. On Tue, Nov 4, 2014 at 9:56 AM, Ryan freelanceflashga...@gmail.com wrote: I'm attempting to build, compile and install Giraph 1.1 on a server running CDH5.1.2. A few weeks ago I successfully compiled it by changing the hadoop_2

Re: [VOTE] Apache Giraph 1.1.0 RC1

On Mon, Nov 3, 2014 at 4:51 PM, Maja Kabiljo majakabi...@fb.com wrote: We¹ve been running code which is the same as release candidate plus fix on GIRAPH-961 in production for 5 days now, no problems. This is hadoop_facebook profile, using only hive-io from all io modules. Great! This tells me

Re: [VOTE] Apache Giraph 1.1.0 RC1

On Tue, Nov 4, 2014 at 5:47 AM, Claudio Martella claudio.marte...@gmail.com wrote: I am indeed having some problems. mvn install will fail because the test is opening too many files: [snip] I have to investigate why this happens. I'm not using a different ulimit than what I have on my Mac OS

Re: Problem running Giraph in local mode (Stuck at MASTER_ZOOKEEPER_ONLY checkWorkers)

Hi, I built it using the hadoop_2 profile. More specifically, the command I used is: mvn –Phadoop_2 –Dhadoop=2.5.1 compile -DskipTests Regards, Kiran From: Tripti Singh tri...@yahoo-inc.commailto:tri...@yahoo-inc.com Reply-To: user@giraph.apache.orgmailto:user@giraph.apache.org

Giraph 1.1.0- SNAPSHOT with Hadoop 2.2.0: Classnotfound Exception

Hi, I have a trouble when trying to run giraph trunk on Hadoop 2.2.0 Job terminated, giving the exception ERROR yarn.GiraphYarnClient: Giraph: org.apache.giraph.examples.SimpleShortestPathsComputation reports FAILED state, diagnostics show: Application application_1415138324209_0002 failed 2

Re: Compiling Giraph 1.1

It's 'mvn -Phadoop_2 -fae -DskipTests clean install' Thanks, Ryan On Tue, Nov 4, 2014 at 2:02 PM, Roman Shaposhnik ro...@shaposhnik.org wrote: What's the exact compilation incantation you use? Thanks, Roman. On Tue, Nov 4, 2014 at 9:56 AM, Ryan freelanceflashga...@gmail.com wrote: I'm

Re: Giraph 1.1.0- SNAPSHOT with Hadoop 2.2.0: Classnotfound Exception

Hi, Adding some information to the thread: I tried to run application Map reduce mode by doing the following steps. (Java version 1.7.0_71) 1) Build giraph: $mvn -Phadoop_2 -fae -DskipTests clean install 2) Run the map reduce job: $HADOOP_HOME/bin/hadoop jar