how we serialize giraph-conf.xml in
to HDFS. We can use HDFS paths instead of paths from client machine.
@Eli
I really appreciate your comments regarding above. I can create a JIRA
ticket if needed.
Thanks
Milinda
--
Milinda Pathirage
twitter: milindalakmal
skype: milinda.pathirage
blog: htt
;m guessing this has something to do with the -yj option and ensuring
the jar is distributed to all the workers, am I looking in the correct
direction or does anyone have advice on solving this issue?
Thanks.
On 13-10-14 04:55 PM, Matthew Laird wrote:
After much googling I finally pieced together how
After much googling I finally pieced together how to run in pure yarn
mode, first, for any future googlers here's the two command lines I used
to build and run giraph head:
mvn -Dhadoop.version=2.0.3-alpha -Phadoop_yarn -DskipTests clean install
$HADOOP_HOME/bin/hadoop jar
$GIRAPH_HOME/giraph
I've been trying to work through the Quick Start examples and adapting
it to my local installation, I'm running Hadoop 2.0.5-alpha across 4
machines.
I've done the checkout from github
sudo git clone https://github.com/apache/giraph.git
Applied the patch to ZooKeeperManager
http://www.mail-a
though i have hadoop 2.0 i use MR1 not YARN.
I'm sorry again.
2013/10/7 Matthew Laird mailto:lai...@sfu.ca>>
Hmm, it seems there have been some recent pushes that have broken
trunk as I discovered yesterday. :)
But I guess that brings me back to my original question, to bu
it's 0.20xxx
or tell it 2.0.5, or something else?
Thanks.
On 13-10-07 11:50 AM, Claudio Martella wrote:
trunk is 1.1.0-SNAPSHOT. I believe the date refers to the last update to
the site.
On Mon, Oct 7, 2013 at 8:48 PM, Matthew Laird mailto:lai...@sfu.ca>> wrote:
Thanks, which
ew
I use giraph 1.1.0 and cdh4 hadoop 0.23
the patch of Marco:
http://www.mail-archive.com/__user@giraph.apache.org/__msg00945/check.diff
<http://www.mail-archive.com/user@giraph.apache.org/msg00945/check.diff>
and build
mvn clean install -P hadoop_cdh4.1.2
Il giorno 07/ott/2013 20:20, "
-
Claudio Martella
claudio.marte...@gmail.com
<mailto:claudio.marte...@gmail.com>
--
Claudio Martella
claudio.marte...@gmail.com <mailto:claudio.marte...@gmail.com>
--
Claudio Martella
claudio.marte...@gmail.com <mailto:claudio.marte...@gmail.com>
--
Matthew Laird
Lead Software Developer, Bioinformatics
Brinkman Laboratory
Simon Fraser University, Burnaby, BC, Canada
scripts which can use to
submit jobs to YARN cluster (for pure YARN based implementation). So
going with giraph version which is based on map-reduce API will be
easy for you.
Thanks
Milinda
On Sun, Oct 6, 2013 at 10:04 PM, Matthew Laird wrote:
Hmm, is there a recommendation on a particular ver
iguration,
ApplicationId) ["org.apache.giraph.yarn.YarnUtils"] At
YarnUtils.java:[lines 47-240]
I guess this is what I get for playing with the trunk. :) But, what
version was it that is mentioned in the previous mailing list threads
that you can apply the patch to and get it compiled?
Thanks
, you need to specify hadoop.version system property. So command
to build giraph with YARN (2.0.5) should be something like following.
mvn -Phadoop_yarn -Dhadoop.version=2.0.5-alpha clean install
Hope this helps.
Thanks
Milinda
On Sun, Oct 6, 2013 at 9:04 PM, Matthew Laird wrote:
Further, I let
Further, I let it go and after two hours I see the file:
/giraph-core/target/munged/main/org/apache/giraph/yarn/GiraphYarnTask.java.rej
is now 295GB in size. I'm not sure what it's stuck doing after applying
this patch...
Thanks.
On 06/10/13 16:13, Matthew Laird wrote:
Hello,
Hello,
I'm trying to build giraph against Hadoop 2.0.5, and I've been browsing
the mailing list archives but am still having an issue. I found the
previous thread where Eli points to
https://issues.apache.org/jira/browse/GIRAPH-688
I've grabbed the patch and applied it against a clone from
13 matches
Mail list logo
