or giraph from the trunk?
Thanks
On Mon, Mar 10, 2014 at 3:11 AM, Alexandre Fonseca
alexandrejorgefons...@gmail.com wrote:
Hello Vishal,
I've run it successfully in hadoop-2.2.0 with both MR2 and Yarn
computations.
For MR2, you just have to compile Giraph with the new hadoop_2 profile
Hello Vishal,
I've run it successfully in hadoop-2.2.0 with both MR2 and Yarn computations.
For MR2, you just have to compile Giraph with the new hadoop_2 profile and then
it should work with no problems using the commands shown in the Giraph
quickstart.
For Yarn, compile with the hadoop_yarn
The yarn version of Giraph is quite finicky when it comes to detecting the
giraph jar. When it can't find the jar on the new containers you get that
exception.
After much experimentation I've had great success with the following
(substitute paths and filenames where needed):
)) -
cleanUpZooKeeper: Got 2 of 1 desired children from
/_hadoopBsp/giraph_yarn_application_138757$
$7571436273_0001/_cleanedUpDir to change since only got 2 nodes.
Any reason why this is happening?
Thanks,
Rohit
On Mon, Dec 9, 2013 at 3:45 PM, Alexandre Fonseca
alexandrejorgefons...@gmail.com wrote
GiraphApplicationMaster not found error
Rob
On 09/12/2013 21:45, Alexandre Fonseca alexandrejorgefons...@gmail.com
wrote:
I have confirmed a bug in Giraph's YARN code related to the default
MapReduce
configuration. Either provide your own mapreduce.application.classpath in
mapred-site.xml
Hello Vishal,
Cross-posting from a different mailing list thread with the steps that allowed
me to compile and run SimpleShortestPaths on a pure-yarn cluster. Hope it
works for you too :)
I was able to compile and run Giraph 1.1.0-SNAPSHOT on top of hadoop-2.2.0.
Here's what I did:
.
This runs on top of MapReduce just as Giraph on Hadoop 1.x or 0.20.x do,
but riding on Mapper task instead of running the workers in YARN
containers.
On Sat, Dec 7, 2013 at 8:53 PM, Alexandre Fonseca
alexandrejorgefons...@gmail.com wrote:
Hello Yong,
I was able
.jar but that did not help. HADOOP_MAPRED_HOME
is pointing to HADOOP_HOME on my setup.
On Mon, Dec 9, 2013 at 10:11 AM, Alexandre Fonseca
alexandrejorgefons...@gmail.com wrote:
Hi Rohit,
In my case, I got 2 Shell$ExitCodeExceptions when trying to run
custom mapreduce.application.classpath
or no default mapreduce.application.classpath + patch. Application fails if
using default mapreduce.application.classpath and no patch.
Cheers,
Alex
On Monday 09 December 2013 22:05:20 Alexandre Fonseca wrote:
mapreduce.application.classpath
Hello Yong,
I was able to compile and run Giraph 1.1.0-SNAPSHOT on top of hadoop-2.2.0.
Here's what I did:
git clone https://git-wip-us.apache.org/repos/asf/giraph.git
cd giraph
git revert ac93c3b6c5bce5f22b293b29df91663ca7d7ce63
mvn -Phadoop_yarn
10 matches
Mail list logo
