I think the problem may have something to do with the fact that we are
using cloudera. Is there anyone who has experience with cloudera who may
have some idea how to fix this?
On Wed, Jul 31, 2013 at 6:59 AM, Alex Waagen wrote:
> I tried running both the shortest paths and pagerank examples, bu
I tried running both the shortest paths and pagerank examples, but I am
still getting the same errors.
On Tue, Jul 30, 2013 at 12:49 PM, Ryan Compton wrote:
> Hey Alex,
>
> Our cluster uses Cloudera for Hadoop admin stuff. To the best of my
> knowledge, we need to do our configs through the Clou
Hey Alex,
Our cluster uses Cloudera for Hadoop admin stuff. To the best of my
knowledge, we need to do our configs through the Cloudera GUI (which
is a royal pain).
The "mapred.tasktracker.map.tasks.maximum" should be at 16 everywhere
(save for a few of the higher nodes which already had it at 32
Ah, that might be your problem.
Try adding this between the and :
mapred.tasktracker.map.tasks.maximum
4
mapred.map.tasks
4
See if it works, that's really the only thing I can think of.
By default, the max number of map tasks and reduce tasksfor Hadoop is
2. This changes the max
Here is the file. It is almost empty.
On Tue, Jul 30, 2013 at 8:33 AM, Kyle Orlando wrote:
> Hmmm, could you post the contents of your mapred-site.xml in
> $HADOOP_HOME/conf? You may need to increase the number of map tasks.
>
> On Tue, Jul 30, 2013 at 11:02 AM, Alex Waagen wrote:
>
Hmmm, could you post the contents of your mapred-site.xml in
$HADOOP_HOME/conf? You may need to increase the number of map tasks.
On Tue, Jul 30, 2013 at 11:02 AM, Alex Waagen wrote:
> I am having some trouble getting these examples running. I’m using giraph
> version 1.1.0 and hadoop 0.20.2. I
I am having some trouble getting these examples running. I’m using giraph
version 1.1.0 and hadoop 0.20.2. I am using the following json file as
input:
[0,0,[[1,1],[3,3]]]
[1,0,[[0,1],[2,2],[3,1]]]
[2,0,[[1,2],[4,4]]]
[3,0,[[0,3],[1,1],[4,4]]]
[4,0,[[3,4],[2,4]]]
The command I use is:
hadoop jar
