I've been following Michael Noll's Single node cluster tutorial but am
unable to run the wordcount example successfully.
It appears that I'm having some sort of problem involving the nodes. Using
copyFromLocal fails to replicate the data across 1 node.
When I try to look at the hadoop web inte
Nick:
It appears that the datanode daemon isn't running.
> /usr/local/hadoop/bin$ jps
> 24440 SecondaryNameNode
> 24626 TaskTracker
> 24527 JobTracker
> 24218 NameNode
> 24725 Jps
There's no process for DataNode. This is the process that is responsible
for storing blocks. In other words, no da
On 2/10/10 12:42 PM, "Nick Klosterman" wrote:
> I've been following Michael Noll's Single node cluster tutorial but am
> unable to run the wordcount example successfully.
>
> It appears that I'm having some sort of problem involving the nodes. Using
> copyFromLocal fails to replicate the dat
It appears I have incompatible namespaceIDs. Any thoughts on how to
resolve that?
This is what the full datanodes log is saying:
2010-02-10 15:25:09,125 INFO
org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
/
STARTUP_MSG:
So Michael Noll's tutorial page has the following tips for the error
you are facing.
http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster)#java.io.IOException:_Incompatible_namespaceIDs
Abhishek
On Wed, Feb 10, 2010 at 12:57 PM, Nick Klosterman
wrote:
> It appears
On 2/10/10 3:57 PM, Nick Klosterman wrote:
It appears I have incompatible namespaceIDs. Any thoughts on how to
resolve that?
This is what the full datanodes log is saying:
Was this data node part of a another DFS cluster at some point? It looks
like you've reformatted the name node since the d
@E.Sammer, no I don't *think* that it is part of another cluster. The
tutorial is for a single node cluster just as a initial set up to see if
you can get things up and running. I have reformatted the namenode
several times in my effort to get hadoop to work.
@abishek
I tried the workaround y
On 2/10/10 5:19 PM, Nick Klosterman wrote:
@E.Sammer, no I don't *think* that it is part of another cluster. The
tutorial is for a single node cluster just as a initial set up to see if
you can get things up and running. I have reformatted the namenode
several times in my effort to get hadoop to
Hi
I had faced a similar issue on Ubuntu and Hadoop 0.20 and modified the
start-all script to introduce a sleep time :
bin=`dirname "$0"`
bin=`cd "$bin"; pwd`
. "$bin"/hadoop-config.sh
# start dfs daemons
"$bin"/start-dfs.sh --config $HADOOP_CONF_DIR
*echo 'sleeping'
sleep 60
echo 'awake'*
# st
Sonal,
Can I ask why you're sleeping between starting hdfs and mapreduce? I've
never needed this in my own code. In general, Hadoop is pretty tolerant
about starting daemons "out of order."
If you need to wait for HDFS to be ready and come out of safe mode before
launching a job, that's another s
Hi Aaron,
I am on Hadoop 0.20.0 on Ubuntu, pseudo distributed mode. If I remove the
sleep time from my start-all.sh script, my jobtracker comes up momentarily
and then dies.
Here is a capture of my commands:
sgo...@desktop:~/software/hadoop-0.20.0$ bin/hadoop namenode -format
10/02/13 21:54:19 I
Hi Sonal,
Why are you using Hadoop 0.20.0? It's fairly old and there are lots of
fixes in 0.20.1, and more in 0.20.2 which should be released any
minute now.
In particular, you're missing this change:
https://issues.apache.org/jira/browse/HADOOP-5921
which makes the JobTracker stubbornly wait fo
Yes, thanks Todd. I am looking to upgrade to 0.20.2.
Thanks and Regards,
Sonal
On Sat, Feb 13, 2010 at 11:07 PM, Todd Lipcon wrote:
> Hi Sonal,
>
> Why are you using Hadoop 0.20.0? It's fairly old and there are lots of
> fixes in 0.20.1, and more in 0.20.2 which should be released any
> minute
13 matches
Mail list logo
