Re: installation of Hadoop 0.21

2011-01-25 Thread Jim X 
Thanks for your information. I was misled by the tutorial at
http://alans.se/blog/2010/hadoop-hbase-cygwin-windows-7-x64/. I can
access the urls from
 NameNode - http://localhost:50070/
 JobTracker - http://localhost:50030/

instead of from http://localhost:9100 and http://localhost:9101
mentioned in the tutorial.


Jim

On Tue, Jan 25, 2011 at 12:04 AM, li ping li.j...@gmail.com wrote:
 The exception java.io.IOException: NameNode is not formatted. indicated you
 should format the NameNode first.
 hadoop -fs namenode -format

 On Tue, Jan 25, 2011 at 12:47 PM, Jim X jim.p...@gmail.com wrote:

 I am trying to install Hadoop by following the instruction from
 http://alans.se/blog/2010/hadoop-hbase-cygwin-windows-7-x64/.

 1. I can not open http://localhost:9100 or http://localhost:9101 after
 I run bin/start-dfs.sh and bin/start-mapred.sh without any error
 message being printed.

 2. I shutdown cygwin shell.

 3. I start another cygwin shell, run bin/start-dfs.sh and get the
 following message from the shell.
       $ bin/start-dfs.sh
       starting namenode, logging to
 C:\cygwin\hadoop\0.21.0\logs/hadoop-Jim-namenode-Jim-PC.out
       localhost: datanode running as process 6908. Stop it first.
       localhost: secondarynamenode running as process 6156. Stop it first.



       Log message in
 C:\cygwin\hadoop\0.21.0\logs/hadoop-Jim-namenode-Jim-PC.out are listed
 as below:

 2011-01-24 23:10:11,202 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode up at:
 127.0.0.1/127.0.0.1:9100
 2011-01-24 23:10:36,187 INFO org.apache.hadoop.ipc.Server: IPC Server
 listener on 9100: readAndProcess threw exception java.io.IOException:
 Unable to read authentication method. Count of bytes read: 0
 java.io.IOException: Unable to read authentication method
        at
 org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1079)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:525)
        at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:332)
        at
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)

 


 2011-01-24 23:41:47,815 INFO
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
 FSNamesystemStatusMBean
 2011-01-24 23:41:47,915 ERROR
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem
 initialization failed.
 java.io.IOException: NameNode is not formatted.
        at
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:434)
        at
 org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:110)
        at
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:291)
        at
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.init(FSNamesystem.java:270)
        at
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:271)
        at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:303)
        at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:433)
        at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:421)
        at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1359)
        at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1368)


 I am running Window Vista, JDK 1.6. I appreciate your help.


 Jim




 --
 -李平

installation of Hadoop 0.21

2011-01-24 Thread Jim X 
I am trying to install Hadoop by following the instruction from
http://alans.se/blog/2010/hadoop-hbase-cygwin-windows-7-x64/.

1. I can not open http://localhost:9100 or http://localhost:9101 after
I run bin/start-dfs.sh and bin/start-mapred.sh without any error
message being printed.

2. I shutdown cygwin shell.

3. I start another cygwin shell, run bin/start-dfs.sh and get the
following message from the shell.
   $ bin/start-dfs.sh
   starting namenode, logging to
C:\cygwin\hadoop\0.21.0\logs/hadoop-Jim-namenode-Jim-PC.out
   localhost: datanode running as process 6908. Stop it first.
   localhost: secondarynamenode running as process 6156. Stop it first.



   Log message in
C:\cygwin\hadoop\0.21.0\logs/hadoop-Jim-namenode-Jim-PC.out are listed
as below:

2011-01-24 23:10:11,202 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode up at:
127.0.0.1/127.0.0.1:9100
2011-01-24 23:10:36,187 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 9100: readAndProcess threw exception java.io.IOException:
Unable to read authentication method. Count of bytes read: 0
java.io.IOException: Unable to read authentication method
at 
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1079)
at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:525)
at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:332)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)




2011-01-24 23:41:47,815 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
FSNamesystemStatusMBean
2011-01-24 23:41:47,915 ERROR
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem
initialization failed.
java.io.IOException: NameNode is not formatted.
at 
org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:434)
at 
org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:110)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:291)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.init(FSNamesystem.java:270)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:271)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:303)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:433)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:421)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1359)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1368)


I am running Window Vista, JDK 1.6. I appreciate your help.


Jim

Re: installation of Hadoop 0.21

2011-01-24 Thread li ping 
The exception java.io.IOException: NameNode is not formatted. indicated you
should format the NameNode first.
hadoop -fs namenode -format

On Tue, Jan 25, 2011 at 12:47 PM, Jim X jim.p...@gmail.com wrote:

 I am trying to install Hadoop by following the instruction from
 http://alans.se/blog/2010/hadoop-hbase-cygwin-windows-7-x64/.

 1. I can not open http://localhost:9100 or http://localhost:9101 after
 I run bin/start-dfs.sh and bin/start-mapred.sh without any error
 message being printed.

 2. I shutdown cygwin shell.

 3. I start another cygwin shell, run bin/start-dfs.sh and get the
 following message from the shell.
   $ bin/start-dfs.sh
   starting namenode, logging to
 C:\cygwin\hadoop\0.21.0\logs/hadoop-Jim-namenode-Jim-PC.out
   localhost: datanode running as process 6908. Stop it first.
   localhost: secondarynamenode running as process 6156. Stop it first.



   Log message in
 C:\cygwin\hadoop\0.21.0\logs/hadoop-Jim-namenode-Jim-PC.out are listed
 as below:

 2011-01-24 23:10:11,202 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: NameNode up at:
 127.0.0.1/127.0.0.1:9100
 2011-01-24 23:10:36,187 INFO org.apache.hadoop.ipc.Server: IPC Server
 listener on 9100: readAndProcess threw exception java.io.IOException:
 Unable to read authentication method. Count of bytes read: 0
 java.io.IOException: Unable to read authentication method
at
 org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1079)
at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:525)
at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:332)
at
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)

 


 2011-01-24 23:41:47,815 INFO
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered
 FSNamesystemStatusMBean
 2011-01-24 23:41:47,915 ERROR
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem
 initialization failed.
 java.io.IOException: NameNode is not formatted.
at
 org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:434)
at
 org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:110)
at
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:291)
at
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.init(FSNamesystem.java:270)
at
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:271)
at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:303)
at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:433)
at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:421)
at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1359)
at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1368)


 I am running Window Vista, JDK 1.6. I appreciate your help.


 Jim




-- 
-李平