Jotracker java.lang.NumberFormatException
Hi All , I have multinode cluster with 1 master (namenode,+ jobtracker) and 2 slavers (datanode + tasktracker). I can start namenode and datanodes,but CANT start jobtracker.The log shows java.lang.NumberFormatException. I will be greatfull if anybody can tell me what is the problem and why is this java execption being thrown? here is the complete log , all the files value are attached.(master,slaves,core-site.xml...etc) / 2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG: / STARTUP_MSG: Starting JobTracker STARTUP_MSG: host = centosxcat1/192.168.15.140 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.20.2 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 / 2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1) 2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker: java.lang.NumberFormatException: For input string: 54311 at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:481) at java.lang.Integer.parseInt(Integer.java:514) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123) at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807) at org.apache.hadoop.mapred.JobTracker.init(JobTracker.java:1579) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175) at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702) 2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140 / cat conf/master centosxcat1 cat conf/salves aadityaxcat3 linux-466z cat conf/core-site.xml ?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. --?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. -- configuration property name dfs.name.dir /name value /fsname /value /property property name dfs.data.dir /name value /fsdata /value /property property name dfs.replication /name value 2 /value /property /configuration cat conf/mapred-site.xml ?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. -- configuration property name mapred.job.tracker /name value centosxcat1:54311 /value /property /configuration configuration property namefs.default.name/name valuehdfs://centosxcat1/value /property /configuration cat conf/hdfs-site.xml
Re: Jotracker java.lang.NumberFormatException
Hi Ankit, You need to trim your configuration variables so there is no extra whitespace. eg valuefoo/value, not: value foo /value There's a patch up for this in many of the configs, but not sure if we got mapred.job.tracker. -Todd On Tue, Jun 15, 2010 at 5:55 AM, ankit sharma ankit1984.c...@gmail.comwrote: Hi All , I have multinode cluster with 1 master (namenode,+ jobtracker) and 2 slavers (datanode + tasktracker). I can start namenode and datanodes,but CANT start jobtracker.The log shows java.lang.NumberFormatException. I will be greatfull if anybody can tell me what is the problem and why is this java execption being thrown? here is the complete log , all the files value are attached.(master,slaves,core-site.xml...etc) / 2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG: / STARTUP_MSG: Starting JobTracker STARTUP_MSG: host = centosxcat1/192.168.15.140 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.20.2 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 / 2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1) 2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker: java.lang.NumberFormatException: For input string: 54311 at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:481) at java.lang.Integer.parseInt(Integer.java:514) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123) at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807) at org.apache.hadoop.mapred.JobTracker.init(JobTracker.java:1579) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175) at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702) 2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140 / cat conf/master centosxcat1 cat conf/salves aadityaxcat3 linux-466z cat conf/core-site.xml ?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. --?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. -- configuration property name dfs.name.dir /name value /fsname /value /property property name dfs.data.dir /name value /fsdata /value /property property name dfs.replication /name value 2 /value /property /configuration cat conf/mapred-site.xml ?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. -- configuration property name mapred.job.tracker /name value centosxcat1:54311 /value /property /configuration configuration property namefs.default.name/name valuehdfs://centosxcat1/value /property /configuration cat conf/hdfs-site.xml -- Todd Lipcon Software Engineer, Cloudera
Re: Jotracker java.lang.NumberFormatException
Hi , I got the mistake, It was unwanted newline in mapred-site.xml in mapred.job.tracker. On Tue, Jun 15, 2010 at 6:25 PM, ankit sharma ankit1984.c...@gmail.comwrote: Hi All , I have multinode cluster with 1 master (namenode,+ jobtracker) and 2 slavers (datanode + tasktracker). I can start namenode and datanodes,but CANT start jobtracker.The log shows java.lang.NumberFormatException. I will be greatfull if anybody can tell me what is the problem and why is this java execption being thrown? here is the complete log , all the files value are attached.(master,slaves,core-site.xml...etc) / 2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG: / STARTUP_MSG: Starting JobTracker STARTUP_MSG: host = centosxcat1/192.168.15.140 STARTUP_MSG: args = [] STARTUP_MSG: version = 0.20.2 STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 / 2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1) 2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker: java.lang.NumberFormatException: For input string: 54311 at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:481) at java.lang.Integer.parseInt(Integer.java:514) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123) at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807) at org.apache.hadoop.mapred.JobTracker.init(JobTracker.java:1579) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175) at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702) 2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG: / SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140 / cat conf/master centosxcat1 cat conf/salves aadityaxcat3 linux-466z cat conf/core-site.xml ?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. --?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. -- configuration property name dfs.name.dir /name value /fsname /value /property property name dfs.data.dir /name value /fsdata /value /property property name dfs.replication /name value 2 /value /property /configuration cat conf/mapred-site.xml ?xml version=1.0? ?xml-stylesheet type=text/xsl href=configuration.xsl? !-- Put site-specific property overrides in this file. -- configuration property name mapred.job.tracker /name value centosxcat1:54311 /value /property /configuration configuration property namefs.default.name/name valuehdfs://centosxcat1/value /property /configuration cat conf/hdfs-site.xml
