Simply remove that trailing slash (forgot to catch it earlier, sorry)
and you should be set (or at least more set than before surely.)
On Tue, May 31, 2011 at 10:51 PM, Steve Lewis <lordjoe2...@gmail.com> wrote:
> 0.20.2 - we have been avoiding 0.21 because it is not terribly stable and
> made some MAJOR changes to
> critical classes
>
> When I say
>
> Configuration conf = new Configuration();
> // cause output to go to the cluster
> conf.set("fs.default.name", "hdfs://glados:9000/");
> // conf.set("mapreduce.jobtracker.address", "glados:9000/");
> conf.set("mapred.job.tracker", "glados:9000/");
> conf.set("mapred.jar", "NShot.jar");
> // conf.set("fs.defaultFS","hdfs://glados:9000/");
> String[] otherArgs = new GenericOptionsParser(conf,
> args).getRemainingArgs();
> // if (otherArgs.length != 2) {
> // System.err.println("Usage: wordcount <in> <out>");
> // System.exit(2);
> // }
> Job job = new Job(conf, "Generated data");
> I get
> Exception in thread "main" java.lang.IllegalArgumentException:
> java.net.URISyntaxException: Relative path in absolute URI: glados:9000
> at org.apache.hadoop.fs.Path.initialize(Path.java:140)
> at org.apache.hadoop.fs.Path.<init>(Path.java:126)
> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:150)
> at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
> at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
> at org.apache.hadoop.mapred.JobClient.init(JobClient.java:423)
> at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:410)
> at org.apache.hadoop.mapreduce.Job.<init>(Job.java:50)
> at org.apache.hadoop.mapreduce.Job.<init>(Job.java:54)
> at org.systemsbiology.hadoopgenerated.NShotTest.main(NShotTest.java:188)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI:
> glados:9000
> at java.net.URI.checkPath(URI.java:1787)
> at java.net.URI.<init>(URI.java:735)
> at org.apache.hadoop.fs.Path.initialize(Path.java:137)
>
> I promise to publish a working example if this ever works
> On Tue, May 31, 2011 at 10:02 AM, Harsh J <ha...@cloudera.com> wrote:
>>
>> Steve,
>>
>> On Tue, May 31, 2011 at 10:27 PM, Steve Lewis <lordjoe2...@gmail.com>
>> wrote:
>> > My Reducer code says this:
>> > dkey,dValue,"os.arch",System.getProperty("os.arch"));
>> > writeKeyValue(context,
>> > dkey,dValue,"os.name",System.getProperty("os.name"));
>> > if os.arch is linux I am running on the cluster -
>> > if windows I am running locally
>>
>> Correct, so it should be Linux since these are System properties, and
>> if you're getting Windows its probably running locally on your client
>> box itself!
>>
>> > conf.set("mapreduce.jobtracker.address", "glados:9000/");
>>
>> This here might be your problem. That form of property would only work
>> with 0.21.x, while on 0.20.x if you do not set it as
>> "mapred.job.tracker" then the local job runner takes over by default,
>> thereby making this odd thing happen (that's my guess).
>>
>> What version of Hadoop are you using?
>>
>> --
>> Harsh J
>
>
>
> --
> Steven M. Lewis PhD
> 4221 105th Ave NE
> Kirkland, WA 98033
> 206-384-1340 (cell)
> Skype lordjoe_com
>
>
>
--
Harsh J
