As a follow up, this is not peculiar to my programs but hadoop ones too: I started the cluster as (using Fedora AMI and c1.medium)
hadoop-ec2 launch-cluster --env REPO=testing --env HADOOP_VERSION=0.20 test2 1 and error is [1] But it works(and so do my programs) if I launch a cluster with e.g. 4 nodes as opposed to 1. Regards Saptarshi [1] [r...@ip-10-250-195-225 ~]# hadoop jar /usr/lib/hadoop-0.20/hadoop-0.20.1+169.56-examples.jar wordcount /tmp/foo /tmp/f1 10/02/19 17:31:45 WARN conf.Configuration: DEPRECATED: hadoop-site.xml found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of core-default.xml, mapred-default.xml and hdfs-default.xml respectively 10/02/19 17:31:45 INFO input.FileInputFormat: Total input paths to process : 1 org.apache.hadoop.ipc.RemoteException: java.io.IOException: No valid local directories in property: mapred.local.dir at org.apache.hadoop.conf.Configuration.getLocalPath(Configuration.java:975) at org.apache.hadoop.mapred.JobConf.getLocalPath(JobConf.java:279) at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:256) at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:240) at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3026) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:966) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:962) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:960) at org.apache.hadoop.ipc.Client.call(Client.java:740) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) at org.apache.hadoop.mapred.$Proxy0.submitJob(Unknown Source) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:841) at org.apache.hadoop.mapreduce.Job.submit(Job.java:432) at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447) at org.apache.hadoop.examples.WordCount.main(WordCount.java:67) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139) at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) On Fri, Feb 19, 2010 at 5:13 PM, Saptarshi Guha <saptarshi.g...@gmail.com> wrote: > Hello, > Not sure if i should post this here or on Cloudera's message board, > but here goes. > When I run EC2 using the latest CDH2 and Hadoop 0.20 (by settiing the > env variables are hadoop-ec2), > and launch a job > hadoop jar ... > > I get the following error > > > 10/02/19 17:04:55 WARN mapred.JobClient: Use GenericOptionsParser for > parsing the arguments. Applications should implement Tool for the > same. > org.apache.hadoop.ipc.RemoteException: java.io.IOException: No valid > local directories in property: mapred.local.dir > at > org.apache.hadoop.conf.Configuration.getLocalPath(Configuration.java:975) > at org.apache.hadoop.mapred.JobConf.getLocalPath(JobConf.java:279) > at > org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:256) > at > org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:240) > at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3026) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:966) > at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:962) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:960) > > at org.apache.hadoop.ipc.Client.call(Client.java:740) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) > at org.apache.hadoop.mapred.$Proxy0.submitJob(Unknown Source) > at > org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:841) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:432) > > at org.godhuli.f.RHMR.submitAndMonitorJob(RHMR.java:195) > > but the value of mapred.local.dir is "/mnt/hadoop/mapred/local" > > Any ideas? >