It looks like there is something wrong with your configuration where the
default file system is coming back as the local file system, but you are
passing in an HDFS URI fs.exists(Path), I cannot tell for sure because I don't
have access to
com.amd.kdf.protobuf.SequentialFileDriver.main(SequentialFileDriver.java:64).
If running it works just fine from the command line, you could try doing a
fork/exec to launch the process and then monitor it.
--Bobby Evans
On 2/2/12 11:31 PM, "Abees Muhammad" <abees...@gmail.com> wrote:
Hi Evans,
Thanks for your reply. I have a mapreduce job jar file lets call it as
test.jar. I am executing this jar file as hadoop jar test.jar inputpath
outPath, and it is executed succesfully. Now i want to execute this job for a
batch of files(a batch of 20 files), for this purpose i have created another
java application,this application moves a batch of files from one location of
hdfs to another location in hdfs. After that this application needs to execute
the m/R job for this batch. we will invoke the second application(which will
execute the M/R Job) from as control m job.But i dont know how to create the
second java application which will invoke the M/R job. The code snippet i used
for testing the jar which calls the M/R job is
List arguments = new ArrayList();
arguments.add("test.jar");
arguments.add("inputPath");
arguments.add(outputPath);
RunJar.main((String[])arguments.toArray(new String[0]));
i executed this jar as java -jar M/RJobInvokeApp.jar but i got error as
java.lang.IllegalArgumentException: Wrong FS: hdfs://ip
address:54310/tmp/test-out, expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:410)
at
org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:56)
at
org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:379)
at
org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:748)
at
com.amd.kdf.protobuf.SequentialFileDriver.main(SequentialFileDriver.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
at com.amd.wrapper.main.ParserWrapper.main(ParserWrapper.java:31)
Thanks,
Abees
On 2 February 2012 23:02, Robert Evans <ev...@yahoo-inc.com> wrote:
What happens? Is there an exception, does nothing happen? I am curious. Also
how did you launch your other job that is trying to run this one. The hadoop
script sets up a lot of environment variables classpath etc to make hadoop work
properly, and some of that may not be set up correctly to make RunJar work.
--Bobby Evans
On 2/2/12 9:36 AM, "Harsh J" <ha...@cloudera.com <http://ha...@cloudera.com> >
wrote:
Moving to common-user. Common-dev is for project development
discussions, not user help.
Could you elaborate on how you used RunJar? What arguments did you
provide, and is the target jar a runnable one or a regular jar? What
error did you get?
On Thu, Feb 2, 2012 at 8:44 PM, abees muhammad <abees...@gmail.com
<http://abees...@gmail.com> > wrote:
>
> Hi,
>
> I am a newbie to Hadoop Development. I have a Map/Reduce job jar file, i
> want to execute this jar file programmatically from another java program. I
> used the following code to execute it.
>
> RunJar.main(String[] args). But The jar file is not executed.
>
> Can you please give me a work around for this issue.
> --
> View this message in context:
> http://old.nabble.com/Execute-a-Map-Reduce-Job-Jar-from-Another-Java-Program.-tp33250801p33250801.html
> Sent from the Hadoop core-dev mailing list archive at Nabble.com.
>
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
