I tried E:\tmp and also /cygdrive/e/tmp, but the error message keeps the
same, except the job ids. I think the file conf/mapred-site.xml is ignored,
is it possible (I restarted hdfs after conf changes)? This is the file:
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>hadoop-cemsbr:9001</value>
</property>
<property>
<name>mapred.child.tmp</name>
<value>E:\tmp</value>
</property>
</configuration>
Thank you,
Carlos Eduardo
On Mon, May 3, 2010 at 4:38 AM, Aleksandar Stupar <
stupar.aleksan...@yahoo.com> wrote:
> Hi,
>
> I had the same problem. This worked for me:
>
> <property>
> <name>mapred.child.tmp</name>
> <value>D:\tmp</value>
> </property>
>
> Kind regards,
> Aleksandar Stupar.
>
> ------------------------------
> *From:* Carlos Eduardo Moreira dos Santos <cem...@gmail.com>
> *To:* common-user <common-user@hadoop.apache.org>
> *Sent:* Sun, May 2, 2010 9:10:03 PM
> *Subject:* Re: java.io.FileNotFoundException
>
> Yes, I can create it:
>
> $ ls
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/
> ls: cannot access
>
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/:
> No such file or directory
>
> $ mkdir -p
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/tmp
>
> $ ls
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/
> tmp
>
> On Sun, May 2, 2010 at 10:39 AM, Ted Yu <yuzhih...@gmail.com> wrote:
> > Looks like localFs.mkdirs(tmpDir) failed. Can you check whether you can
> > manually create
> >
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/tmp
> > ?
> >
> > Also, what do you set mapred.local.dir to ? Try not using /tmp.
> >
> I didn't set it. It has its default value: ${hadoop.tmp.dir}/mapred/local
>
> > On Sat, May 1, 2010 at 9:42 PM, Carlos Eduardo Moreira dos Santos <
> > c...@cemshost.com.br> wrote:
> >
> >> Hadoop is working fine in Linux. In Windows (using cygwin) I can't get
> >> mapred to work, though hdfs is ok. This is the stacktrace:
> >>
> >> java.io <http://java.io.Fi>.FileNotFoundException: File
> >>
> >>
> E:/tmp/hadoop-SYSTEM/mapred/local/taskTracker/jobcache/job_201005020105_0001/attempt_201005020105_0001_m_000002_0/work/tmp
> >> does not exist.
> >> at
> >>
> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
> >> at
> >>
> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
> >> at
> >> org.apache.hadoop.mapred.TaskRunner.setupWorkDir(TaskRunner.java:519)
> >> at org.apache.hadoop.mapred.Child.main(Child.java:155)
> >>
> >> The beginning of the path (E:/) seems strange (I was hoping for
> >> something like /cygdrive/e or just /tmp). I read TaskRunner.java:519
> >> and I tried to use an absolute path in mapred.child.tmp in
> >> conf/mapred-site.xml, but it keeps looking for the same path even if I
> >> restart mapred. The path exists until jobcache
> >>
> >> The tasktracker log shows:
> >>
> >> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
> >> LaunchTaskAction (registerTask): attempt_201005020105_0001_m_000002_0
> >> task's state:UNASSIGNED^M
> >> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
> >> LaunchTaskAction (registerTask): attempt_201005020105_0001_m_000003_0
> >> task's state:UNASSIGNED^M
> >> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker:
> >> Trying to launch : attempt_201005020105_0001_m_000002_0^M
> >> 2010-05-02 01:06:23,765 INFO org.apache.hadoop.mapred.TaskTracker: In
> >> TaskLauncher, current free slots : 2 and trying to launch
> >> attempt_201005020105_0001_m_000002_0^M
> >> 2010-05-02 01:06:37,562 INFO org.apache.hadoop.mapred.TaskTracker:
> >> Trying to launch : attempt_201005020105_0001_m_000003_0^M
> >> 2010-05-02 01:06:37,562 INFO org.apache.hadoop.mapred.TaskTracker: In
> >> TaskLauncher, current free slots : 1 and trying to launch
> >> attempt_201005020105_0001_m_000003_0^M
> >> 2010-05-02 01:06:37,625 INFO org.apache.hadoop.mapred.JvmManager: In
> >> JvmRunner constructed JVM ID: jvm_201005020105_0001_m_518928642^M
> >> 2010-05-02 01:06:37,625 INFO org.apache.hadoop.mapred.JvmManager: JVM
> >> Runner jvm_201005020105_0001_m_518928642 spawned.^M
> >> 2010-05-02 01:06:37,921 INFO org.apache.hadoop.mapred.JvmManager: In
> >> JvmRunner constructed JVM ID: jvm_201005020105_0001_m_1918177803^M
> >> 2010-05-02 01:06:37,921 INFO org.apache.hadoop.mapred.JvmManager: JVM
> >> Runner jvm_201005020105_0001_m_1918177803 spawned.^M
> >> 2010-05-02 01:06:40,312 INFO org.apache.hadoop.mapred.TaskTracker: JVM
> >> with ID: jvm_201005020105_0001_m_518928642 given task:
> >> attempt_201005020105_0001_m_000002_0^M
> >> 2010-05-02 01:06:40,578 INFO org.apache.hadoop.mapred.TaskTracker:
> >> attempt_201005020105_0001_m_000002_0 0.0% ^M
> >> 2010-05-02 01:06:40,687 INFO org.apache.hadoop.mapred.JvmManager: JVM
> >> : jvm_201005020105_0001_m_518928642 exited. Number of tasks it ran:
> >> 0^M
> >> 2010-05-02 01:06:41,046 INFO org.apache.hadoop.mapred.TaskTracker: JVM
> >> with ID: jvm_201005020105_0001_m_1918177803 given task:
> >> attempt_201005020105_0001_m_000003_0^M
> >> 2010-05-02 01:06:41,265 INFO org.apache.hadoop.mapred.TaskTracker:
> >> attempt_201005020105_0001_m_000003_0 0.0% ^M
> >> 2010-05-02 01:06:41,421 INFO org.apache.hadoop.mapred.JvmManager: JVM
> >> : jvm_201005020105_0001_m_1918177803 exited. Number of tasks it ran:
> >> 0^M
> >> 2010-05-02 01:06:43,687 INFO org.apache.hadoop.mapred.TaskRunner:
> >> attempt_201005020105_0001_m_000002_0 done; removing files.^M
> >> 2010-05-02 01:06:43,687 INFO org.apache.hadoop.mapred.TaskTracker:
> >> addFreeSlot : current free slots : 1^M
> >> 2010-05-02 01:06:44,421 INFO org.apache.hadoop.mapred.TaskRunner:
> >> attempt_201005020105_0001_m_000003_0 done; removing files.^M
> >> 2010-05-02 01:06:44,421 INFO org.apache.hadoop.mapred.TaskTracker:
> >> addFreeSlot : current free slots : 2^M
> >> 2010-05-02 01:07:20,953 INFO org.apache.hadoop.mapred.TaskTracker:
> >> Received 'KillJobAction' for job: job_201005020105_0001
> >>
> >> Any idea?
> >>
> >> Thank you,
> >> Carlos Eduardo
> >>
> >
>
>
