Still broken. On Windows I still get:
[junit] Job tracker crashed:
[junit] java.lang.IllegalArgumentException: Pathname /C:/trunk/
build/contrib/streaming/test/mapred/system from C:/trunk/build/
contrib/streaming/test/mapred/system is not a valid DFS filename.
[junit] at
org.apache.hadoop.dfs.DistributedFileSystem.getPath
(DistributedFileSystem.java:111)
[junit] at
org.apache.hadoop.dfs.DistributedFileSystem.isDirectory
(DistributedFileSystem.java:167)
[junit] at org.apache.hadoop.fs.FileSystem.delete
(FileSystem.java:507)
[junit] at org.apache.hadoop.mapred.JobTracker.<init>
(JobTracker.java:582)
[junit] at org.apache.hadoop.mapred.JobTracker.startTracker
(JobTracker.java:92)
[junit] at org.apache.hadoop.mapred.MiniMRCluster
$JobTrackerRunner.run(MiniMRCluster.java:61)
[junit] at java.lang.Thread.run(Thread.java:595)
from org.apache.hadoop.streaming.TestSymLink
On Feb 26, 2007, at 1:38 PM, Doug Cutting (JIRA) wrote:
[ https://issues.apache.org/jira/browse/HADOOP-1020?
page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated HADOOP-1020:
---------------------------------
Attachment: HADOOP-1020.patch
The bug was an erroneous optimization in the Path(Path,Path)
constructor. I removed that and added a test case in the attached
patch.
Nigel, does this fix things for you on Windows?
Path class on Windows seems broken
----------------------------------
Key: HADOOP-1020
URL: https://issues.apache.org/jira/browse/
HADOOP-1020
Project: Hadoop
Issue Type: Bug
Components: dfs
Affects Versions: 0.11.1
Reporter: Nigel Daley
Assigned To: Doug Cutting
Attachments: HADOOP-1020.patch, TestPath.java.patch
Executing this code:
Path file = new Path("file:///", "C:/trunk/build/test/data");
or Path file = new Path("C:/trunk/build/test/data");
FileSystem fs = file.getFileSystem(conf);
fs.mkdirs(file))
produces this exception. It looks like it's defaulting to the
DistributedFileSystem.
2007-02-14 11:36:31,700 INFO mapred.TaskInProgress
(TaskInProgress.java:updateStatus(296)) - Error from
task_0001_m_000000_0: java.lang.IllegalArgumentException:
Pathname /C:/trunk/build/test/data from C:/trunk/build/test/data
is not a valid DFS filename.
at org.apache.hadoop.dfs.DistributedFileSystem.getPath
(DistributedFileSystem.java:111)
at org.apache.hadoop.dfs.DistributedFileSystem.mkdirs
(DistributedFileSystem.java:211)
at org.apache.hadoop.mapred.MRCaching$MapClass.configure
(MRCaching.java:68)
at org.apache.hadoop.util.ReflectionUtils.setConf
(ReflectionUtils.java:50)
at org.apache.hadoop.util.ReflectionUtils.newInstance
(ReflectionUtils.java:70)
at org.apache.hadoop.mapred.MapRunner.configure
(MapRunner.java:34)
at org.apache.hadoop.util.ReflectionUtils.setConf
(ReflectionUtils.java:50)
at org.apache.hadoop.util.ReflectionUtils.newInstance
(ReflectionUtils.java:70)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:178)
at org.apache.hadoop.mapred.TaskTracker$Child.main
(TaskTracker.java:1396)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
