On Apr 1, 2010, at 11:12am, Eleftherios Spyromitros wrote:
If you're trying to run (versus develop) Hadoop on Windows, I think
you must use Cygwin.
So that same note should probably be added someplace on the Mahout
site, if it's not there already.
There is a note in BuildingMahout page, but I think that the place
is a
little
bit misleading. I would place Cygwin in the Prerequisites section of
the
wiki page,
with an optional indication e.g. (Only on windows).
See http://hayesdavis.net/2008/06/14/running-hadoop-on-windows/ for
some good notes.
I suppose I don't need to install hadoop as well.. Just install
Cygwin,
right?
I believe so. But IANAWU (I Am Not A Windows User).
-- Ken
On Apr 1, 2010, at 10:49am, Sean Owen wrote:
A-ha. It's trying to execute a command called chmod that is a
standard
Unix/Linux/OS X command but not present on Windows.
I am not sure why Hadoop tries this on Windows though... surely it
supports Windows? I somehow think we've seen this before and I
forget
what the story was.
It's not something to do with Mahout unfortunately.
One possible solution is to install Cygwin, which gives you a little
Unix-like environment on Windows. It has a chmod binary. Running via
Cygwin might work.
On Thu, Apr 1, 2010 at 6:46 PM, Eleftherios Spyromitros
<[email protected]> wrote:
OK guys you are being very helpful. Here is an error file
(I think that most if not all error files complain about chmod..
does this have to do with admin privilages??):
--------------------------------------------------------------------
-----------
Test set: org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest
--------------------------------------------------------------------
-----------
Tests run: 3, Failures: 1, Errors: 2, Skipped: 0, Time elapsed:
0.14 sec <<< FAILURE!
testStartParallelCounting
(org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest) Time elapsed:
0.063 sec <<< ERROR!
java.io.IOException: Cannot run program "chmod": CreateProcess
error=2, The system cannot find the file specified
at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:149)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.util.Shell
$ShellCommandExecutor.execute(Shell.java:286)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:354)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:337)
at
org
.apache
.hadoop.fs.RawLocalFileSystem.execCommand(RawLocalFileSystem.java:
481)
at
org
.apache
.hadoop
.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:
473)
at
org
.apache
.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:
280)
at
org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:266)
at
org
.apache
.hadoop
.mapred.JobClient.configureCommandLineOptions(JobClient.java:
573)
at
org
.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:
761)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
at
org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
at
org
.apache
.mahout
.fpm.pfpgrowth.PFPGrowth.startParallelCounting(PFPGrowth.java:318)
at
org
.apache
.mahout
.fpm
.pfpgrowth
.PFPGrowthTest.testStartParallelCounting(PFPGrowthTest.java:89)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
at
sun
.reflect
.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun
.reflect
.DelegatingMethodAccessorImpl
.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at junit.framework.TestCase.runTest(TestCase.java:168)
at junit.framework.TestCase.runBare(TestCase.java:134)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:
128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:232)
at junit.framework.TestSuite.run(TestSuite.java:227)
at
org
.junit
.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:
83)
at
org
.apache
.maven.surefire.junit4.JUnit4TestSet.execute(JUnit4TestSet.java:59)
at
org
.apache
.maven
.surefire
.suite
.AbstractDirectoryTestSuite
.executeTestSet(AbstractDirectoryTestSuite.java:115)
at
org
.apache
.maven
.surefire
.suite
.AbstractDirectoryTestSuite
.execute(AbstractDirectoryTestSuite.java:
102)
at org.apache.maven.surefire.Surefire.run(Surefire.java:180)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
at
sun
.reflect
.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun
.reflect
.DelegatingMethodAccessorImpl
.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org
.apache
.maven
.surefire
.booter.SurefireBooter.runSuitesInProcess(SurefireBooter.java:350)
at
org
.apache
.maven.surefire.booter.SurefireBooter.main(SurefireBooter.java:
1021)
Caused by: java.io.IOException: CreateProcess error=2, The system
cannot find the file specified
at java.lang.ProcessImpl.create(Native Method)
at java.lang.ProcessImpl.<init>(ProcessImpl.java:81)
at java.lang.ProcessImpl.start(ProcessImpl.java:30)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)
... 38 more
--------------------------------------------
Ken Krugler
+1 530-210-6378
http://bixolabs.com
e l a s t i c w e b m i n i n g
--------------------------------------------
Ken Krugler
+1 530-210-6378
http://bixolabs.com
e l a s t i c w e b m i n i n g
