Hi everyone, If you run the Nutch on Windows using the Cygwin, it may fail due to a permission error.
$./crawl urls crawlId http://localhost:8983/solr/collection1 2 2014-11-17 15:39:25,041 ERROR security.UserGroupInformation - PriviledgedActionException as:YangLu cause:java.io.IOException: Failed to set permissions of path: \tmp\hadoop-YangLu\mapred\staging\YangLu534937598\.staging to 0700 2014-11-17 15:39:25,046 ERROR crawl.Injector - Injector: java.io.IOException: Failed to set permissions of path: \tmp\hadoop-YangLu\mapred\staging\YangLu534937598\.staging to 0700 at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:691) at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:664) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:514) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:349) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:193) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:126) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:942) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:910) at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1353) at org.apache.nutch.crawl.Injector.inject(Injector.java:324) at org.apache.nutch.crawl.Injector.run(Injector.java:380) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) at org.apache.nutch.crawl.Injector.main(Injector.java:370) To solve the problem, you should download Hadoop Core 0.20.2 <http://mvnrepository.com/artifact/org.apache.hadoop/hadoop-core/0.20.2> from the MVN repository to your (nutch-home)/lib directory. For the details, please refer to http://stackoverflow.com/questions/15188050/nutch-in-windows-failed-to-set-permissions-of-path. Thanks. -- Best, Mengying (Angela) Wang
