I tried doing as you said but it's doesn't work. JobConf doesn't have a uri
constructor so I changed it for filesystem.get which is 2 or 3 lines after
but the problem still persists in the install method of crawldb with the
Exception in thread "main" java.lang.IllegalArgumentException: This file
system object (hdfs://10.240.55.134:9000) does not support access to the
request path 's3n://nutchdeploy/crawls/crawldb/current' You possibly called
FileSystem.get(conf) when you should have called FileSystem.get(uri, conf)
to obtain a file system supporting your path.
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:375)
at
org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:106)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:162)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:530)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:712)
at org.apache.nutch.crawl.CrawlDb.install(CrawlDb.java:155)
at org.apache.nutch.crawl.Injector.inject(Injector.java:227)
at org.apache.nutch.crawl.Crawl.run(Crawl.java:127)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:55)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
I'm a beginning programmer so going further than this to fix this bug is
beyond my scope.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Error-running-Nutch-1-4-crawl-on-Amazon-EMR-using-the-S3-s3n-filesystem-tp3766352p3996102.html
Sent from the Nutch - User mailing list archive at Nabble.com.
