I've checked out code and am running crawl and get this error; any
thoughts?
environment: java 6, eclipse
009-04-08 01:22:41,658 INFO crawl.Injector (Injector.java:inject(136)) -
Injector: starting
2009-04-08 01:22:41,658 INFO crawl.Injector (Injector.java:inject(137)) -
Injector: crawlDb: crawl/crawldb
2009-04-08 01:22:41,659 INFO crawl.Injector (Injector.java:inject(138)) -
Injector: urlDir: urls
2009-04-08 01:22:41,660 INFO crawl.Injector (Injector.java:inject(148)) -
Injector: Converting injected urls to crawl db entries.
2009-04-08 01:22:41,688 INFO jvm.JvmMetrics (JvmMetrics.java:init(67)) -
Initializing JVM Metrics with processName=JobTracker, sessionId=
2009-04-08 01:22:41,704 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(547)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
2009-04-08 01:22:41,756 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(697)) - No job jar file set.
User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
2009-04-08 01:22:41,794 INFO mapred.FileInputFormat
(FileInputFormat.java:listStatus(181)) - Total input paths to process : 1
2009-04-08 01:22:42,114 INFO mapred.JobClient (JobClient.java:runJob(1144))
- Running job: job_local_0001
2009-04-08 01:22:42,117 INFO mapred.FileInputFormat
(FileInputFormat.java:listStatus(181)) - Total input paths to process : 1
2009-04-08 01:22:42,161 INFO mapred.MapTask (MapTask.java:run(302)) -
numReduceTasks: 1
2009-04-08 01:22:42,171 INFO mapred.MapTask (MapTask.java:<init>(493)) -
io.sort.mb = 100
2009-04-08 01:22:42,241 WARN mapred.LocalJobRunner
(LocalJobRunner.java:run(194)) - job_local_0001
java.lang.OutOfMemoryError: Java heap space
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:498)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:138)
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1232)
at org.apache.nutch.crawl.Injector.inject(Injector.java:160)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:113)
