Hi Erol, It looks like the error is from Nutch side and i would suggest you to check your database for entries and see how the documents, fields are saved or you can dump the database and see the values of the fields and check if there are any multiple values in there. Looks like the document Id is an array in Nutch document than a string.
Hope this helps. On Mon, Nov 12, 2012 at 12:45 PM, Erol Akarsu <eaka...@gmail.com> wrote: > I am trying to crawl with nutch and index on solr. Crawling went fine > > But when I try to index with SOLR, then I am getting error in my tomcat log > file "SEVERE: org.apache.solr.common.SolrException: Document contains > multiple values for uniqueKey field: > id=[fi.foofactory.blog:http/2007/03/twice-speed-half-size.html, > http://blog.foofactory.fi/2007/03/twice-speed-half-size.html, > 0000000000000000]" > > bin/nutch crawl urls/ -depth 2 > > eakarsu@ubuntu:~/apache-nutch-2.1/runtime/local$ bin/nutch solrindex > http://localhost:8983/solr40/ -reindex > SolrIndexerJob: starting > Adding 31 documents > SolrIndexerJob: java.lang.RuntimeException: job failed: name=solr-index, > jobid=job_local_0001 > at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:54) > at > org.apache.nutch.indexer.solr.SolrIndexerJob.run(SolrIndexerJob.java:46) > at > > org.apache.nutch.indexer.solr.SolrIndexerJob.indexSolr(SolrIndexerJob.java:54) > at > org.apache.nutch.indexer.solr.SolrIndexerJob.run(SolrIndexerJob.java:75) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at > org.apache.nutch.indexer.solr.SolrIndexerJob.main(SolrIndexerJob.java:84) > > > Nov 12, 2012 10:42:59 AM org.apache.solr.common.SolrException log > SEVERE: org.apache.solr.common.SolrException: Document contains multiple > values for uniqueKey field: > id=[fi.foofactory.blog:http/2007/03/twice-speed-half-size.html, > http://blog.foofactory.fi/2007/03/twice-speed-half-size.html, > 0000000000000000] > at > > org.apache.solr.update.AddUpdateCommand.getIndexedId(AddUpdateCommand.java:91) > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:445) > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:325) > at > > org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:100) > at > > org.apache.solr.update.processor.SignatureUpdateProcessorFactory$SignatureUpdateProcessor.processAdd(SignatureUpdateProcessorFactory.java:181) > at > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:230) > at > org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:157) > at > > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:92) > at > > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1699) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:455) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:276) > at > > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) > at > > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) > at > > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > at > > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859) > at > > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602) > at > org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) > at java.lang.Thread.run(Thread.java:662) > -- Kiran Chitturi
