Hi, > Hello. > I'm using Nutch 1.3. I decided to upgrade Solr to version 4.0 and I > replaced Nutch libs (Snapshot and SolrJ) from Solr dist. After that I got > the error at SolrIndexer on Reduce stage: > > 11/04/19 01:47:19 INFO mapred.JobClient: map 100% reduce 27% > 11/04/19 01:47:21 INFO mapred.JobClient: Task Id : > attempt_201104190142_0009_r_000000_0, Status : FAILED > org.apache.solr.common.SolrException: ERROR: [doc=http://www.site.net/] > Error adding field 'tstamp'='2011-04-18T22:45:17.404Z' > > ERROR: [doc=http://www.site.net/] Error adding field > 'tstamp'='2011-04-18T22:45:17.404Z' > > request: http://127.0.0.1:8983/solr/update?wt=javabin&version=2 > at > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttp > SolrServer.java:436) at > org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttp > SolrServer.java:245) at > org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(Abstract > UpdateRequest.java:105) at > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:50) at > org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:75) at > org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.ja > va:48) at > org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:474) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > at org.apache.hadoop.mapred.Child.main(Child.java:170)
If you are using Solr > 1.4.x then you must upgrade the SolrJ jar's in Nutch. Solr 1.4.x and higher are not compatible. Just remove the 1.4.x jar's and copy over the new. > > I tried to remove tstamp from solrindex-mapping.xml and Solr's schema.xml. > But this field is required in schema.xml and I got the error: > > 11/04/19 01:58:03 INFO mapred.JobClient: Task Id : > attempt_201104190142_0010_r_000000_0, Status : FAILED > org.apache.solr.common.SolrException: ERROR: [doc=http://www.site.net/] > unknown field 'tstamp' > > ERROR: [doc=http://www.site.net/] unknown field 'tstamp' Removing a mapping doesn't mean the field isn't copied over. All unmapped fields are copied as is. The example mapping seems rather useless as it copies exact field names. It's only useful if your source fields and destination fields are actually different, which is usually not the case if you dedicate a Solr core for a Nutch crawl. You must either not create the field by some plugin or add the field to your Solr index. I'm surprised this error actually showed up considering the incompatible Javabin versions. Perhaps you already upgraded the SolrJ api? > > How I can upgrade Solr to 4 version? > > Thank you.
