Ah yes, it seems i didn't check your exception that well. This issue must be fixed in 1.3. Either by reverting to the long or changing code to work with date fields.
> I solved the problem. You need to use > > field name="tstamp" type="*date*" > > instead old > > field name="tstamp" type="*long*" > > that specified in nutch's schema.xml. > > Thanks. > > 2011/4/19 Haspadar <[email protected]> > > > Yes, I did it. I changed the version in ivy.xml and rebuilt Nutch. > > I'm using 'deploy' version for running it on separate Hadoop instance. > > The error however remains the same. > > Even If I running Solr 3.1 and SolrIndexer job with SolrJ 4.0 - all works > > fine. > > > > > > 2011/4/19 Julien Nioche <[email protected]> > > > >> You need to change the version of SOLR in ivy/ivy.xml then rebuild > >> unless you change the jars straight in to nutch-1.3/runtime/local/lib - > >> assuming that you're running Nutch locally only > >> > >> On 19 April 2011 07:09, Haspadar <[email protected]> wrote: > >> > Yes, it occured after removing SolrJ1.4 jar and copy 4.0 version. > >> > Before > >> > >> it > >> > >> > I upgrated Nutch for Solr 3.1 the same way and all worked fine. > >> > > >> > Thanks > >> > > >> > 2011/4/19 Markus Jelsma <[email protected]> > >> > > >> > > Hi, > >> > > > >> > > > Hello. > >> > > > I'm using Nutch 1.3. I decided to upgrade Solr to version 4.0 and > >> > > > I replaced Nutch libs (Snapshot and SolrJ) from Solr dist. After > >> > > > that > >> > >> I > >> > >> > got > >> > > >> > > > the error at SolrIndexer on Reduce stage: > >> > > > > >> > > > 11/04/19 01:47:19 INFO mapred.JobClient: map 100% reduce 27% > >> > > > 11/04/19 01:47:21 INFO mapred.JobClient: Task Id : > >> > > > attempt_201104190142_0009_r_000000_0, Status : FAILED > >> > > > org.apache.solr.common.SolrException: ERROR: [doc= > >> > >> http://www.site.net/ > >> > >> > ] > >> > > >> > > > Error adding field 'tstamp'='2011-04-18T22:45:17.404Z' > >> > > > > >> > > > ERROR: [doc=http://www.site.net/] Error adding field > >> > > > 'tstamp'='2011-04-18T22:45:17.404Z' > >> > > > > >> > > > request: http://127.0.0.1:8983/solr/update?wt=javabin&version=2 > >> > > > > >> > > > at > >> > >> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsH > >> ttp > >> > >> > > > SolrServer.java:436) at > >> > >> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsH > >> ttp > >> > >> > > > SolrServer.java:245) at > >> > >> org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(Abstr > >> act > >> > >> > > > UpdateRequest.java:105) at > >> > > > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:50) at > >> > > > org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:75) > >> > >> at > >> > >> > >> > >> org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat > >> .ja > >> > >> > > > va:48) at > >> > >> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:474) > >> > >> > > > at > >> > > > org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411) > >> > > > at org.apache.hadoop.mapred.Child.main(Child.java:170) > >> > > > >> > > If you are using Solr > 1.4.x then you must upgrade the SolrJ jar's > >> > > in Nutch. > >> > > Solr 1.4.x and higher are not compatible. Just remove the 1.4.x > >> > > jar's > >> > >> and > >> > >> > > copy > >> > > over the new. > >> > > > >> > > > I tried to remove tstamp from solrindex-mapping.xml and Solr's > >> > > > >> > > schema.xml. > >> > > > >> > > > But this field is required in schema.xml and I got the error: > >> > > > > >> > > > 11/04/19 01:58:03 INFO mapred.JobClient: Task Id : > >> > > > attempt_201104190142_0010_r_000000_0, Status : FAILED > >> > > > org.apache.solr.common.SolrException: ERROR: [doc= > >> > >> http://www.site.net/ > >> > >> > ] > >> > > >> > > > unknown field 'tstamp' > >> > > > > >> > > > ERROR: [doc=http://www.site.net/] unknown field 'tstamp' > >> > > > >> > > Removing a mapping doesn't mean the field isn't copied over. All > >> > >> unmapped > >> > >> > > fields > >> > > are copied as is. The example mapping seems rather useless as it > >> > >> copies > >> > >> > > exact > >> > > field names. It's only useful if your source fields and destination > >> > > >> > fields > >> > > >> > > are > >> > > actually different, which is usually not the case if you dedicate a > >> > >> Solr > >> > >> > > core > >> > > for a Nutch crawl. > >> > > > >> > > You must either not create the field by some plugin or add the field > >> > >> to > >> > >> > > your > >> > > Solr index. > >> > > > >> > > I'm surprised this error actually showed up considering the > >> > >> incompatible > >> > >> > > Javabin versions. Perhaps you already upgraded the SolrJ api? > >> > > > >> > > > How I can upgrade Solr to 4 version? > >> > > > > >> > > > Thank you. > >> > >> -- > >> * > >> *Open Source Solutions for Text Engineering > >> > >> http://digitalpebble.blogspot.com/ > >> http://www.digitalpebble.com
