I solved the problem. You need to use

field name="tstamp" type="*date*"

instead old

field name="tstamp" type="*long*"

that specified in nutch's schema.xml.

Thanks.

2011/4/19 Haspadar <[email protected]>

> Yes, I did it. I changed the version in ivy.xml and rebuilt Nutch.
> I'm using 'deploy' version for running it on separate Hadoop instance.
> The error however remains the same.
> Even If I running Solr 3.1 and SolrIndexer job with SolrJ 4.0 - all works
> fine.
>
>
> 2011/4/19 Julien Nioche <[email protected]>
>
>> You need to change the version of SOLR in ivy/ivy.xml then rebuild unless
>> you change the jars straight in to nutch-1.3/runtime/local/lib - assuming
>> that you're running Nutch locally only
>>
>> On 19 April 2011 07:09, Haspadar <[email protected]> wrote:
>>
>> > Yes, it occured after removing SolrJ1.4 jar and copy 4.0 version. Before
>> it
>> > I upgrated Nutch for Solr 3.1 the same way and all worked fine.
>> >
>> > Thanks
>> >
>> > 2011/4/19 Markus Jelsma <[email protected]>
>> >
>> > > Hi,
>> > >
>> > > > Hello.
>> > > > I'm using Nutch 1.3. I decided to upgrade Solr to version 4.0 and I
>> > > > replaced Nutch libs (Snapshot and SolrJ) from Solr dist. After that
>> I
>> > got
>> > > > the error at SolrIndexer on Reduce stage:
>> > > >
>> > > > 11/04/19 01:47:19 INFO mapred.JobClient:  map 100% reduce 27%
>> > > > 11/04/19 01:47:21 INFO mapred.JobClient: Task Id :
>> > > > attempt_201104190142_0009_r_000000_0, Status : FAILED
>> > > > org.apache.solr.common.SolrException: ERROR: [doc=
>> http://www.site.net/
>> > ]
>> > > > Error adding field 'tstamp'='2011-04-18T22:45:17.404Z'
>> > > >
>> > > > ERROR: [doc=http://www.site.net/] Error adding field
>> > > > 'tstamp'='2011-04-18T22:45:17.404Z'
>> > > >
>> > > > request: http://127.0.0.1:8983/solr/update?wt=javabin&version=2
>> > > >     at
>> > > >
>> > >
>> >
>> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttp
>> > > > SolrServer.java:436) at
>> > > >
>> > >
>> >
>> org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttp
>> > > > SolrServer.java:245) at
>> > > >
>> > >
>> >
>> org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(Abstract
>> > > > UpdateRequest.java:105) at
>> > > > org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:50) at
>> > > > org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:75)
>> at
>> > > >
>> > >
>> >
>> org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.ja
>> > > > va:48) at
>> > > >
>> org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:474)
>> > > >     at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
>> > > >     at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> > >
>> > > If you are using Solr > 1.4.x then you must upgrade the SolrJ jar's in
>> > > Nutch.
>> > > Solr 1.4.x and higher are not compatible. Just remove the 1.4.x jar's
>> and
>> > > copy
>> > > over the new.
>> > >
>> > > >
>> > > > I tried to remove tstamp from solrindex-mapping.xml and Solr's
>> > > schema.xml.
>> > > > But this field is required in schema.xml and I got the error:
>> > > >
>> > > > 11/04/19 01:58:03 INFO mapred.JobClient: Task Id :
>> > > > attempt_201104190142_0010_r_000000_0, Status : FAILED
>> > > > org.apache.solr.common.SolrException: ERROR: [doc=
>> http://www.site.net/
>> > ]
>> > > > unknown field 'tstamp'
>> > > >
>> > > > ERROR: [doc=http://www.site.net/] unknown field 'tstamp'
>> > >
>> > > Removing a mapping doesn't mean the field isn't copied over. All
>> unmapped
>> > > fields
>> > > are copied as is. The example mapping seems rather useless as it
>> copies
>> > > exact
>> > > field names. It's only useful if your source fields and destination
>> > fields
>> > > are
>> > > actually different, which is usually not the case if you dedicate a
>> Solr
>> > > core
>> > > for a Nutch crawl.
>> > >
>> > > You must either not create the field by some plugin or add the field
>> to
>> > > your
>> > > Solr index.
>> > >
>> > > I'm surprised this error actually showed up considering the
>> incompatible
>> > > Javabin versions. Perhaps you already upgraded the SolrJ api?
>> > >
>> > > >
>> > > > How I can upgrade Solr to 4 version?
>> > > >
>> > > > Thank you.
>> > >
>> >
>>
>>
>>
>> --
>> *
>> *Open Source Solutions for Text Engineering
>>
>> http://digitalpebble.blogspot.com/
>> http://www.digitalpebble.com
>>
>
>

Reply via email to