Re: Solr Delta Import Handler not working
| dataSource=null
I think this should not be here. The datasource should default to the
dataSource listing. And 'rootEntity=true' should be in the
XPathEntityProcessor block, because you are adding each file as one document.
- Original Message -
| From: Spadez james_will...@hotmail.com
| To: solr-user@lucene.apache.org
| Sent: Sunday, November 18, 2012 7:34:34 AM
| Subject: Re: Solr Delta Import Handler not working
|
| Update! Thank you to Lance for the help. Based on your suggestion I
| have
| fixed up a few things.
|
| *My Dataconfig now has the filename pattern fixed and root
| entity=true*
| /dataConfig
| dataSource type=FileDataSource /
| document
| entity
| name=document
| processor=FileListEntityProcessor
| baseDir=/var/lib/employ
| fileName=^.*\.xml$
| recursive=false
| rootEntity=true
| dataSource=null
| entity
| processor=XPathEntityProcessor
| url=${document.fileAbsolutePath}
| useSolrAddSchema=true
| stream=true
| /entity
| /entity
| /document
| /dataConfig/
|
| *My data.xml has a corrected date format with T:*
| /add
| doc
| field name=id123/field
| field name=titleDelta Import 2/field
| field name=descriptionThis is my long description/field
| field name=truncated_descriptionThis is/field
|
| field name=companyGoogle/field
| field name=location_nameEngland/field
| field name=date2007-12-31T22:29:59/field
| field name=sourceGoogle/field
| field name=urlwww.google.com/field
| field name=latlng45.17614,45.17614/field
| /doc
| /add/
|
|
|
| --
| View this message in context:
|
http://lucene.472066.n3.nabble.com/Solr-Delta-Import-Handler-not-working-tp4020897p4020925.html
| Sent from the Solr - User mailing list archive at Nabble.com.
|
Re: Solr Delta Import Handler not working
I think this means the pattern did not match any files:
str name=Total Rows Fetched0/str
The wiki example includes a '^' at the beginning of the filename pattern. This
matches a complete line.
http://wiki.apache.org/solr/DataImportHandler#Transformers_Example
More:
Add rootEntity=true. It cannot hurt to be explicit.
The date format needs a 'T' instead of a space:
http://en.wikipedia.org/wiki/ISO_8601
Cheers!
- Original Message -
| From: Spadez james_will...@hotmail.com
| To: solr-user@lucene.apache.org
| Sent: Saturday, November 17, 2012 2:49:30 PM
| Subject: Solr Delta Import Handler not working
|
| Hi,
|
| These are the exact steps that I have taken to try and get delta
| import
| handler working. If I can provide any more information to help let me
| know.
| I have literally spent the entire friday night and today on this and
| I throw
| in the towel. Where have I gone wrong?
|
| *Added this line to the solrconfig:*
| /requestHandler name=/dataimport
| class=org.apache.solr.handler.dataimport.DataImportHandler
| lst name=defaults
| str name=config/home/solr/data-config.xml/str
| /lst
| /requestHandler/
|
| *Then my data-config.xml looks like this:*
| /dataConfig
| dataSource type=FileDataSource /
| document
| entity
| name=document
| processor=FileListEntityProcessor
| baseDir=/var/lib/data
| fileName=.*.xml$
| recursive=false
| rootEntity=false
| dataSource=null
| entity
| processor=XPathEntityProcessor
| url=${document.fileAbsolutePath}
| useSolrAddSchema=true
| stream=true
| /entity
| /entity
| /document
| /dataConfig/
|
| *Then in my var/lib/data folder I have a data.xml file that looks
| like
| this:*
| /add
| doc
| field name=id123/field
| field name=descriptionThis is my long description/field
| field name=companyGoogle/field
| field name=location_nameEngland/field
| field name=date2007-12-31 22:29:59/field
| field name=sourceGoogle/field
| field name=urlwww.google.com/field
| field name=latlng45.17614,45.17614/field
| /doc
| /add/
|
| *Finally I then ran this command:*
| /http://localhost:8080/solr/dataimport?command=delta-importclean=false/
|
| *And I get this result (failed):*
| /response
| lst name=responseHeader
| int name=status0/int
| int name=QTime1/int
| /lst
| lst name=initArgs
| lst name=defaults
| str name=config/opt/solr/example/solr/conf/data-config.xml/str
| /lst
| /lst
| str name=commanddelta-import/str
| str name=statusidle/str
| str name=importResponse/
| lst name=statusMessages
| str name=Time Elapsed0:15:9.543/str
| str name=Total Requests made to DataSource0/str
| str name=Total Rows Fetched0/str
| str name=Total Documents Processed0/str
| str name=Total Documents Skipped0/str
| str name=Delta Dump started2012-11-17 17:32:56/str
| str name=Identifying Delta2012-11-17 17:32:56/str
| str name=*Indexing failed*. Rolled back all changes./str
| str name=Rolledback2012-11-17 17:32:56/str
| /lst
| str name=WARNING
| This response format is experimental. It is likely to change in the
| future.
| /str
| /response/
|
|
|
|
|
| --
| View this message in context:
|
http://lucene.472066.n3.nabble.com/Solr-Delta-Import-Handler-not-working-tp4020897.html
| Sent from the Solr - User mailing list archive at Nabble.com.
|
