Hi,
I want to use the delta import, then i have configured the DIH like this :
<dataConfig>
<dataSource name="f" type="FieldReaderDataSource" />
<document>
<entity name="contrat" dataSource="d" processor="SqlEntityProcessor"
pk="id" query="select * from contrats"
deltaImportQuery="select * from contrats where
id='${dataimporter.delta.id}'"
deltaQuery="select id from contrats where last_modified_at >
to_date('${dataimporter.last_index_time}','YYYY-MM-DD HH24:MI:SS')">
<field column="id" name="id" />
<field column="uri" name="uri" />
<entity name="content" dataSource="f"
processor="XPathEntityProcessor" dataField="contrat.CONTENT"
forEach="/entry/content/contrat/"
transformer="DateFormatTransformer, TemplateTransformer">
<field column="idContrat" xpath="/entry/content/contrat/id"
/>
<field column="versionTechnique"
xpath="/entry/content/contrat/modification/version" />
<field column="etat" xpath="/entry/content/contrat/etat" />
<field column="idIndex"
template="${content.idContrat}_${content.etat}" />
<field column="idAnciensTarifs"
xpath="/entry/content/contrat/anciensTarifs/id" />
<field column="codeClientPayeurFraisTransport"
xpath="/entry/content/contrat/client/payeursFraisTransport/payeurFraisTransport/code"
/>
<field column="codeContractant"
xpath="/entry/content/contrat/client/contractant/code" />
<field column="codeDonneurOrdre"
xpath="/entry/content/contrat/client/donneurOrdre/code" />
<field column="compteClientPayeur"
xpath="/entry/content/contrat/client/payeur/compte" />
<field column="dateDebut"
xpath="/entry/content/contrat/dateDebut" dateTimeFormat="yyyy-MM-dd" />
<field column="dateFin"
xpath="/entry/content/contrat/dateFin" dateTimeFormat="yyyy-MM-dd" />
</entity>
<entity name="flux" dataSource="f"
processor="XPathEntityProcessor" dataField="contrat.CONTENT"
forEach="/entry/content/contrat/axeContrat/fluxContrat/"
transformer="DateFormatTransformer, TemplateTransformer" >
<field column="idFlux"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/id" />
<field column="uriFlux"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/uri" />
<field column="videcharge"
xpath="/entry/content/contrat/axeContrat/fluxContrat/nature" />
<field column="od"
template="${flux.idFlux}_${flux.videcharge}_${flux.uriFlux}" />
<field column="paysOrigine"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/paysOrigine" />
<field column="gareOrigine"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/gareOrigine" />
<field column="lieuOrigine"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/lieuOrigine" />
<field column="paysDestination"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/paysDestination"
/>
<field column="gareDestination"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/gareDestination"
/>
<field column="lieuDestination"
xpath="/entry/content/contrat/axeContrat/fluxContrat/flux/lieuDestination"
/>
</entity>
</entity>
</document>
</dataConfig>
When i use the delta import, i get this response :
<lst name="statusMessages">
<str name="Total Requests made to DataSource">21</str>
<str name="Total Rows Fetched">20</str>
<str name="Total Documents Skipped">0</str>
<str name="Delta Dump started">2010-11-25 13:59:44</str>
<str name="Identifying Delta">2010-11-25 13:59:44</str>
<str name="Deltas Obtained">2010-11-25 13:59:44</str>
<str name="Building documents">2010-11-25 13:59:44</str>
<str name="Total Changed Documents">20</str>
<str name="Total Documents Processed">0</str>
<str name="Time taken ">0:0:0.594</str>
</lst>
and in the logs :
INFO: Starting Delta Import
25 nov. 2010 13:59:44 org.apache.solr.core.SolrCore execute
INFO: [] webapp=/bricmlmc-search path=/select
params={clean=false&commit=true&command=delta-import&qt=/dataimport}
status=0 QTime=172
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.SolrWriter
readIndexerProperties
INFO: Read dataimport.properties
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder doDelta
INFO: Starting delta collection.
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Running ModifiedRowKey() for Entity: content
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed ModifiedRowKey for Entity: content rows obtained : 0
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed DeletedRowKey for Entity: content rows obtained : 0
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed parentDeltaQuery for Entity: content
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Running ModifiedRowKey() for Entity: flux
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed ModifiedRowKey for Entity: flux rows obtained : 0
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed DeletedRowKey for Entity: flux rows obtained : 0
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed parentDeltaQuery for Entity: flux
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Running ModifiedRowKey() for Entity: contrat
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.JdbcDataSource$1
call
INFO: Creating a connection for entity contrat with URL:
jdbc:oracle:thin:@localhost:1521:XE
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.JdbcDataSource$1
call
INFO: Time taken for getConnection(): 422
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed ModifiedRowKey for Entity: contrat rows obtained : 20
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed DeletedRowKey for Entity: contrat rows obtained : 0
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed parentDeltaQuery for Entity: contrat
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder doDelta
INFO: Delta Import completed successfully
25 nov. 2010 13:59:44 org.apache.solr.handler.dataimport.DocBuilder execute
INFO: Time taken = 0:0:0.594
The import looks to be good, he found my changed documents, but none of this
documents were processed. Then i can't find my new documents in the index.
Do you have any idea on that point ?
Thanks
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-Delta-import-don-t-process-the-updated-documents-tp1966881p1966881.html
Sent from the Solr - User mailing list archive at Nabble.com.
