Re: Discrepancy between Full import and Delta import query

[Aniket Bhoi]

On Tue, Feb 17, 2015 at 8:21 PM, Aniket Bhoi <aniket.b...@gmail.com> wrote:

> Hi Folks,
>
> I am running Solr 3.4 and using DIH for importing data from a SQL server
> backend.
>
> The query for Full import and Delta import is the same ie both pull the
> same data.
>
> Full and Delta import query:
>
> SELECT KB_ENTRY.ADDITIONAL_INFO ,KB_ENTRY.KNOWLEDGE_REF
> ID,SU_ENTITY_TYPE.REF ENTRY_TYPE_REF,KB_ENTRY.PROFILE_REF,
> KB_ENTRY.ITEM_REF, KB_ENTRY.TITLE, KB_ENTRY.ABSTRACT, KB_ENTRY.SOLUTION,
> KB_ENTRY.SOLUTION_HTML, KB_ENTRY.FREE_TEXT, KB_ENTRY.DATE_UPDATED,
> KB_ENTRY.STATUS_REF, KB_ENTRY.CALL_NUMBER, SU_ENTITY_TYPE.DISPLAY
> ENTRY_TYPE, KB_PROFILE.NAME PROFILE_TYPE, AR_PRIMARY_ASSET.ASSET_REF
> SERVICE_TYPE, AR_PERSON.FULL_NAME CONTRIBUTOR, IN_SYS_SOURCE.NAME SOURCE,
> KB_ENTRY_STATUS.NAME STATUS,(SELECT COUNT (CL_KB_REFER.CALL_NUMBER) FROM
> CL_KB_REFER WHERE CL_KB_REFER.ARTICLE_REF = KB_ENTRY.KNOWLEDGE_REF)
> LINK_RATE FROM KB_ENTRY, SU_ENTITY_TYPE, KB_PROFILE, AR_PRIMARY_ASSET,
> AR_PERSON, IN_SYS_SOURCE, KB_ENTRY_STATUS WHERE KB_ENTRY.PARTITION = 1 AND
> KB_ENTRY.STATUS = 'A' AND AR_PERSON.OFFICER_IND = 1 AND
> KB_ENTRY.CREATED_BY_REF = AR_PERSON.REF AND KB_ENTRY.SOURCE =
> IN_SYS_SOURCE.REF AND KB_ENTRY.STATUS_REF = KB_ENTRY_STATUS.REF AND
> KB_ENTRY_STATUS.STATUS = 'A' AND KB_ENTRY.PROFILE_REF = KB_PROFILE.REF AND
> KB_ENTRY.ITEM_REF = AR_PRIMARY_ASSET.ITEM_REF AND KB_ENTRY.ENTITY_TYPE =
> SU_ENTITY_TYPE.REF AND KB_ENTRY.KNOWLEDGE_REF='${dataimporter.delta.ID}'"
>
>
> Delta query:select KNOWLEDGE_REF as ID from KB_ENTRY where (DATE_UPDATED
> &gt; '${dataimporter.last_index_time}' OR DATE_CREATED &gt;
> '${dataimporter.last_index_time}')">
>
>
> The Problem here is that When I run the full Import ,everything works fine
> and all the feilds .data are displayed fine in the search
>
> However When I run Delta import,for some records the ENTRY_TYPE field is
> not returned from the database,
>
> Let me illustrate it with an example:
>
> Search result After running Full Import:
>
> Record Name:John Doe
> Entry ID:500
> Entry Type:Worker
>
> Search result after running Delta import:
>
> Record Name:John Doe
> Entry ID:500
> Entry Type:
>
>
> FYI:I have run the Full and Delta import queries(Though both are the same)
> on the SQL Server IDE  and both return The Entry Type feild correctly.
>
> Not sure why the entry Type feild vanishes from Solr when Delta import is
> run.
>
> Any idea why this would happen.
>
> Thanks,
>
> Aniket
>
>

Hi folks,

Anyone with any luck or knowledge on this?

Regards

Aniket