Re: DataImportHandler ignoring most rows

[Erik Earle]

Upgraded to the tip from svn and still no love.



----- Original Message ----
From: Erik Earle <erikea...@yahoo.com>
To: solr-user@lucene.apache.org
Sent: Tuesday, August 18, 2009 3:16:47 PM
Subject: DataImportHandler ignoring most rows

Using:
- apache-solr-1.3.0
- java 1.6 
- tomcat 6
- sql server 2005 w/ JSQLConnect 4.0 driver

I have a group table with 3007 rows.  I have confirmed the key is
unique with "select distinct id from group"  and it returns 3007.  When i 
re-index using http://host:port/solr/dataimport?command=full-import  I only get 
7 records indexed.  Any insight into what is going on would be really great.  

A partial response:
    <lst name="statusMessages">
    <str name="Total Requests made to DataSource">1</str>
    <str name="Total Rows Fetched">7</str>
    <str name="Total Documents Skipped">0</str>


I have other entities that index all the rows without issue.

There are no errors in the logs.

I am not using any Transformers (and most of my config is not changed from 
install)

My schema.xml contains:

     <uniqueKey>key</uniqueKey>

and field defs (not a full list of fields):
   <field name="key" type="string" indexed="true" stored="true" required="true" 
/> 
   <field name="class" type="string" indexed="true" stored="true" 
required="true" />
   <field name="id" type="string" indexed="true" stored="true" /> 
   <field name="description" type="text" indexed="true" stored="true" />
   <field name="created" type="date" indexed="true" stored="true" />
   <field name="updated" type="date" indexed="true" stored="true" />

data-config.xml
################
<dataConfig>
    <!-- 
jdbc:JSQLConnect://se-eriearle-lt1/database=SocialSite2/user=SocialSite2/logfile=DB_TRACE.log
 -->
    <dataSource type="JdbcDataSource" 
        driver="com.jnetdirect.jsql.JSQLDriver"
        
url="jdbc:JSQLConnect://se-eriearle-lt1/database=SocialSite2/user=SocialSite2" 
        user="SocialSite2" 
        password="SocialSite2" />

    <document>
      
    ....

        <entity name="Group"  pk="key"
            query="select 'group.'+id as 'key', 'group' as 'class', name, 
handle, description, created, updated from group order by created asc">
        </entity>

        <entity name="Message" pk="key"
            query="<...redacted...>">
        </entity>
  
    </document>
</dataConfig>