[ 
https://issues.apache.org/jira/browse/CONNECTORS-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13137773#comment-13137773
 ] 

Karl Wright commented on CONNECTORS-284:
----------------------------------------

After much back-and-forth with the HSQLDB team, it appears that there are 
several issues.

First issue is that indexes do not match inequalities in the WHERE clause.  The 
HSQLDB team has promised a fix for this.

Second issue is that HSQLDB will not read rows from the index except as a last 
resort.  This is important for the stuffer query.  While there are ways to 
force it to use the index, these require adding a dummy clause to the WHERE 
which mentions the ORDER BY column.  For doc priority, the dummy clause must be 
an inequality, but inequalities terminate all index matching, so there's no 
possibility of just folding the docpriority into the existing index and 
expecting reasonable performance in most cases.  Until this is ironed out, 
HSQLDB remains too limited to recommend for general crawling.  The HSQLDB team 
has not offered an enhancement for this problem as of this time.


                
> HSQLDB load test runs out of memory and has lots of very slow queries
> ---------------------------------------------------------------------
>
>                 Key: CONNECTORS-284
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-284
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Framework core
>    Affects Versions: ManifoldCF 0.4
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>             Fix For: ManifoldCF 0.4
>
>
> Some of the long-running queries are as follows:
> - document stuffer query
> - locating carrydown information

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to