[jira] [Created] (CONNECTORS-284) HSQLDB load test runs out of memory and has lots of very slow queries

2011-10-26 Thread Karl Wright (Created) (JIRA)
HSQLDB load test runs out of memory and has lots of very slow queries
-

 Key: CONNECTORS-284
 URL: https://issues.apache.org/jira/browse/CONNECTORS-284
 Project: ManifoldCF
  Issue Type: Bug
  Components: Framework core
Affects Versions: ManifoldCF 0.4
Reporter: Karl Wright
Assignee: Karl Wright
 Fix For: ManifoldCF 0.4


Some of the long-running queries are as follows:

- document stuffer query
- locating carrydown information



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (CONNECTORS-284) HSQLDB load test runs out of memory and has lots of very slow queries

2011-10-26 Thread Karl Wright (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/CONNECTORS-284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13136112#comment-13136112
 ] 

Karl Wright commented on CONNECTORS-284:


I created a branch (CONNECTORS-284) that has some changes, most notably strict 
adherence to index column order in AND clauses.  I'm still getting some long 
running queries though:

{code}
Found a query that took more than a minute (66375 ms): [SELECT * FROM agents]

Found a query that took more than a minute (97358 ms): [SELECT 
t0.id,t0.jobid,t0.dochash,t0.docid,t0.status,t0.failtime,t0.failcount,t0.priorityset
 FROM jobqueue t0 WHERE EXISTS(SELECT 'x' FROM jobs t1 WHERE t0.jobid=t1.id AND 
t1.status IN(?,?) AND t1.priority=?) AND t0.checkaction=? AND t0.checktime<=? 
AND t0.status IN (?,?) AND NOT EXISTS(SELECT 'x' FROM jobqueue t2 WHERE 
t0.dochash=t2.dochash AND t0.jobid!=t2.jobid AND t2.status IN (?,?,?,?,?,?)) 
AND NOT EXISTS(SELECT 'x' FROM prereqevents t3,events t4 WHERE t0.id=t3.owner 
AND t3.eventname=t4.name) ORDER BY t0.docpriority ASC LIMIT 400]
  Parameter 0: 'A'
  Parameter 1: 'a'
  Parameter 2: '5'
  Parameter 3: 'R'
  Parameter 4: '1319628631492'
  Parameter 5: 'P'
  Parameter 6: 'G'
  Parameter 7: 'A'
  Parameter 8: 'F'
  Parameter 9: 'a'
  Parameter 10: 'f'
  Parameter 11: 'D'
  Parameter 12: 'd'

Found a query that took more than a minute (92926 ms): [SELECT 
jobid,CAST(COUNT(dochash) AS BIGINT) AS doccount FROM jobqueue t1 WHERE 
EXISTS(SELECT 'x' FROM jobs t0 WHERE t0.id=t1.jobid AND id=?) GROUP BY jobid]
  Parameter 0: '1319627670575'

Found a query that took more than a minute (92248 ms): [SELECT 
t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs 
t0  WHERE id=? ORDER BY description ASC]
  Parameter 0: '1319627670575'
  
Found a query that took more than a minute (62997 ms): [SELECT 
t0.id,t0.dochash,t0.docid FROM jobqueue t0 WHERE t0.jobid=? AND EXISTS(SELECT 
'x' FROM carrydown t1 WHERE t0.jobid=t1.jobid AND parentidhash IN (?) AND 
t1.childidhash=t0.dochash AND t1.isnew=?)]
  Parameter 0: '1319627670575'
  Parameter 1: '0B75C77A4A188D383A1BCD0E138182E37AEF8AE8'
  Parameter 2: 'B'
{code}

Only a couple of these make even a glimmer of sense; the reasons for the others 
being slow are completely opaque.  I've asked the HSQLDB team for their opinion.


> HSQLDB load test runs out of memory and has lots of very slow queries
> -
>
> Key: CONNECTORS-284
> URL: https://issues.apache.org/jira/browse/CONNECTORS-284
> Project: ManifoldCF
>  Issue Type: Bug
>  Components: Framework core
>Affects Versions: ManifoldCF 0.4
>Reporter: Karl Wright
>Assignee: Karl Wright
> Fix For: ManifoldCF 0.4
>
>
> Some of the long-running queries are as follows:
> - document stuffer query
> - locating carrydown information

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Resolved] (CONNECTORS-283) Upgrade to jcifs.jar 1.3.17

2011-10-26 Thread Shinichiro Abe (Resolved) (JIRA)

 [ 
https://issues.apache.org/jira/browse/CONNECTORS-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shinichiro Abe resolved CONNECTORS-283.
---

Resolution: Fixed

r1189564

> Upgrade to jcifs.jar 1.3.17
> ---
>
> Key: CONNECTORS-283
> URL: https://issues.apache.org/jira/browse/CONNECTORS-283
> Project: ManifoldCF
>  Issue Type: Improvement
>  Components: Build, JCIFS connector
>Affects Versions: ManifoldCF 0.4
>Reporter: Shinichiro Abe
>Assignee: Shinichiro Abe
>Priority: Minor
> Fix For: ManifoldCF 0.4
>
> Attachments: CONNECTORS-283.patch
>
>
> I upgrade new jcifs version because of missing link of previous version 
> 1.3.16.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira