[ https://issues.apache.org/jira/browse/CONNECTORS-880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795657#comment-16795657 ]
Subasini Rath commented on CONNECTORS-880: ------------------------------------------ Hi Karl, I am also facing the above mentioned issue. (Similar to Connector-880) I am using manifold2.12 binary version. I am using Solr output connector and Web repository connection. Manifold is using all default configuration. When I am running the jobs manually, it runs fine. Same jobs have been scheduled to run everyday. I am getting below exceptions and the job gets hanged/ going to waiting stage. Could you please help me in resolving the same. I am getting the below error - Scenario-1 WARN 2019-03-08T23:58:20,338 (qtp550147359-413) - Found a long-running query (2706114 ms): [SELECT t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs t0 ORDER BY description ASC] WARN 2019-03-08T23:58:20,337 (Document delete stuffer thread) - Found a long-running query (2737370 ms): [SELECT id FROM jobs WHERE status=? LIMIT 1] WARN 2019-03-08T23:58:20,339 (Job reset thread) - Found a long-running query (2770133 ms): [SELECT id FROM jobs WHERE status IN (?,?)] WARN 2019-03-08T23:58:20,386 (Document delete stuffer thread) - Parameter 0: 'e' WARN 2019-03-08T23:58:20,337 (Set priority thread) - Found a long-running query (2732379 ms): [SELECT id,dochash,docid,jobid FROM jobqueue WHERE needpriority=? LIMIT 1000] WARN 2019-03-08T23:58:20,386 (Set priority thread) - Parameter 0: 'T' WARN 2019-03-08T23:58:20,386 (Job reset thread) - Parameter 0: 'I' WARN 2019-03-08T23:58:20,386 (Job reset thread) - Parameter 1: 'i' WARN 2019-03-08T23:58:20,372 (Seeding thread) - Parameter 2: '1552047176062' WARN 2019-03-08T23:58:20,474 (Document cleanup stuffer thread) - Found a long-running query (2737524 ms): [SELECT id FROM jobs WHERE status=? LIMIT 1] WARN 2019-03-08T23:58:20,474 (Document cleanup stuffer thread) - Parameter 0: 'S' WARN 2019-03-08T23:58:20,474 (Finisher thread) - Found a long-running query (2752034 ms): [SELECT id FROM jobs WHERE status IN (?,?,?) FOR UPDATE] WARN 2019-03-08T23:58:20,474 (Finisher thread) - Parameter 0: 'A' WARN 2019-03-08T23:58:20,475 (Finisher thread) - Parameter 1: 'W' WARN 2019-03-08T23:58:20,475 (Finisher thread) - Parameter 2: 'R' WARN 2019-03-08T23:58:20,475 (Delete startup thread) - Found a long-running query (2752036 ms): [SELECT id FROM jobs WHERE status=? FOR UPDATE] WARN 2019-03-08T23:58:20,475 (Delete startup thread) - Parameter 0: 'E' WARN 2019-03-08T23:58:20,483 (qtp550147359-4339) - Found a long-running query (2496641 ms): [SELECT t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs t0 ORDER BY description ASC] WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isDistinctSelect=[false] WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isGrouped=[false] WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isAggregated=[false] WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: columns=[ COLUMN: PUBLIC.JOBS.ID not nullable WARN 2019-03-08T23:58:20,492 (qtp550147359-4346) - Found a long-running query (2435908 ms): [SELECT t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs t0 ORDER BY description ASC] WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: ] WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: [range variable 1 WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: join type=INNER WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: table=SYSTEM_SUBQUERY WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: cardinality=0 WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: access=FULL SCAN WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join condition = [index=SYS_IDX_13329 WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ] WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ][range variable 2 WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join type=INNER WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: table=JOBS WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: cardinality=3 WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: access=INDEX PRED WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join condition = [index=I1549955498033 WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: start conditions=[ WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ] arg_right=[ COLUMN: C1 WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ]] WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: end condition=[ WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] arg_right=[ COLUMN: C1 WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: other condition=[ WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] arg_right=[ COLUMN: C1 WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: PARAMETERS=[ WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @0[DYNAMIC PARAM: , TYPE = VARCHAR WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @1[DYNAMIC PARAM: , TYPE = VARCHAR WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @2[DYNAMIC PARAM: , TYPE = VARCHAR WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]] WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: SUBQUERIES[ WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: [level=1 WARN 2019-03-08T23:58:20,502 (Finisher thread) - Plan: value expression]] WARN 2019-03-08T23:58:20,502 (Finisher thread) - WARN 2019-03-08T23:58:20,504 (Delete startup thread) - Plan: isDistinctSelect=[false] WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: isGrouped=[false] WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: isAggregated=[false] WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: columns=[ COLUMN: PUBLIC.JOBS.ID not nullable WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: ] WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: [range variable 1 WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: join type=INNER WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: table=JOBS WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: cardinality=3 WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: access=INDEX PRED WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: join condition = [index=I1549955498033 WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: start conditions=[ WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: ] arg_right=[ DYNAMIC PARAM: , TYPE = CHARACTER WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: ]] WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: isDistinctSelect=[false] WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: isGrouped=[false] WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: isAggregated=[false] WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: columns=[ COLUMN: PUBLIC.JOBS.ID not nullable WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ] WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: [range variable 1 WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: join type=INNER WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: table=JOBS WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: cardinality=3 WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: access=INDEX PRED WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: join condition = [index=I1549955498033 WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: start conditions=[ WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: end condition=[ WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ] arg_right=[ DYNAMIC PARAM: , TYPE = CHARACTER WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ]] WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS WARN 2019-03-08T23:58:20,508 (Document cleanup stuffer thread) - Plan: end condition=[ WARN 2019-03-08T23:58:20,508 (Delete startup thread) - Plan: ] arg_right=[ DYNAMIC PARAM: , TYPE = CHARACTER WARN 2019-03-08T23:58:20,508 (Document cleanup stuffer thread) - Plan: EQUAL arg_left=[ COLUMN: PUBLIC.JOBS.STATUS Scenario-2 WEB: Illegal seed URL 'http://intranet.abcde.com/wps/wcm/connect/xxx/xxxwebsite/home > Under the right conditions, job aborts do not update "last checked" time > ------------------------------------------------------------------------ > > Key: CONNECTORS-880 > URL: https://issues.apache.org/jira/browse/CONNECTORS-880 > Project: ManifoldCF > Issue Type: Bug > Components: Framework crawler agent > Affects Versions: ManifoldCF 1.4.1 > Reporter: Karl Wright > Assignee: Karl Wright > Priority: Major > Fix For: ManifoldCF 1.6 > > > When a scheduled job is being considered to be started, MCF updates the > last-check field ONLY if the job didn't start. It relies on the job's > completion to set the last-check field in the case where the job does start. > But if the job aborts, in at least one case the last-check field is NOT > updated. This leads to the job being run over and over again within the > schedule window. -- This message was sent by Atlassian JIRA (v7.6.3#76005)