[ 
https://issues.apache.org/jira/browse/CONNECTORS-880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795657#comment-16795657
 ] 

Subasini Rath commented on CONNECTORS-880:
------------------------------------------

Hi Karl,

   I am also facing the above mentioned issue. (Similar to Connector-880)

I am using manifold2.12 binary version. I am using Solr output connector and 
Web repository connection. Manifold is using all default configuration.

When I am running the jobs manually, it runs fine. Same jobs have been 
scheduled to run everyday.

I am getting below exceptions and the job gets hanged/ going to waiting stage.

Could you please help me in resolving the same.

I am getting the below error -

Scenario-1

WARN 2019-03-08T23:58:20,338 (qtp550147359-413) - Found a long-running query 
(2706114 ms): [SELECT 
t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs 
t0 ORDER BY description ASC]
WARN 2019-03-08T23:58:20,337 (Document delete stuffer thread) - Found a 
long-running query (2737370 ms): [SELECT id FROM jobs WHERE status=? LIMIT 1]
WARN 2019-03-08T23:58:20,339 (Job reset thread) - Found a long-running query 
(2770133 ms): [SELECT id FROM jobs WHERE status IN (?,?)]
WARN 2019-03-08T23:58:20,386 (Document delete stuffer thread) - Parameter 0: 'e'
WARN 2019-03-08T23:58:20,337 (Set priority thread) - Found a long-running query 
(2732379 ms): [SELECT id,dochash,docid,jobid FROM jobqueue WHERE needpriority=? 
LIMIT 1000]
WARN 2019-03-08T23:58:20,386 (Set priority thread) - Parameter 0: 'T'
WARN 2019-03-08T23:58:20,386 (Job reset thread) - Parameter 0: 'I'
WARN 2019-03-08T23:58:20,386 (Job reset thread) - Parameter 1: 'i'
WARN 2019-03-08T23:58:20,372 (Seeding thread) - Parameter 2: '1552047176062'
WARN 2019-03-08T23:58:20,474 (Document cleanup stuffer thread) - Found a 
long-running query (2737524 ms): [SELECT id FROM jobs WHERE status=? LIMIT 1]
WARN 2019-03-08T23:58:20,474 (Document cleanup stuffer thread) - Parameter 0: 
'S'
WARN 2019-03-08T23:58:20,474 (Finisher thread) - Found a long-running query 
(2752034 ms): [SELECT id FROM jobs WHERE status IN (?,?,?) FOR UPDATE]
WARN 2019-03-08T23:58:20,474 (Finisher thread) - Parameter 0: 'A'
WARN 2019-03-08T23:58:20,475 (Finisher thread) - Parameter 1: 'W'
WARN 2019-03-08T23:58:20,475 (Finisher thread) - Parameter 2: 'R'
WARN 2019-03-08T23:58:20,475 (Delete startup thread) - Found a long-running 
query (2752036 ms): [SELECT id FROM jobs WHERE status=? FOR UPDATE]
WARN 2019-03-08T23:58:20,475 (Delete startup thread) - Parameter 0: 'E'
WARN 2019-03-08T23:58:20,483 (qtp550147359-4339) - Found a long-running query 
(2496641 ms): [SELECT 
t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs 
t0 ORDER BY description ASC]
WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isDistinctSelect=[false]
WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isGrouped=[false]
WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: isAggregated=[false]
WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: columns=[ COLUMN: 
PUBLIC.JOBS.ID not nullable
WARN 2019-03-08T23:58:20,492 (qtp550147359-4346) - Found a long-running query 
(2435908 ms): [SELECT 
t0.id,t0.description,t0.status,t0.starttime,t0.endtime,t0.errortext FROM jobs 
t0 ORDER BY description ASC]
WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: 
WARN 2019-03-08T23:58:20,492 (Finisher thread) - Plan: ]
WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: [range variable 1
WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: join type=INNER
WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: table=SYSTEM_SUBQUERY
WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: cardinality=0
WARN 2019-03-08T23:58:20,499 (Finisher thread) - Plan: access=FULL SCAN
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join condition = 
[index=SYS_IDX_13329
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ]
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ][range variable 2
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join type=INNER
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: table=JOBS
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: cardinality=3
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: access=INDEX PRED
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: join condition = 
[index=I1549955498033
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: start conditions=[
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: EQUAL arg_left=[ COLUMN: 
PUBLIC.JOBS.STATUS
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ] arg_right=[ COLUMN: C1
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: ]]
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: end condition=[
WARN 2019-03-08T23:58:20,500 (Finisher thread) - Plan: EQUAL arg_left=[ COLUMN: 
PUBLIC.JOBS.STATUS
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] arg_right=[ COLUMN: C1
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: other condition=[
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: EQUAL arg_left=[ COLUMN: 
PUBLIC.JOBS.STATUS
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ] arg_right=[ COLUMN: C1
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: PARAMETERS=[
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @0[DYNAMIC PARAM: , TYPE 
= VARCHAR
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @1[DYNAMIC PARAM: , TYPE 
= VARCHAR
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: @2[DYNAMIC PARAM: , TYPE 
= VARCHAR
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: ]]
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: SUBQUERIES[
WARN 2019-03-08T23:58:20,501 (Finisher thread) - Plan: [level=1
WARN 2019-03-08T23:58:20,502 (Finisher thread) - Plan: value expression]]
WARN 2019-03-08T23:58:20,502 (Finisher thread) - 
WARN 2019-03-08T23:58:20,504 (Delete startup thread) - Plan: 
isDistinctSelect=[false]
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: isGrouped=[false]
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: 
isAggregated=[false]
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: columns=[ COLUMN: 
PUBLIC.JOBS.ID not nullable
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: 
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: ]
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: [range variable 1
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: join type=INNER
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: table=JOBS
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: cardinality=3
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: access=INDEX PRED
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: join condition = 
[index=I1549955498033
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: start conditions=[
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: EQUAL arg_left=[ 
COLUMN: PUBLIC.JOBS.STATUS
WARN 2019-03-08T23:58:20,505 (Delete startup thread) - Plan: ] arg_right=[ 
DYNAMIC PARAM: , TYPE = CHARACTER
WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: ]]
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
isDistinctSelect=[false]
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
isGrouped=[false]
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
isAggregated=[false]
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
columns=[ COLUMN: PUBLIC.JOBS.ID not nullable
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ]
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: [range 
variable 1
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: join 
type=INNER
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
table=JOBS
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
cardinality=3
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: 
access=INDEX PRED
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: join 
condition = [index=I1549955498033
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: start 
conditions=[
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: EQUAL 
arg_left=[ COLUMN: PUBLIC.JOBS.STATUS
WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: end condition=[
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ] 
arg_right=[ DYNAMIC PARAM: , TYPE = CHARACTER
WARN 2019-03-08T23:58:20,507 (Document cleanup stuffer thread) - Plan: ]]
WARN 2019-03-08T23:58:20,507 (Delete startup thread) - Plan: EQUAL arg_left=[ 
COLUMN: PUBLIC.JOBS.STATUS
WARN 2019-03-08T23:58:20,508 (Document cleanup stuffer thread) - Plan: end 
condition=[
WARN 2019-03-08T23:58:20,508 (Delete startup thread) - Plan: ] arg_right=[ 
DYNAMIC PARAM: , TYPE = CHARACTER
WARN 2019-03-08T23:58:20,508 (Document cleanup stuffer thread) - Plan: EQUAL 
arg_left=[ COLUMN: PUBLIC.JOBS.STATUS

 

Scenario-2

WEB: Illegal seed URL 
'http://intranet.abcde.com/wps/wcm/connect/xxx/xxxwebsite/home

> Under the right conditions, job aborts do not update "last checked" time
> ------------------------------------------------------------------------
>
>                 Key: CONNECTORS-880
>                 URL: https://issues.apache.org/jira/browse/CONNECTORS-880
>             Project: ManifoldCF
>          Issue Type: Bug
>          Components: Framework crawler agent
>    Affects Versions: ManifoldCF 1.4.1
>            Reporter: Karl Wright
>            Assignee: Karl Wright
>            Priority: Major
>             Fix For: ManifoldCF 1.6
>
>
> When a scheduled job is being considered to be started, MCF updates the 
> last-check field ONLY if the job didn't start.  It relies on the job's 
> completion to set the last-check field in the case where the job does start.  
> But if the job aborts, in at least one case the last-check field is NOT 
> updated.  This leads to the job being run over and over again within the 
> schedule window.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to