[jira] [Updated] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arcadius Ahouansou updated CONNECTORS-1191:
---
Attachment: 1433374857580-schedule.png
1433374857580-jobs.png
Got some log entries:
{code}
$ cat manifoldcf.log.12 | grep 1433374857580
DEBUG 2015-06-03 23:48:20,721 (Worker thread '82') - Worker thread processing
documents: 1433374857580
DEBUG 2015-06-03 23:48:20,722 (Worker thread '82') - Worker thread about to
process {1433374857580 }
DEBUG 2015-06-03 23:48:21,405 (Worker thread '99') - Worker thread processing
documents: 1433374857580
DEBUG 2015-06-03 23:48:21,407 (Worker thread '99') - Worker thread about to
process {1433374857580 }
$ cat manifoldcf.log.11 | grep 1433374857580
DEBUG 2015-06-04 00:17:31,231 (Worker thread '99') - Adding 1433374857580 to
finishList
DEBUG 2015-06-04 00:17:31,231 (Worker thread '99') - Finishing documents
{1433374857580 }
DEBUG 2015-06-04 00:18:37,459 (Worker thread '82') - Adding 1433374857580 to
finishList
DEBUG 2015-06-04 00:18:37,459 (Worker thread '82') - Finishing documents
{1433374857580 }
DEBUG 2015-06-04 00:19:16,946 (Worker thread '82') - Marking completed
{1433374857580 }
DEBUG 2015-06-04 00:19:38,967 (Worker thread '99') - Marking completed
{1433374857580 }
ERROR 2015-06-04 00:19:47,486 (Worker thread '99') - Exception tossed:
Unexpected jobqueue status - record id 1433374857580, expecting active status,
saw 2
org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue
status - record id 1433374857580, expecting active status, saw 2
{code}
This clearly shows that we have thread 99 and 82 processing the very same
document.
I have attached a screenshot of the schedule as well.
Is it possible that another instance of the jobs is scheduled while one is
already running?
BTW: Some jobs have status "Waiting" ... I wonder what that means.
Thanks.
> ManifoldCFException: Unexpected job status encountered
> --
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
>Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>Reporter: Arcadius Ahouansou
>Assignee: Karl Wright
>Priority: Critical
> Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
> Attachments: 1433374857580-jobs.png, 1433374857580-schedule.png,
> CONNECTORS-1191-2.patch, CONNECTORS-1191.patch, manifoldcf2.0.2.log,
> stuffer-thread-manifoldcf.log, unexpected-jobqueue.png
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arcadius Ahouansou updated CONNECTORS-1191:
---
Attachment: unexpected-jobqueue.png
stuffer-thread-manifoldcf.log
Hi [~kwri...@metacarta.com]
Please stuffer-thread-manifoldcf.log is the full log copied from the server.
It does not seem to contain any error, however, the job status screen shows
some jobqueue status errors
> ManifoldCFException: Unexpected job status encountered
> --
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
>Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>Reporter: Arcadius Ahouansou
>Assignee: Karl Wright
>Priority: Critical
> Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
> Attachments: CONNECTORS-1191-2.patch, CONNECTORS-1191.patch,
> manifoldcf2.0.2.log, stuffer-thread-manifoldcf.log, unexpected-jobqueue.png
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karl Wright updated CONNECTORS-1191:
Attachment: CONNECTORS-1191-2.patch
This patch enhances worker thread logging. If there is a logic error in it, we
should be able to find it with this in place.
Please deploy this patch. Turn on mcf "threads" debugging as follows:
The next time you see the error, look for the document row ID in the error
message. Then grep your logs for that ID, and we can then see what is going on.
Thanks.
> ManifoldCFException: Unexpected job status encountered
> --
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
>Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>Reporter: Arcadius Ahouansou
>Assignee: Karl Wright
>Priority: Critical
> Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
> Attachments: CONNECTORS-1191-2.patch, CONNECTORS-1191.patch,
> manifoldcf2.0.2.log
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karl Wright updated CONNECTORS-1191:
Attachment: CONNECTORS-1191.patch
This patch is for the release 2.0.2 only.
Committing a fix to trunk and to dev_1x shortly.
> ManifoldCFException: Unexpected job status encountered
> --
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
>Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>Reporter: Arcadius Ahouansou
>Assignee: Karl Wright
>Priority: Critical
> Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
> Attachments: CONNECTORS-1191.patch, manifoldcf2.0.2.log
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karl Wright updated CONNECTORS-1191:
Priority: Critical (was: Major)
Fix Version/s: ManifoldCF 2.1
ManifoldCF 1.9
> ManifoldCFException: Unexpected job status encountered
> --
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
>Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>Reporter: Arcadius Ahouansou
>Assignee: Karl Wright
>Priority: Critical
> Fix For: ManifoldCF 1.9, ManifoldCF 2.1
>
> Attachments: manifoldcf2.0.2.log
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (CONNECTORS-1191) ManifoldCFException: Unexpected job status encountered
[
https://issues.apache.org/jira/browse/CONNECTORS-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arcadius Ahouansou updated CONNECTORS-1191:
---
Attachment: manifoldcf2.0.2.log
full log file
> ManifoldCFException: Unexpected job status encountered
> --
>
> Key: CONNECTORS-1191
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1191
> Project: ManifoldCF
> Issue Type: Bug
> Components: Web connector
>Affects Versions: ManifoldCF 2.0.2
> Environment: - Debian 7.8 x86_64 GNU/Linux
> - Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
> - Server version: 5.5.41-0+wheezy1 (Debian)
>Reporter: Arcadius Ahouansou
> Attachments: manifoldcf2.0.2.log
>
>
> Hello.
> I am running the latest ManifoldCF 2.0.2 and my log is filled of
> {code}
> org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected job
> status encountered: 34
> at
> org.apache.manifoldcf.crawler.jobs.Jobs.returnJobToActive(Jobs.java:2073)
> at
> org.apache.manifoldcf.crawler.jobs.JobManager.resetJobs(JobManager.java:8261)
> at
> org.apache.manifoldcf.crawler.system.JobResetThread.run(JobResetThread.java:91)
> {code}
> I have attached full log for more detail.
> Note that I am running against MySQL.
> Thanks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
