Re: Web crawl exited with an unexpected jobqueue status error under MySQL
Oh , I see... I will upgrade MCF and will try again... Thanks! Regards, Shigeki 2012/12/6 Karl Wright daddy...@gmail.com Actually, I just noticed this: I ran MCF0.6 . MCF 0.6 runs MySQL in the wrong mode, so this was a problem. It was fixed in ManifoldCF 1.0. Can you upgrade to MCF 1.01 and see if this still happens for you? Karl On Wed, Dec 5, 2012 at 9:46 PM, Shigeki Kobayashi shigeki.kobayas...@g.softbank.co.jp wrote: Hello Karl. MySQL: 5.5.24 Tomcat: 6.0.35 CentOS: 6.3 Regards, Shigeki 2012/12/5 Karl Wright daddy...@gmail.com Yes, I believe it is related, in the sense that the fix for CONNECTORS-246 was a fix to the HSQLDB database. This error makes it clear that MySQL has a similar problem with its MVCC model, and will also require a fix. However, I do not have the same kinds of leverage in the MySQL community that I do with HSQLDB. Can you give some details about the version of MySQL you are running, and on what platform? I will capture that and then maybe figure out how to open a MySQL ticket. Karl On Wed, Dec 5, 2012 at 6:57 AM, Shigeki Kobayashi shigeki.kobayas...@g.softbank.co.jp wrote: Hi. I ran MCF0.6 under MySQL5.5. I crawled WEB and the following error occurred, then MCF stopped the job: 2012/12/04 18:50:07 ERROR (Worker thread '0') - Exception tossed: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:711) at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2435) at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:745) There was a similar ticket A file crawl exited with an unexpected jobqueue status error under HSQLDB. https://issues.apache.org/jira/browse/CONNECTORS-246 Wondering if this is related.. Regards, Shigeki
Web crawl exited with an unexpected jobqueue status error under MySQL
Hi. I ran MCF0.6 under MySQL5.5. I crawled WEB and the following error occurred, then MCF stopped the job: 2012/12/04 18:50:07 ERROR (Worker thread '0') - Exception tossed: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:711) at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2435) at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:745) There was a similar ticket A file crawl exited with an unexpected jobqueue status error under HSQLDB. https://issues.apache.org/jira/browse/CONNECTORS-246 Wondering if this is related.. Regards, Shigeki
Re: Web crawl exited with an unexpected jobqueue status error under MySQL
Hello Karl. MySQL: 5.5.24 Tomcat: 6.0.35 CentOS: 6.3 Regards, Shigeki 2012/12/5 Karl Wright daddy...@gmail.com Yes, I believe it is related, in the sense that the fix for CONNECTORS-246 was a fix to the HSQLDB database. This error makes it clear that MySQL has a similar problem with its MVCC model, and will also require a fix. However, I do not have the same kinds of leverage in the MySQL community that I do with HSQLDB. Can you give some details about the version of MySQL you are running, and on what platform? I will capture that and then maybe figure out how to open a MySQL ticket. Karl On Wed, Dec 5, 2012 at 6:57 AM, Shigeki Kobayashi shigeki.kobayas...@g.softbank.co.jp wrote: Hi. I ran MCF0.6 under MySQL5.5. I crawled WEB and the following error occurred, then MCF stopped the job: 2012/12/04 18:50:07 ERROR (Worker thread '0') - Exception tossed: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:711) at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2435) at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:745) There was a similar ticket A file crawl exited with an unexpected jobqueue status error under HSQLDB. https://issues.apache.org/jira/browse/CONNECTORS-246 Wondering if this is related.. Regards, Shigeki
Re: Web crawl exited with an unexpected jobqueue status error under MySQL
Actually, I just noticed this: I ran MCF0.6 . MCF 0.6 runs MySQL in the wrong mode, so this was a problem. It was fixed in ManifoldCF 1.0. Can you upgrade to MCF 1.01 and see if this still happens for you? Karl On Wed, Dec 5, 2012 at 9:46 PM, Shigeki Kobayashi shigeki.kobayas...@g.softbank.co.jp wrote: Hello Karl. MySQL: 5.5.24 Tomcat: 6.0.35 CentOS: 6.3 Regards, Shigeki 2012/12/5 Karl Wright daddy...@gmail.com Yes, I believe it is related, in the sense that the fix for CONNECTORS-246 was a fix to the HSQLDB database. This error makes it clear that MySQL has a similar problem with its MVCC model, and will also require a fix. However, I do not have the same kinds of leverage in the MySQL community that I do with HSQLDB. Can you give some details about the version of MySQL you are running, and on what platform? I will capture that and then maybe figure out how to open a MySQL ticket. Karl On Wed, Dec 5, 2012 at 6:57 AM, Shigeki Kobayashi shigeki.kobayas...@g.softbank.co.jp wrote: Hi. I ran MCF0.6 under MySQL5.5. I crawled WEB and the following error occurred, then MCF stopped the job: 2012/12/04 18:50:07 ERROR (Worker thread '0') - Exception tossed: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 org.apache.manifoldcf.core.interfaces.ManifoldCFException: Unexpected jobqueue status - record id 1354608871138, expecting active status, saw 3 at org.apache.manifoldcf.crawler.jobs.JobQueue.updateCompletedRecord(JobQueue.java:711) at org.apache.manifoldcf.crawler.jobs.JobManager.markDocumentCompletedMultiple(JobManager.java:2435) at org.apache.manifoldcf.crawler.system.WorkerThread.run(WorkerThread.java:745) There was a similar ticket A file crawl exited with an unexpected jobqueue status error under HSQLDB. https://issues.apache.org/jira/browse/CONNECTORS-246 Wondering if this is related.. Regards, Shigeki