[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[
https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371283#comment-16371283
]
Karl Wright commented on CONNECTORS-1367:
-
[~piergiorgioluc...@gmail.com], the 0.8.1 release is what we depend on now:
{code}
{code}
The ticket wasn't closed because we received no confirmation. But it sounds
like it can be resolved.
> Alfresco Connector fails to complete seeding request, leading to hang (and
> postgresql deadlock)
> ---
>
> Key: CONNECTORS-1367
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1367
> Project: ManifoldCF
> Issue Type: Bug
> Components: Alfresco webscript connector
>Affects Versions: ManifoldCF 2.5
>Reporter: Chalitha Perera
>Assignee: Karl Wright
>Priority: Major
> Attachments: jstack5.out
>
>
> Alfresco connector gets stuck when processing documents around 35,000 and
> postgres manifold database in idle state and after days gets deadlock message
> "
> 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected
> < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on
> transaction 432231; blocked by process 28038.
> Process 28038 waits for ShareLock on transaction 432227; blocked by
> process 28072.
> Process 28072: UPDATE jobqueue SET
> failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND
> (status=$4 OR status=$5)
> Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE
> < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details."
> On separate note, ran ant load-pg and it was completed successfully.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371168#comment-16371168 ] Piergiorgio Lucidi commented on CONNECTORS-1367: [~lcabaceira] do you have some news about this? > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright >Priority: Major > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826259#comment-15826259 ] Chalitha Perera commented on CONNECTORS-1367: - [~maoo], Sure, we will test it and let you know thanks ! > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15826183#comment-15826183 ] Maurizio Pillitu commented on CONNECTORS-1367: -- PR merged on alfresco-indexer - https://github.com/Alfresco/alfresco-indexer/pull/18 alfresco-indexer 0.8-SNAPSHOT was just deployed on https://oss.sonatype.org/content/repositories/snapshots/com/github/maoo/indexer/ [~chalitha.perera], could you please try to use this SNAPSHOT version? If the test is successful, I can go ahead and release version 0.8.1, then poin the manifold connector to it. > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824661#comment-15824661 ] Maurizio Pillitu commented on CONNECTORS-1367: -- Thanks for the feedback [~kwri...@metacarta.com], I've extended default socket timeout to 5mins (in the linked PR). Tomorrow I'll ask Alfresco to merge the PR and restore my commit rights (as I don't work for Alfresco any longer) > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824393#comment-15824393 ] Maurizio Pillitu commented on CONNECTORS-1367: -- PR is ready for review - https://github.com/Alfresco/alfresco-indexer/pull/18 > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824381#comment-15824381 ] Maurizio Pillitu commented on CONNECTORS-1367: -- working on a PR now; I'll keep u posted shortly > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824271#comment-15824271 ] Rafa Haro commented on CONNECTORS-1367: --- Code is hosted at Alfresco's github account. I suppose [~maoo] still has karma for merging a PR. The fix is a matter of a couple of lines of code > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824256#comment-15824256 ] Karl Wright commented on CONNECTORS-1367: - That would explain it. Who is in charge of the alfresco indexer code base at this point? > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824247#comment-15824247 ] Piergiorgio Lucidi commented on CONNECTORS-1367: Unfortunately HttpClient 4.3 has an infinite timeout as the default value: https://github.com/apache/httpcore/blob/4.3.x/httpcore/src/main/java/org/apache/http/impl/pool/BasicConnFactory.java#L78 > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CONNECTORS-1367) Alfresco Connector fails to complete seeding request, leading to hang (and postgresql deadlock)
[ https://issues.apache.org/jira/browse/CONNECTORS-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824204#comment-15824204 ] Rafa Haro commented on CONNECTORS-1367: --- Hi guys. Taking a quick look to Maurizio's Alfresco Indexer client, it seems that there isn't any defined socket timeout for requests. Http Client version is 4.3 which at this I moment I ignore if by default configures any timeout under the hood > Alfresco Connector fails to complete seeding request, leading to hang (and > postgresql deadlock) > --- > > Key: CONNECTORS-1367 > URL: https://issues.apache.org/jira/browse/CONNECTORS-1367 > Project: ManifoldCF > Issue Type: Bug > Components: Alfresco webscript connector >Affects Versions: ManifoldCF 2.5 >Reporter: Chalitha Perera >Assignee: Karl Wright > Attachments: jstack5.out > > > Alfresco connector gets stuck when processing documents around 35,000 and > postgres manifold database in idle state and after days gets deadlock message > " > 2016-12-21 10:54:17.946 UTC >ERROR: deadlock detected > < 2016-12-21 10:54:17.946 UTC >DETAIL: Process 28072 waits for ShareLock on > transaction 432231; blocked by process 28038. > Process 28038 waits for ShareLock on transaction 432227; blocked by > process 28072. > Process 28072: UPDATE jobqueue SET > failtime=NULL,checktime=$1,failcount=NULL,checkaction=$2 WHERE jobid=$3 AND > (status=$4 OR status=$5) > Process 28038: SELECT needpriority FROM jobqueue WHERE id=$1 FOR UPDATE > < 2016-12-21 10:54:17.946 UTC >HINT: See server log for query details." > On separate note, ran ant load-pg and it was completed successfully. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
