[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14611743#comment-14611743 ] Andrija Panic commented on CLOUDSTACK-7566: --- Rohit, is this maybe backported to 4.3.x ? I have this issue on 4.3.2 release... Thanks Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Assignee: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233521#comment-14233521 ] ASF subversion and git services commented on CLOUDSTACK-7566: - Commit 835abe6c7c98fd3db6af65597d0c7e9c48bb034e in cloudstack's branch refs/heads/master from [~rohit.ya...@shapeblue.com] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=835abe6 ] Revert CLOUDSTACK-7566:Many jobs getting stuck in pending state and cloud is unusable. This reverts commit 6df38427cffe9cab5a2a842571941a97a3a07b52. Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Assignee: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224554#comment-14224554 ] Rohit Yadav commented on CLOUDSTACK-7566: - ping [~minchen07] should we backport this to 4.3 ? Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Assignee: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208173#comment-14208173 ] ASF subversion and git services commented on CLOUDSTACK-7566: - Commit 6df38427cffe9cab5a2a842571941a97a3a07b52 in cloudstack's branch refs/heads/master from [~minchen07] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=6df3842 ] CLOUDSTACK-7566:Many jobs getting stuck in pending state and cloud is unusable. (cherry picked from commit a2d85c8cae5f603bbcfcd3659c1207f0bfe461a7) Signed-off-by: Rohit Yadav rohit.ya...@shapeblue.com Conflicts: framework/jobs/src/org/apache/cloudstack/framework/jobs/impl/AsyncJobManagerImpl.java Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Assignee: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208179#comment-14208179 ] Rohit Yadav commented on CLOUDSTACK-7566: - Should we backport the fix to 4.3 and 4.4 branches as well? Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Assignee: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136374#comment-14136374 ] ASF subversion and git services commented on CLOUDSTACK-7566: - Commit a2d85c8cae5f603bbcfcd3659c1207f0bfe461a7 in cloudstack's branch refs/heads/master from [~minchen07] [ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=a2d85c8 ] CLOUDSTACK-7566:Many jobs getting stuck in pending state and cloud is unusable. Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CLOUDSTACK-7566) Many jobs getting stuck in pending state and cloud is unusable
[ https://issues.apache.org/jira/browse/CLOUDSTACK-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136380#comment-14136380 ] Min Chen commented on CLOUDSTACK-7566: -- Guard all potential unhandled exception in MessageBus gate.enter and gate.leave routine to avoid potential lock holdup. Since each API will invoke messageBus to publish event, any potential lock holdup will make jobs pending in the system and render cloud unusable. Many jobs getting stuck in pending state and cloud is unusable -- Key: CLOUDSTACK-7566 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7566 Project: CloudStack Issue Type: Bug Security Level: Public(Anyone can view this level - this is the default.) Components: Management Server Affects Versions: 4.3.0 Reporter: Min Chen Priority: Blocker Fix For: 4.5.0 Many jobs are getting stuck with errors like: 2014-09-09 18:55:41,964 WARN [jobs.impl.AsyncJobMonitor] (Timer-1:ctx-1e7a8a7e) Task (job-355415) has been pending for 690 seconds Even jobs that apparently succeed are getting the same error. Async job table is not updated with complete even though job is completed. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
