[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe updated an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Change By: James Howe Priority: Major Minor Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe commented on JENKINS-28532 Re: Jobs get stuck in the queue I disabled hudson.tasks.Fingerprinter.enableFingerprintsInDependencyGraph, which I had not realised had been set. No further problems. I suspect it's purely using the timestamp of a fingerprint rather than any other relationship, which lead to my nonsensical dependencies. Perhaps there should be a way to detect these cycles, to remove the offending fingerprint, or to override the detected dependency. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title Daniel Beck commented on JENKINS-28532 Re: Jobs get stuck in the queue James Howe Could you explain how to reproduce the issue on a new Jenkins instance? Even if that happened, there should be a user-visible explanation of the behavior. ??? isn't exactly helpful. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe commented on JENKINS-28532 Re: Jobs get stuck in the queue Not easily, this instance has been up for many years, and anything could have happened to mix up the fingerprints. There are also two different cases I've detailed above. The one with the blank reason, and the one with ???. Each has a different workaround to recover. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe commented on JENKINS-28532 Re: Jobs get stuck in the queue I think the non-fixable blocking may be due to a detected circular dependency. Job A has job B listed as upstream, but job B should actually be a few layers downstream of job A. Both jobs, and all jobs downstream and in-between, are blocked with no message. This would have been computed using historical fingerprints? Any way to sort this out? At the moment I just have to cancel them all and manually trigger the bottom one. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title Magnus Sandberg commented on JENKINS-28532 Re: Jobs get stuck in the queue The log-line you have is telling us that the jenkins-core has changed status of the Job to BLOCKED - not more than that. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe commented on JENKINS-28532 Re: Jobs get stuck in the queue Got stuck with a blank status, and a config save no longer pushes them though. Maybe there are two related issues here. May 28, 2015 2:12:32 PM FINE PrioritySorter.Queue.Items Blocking: Id: 1093, JobName: MyJob, jobGroupId: 1, reason: none, priority: 4, weight: 5.997E-4, status: BLOCKED Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe updated an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Change By: James Howe Priority: Minor Major Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe edited a comment on JENKINS-28532 Re: Jobs get stuck in the queue - Doesn'tappeartohavegottenstuckagainsincethen. -Jobsgotstuckagainforafewhours.Fewerthanbefore.Thistimeclickingononeofthemwasenoughtohavethemimmediatelyexecute. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe updated an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Change By: James Howe Priority: Major Minor Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe commented on JENKINS-28532 Re: Jobs get stuck in the queue Doesn't appear to have gotten stuck again since then. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe updated an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Change By: James Howe Component/s: prioritysorter-plugin Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe commented on JENKINS-28532 Re: Jobs get stuck in the queue Downgraded plugin to 2.12. Restarted. Dependency graph errors not seen. Items already stuck in queue went through, though a few hours later they were stuck again. Status now shows as (pending—???) Manually deleted from disk fingerprints that mentioned jobs I'd recently deleted. Reloaded. As above. Opened and saved the config of a job that was stuck without making changes. Immediately all jobs that were stuck began executing. Became stuck again later. Unconfirmed if exactly the same jobs. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe edited a comment on JENKINS-28532 Re: Jobs get stuck in the queue Downgradedpluginto2.12.Restarted.Dependencygrapherrorsnotseen.Itemsalreadystuckinqueuewentthrough,thoughafewhourslatertheywerestuckagain.Statusnowshowsas(pending—???)ManuallydeletedfromdiskfingerprintsthatmentionedjobsI'drecentlydeleted.Reloaded.Asabove.Openedandsavedtheconfigofajobthatwasstuckwithoutmakingchanges.Immediatelyalljobsthatwerestuckbeganexecuting. Became Nexttimethejobcamethroughthequeue,itandsomeothersgot stuckagain later . Unconfirmedifexactlythesamejobs. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title Magnus Sandberg commented on JENKINS-28532 Re: Jobs get stuck in the queue PrioritySorter will only order the Jobs in the Queue and will not interfere with execution/scheduling (if you do not use Run Exclusive) so this does look like a problem somewhere else. Totally of the topic: You are the first one I see that uses anything else besides Absolute sorting - I would be happy if you can share your thought on the Queueing strategy, feel free to email me. Thanks, Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe created an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Issue Type: Bug Assignee: Magnus Sandberg Components: core, prioritysorter-plugin Created: 21/May/15 4:06 PM Environment: Jenkins 1.611, prioritysorter 3.2 Priority: Minor Reporter: James Howe Unknown if core or plugin issue. Had a group of jobs stuck waiting in the queue. Hovering over them shows triggers and wait time as usual, but no indication of what they're waiting for. May 21, 2015 4:43:19 PM hudson.util.DescribableList buildDependencyGraph SEVERE: Failed to build dependency graph for hudson.model.FreeStyleProject@57fdabe[MyStuckJob] java.lang.NullPointerException at hudson.tasks.Fingerprinter$FingerprintAction.getFingerprints(Fingerprinter.java:373) at hudson.tasks.Fingerprinter$FingerprintAction.getDependencies(Fingerprinter.java:403) at hudson.tasks.Fingerprinter$FingerprintAction.getDependencies(Fingerprinter.java:390) at hudson.tasks.Fingerprinter.buildDependencyGraph(Fingerprinter.java:157) at hudson.util.DescribableList.buildDependencyGraph(DescribableList.java:219) at hudson.model.Project.buildDependencyGraph(Project.java:207) at hudson.model.DependencyGraph.build(DependencyGraph.java:95) at jenkins.model.Jenkins.rebuildDependencyGraph(Jenkins.java:3748) at jenkins.model.Jenkins$25.call(Jenkins.java:3770) at
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe updated an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Change By: James Howe Unknownifcoreorpluginissue.Hadagroupofjobsstuckwaitinginthequeue.Hoveringoverthemshowstriggersandwaittimeasusual,butnoindicationofwhatthey'rewaitingfor. Suspiciouslogentry: May21,20154:43:19PMhudson.util.DescribableListbuildDependencyGraphSEVERE:Failedtobuilddependencygraphforhudson.model.FreeStyleProject@57fdabe[MyStuckJob]java.lang.NullPointerExceptionathudson.tasks.Fingerprinter$FingerprintAction.getFingerprints(Fingerprinter.java:373)athudson.tasks.Fingerprinter$FingerprintAction.getDependencies(Fingerprinter.java:403)athudson.tasks.Fingerprinter$FingerprintAction.getDependencies(Fingerprinter.java:390)athudson.tasks.Fingerprinter.buildDependencyGraph(Fingerprinter.java:157)athudson.util.DescribableList.buildDependencyGraph(DescribableList.java:219)athudson.model.Project.buildDependencyGraph(Project.java:207)athudson.model.DependencyGraph.build(DependencyGraph.java:95)atjenkins.model.Jenkins.rebuildDependencyGraph(Jenkins.java:3748)atjenkins.model.Jenkins$25.call(Jenkins.java:3770)atjenkins.model.Jenkins$25.call(Jenkins.java:3766)atjava.util.concurrent.FutureTask.run(FutureTask.java:262)atjava.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)atjava.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)atjava.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)atjava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)atjava.lang.Thread.run(Thread.java:745)Possiblycausedbydeletingsomeotherjobs-theyweren'tsupposedtobeinthedependencytree,butcoincidentallyincludedidenticalfilesthatwerefingerprintedatsomepoint.QueuingstrategyisWeightedFairQueuing.Weren'tinthequeueonstartup,unlesslackofJENKINS-28486pullingtheminwouldcount. Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)
[JIRA] [core] (JENKINS-28532) Jobs get stuck in the queue
Title: Message Title James Howe updated an issue Jenkins / JENKINS-28532 Jobs get stuck in the queue Change By: James Howe Priority: Minor Major Add Comment This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265) -- You received this message because you are subscribed to the Google Groups Jenkins Issues group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.