[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Dan Alvizu commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild good to hear, all credit to jpederzolli Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Sean McIntyre commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Great, Dan Alvizu. Our Jenkins page load times fell from 2s to 20ms with the upgrade to 1.5.6. Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Dan Alvizu commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild 1.5.6 included this fix: https://github.com/jenkinsci/build-pipeline-plugin/pull/88 Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Dan Alvizu commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Fixed in 1.5.6 Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Sean McIntyre commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Hi there, I wanted to chime in and let everyone know we are having a similar issue with our Jenkins setup using the Pipeline plug-in. Each page load in Jenkins was approaching 11s, which is unacceptable for our CI pipeline and causing friction on our team. I found that this was the issue by sampling the Java stack every second during a GET request, here are the results in a gist. I saw the common denominator of each sample was the BuildUtil.getDownstreamBuild, and found this ticket. We have 7 pipelines in our installation, each having about 6 jobs, and most of those jobs having 1-3K builds in their histories. I purged the histories of these pipelines, reducing their histories to about 300 each (total 60K -> 17K), and Jenkins pageloads are now 2s. I had to do a Jenkins restart after the purges. We are running Build Pipeline Plugin 1.5.4 and Jenkins 2.30. Thanks! Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Andrew Buckles commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Hi, a bit more information here with regards to the pipeline we are having issues with. Total number of potential jobs for the pipeline is 17... however, each one of those jobs has a range of build history in the thousands (some 8-9K, some 5K and others have 1-2K). The pipeline is configured to only show the last 100 builds, however, will Jenkins still attempt to load all of the build history for each of the jobs involved in the pipeline? For instance, what we observe with a standard job is that Jenkins will take a significant amount of time to load a job page if there are 8000 builds in the build history versus 100-200. Even though Jenkins won't display all of the build history, it still seems to load all of them into memory. Does the pipeline job loading/rendering do a similar style of data fetch for each job in the pipeline? Thanks, Andy Buckles Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Audrey Azra commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Steven Christou: Any news or workaround on this issue? Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title J F commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild There are ~280 builds, and 50 pipelines, with varying numbers of build jobs each. (Answering on behalf of Dilip) Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Steven Christou commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Dilip M How many builds are currently in your pipeline view, and how many pipelines are you currently displaying? A large part of the performance issue also revolves around the number of pipeline runs that are being displayed. Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Dilip M commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Hi, Any news or workaround for this please? Thanks! Dilip Mahadevappa Add Comment This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c) -- You received this message because you are subscribed to the Google Groups "Jenkins Issues" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title Dilip M commented on JENKINS-34722 Re: Unbounded searches with BuildUtil.getDownstreamBuild Here is the threadump on multiple http requests for Build Pipe line view. Client #1: 142.133.110.108 Cleint #2: 142.133.185.30 "Handling GET /jenkins/view/RadioSW/view/40%C2%B0%20Wash%20Pipeline/ from 142.133.110.108 : http-bio-8443-exec-124 View/index.jelly View/sidepanel.jelly" daemon prio=10 tid=0x7f379016f000 nid=0x6d90 waiting for monitor entry [0x7f3778ec9000] java.lang.Thread.State: BLOCKED (on object monitor) at jenkins.model.lazy.AbstractLazyLoadRunMap.load(AbstractLazyLoadRunMap.java:465) - waiting to lock <0x7f38a8dcac70> (a hudson.model.RunMap) at jenkins.model.lazy.AbstractLazyLoadRunMap.load(AbstractLazyLoadRunMap.java:448) at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:356) at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:332) at jenkins.model.lazy.LazyLoadRunMapEntrySet$1.next(LazyLoadRunMapEntrySet.java:74) . . . "Handling GET /jenkins/view/RadioSW/view/40%C2%B0%20Wash%20Pipeline/ from 142.133.185.30 : http-bio-8443-exec-97 View/index.jelly View/sidepanel.jelly NextExecutionsWidget/index.jelly" daemon prio=10 tid=0x7f3784219000 nid=0x5e0d waiting for monitor entry [0x7f37704be000] java.lang.Thread.State: BLOCKED (on object monitor) at com.thoughtworks.xstream.core.DefaultConverterLookup.lookupConverterForType(DefaultConverterLookup.java:49) - locked <0x7f38a9c96380> (a com.thoughtworks.xstream.core.DefaultConverterLookup) at com.thoughtworks.xstream.XStream$1.lookupConverterForType(XStream.java:498) at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:56) at com.thoughtworks.xstream.core.TreeUnmarshaller.convertAnother(TreeUnmarshaller.java:50) at com.thoughtworks.xstream.converters.reflection.SerializableConverter$2.readFromStream(SerializableConverter.java:340) at com.thoughtworks.xstream.core.util.CustomObjectInputStream.readObjectOverride(CustomObjectInputStream.java:120) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:364) at java.util.TreeMap.buildFromSorted(TreeMap.java:2403) at java.util.TreeMap.buildFromSorted(TreeMap.java:2418) at java.util.TreeMap.buildFromSorted(TreeMap.java:2418) at java.util.TreeMap.buildFromSorted(TreeMap.java:2418) at java.util.TreeMap.buildFromSorted(TreeMap.java:2418) at java.util.TreeMap.buildFromSorted(TreeMap.java:2386) at java.util.TreeMap.buildFromSorted(TreeMap.java:2418) at java.util.TreeMap.buildFromSorted(TreeMap.java:2418) at java.util.TreeMap.buildFromSorted(TreeMap.java:2344) at java.util.TreeMap.readObject(TreeMap.java:2290) at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.thoughtworks.xstream.converters.reflection.SerializationMethodInvoker.callReadObject(SerializationMethodInvoker.java:114) at com.thoughtworks.xstream.converters.reflection.SerializableConverter.doUnmarshal(SerializableConverter.java:454) at com.thoughtworks.xstream.converters.reflection.AbstractReflectionConverter.unmarshal(AbstractReflectionConverter.java:257) at com.thoughtworks.xstream.core.TreeUnmarshaller.convert(TreeUnmarshaller.java:72) at com.thoughtworks.xstream.core.AbstractReferenceUnmarshaller.convert(AbstractReferenceUnmarshaller.java:65) at com.
[JIRA] (JENKINS-34722) Unbounded searches with BuildUtil.getDownstreamBuild
Title: Message Title
Dilip M commented on JENKINS-34722
Re: Unbounded searches with BuildUtil.getDownstreamBuild
Hi, Unfortunately we are not seeing any performance improvements . We upgraded to 1.5.3.1 version of plugin and set the System property using the groovy script console. Core: 1.642.1 https://JENKINS_URL/script System.setProperty('au.com.centurmsystems.hudson.plugin.util.BuildUtil.MAX_DOWNSTREAM_DEPTH', '3') It takes 10+ mins to initialize the Build Pipe line page. Here is the few threadDumps taken during various stages…until the build-pipe-line view finally rendered. Let me know if you need more logging... Snapshot 1:
"Handling GET /jenkins/view/RadioSW/view/40%C2%B0%20Wash%20Pipeline/ from 142.133.110.108 : http-bio-8443-exec-114 View/index.jelly" daemon prio=10 tid=0x7f3790168000 nid=0x507c runnable [0x7f376fcb8000]
java.lang.Thread.State: RUNNABLE
at java.util.AbstractList$Itr.hasNext(AbstractList.java:351)
at java.util.AbstractCollection.toArray(AbstractCollection.java:139)
at java.util.ArrayList.(ArrayList.java:164)
at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:326)
at jenkins.model.lazy.LazyLoadRunMapEntrySet$1.next(LazyLoadRunMapEntrySet.java:74)
at jenkins.model.lazy.LazyLoadRunMapEntrySet$1.next(LazyLoadRunMapEntrySet.java:63)
at java.util.AbstractMap$2$1.next(AbstractMap.java:385)
at hudson.util.Iterators$9.fetch(Iterators.java:383)
at hudson.util.Iterators$9.hasNext(Iterators.java:369)
at au.com.centrumsystems.hudson.plugin.util.BuildUtil.getDownstreamBuild(BuildUtil.java:80)
at au.com.centrumsystems.hudson.plugin.buildpipeline.PipelineBuild.getDownstreamPipeline(PipelineBuild.java:189)
at au.com.centrumsystems.hudson.plugin.buildpipeline.BuildForm.(BuildForm.java:90)
at au.com.centrumsystems.hudson.plugin.buildpipeline.BuildForm.(BuildForm.java:74)
at au.com.centrumsystems.hudson.plugin.buildpipeline.DownstreamProjectGridBuilder$GridImpl$1$1.adapt(DownstreamProjectGridBuilder.java:117)
at au.com.centrumsystems.hudson.plugin.buildpipeline.DownstreamProjectGridBuilder$GridImpl$1$1.adapt(DownstreamProjectGridBuilder.java:114)
at hudson.util.AdaptedIterator.next(AdaptedIterator.java:54)
at com.google.common.collect.Iterators$9.next(Iterators.java:969)
at com.google.common.collect.Lists.newArrayList(Lists.java:139)
at com.google.common.collect.Iterables.toCollection(Iterables.java:315)
at com.google.common.collect.Iterables.toArray(Iterables.java:293)
at au.com.centrumsystems.hudson.plugin.buildpipeline.BuildPipelineForm.(BuildPipelineForm.java:40)
at au.com.centrumsystems.hudson.plugin.buildpipeline.BuildPipelineView.getBuildPipelineForm(BuildPipelineView.java:360)
at au.com.centrumsystems.hudson.plugin.buildpipeline.BuildPipelineView.getItems(BuildPipelineView.java:814)
at au.com.centrumsystems.hudson.plugin.buildpipeline.BuildPipelineView.hasPermission(BuildPipelineView.java:882)
at hudson.Functions.hasPermission(Functions.java:791)
at sun.reflect.GeneratedMethodAccessor157.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.commons.jexl.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:258)
at org.apache.commons.jexl.parser.ASTMethod.execute(ASTMethod.java:104)
at org.apache.commons.jexl.parser.ASTReference.execute(ASTReference.java:83)
at org.apache.commons.jexl.parser.ASTReference.value(ASTRefe
