Remote logging Kubernetes agents dying due to channel closed exception

[Andrew Feller]

We've been trying to troubleshoot OpenShift-support
 Jenkins
Kubernetes agents terminating due to closed channel exceptions and reaching
for straws here.  We're considering enabling remote logging
 as a
last ditch effort to debug what is going on within the JNLP container,
however I'm not sure how configuring -workDir
 should
take into account ephemeral Kubernetes pods for agents.

Any help would be appreciated!
-- 

[image: BandwidthMaroon.png]

Andy Feller  •  Sr DevOps Engineer

900 Main Campus Drive, Suite 500, Raleigh, NC 27606


e: afel...@bandwidth.com

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/CAAg6KNENkQCCMSP4%2BOp99rxbcyGeSSjUA4-Fv_o8i1N4gsiJWQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Using variables or closures to define pipeline agent

[Andrew Feller]

Is there any way to use a variable or closure to configure a pipeline's
agent?

We have cases where a pipeline has to run on a VM and others when it runs
on Kubernetes, however we don't want to duplicate the entire pipeline.  All
of the documentation shows this as being hardcoded
 and our attempts to
define variables using closures to configure it failed.
-- 

[image: BandwidthMaroon.png]

Andy Feller  •  Sr DevOps Engineer

900 Main Campus Drive, Suite 500, Raleigh, NC 27606


e: afel...@bandwidth.com

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/CAAg6KNHXyALEGh_krdFf7pkcxOQHE%3DrWfr_mdBPVUiaepVg7-g%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Kubernetes-based Jenkins worker pipeline fails because it hasn't started yet error

[Andrew Feller]

I'm using Jenkins on OpenShift with the kubernetes plugin for creating
Jenkins workers.  Occasionally we get the following error whenever the
pipeline first runs but can't explain what is going on; simply rerun it and
the 2nd time will work.

Many thanks for someone who can point out to what is going on as I really
hate explaining to people it's a stupid bug we don't know enough to fix.
Kind of erodes people's confidence in both my team and Jenkins.

[Pipeline] properties[Pipeline] End of Pipelinejava.io.IOException:
.../... #1 did not yet start
at 
org.jenkinsci.plugins.workflow.job.WorkflowRun$Owner.get(WorkflowRun.java:1104)
at 
org.jenkinsci.plugins.workflow.multibranch.JobPropertyStep$Execution.run(JobPropertyStep.java:104)
at 
org.jenkinsci.plugins.workflow.multibranch.JobPropertyStep$Execution.run(JobPropertyStep.java:84)
at 
org.jenkinsci.plugins.workflow.steps.AbstractSynchronousStepExecution.start(AbstractSynchronousStepExecution.java:42)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeStep(DSL.java:229)
at org.jenkinsci.plugins.workflow.cps.DSL.invokeMethod(DSL.java:153)
at 
org.jenkinsci.plugins.workflow.cps.CpsScript.invokeMethod(CpsScript.java:122)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1213)
at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1022)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:42)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:48)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:113)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:157)
at 
org.kohsuke.groovy.sandbox.GroovyInterceptor.onMethodCall(GroovyInterceptor.java:23)
at 
org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:133)
at 
org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.SandboxInterceptor.onMethodCall(SandboxInterceptor.java:120)
at org.kohsuke.groovy.sandbox.impl.Checker$1.call(Checker.java:155)
at org.kohsuke.groovy.sandbox.impl.Checker.checkedCall(Checker.java:159)
at 
com.cloudbees.groovy.cps.sandbox.SandboxInvoker.methodCall(SandboxInvoker.java:17)
at 
pipelineUtils.applyCommonProperties(/var/lib/jenkins/jobs/vps-cgaertner-test/jobs/vps-cgaertner-test-deployment/builds/2/libs/pipeline-utils/vars/pipelineUtils.groovy:121)
at 
bwPipeline.call(/var/lib/jenkins/jobs/vps-cgaertner-test/jobs/vps-cgaertner-test-deployment/builds/2/libs/pipeline-utils/vars/bwPipeline.groovy:238)
at 
bwJavaPipeline.call(/var/lib/jenkins/jobs/vps-cgaertner-test/jobs/vps-cgaertner-test-deployment/builds/2/libs/pipeline-utils/vars/bwJavaPipeline.groovy:136)
at WorkflowScript.run(WorkflowScript:117)
at ___cps.transform___(Native Method)
at 
com.cloudbees.groovy.cps.impl.ContinuationGroup.methodCall(ContinuationGroup.java:57)
at 
com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:109)
at 
com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.fixArg(FunctionCallBlock.java:82)
at sun.reflect.GeneratedMethodAccessor402.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at 
com.cloudbees.groovy.cps.impl.CollectionLiteralBlock$ContinuationImpl.dispatch(CollectionLiteralBlock.java:55)
at 
com.cloudbees.groovy.cps.impl.CollectionLiteralBlock$ContinuationImpl.item(CollectionLiteralBlock.java:45)
at sun.reflect.GeneratedMethodAccessor401.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
com.cloudbees.groovy.cps.impl.ContinuationPtr$ContinuationImpl.receive(ContinuationPtr.java:72)
at 
com.cloudbees.groovy.cps.impl.ContinuationGroup.methodCall(ContinuationGroup.java:60)
at 
com.cloudbees.groovy.cps.impl.FunctionCallBlock$ContinuationImpl.dispatchOrArg(FunctionCallBlock.java:109)
at 

Troubleshooting deadlocking between Jenkins plugins

[Andrew Feller]

Appreciate any thoughts on how to address these:

Found one Java-level deadlock:

=

"RMI TCP Connection(39)-172.23.4.92":

  waiting to lock monitor 0x7feae80062c8 (object 0xebbd7358, a
java.util.logging.StreamHandler),

  which is held by "GitSCM.onLoaded"

"GitSCM.onLoaded":

  waiting to lock monitor 0x7fec500106a8 (object 0xc06d2bf8, a
hudson.util.MaskingClassLoader),

  which is held by "ReplayAction.ensurePermissionRegistered"

"ReplayAction.ensurePermissionRegistered":

  waiting to lock monitor 0x7feae80062c8 (object 0xebbd7358, a
java.util.logging.StreamHandler),

  which is held by "GitSCM.onLoaded"

-- 

[image: BandwidthMaroon.png]

Andy Feller  •  Sr DevOps Engineer

900 Main Campus Drive, Suite 500, Raleigh, NC 27606


e: afel...@bandwidth.com

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/CAAg6KNFFHOpPOmv2qReL_xC5U8ug4rbzLgcUO319JQtKbajWtg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Subscribe

[Andrew Feller]

-- 

[image: BandwidthMaroon.png]

Andy Feller  •  Sr DevOps Engineer

900 Main Campus Drive, Suite 500, Raleigh, NC 27606


e: afel...@bandwidth.com

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/CAAg6KNGBLwMoW6CD2oSNGB3%2B-PhsnsRvQF%3DgpTsgn5Fst9MsPQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.