With more than one executors on a node, the builds often go bad with "hudson.remoting.ChannelClosedException".

2020-04-05 Thread Fabio Marzotti 


With more than one executors on a node, the builds often go bad with 
"hudson.remoting.ChannelClosedException". When two different builds run 
togheter on two different executors, they go in failed state. Below you can 
see a log section. 

Instead if I set just  one executor on the same node, no problem at all.

I alsto tried these:

1) set the jvm option -Xmx1048m on the build but same problem!

2) remove the jvm option and double the ram (8gb) but same problem!

I'll really appreciate an help on this! Bye, Fabio

from build output:

Started by timerRunning as SYSTEMBuilding remotely on monauthbep01-auto in 
workspace /var/lib/jenkins/workspace/MONAUTH - INCAS - ISSUING - STANDIN 
[MONAUTH 
- INCAS - ISSUING - STANDIN] $ /bin/sh xe 
/tmp/jenkins5004094442920936653.shFATAL: Unable to delete script file 
/tmp/jenkins5004094442920936653.shjava.io.EOFException at 
java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2680)
 
at 
java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3155)
 
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:861) 
at java.io.ObjectInputStream.(ObjectInputStream.java:357) at 
hudson.remoting.ObjectInputStreamEx.(ObjectInputStreamEx.java:49) at 
hudson.remoting.Command.readFrom(Command.java:140) at 
hudson.remoting.Command.readFrom(Command.java:126) at 
hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:36)
 
at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)Caused:
 
java.io.IOException: Unexpected termination of the channel  
<-!!! at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)Caused:
 
hudson.remoting.ChannelClosedException: Channel "unknown": Remote call on 
monauthbep01-auto failed. The channel is closing down or has closed down

from journalctl:

Mar 26 10:36:00 monauthbep01 sshd[4891]: Received disconnect from 
10.102.132.70 port 47270:11: Closed due to user request. <--!!
Mar 26 10:36:00 monauthbep01 sshd[4891]: Disconnected from 10.102.132.70 
port 47270 <--!!
Mar 26 10:36:00 monauthbep01 sshd[4889]: pam_unix(sshd:session): session 
closed for user auto <--!!

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/897b5cf9-a611-43f5-8a80-322be0ff8f3f%40googlegroups.com.

[Jenkins Kubernetes Plugin] - hudson.remoting.ChannelClosedException: Channel "unknown": Remote call on JNLP4-connect connection from IP/IP:port failed. The channel is closing down or has closed dow

2019-11-01 Thread Eddie Mashayev 
Hey all, 

I have opened an issue in Jenkins project, but didn't get any help yet..
Maybe you can help me, link to the issue 
.

Pasting the issue from the link:


It happens frequently not something constant, which makes it very hard to 
debug.

This is my podTemplate:

podTemplate(containers: [
containerTemplate(
name: 'build',
image: 'my_builder:latest',
command: 'cat',
ttyEnabled: true,
workingDir: '/mnt/jenkins'
)
],
volumes: [
hostPathVolume(mountPath: '/var/run/docker.sock', hostPath: 
'/var/run/docker.sock'),
hostPathVolume(mountPath: '/mnt/jenkins', hostPath: '/mnt/jenkins')
],
yaml: """
spec:
 containers:
   - name: build
 resources:
   requests:
 cpu: "10"
 memory: "10Gi" 
 securityContext:
   fsGroup: 995
"""
)
{
node(POD_LABEL) {
stage("Checkout") {
}   
// more stages}
}

This is the log from the pod:

Inbound agent connected from IP/IP
Waiting for agent to connect (0/100): my_branch
Remoting version: 3.35
This is a Unix agent
Waiting for agent to connect (1/100): my_branch
Agent successfully connected and online
ERROR: Connection terminated
java.nio.channels.ClosedChannelException
at 
org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:154)
at 
org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:142)
at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:795)
at 
jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at 
jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

Logs from Jenkins "cat /var/log/jenkins/jenkins.log":

2019-10-08 14:40:48.171+ [id=287] WARNING 
o.c.j.p.k.KubernetesLauncher#launch: Error in provisioning; 
agent=KubernetesSlave name: branch_name, template=PodTemplate{, 
name='pod_name', namespace='default', label='label_name', 
nodeUsageMode=EXCLUSIVE, volumes=[HostPathVolume 
[mountPath=/var/run/docker.sock, hostPath=/var/run/docker.sock], HostPathVolume 
[mountPath=/mnt/jenkins, hostPath=/mnt/jenkins]], 
containers=[ContainerTemplate{name='build', image='my_builder', 
workingDir='/mnt/jenkins', command='cat', ttyEnabled=true, 
envVars=[KeyValueEnvVar [getValue()=deploy/.dazelrc, getKey()=RC_FILE]]}], 
annotations=[org.csanchez.jenkins.plugins.kubernetes.PodAnnotation@aab9c821]} 
io.fabric8.kubernetes.client.KubernetesClientTimeoutException: Timed out 
waiting for [10] milliseconds for [Pod] with name:[branch_name] in 
namespace [default]. at 
org.csanchez.jenkins.plugins.kubernetes.AllContainersRunningPodWatcher.await(AllContainersRunningPodWatcher.java:130)
 at 
org.csanchez.jenkins.plugins.kubernetes.KubernetesLauncher.launch(KubernetesLauncher.java:134)
 at hudson.slaves.SlaveComputer$1.call(SlaveComputer.java:297) at 
jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
 at 
jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 
at java.lang.Thread.run(Thread.java:748)


It seems to happen for other people as well, but there is no solution, can 
anyone help?


-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/5b400c6b-f62d-4285-8166-f5db8b541ec3%40googlegroups.com.

hudson.remoting.ChannelClosedException: channel is already closed caused by java.net.SocketException: Connection reset

2013-11-21 Thread Kishore RP 
Summary : 

We are seeing the below exception 

hudson.remoting.ChannelClosedException: channel is already closed 

Caused by: java.net.SocketException: Connection reset 

Any suggestions on how to fix it? 


Text of full exception below 

[21-11-2013 14:29:54] FATAL: channel is already closed 
[21-11-2013 14:29:54] hudson.remoting.ChannelClosedException: channel is 
already closed 
[21-11-2013 14:29:54] at hudson.remoting.Channel.send(Channel.java:516) 
[21-11-2013 14:29:54] at hudson.remoting.Request.call(Request.java:129) 
[21-11-2013 14:29:54] at hudson.remoting.Channel.call(Channel.java:714) 
[21-11-2013 14:29:54] at 
hudson.Launcher$RemoteLauncher.kill(Launcher.java:887) 
[21-11-2013 14:29:54] at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:609) 
[21-11-2013 14:29:54] at 
com.tikal.jenkins.plugins.multijob.MultiJobBuild$MultiJobRunnerImpl.run(MultiJobBuild.java:67)
 
[21-11-2013 14:29:54] at hudson.model.Run.execute(Run.java:1603) 
[21-11-2013 14:29:54] at hudson.model.Run.run(Run.java:1549) 
[21-11-2013 14:29:54] at 
com.tikal.jenkins.plugins.multijob.MultiJobBuild.run(MultiJobBuild.java:60) 
[21-11-2013 14:29:54] at 
hudson.model.ResourceController.execute(ResourceController.java:88) 
[21-11-2013 14:29:54] at hudson.model.Executor.run(Executor.java:247) 
[21-11-2013 14:29:54] Caused by: java.net.SocketException: Connection reset 
[21-11-2013 14:29:54] at java.net.SocketInputStream.read(Unknown Source) 
[21-11-2013 14:29:54] at java.net.SocketInputStream.read(Unknown Source) 
[21-11-2013 14:29:54] at java.io.BufferedInputStream.fill(Unknown Source) 
[21-11-2013 14:29:54] at java.io.BufferedInputStream.read(Unknown Source) 
[21-11-2013 14:29:54] at 
hudson.remoting.FlightRecorderInputStream.read(FlightRecorderInputStream.java:77)
 
[21-11-2013 14:29:54] at 
java.io.ObjectInputStream$PeekInputStream.peek(Unknown Source) 
[21-11-2013 14:29:54] at 
java.io.ObjectInputStream$BlockDataInputStream.peek(Unknown Source) 
[21-11-2013 14:29:54] at 
java.io.ObjectInputStream$BlockDataInputStream.peekByte(Unknown Source) 
[21-11-2013 14:29:54] at java.io.ObjectInputStream.readObject0(Unknown 
Source) 
[21-11-2013 14:29:54] at java.io.ObjectInputStream.readObject(Unknown 
Source) 
[21-11-2013 14:29:54] at hudson.remoting.Command.readFrom(Command.java:92) 
[21-11-2013 14:29:54] at 
hudson.remoting.ClassicCommandTransport.read(ClassicCommandTransport.java:71) 
[21-11-2013 14:29:54] at 
hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)

-- 
You received this message because you are subscribed to the Google Groups 
Jenkins Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

hudson.remoting.ChannelClosedException

2012-03-09 Thread Noah Hoffman 
Hi All,


 We're starting to see a few random slave-agent disconnects and I'm 
wondering if anyone has any info.  A search online doesn't reveal anything 
useful nor do the Jenkins logs or System logs.   We're running Jenkins build 
1.448 hosted on a Linux machine, the node is OSX 10.6.8.


Thanks in advance,

Noah




FATAL: channel is already closed
hudson.remoting.ChannelClosedExceptionhttp://stacktrace.jenkins-ci.org/search?query=hudson.remoting.ChannelClosedException:
 channel is already closed
at 
hudson.remoting.Channel.send(Channel.java:499)http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.sendentity=method
at 
hudson.remoting.Request.call(Request.java:110)http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Request.callentity=method
at 
hudson.remoting.Channel.call(Channel.java:681)http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel.callentity=method
at 
hudson.EnvVars.getRemote(EnvVars.java:202)http://stacktrace.jenkins-ci.org/search/?query=hudson.EnvVars.getRemoteentity=method
at 
hudson.model.Computer.getEnvironment(Computer.java:828)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Computer.getEnvironmententity=method
at 
hudson.model.Run.getEnvironment(Run.java:1849)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.getEnvironmententity=method
at 
hudson.model.AbstractBuild.getEnvironment(AbstractBuild.java:819)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild.getEnvironmententity=method
at 
org.jenkinsci.plugins.tokenmacro.impl.EnvironmentVariableMacro.evaluate(EnvironmentVariableMacro.java:23)http://stacktrace.jenkins-ci.org/search/?query=org.jenkinsci.plugins.tokenmacro.impl.EnvironmentVariableMacro.evaluateentity=method
at 
org.jenkinsci.plugins.tokenmacro.DataBoundTokenMacro.evaluate(DataBoundTokenMacro.java:177)http://stacktrace.jenkins-ci.org/search/?query=org.jenkinsci.plugins.tokenmacro.DataBoundTokenMacro.evaluateentity=method
at 
org.jenkinsci.plugins.tokenmacro.TokenMacro.expand(TokenMacro.java:160)http://stacktrace.jenkins-ci.org/search/?query=org.jenkinsci.plugins.tokenmacro.TokenMacro.expandentity=method
at 
org.jenkinsci.plugins.buildnamesetter.BuildNameSetter.setDisplayName(BuildNameSetter.java:47)http://stacktrace.jenkins-ci.org/search/?query=org.jenkinsci.plugins.buildnamesetter.BuildNameSetter.setDisplayNameentity=method
at 
org.jenkinsci.plugins.buildnamesetter.BuildNameSetter.access$000(BuildNameSetter.java:23)http://stacktrace.jenkins-ci.org/search/?query=org.jenkinsci.plugins.buildnamesetter.BuildNameSetter.access$000entity=method
at 
org.jenkinsci.plugins.buildnamesetter.BuildNameSetter$1.tearDown(BuildNameSetter.java:39)http://stacktrace.jenkins-ci.org/search/?query=org.jenkinsci.plugins.buildnamesetter.BuildNameSetter$1.tearDownentity=method
at 
hudson.model.Build$RunnerImpl.doRun(Build.java:150)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Build$RunnerImpl.doRunentity=method
at 
hudson.model.AbstractBuild$AbstractRunner.run(AbstractBuild.java:470)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.AbstractBuild$AbstractRunner.runentity=method
at 
hudson.model.Run.run(Run.java:1404)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Run.runentity=method
at 
hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.FreeStyleBuild.runentity=method
at 
hudson.model.ResourceController.execute(ResourceController.java:88)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.ResourceController.executeentity=method
at 
hudson.model.Executor.run(Executor.java:238)http://stacktrace.jenkins-ci.org/search/?query=hudson.model.Executor.runentity=method
Caused by: 
java.io.IOExceptionhttp://stacktrace.jenkins-ci.org/search?query=java.io.IOException:
 Unexpected termination of the channel
at 
hudson.remoting.Channel$ReaderThread.run(Channel.java:1133)http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel$ReaderThread.runentity=method
Caused by: java.io.EOFException
http://stacktrace.jenkins-ci.org/search?query=java.io.EOFExceptionat 
java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:2553)http://stacktrace.jenkins-ci.org/search/?query=java.io.ObjectInputStream$BlockDataInputStream.peekByteentity=method
at 
java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1296)http://stacktrace.jenkins-ci.org/search/?query=java.io.ObjectInputStream.readObject0entity=method
at 
java.io.ObjectInputStream.readObject(ObjectInputStream.java:350)http://stacktrace.jenkins-ci.org/search/?query=java.io.ObjectInputStream.readObjectentity=method
at 
hudson.remoting.Channel$ReaderThread.run(Channel.java:1127)http://stacktrace.jenkins-ci.org/search/?query=hudson.remoting.Channel