This is a serious blocker to autoscaling jenkins workers. Pretty much any slave that comes us has a random chance of being non-functional. It's a nightmare with as little as 10 workers.

This happens constantly. I've tried "Force polling using workspace." I've tried changing from SSH to https and back. It's a constant and serious problem with no workaround.

A bit about our setup.

We're using ubuntu 12.04 precise servers provisioned with puppet using system packages. We deploy the swarm plugin jar and configure that to start on startup. We then create an ami (amazon machine image) and deploy our workers to an auto-scaling group with 10 workers. Thus we are using system git and java 7, with the version of java matching on the jenkins and slave side. I don't have a way to reproduce this other than "deploy 10 or more workers, and start a bunch of jobs at the same time." It breaks non deterministically.

Here is our full log:

Started by upstream project "qa-us-east-1-minted.package_all" build number 41
originally caused by:
Started by upstream project "qa-us-east-1-minted.push_workflow" build number 49
originally caused by:
Started by user danielr
[EnvInject] - Loading node environment variables.
[EnvInject] - Preparing an environment for the build.
[EnvInject] - Keeping Jenkins system variables.
[EnvInject] - Keeping Jenkins build variables.
[EnvInject] - Injecting as environment variables the properties content
app=mbo
deploy_user=jenkins

[EnvInject] - Variables injected successfully.
[EnvInject] - Injecting contributions.
Building remotely on minted_slave-minted_slave-i-7139f28b (minted_slave swarm) in workspace /local/workspace/qa-us-east-1-minted.package_mbo
[ssh-agent] Using credentials jenkins (jenkins puppet deployment key)
[ssh-agent] Using credentials minted (minted private key – id_rsa.minted)
[ssh-agent] Using credentials ubuntu (legacy admin private key minted-ec2.pem)
[ssh-agent] Looking for ssh-agent implementation...
[ssh-agent] Java/JNR ssh-agent
[ssh-agent] Started.
FATAL: argument type mismatch
java.lang.IllegalArgumentException: argument type mismatch
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:274)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:255)
at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:215)
at hudson.remoting.UserRequest.perform(UserRequest.java:118)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:287)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at hudson.remoting.Engine$1$1.run(Engine.java:60)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to minted_slave-minted_slave-i-7139f28b(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:221)
at hudson.remoting.Channel.call(Channel.java:752)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:179)
at com.sun.proxy.$Proxy65.addCredentials(Unknown Source)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl.addCredentials(RemoteGitImpl.java:197)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:581)
at hudson.plugins.git.GitSCM.createClient(GitSCM.java:558)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:874)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1265)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:622)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:528)
at hudson.model.Run.execute(Run.java:1759)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:89)
at hudson.model.Executor.run(Executor.java:240)

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators.
For more information on JIRA, see: http://www.atlassian.com/software/jira

--
You received this message because you are subscribed to the Google Groups "Jenkins Issues" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-issues+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to