Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
Just to summarize for those in the future who might run into this issue.
Discussed with Darragh over IRC and he came up with a fix for this issue
[1]. Once the patch is merged it should be available in the next release.
In the meantime if you encounter this issue the workaround is to pass the
"-o /path/to/dir" option to the test command to redirect the output to a
directory.
Thanh
[1] https://review.openstack.org/265959
On 11 January 2016 at 12:51, Darragh Bailey wrote:
> Hi Thanh
>
> On 11 January 2016 at 16:03, Thanh Ha
> wrote:
> > Hi Darragh,
> >
> > The extremely strange thing about this one is I've only been able to
> > reproduce it in Jenkins. So imagine having JJB installed on the same
> server
> > as your Jenkins instance or slave. If you ssh to the machine and run JJB
> on
> > the commandline it works. Create a job running on the same system and
> > Jenkins will see the failure in console logs.
> >
> > In case it helps with reproducing. The git repo I've been using to
> reproduce
> > this error is this one:
> >
> > https://git.opendaylight.org/gerrit/#/admin/projects/releng/builder
> >
> > After cloning this repo run "jenkins-jobs test -r jjb/".
> >
> > Regards,
> >
> > Thanh
> >
> >
>
> This triggered a suspicion with me that it wasn't anything to do with
> the project, and it's something to do with how jenkins is reading the
> console output from processes which causes python to use a different
> object for stdout.
>
> I managed to reproduce by creating a local pipe, tailed from that in
> one terminal and run the above command in another and redirecting the
> output into the pipe.
>
> term 1:
> mkfifo /tmp/test_jjb_output_to_pipe
> tail -f /tmp/test_jjb_output_to_pipe
>
> term 2:
> jenkins-jobs test -r builder/jjb > /tmp/test_jjb_output_to_pipe
>
>
> However on closer examination of the code, I suspect that the
> following piece is a little stupid and is causing the problem. Quite
> why it works some of the time and doesn't fail consistently has me
> stumped.
>
> if output:
> for job in self.parser.xml_jobs:
> if hasattr(output, 'write'):
> # `output` is a file-like object
> logger.info("Job name: %s", job.name)
> logger.debug("Writing XML to '{0}'".format(output))
> output = utils.wrap_stream(output)
> try:
> output.write(job.output())
> except IOError as exc:
> if exc.errno == errno.EPIPE:
> # EPIPE could happen if piping output to
> something
> # that doesn't read the whole input (e.g.: the
> UNIX
> # `head` command)
> return
> raise
> continue
>
> This ends up wrapping the object on each an every loop iteration, so
> if it's writing to stdout it wraps the output many, many times. I'm
> going to fix that.
>
> The reason why it may only occur when using a named pipe possibly has
> something to do with the object writing to it not being able to set
> the encoding, so therefore it keeps trying to wrap it with
> "codecs.EncodedFile(stream, encoding, stream_enc)", where as for
> normal pipes and stdout, the encoding is set and read correctly and
> therefore it just returns the stream on subsequent iterations.
>
> Wrapping a StreamReader from codecs with a subsequent StreamReader
> object, would eventually result in the getattr call hitting the
> recursion limit as it tries to find the base object attribute to read.
>
>
> Should be able to knock together a sensible solution relatively easily.
>
>
> --
> Darragh Bailey
> "Nothing is foolproof to a sufficiently talented fool"
>
___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
Btw, as a very dirty hack the following might work within the jenkins job: jenkins-jobs test -r builder/jjb 2>&1 | cat On 11 January 2016 at 17:49, Thanh Ha wrote: > On 11 January 2016 at 11:03, Thanh Ha wrote: >> >> On 9 January 2016 at 07:10, Darragh Bailey >> wrote: >>> >>> On 8 Jan 2016 21:47, "Thanh Ha" wrote: >>> >>> > >>> > (I truncated some of the repetitive output below) >>> > >>> > I just tried with the -o argument and seems like it passes. I guess it >>> > only affects stdout output, good to know. >>> > >>> > We're using python 2.7.5 in production. I did some testing today with >>> > Python 3.4.3 and it seems the 3.4.x stream at least doesn't run into this >>> > issue so I'm guessing this only affects Python 2.7.x. >>> >>> I wonder if it's something that occurs with earlier 2.7 releases, I >>> thought I checked that behavior out on 2.7.9 >>> >>> I'll look to check with pyenv on Monday to go over a few python versions. >> >> >> Hi Darragh, >> >> The extremely strange thing about this one is I've only been able to >> reproduce it in Jenkins. So imagine having JJB installed on the same server >> as your Jenkins instance or slave. If you ssh to the machine and run JJB on >> the commandline it works. Create a job running on the same system and >> Jenkins will see the failure in console logs. >> >> In case it helps with reproducing. The git repo I've been using to >> reproduce this error is this one: >> >> https://git.opendaylight.org/gerrit/#/admin/projects/releng/builder >> >> After cloning this repo run "jenkins-jobs test -r jjb/". > > > > I just tested this with Python 2.7.9 and confirm the issue still persists > for me even with 2.7.9. You can see my test here: > > https://jenkins.opendaylight.org/sandbox/job/thanh-test/7/console > > Regards, > > Thanh > > ___ > OpenStack-Infra mailing list > OpenStack-Infra@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra > -- Darragh Bailey "Nothing is foolproof to a sufficiently talented fool" ___ OpenStack-Infra mailing list OpenStack-Infra@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
Hi Thanh
On 11 January 2016 at 16:03, Thanh Ha wrote:
> Hi Darragh,
>
> The extremely strange thing about this one is I've only been able to
> reproduce it in Jenkins. So imagine having JJB installed on the same server
> as your Jenkins instance or slave. If you ssh to the machine and run JJB on
> the commandline it works. Create a job running on the same system and
> Jenkins will see the failure in console logs.
>
> In case it helps with reproducing. The git repo I've been using to reproduce
> this error is this one:
>
> https://git.opendaylight.org/gerrit/#/admin/projects/releng/builder
>
> After cloning this repo run "jenkins-jobs test -r jjb/".
>
> Regards,
>
> Thanh
>
>
This triggered a suspicion with me that it wasn't anything to do with
the project, and it's something to do with how jenkins is reading the
console output from processes which causes python to use a different
object for stdout.
I managed to reproduce by creating a local pipe, tailed from that in
one terminal and run the above command in another and redirecting the
output into the pipe.
term 1:
mkfifo /tmp/test_jjb_output_to_pipe
tail -f /tmp/test_jjb_output_to_pipe
term 2:
jenkins-jobs test -r builder/jjb > /tmp/test_jjb_output_to_pipe
However on closer examination of the code, I suspect that the
following piece is a little stupid and is causing the problem. Quite
why it works some of the time and doesn't fail consistently has me
stumped.
if output:
for job in self.parser.xml_jobs:
if hasattr(output, 'write'):
# `output` is a file-like object
logger.info("Job name: %s", job.name)
logger.debug("Writing XML to '{0}'".format(output))
output = utils.wrap_stream(output)
try:
output.write(job.output())
except IOError as exc:
if exc.errno == errno.EPIPE:
# EPIPE could happen if piping output to something
# that doesn't read the whole input (e.g.: the UNIX
# `head` command)
return
raise
continue
This ends up wrapping the object on each an every loop iteration, so
if it's writing to stdout it wraps the output many, many times. I'm
going to fix that.
The reason why it may only occur when using a named pipe possibly has
something to do with the object writing to it not being able to set
the encoding, so therefore it keeps trying to wrap it with
"codecs.EncodedFile(stream, encoding, stream_enc)", where as for
normal pipes and stdout, the encoding is set and read correctly and
therefore it just returns the stream on subsequent iterations.
Wrapping a StreamReader from codecs with a subsequent StreamReader
object, would eventually result in the getattr call hitting the
recursion limit as it tries to find the base object attribute to read.
Should be able to knock together a sensible solution relatively easily.
--
Darragh Bailey
"Nothing is foolproof to a sufficiently talented fool"
___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
On 11 January 2016 at 11:03, Thanh Ha wrote: > On 9 January 2016 at 07:10, Darragh Bailey > wrote: > >> On 8 Jan 2016 21:47, "Thanh Ha" wrote: >> >> > >> > (I truncated some of the repetitive output below) >> > >> > I just tried with the -o argument and seems like it passes. I guess it >> only affects stdout output, good to know. >> > >> > We're using python 2.7.5 in production. I did some testing today with >> Python 3.4.3 and it seems the 3.4.x stream at least doesn't run into this >> issue so I'm guessing this only affects Python 2.7.x. >> >> I wonder if it's something that occurs with earlier 2.7 releases, I >> thought I checked that behavior out on 2.7.9 >> >> I'll look to check with pyenv on Monday to go over a few python versions. >> >> > Hi Darragh, > > The extremely strange thing about this one is I've only been able to > reproduce it in Jenkins. So imagine having JJB installed on the same server > as your Jenkins instance or slave. If you ssh to the machine and run JJB on > the commandline it works. Create a job running on the same system and > Jenkins will see the failure in console logs. > > In case it helps with reproducing. The git repo I've been using to > reproduce this error is this one: > > https://git.opendaylight.org/gerrit/#/admin/projects/releng/builder > > After cloning this repo run "jenkins-jobs test -r jjb/". > I just tested this with Python 2.7.9 and confirm the issue still persists for me even with 2.7.9. You can see my test here: https://jenkins.opendaylight.org/sandbox/job/thanh-test/7/console Regards, Thanh ___ OpenStack-Infra mailing list OpenStack-Infra@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
On 9 January 2016 at 07:10, Darragh Bailey wrote: > > Hi Thanh, > > On 8 Jan 2016 21:47, "Thanh Ha" wrote: > > > > (I truncated some of the repetitive output below) > > > > I just tried with the -o argument and seems like it passes. I guess it > only affects stdout output, good to know. > > > > We're using python 2.7.5 in production. I did some testing today with > Python 3.4.3 and it seems the 3.4.x stream at least doesn't run into this > issue so I'm guessing this only affects Python 2.7.x. > > I wonder if it's something that occurs with earlier 2.7 releases, I > thought I checked that behavior out on 2.7.9 > > I'll look to check with pyenv on Monday to go over a few python versions. > > Hi Darragh, The extremely strange thing about this one is I've only been able to reproduce it in Jenkins. So imagine having JJB installed on the same server as your Jenkins instance or slave. If you ssh to the machine and run JJB on the commandline it works. Create a job running on the same system and Jenkins will see the failure in console logs. In case it helps with reproducing. The git repo I've been using to reproduce this error is this one: https://git.opendaylight.org/gerrit/#/admin/projects/releng/builder After cloning this repo run "jenkins-jobs test -r jjb/". Regards, Thanh ___ OpenStack-Infra mailing list OpenStack-Infra@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
Hi Thanh, On 8 Jan 2016 21:47, "Thanh Ha" wrote: > > (I truncated some of the repetitive output below) > > I just tried with the -o argument and seems like it passes. I guess it only affects stdout output, good to know. > > We're using python 2.7.5 in production. I did some testing today with Python 3.4.3 and it seems the 3.4.x stream at least doesn't run into this issue so I'm guessing this only affects Python 2.7.x. I wonder if it's something that occurs with earlier 2.7 releases, I thought I checked that behavior out on 2.7.9 I'll look to check with pyenv on Monday to go over a few python versions. -- Darragh Bailey "Nothing is foolproof to a sufficiently talented fool" - unknown ___ OpenStack-Infra mailing list OpenStack-Infra@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
(I truncated some of the repetitive output below) I just tried with the -o argument and seems like it passes. I guess it only affects stdout output, good to know. We're using python 2.7.5 in production. I did some testing today with Python 3.4.3 and it seems the 3.4.x stream at least doesn't run into this issue so I'm guessing this only affects Python 2.7.x. Regards, Thanh On 8 January 2016 at 12:44, Wayne Warren wrote: > Hey Thanh, > > Looking at that stack trace and the command that causes it, it appears > that the object whose encoding is being accessed is "sys.stdout" [1] > > I would suggest trying to pass a specific "-o" argument to the "test" > subcommand to see if the stream.encoding __getattr__ recursion happens > there also. > > Also, what specific minor version of Python are you using? > > [1] > https://review.openstack.org/gitweb?p=openstack-infra/jenkins-job-builder.git;a=blob;f=jenkins_jobs/cmd.py;h=efafdf05fa35f93a00633489dde160c06930641d;hb=b023d7e23f77e4de33e740dcc37af911e36fb189#l115 > > On Thu, Jan 7, 2016 at 5:40 PM, Thanh Ha > wrote: > > Hi JJB Devs, > > > > We discovered what seems to be a regression with JJB 1.4.0 which after > some > > git bisecting found it was caused by this patch [1]. My Jenkins verify > > builds are failing to pass due to python runtime error: > > > > RuntimeError: maximum recursion depth exceeded > > > > This error follows what seems to be a recursive loop of python codecs > > __getattr__ attempts. I've pasted the full traceback below. This issue > seems > > to only affect the command "jenkins-jobs test --recursive /path/to/jobs" > and > > when as part of a Jenkins verify job. Oddly enough running "jenkins-jobs > > update --recursive /path/to/jobs" seems to pass just fine. > > > > Any ideas how to fix or workaround this issue? (This issue is > preventing us > > from upgrading to JJB 1.4.0) > > > > Thanks, > > > > Thanh > > > > [1] https://review.openstack.org/183939/ > > > > > > Traceback (most recent call last): > > File "/tmp/jjbtest/jjb/bin/jenkins-jobs", line 11, in > > sys.exit(main()) > > File > "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/cmd.py", > > line 172, in main > > execute(options, config) > > File > "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/cmd.py", > > line 337, in execute > > output=options.output_dir) > > File > > "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/builder.py", > line > > 326, in update_job > > output = utils.wrap_stream(output) > > File > "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/utils.py", > > line 25, in wrap_stream > > stream_enc = stream.encoding > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > > __getattr__ > > return getattr(self.stream, name) > > File "/tmp/j
Re: [OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
Hey Thanh, Looking at that stack trace and the command that causes it, it appears that the object whose encoding is being accessed is "sys.stdout" [1] I would suggest trying to pass a specific "-o" argument to the "test" subcommand to see if the stream.encoding __getattr__ recursion happens there also. Also, what specific minor version of Python are you using? [1] https://review.openstack.org/gitweb?p=openstack-infra/jenkins-job-builder.git;a=blob;f=jenkins_jobs/cmd.py;h=efafdf05fa35f93a00633489dde160c06930641d;hb=b023d7e23f77e4de33e740dcc37af911e36fb189#l115 On Thu, Jan 7, 2016 at 5:40 PM, Thanh Ha wrote: > Hi JJB Devs, > > We discovered what seems to be a regression with JJB 1.4.0 which after some > git bisecting found it was caused by this patch [1]. My Jenkins verify > builds are failing to pass due to python runtime error: > > RuntimeError: maximum recursion depth exceeded > > This error follows what seems to be a recursive loop of python codecs > __getattr__ attempts. I've pasted the full traceback below. This issue seems > to only affect the command "jenkins-jobs test --recursive /path/to/jobs" and > when as part of a Jenkins verify job. Oddly enough running "jenkins-jobs > update --recursive /path/to/jobs" seems to pass just fine. > > Any ideas how to fix or workaround this issue? (This issue is preventing us > from upgrading to JJB 1.4.0) > > Thanks, > > Thanh > > [1] https://review.openstack.org/183939/ > > > Traceback (most recent call last): > File "/tmp/jjbtest/jjb/bin/jenkins-jobs", line 11, in > sys.exit(main()) > File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/cmd.py", > line 172, in main > execute(options, config) > File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/cmd.py", > line 337, in execute > output=options.output_dir) > File > "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/builder.py", line > 326, in update_job > output = utils.wrap_stream(output) > File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/utils.py", > line 25, in wrap_stream > stream_enc = stream.encoding > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in > __getattr__ > return getattr(self.stream, name) > File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in >
[OpenStack-Infra] Regression in JJB 1.4.0 maximum recursion depth exceeded
Hi JJB Devs, We discovered what seems to be a regression with JJB 1.4.0 which after some git bisecting found it was caused by this patch [1]. My Jenkins verify builds are failing to pass due to python runtime error: RuntimeError: maximum recursion depth exceeded This error follows what seems to be a recursive loop of python codecs __getattr__ attempts. I've pasted the full traceback below. This issue seems to only affect the command "jenkins-jobs test --recursive /path/to/jobs" and when as part of a Jenkins verify job. Oddly enough running "jenkins-jobs update --recursive /path/to/jobs" seems to pass just fine. Any ideas how to fix or workaround this issue? (This issue is preventing us from upgrading to JJB 1.4.0) Thanks, Thanh [1] https://review.openstack.org/183939/ Traceback (most recent call last): File "/tmp/jjbtest/jjb/bin/jenkins-jobs", line 11, in sys.exit(main()) File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/cmd.py", line 172, in main execute(options, config) File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/cmd.py", line 337, in execute output=options.output_dir) File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/builder.py", line 326, in update_job output = utils.wrap_stream(output) File "/tmp/jjbtest/jjb/lib/python2.7/site-packages/jenkins_jobs/utils.py", line 25, in wrap_stream stream_enc = stream.encoding File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return getattr(self.stream, name) File "/tmp/jjbtest/jjb/lib64/python2.7/codecs.py", line 828, in __getattr__ return
