Re: Mixing automatic and scheduled builds

2012-02-23 Thread Sason
Thanks John, that sounds like a good idea. I'll see what I can do by
way of archiving artifacts. So far, I had been thinking of artifacts
in term of pure build output (files, libraries, whatever), not as
metadata.

On 23 Feb., 23:56, John Vacz 
wrote:
> On 23.02.2012 08:36, Sason wrote:
>
>
>
>
>
>
>
> > Hi there,
>
> > I'd like to set up two dependent build projects for the same software
> > product as follows:
> > - have a "quick" build run every time a developer commits changes,
> > i.e. using the SCM polling trigger. This will only be an incremental
> > build, followed by unit tests.
> > - run a scheduled full "nightly" build using the full test suite,
> > setup creation etc. once a day using the same SCM revision number as
> > the last successful/stable "quick" build (if there is one, and if that
> > revision number has increased since last time the "nightly" build
> > ran).
>
> > I wonder how this could be archived? My current understanding is that
> > it's hard to mix these two concepts in Jenkins. I know about the
> > Parameterized Trigger plugin which covers the "use the same SCM
> > revision number" requirement, but not the requirement of running only
> > once a day.
>
> > Thanks!
>
> I think you can use copy artifacts plugin. The quick build job write its
> revision number in a file, which is archived as artifact. The nightly
> job just copy the archived file from the latest stable build of the
> quick job, and begin to build the same revision number. The nightly job
> may have some logic to check whether the latest stable revision number
> has been built (again, this can be done by archiving artifact and copy
> artifacts plugin). Or this logic can be isolated in an intermediate job
> that checkes the stable revision number of the quick job and trigger the
> nightly build if necessary.


Re: Violations Plugin and JSlint

2012-02-23 Thread Daniel Becroft
2012/2/13 Grzegorz Ślusarek 

> Bob Koertge  gmail.com> writes:
>
> >
> > I cannot seem to get detailed infomration on my errors with JSLint and
> violations.  Here is some screenshots http://screencast.com/t/Vu6vo2y9 ->
> I get
> the overall results, but clicking any of the .js file links leads to a
> blank
> page! http://screencast.com/t/LHM09UYw9rufAnyone have any ideas?
>
>
> I have the same issue, see the jslint violation chart, but when I clik in
> any of
> *.js files, I get empty page.
> This happen on Jenkins 1.450 with Jenkins Violations plugin 0.7.10.
> Any tip to solve this issue will be appreciated.
>

Has anyone had any luck with this problem?


Re: JMS trigger

2012-02-23 Thread Didier Durand
Hi,

If you go to the plugins page and check the Build Triggers section,
you'll see that many plugins have the same intent as yours: FileFound
plugin, FST plugin, IRC plugin, URL change plugin.

So, you should definitely do it.

Btw, the plugins mentionned probably provide good source code
skeletons for you

regards

didier

On Feb 24, 1:51 am, tommyB  wrote:
> So I have been using Jenkins for a couple of years to periodically run
> some etl/batch jobs.  Most of the jobs are simple enough that I just
> need a groovy script or two to take care business.  So anyway, I am
> starting to get requests to start dealing with real time data from
> JMS.  The data processing is fairly simple, and Jenkins has been a
> life saver for notification, logging and its restful api.  If I were
> to do what I need to consume and process data from a message queue, I
> basically would be creating a crappy version of Jenkins.  So I
> thought, why not extend Jenkins?  So here's my proposed use case...
> please tell me if this is insane.  I was thinking I could make a JMS
> trigger that can fire off a job if messages are in a queue; the job
> would run until all messages have been consumed.  I haven't seen
> anyone do this so I wonder if this is beyond the scope of
> Jenkins.


JMS trigger

2012-02-23 Thread tommyB
So I have been using Jenkins for a couple of years to periodically run
some etl/batch jobs.  Most of the jobs are simple enough that I just
need a groovy script or two to take care business.  So anyway, I am
starting to get requests to start dealing with real time data from
JMS.  The data processing is fairly simple, and Jenkins has been a
life saver for notification, logging and its restful api.  If I were
to do what I need to consume and process data from a message queue, I
basically would be creating a crappy version of Jenkins.  So I
thought, why not extend Jenkins?  So here's my proposed use case...
please tell me if this is insane.  I was thinking I could make a JMS
trigger that can fire off a job if messages are in a queue; the job
would run until all messages have been consumed.  I haven't seen
anyone do this so I wonder if this is beyond the scope of
Jenkins.


Re: groovy plugin?

2012-02-23 Thread Vojtech Juranek
> Does the groovy plugin need anything special installed on the slaves?

there are two options, groovy script and system groovy script. First one 
requires groovy installation on slaves (check global jenkins configuration, 
auto-install can be used), second doesn't, however it's not executed on slave, 
but in master JVM (it uses bundled groovy lib in the same way as you run 
groovy script via groovy console)

>  I can run the example 'println System.getenv("PATH")' in the jenkins
> script console for a slave but if I put the same thing in an 'execute
> groovy script''s groovy command box and run a build I get:
> 
> [envtest] $ groovy
> e:\hudson\workspace\envtest\hudson782241948209548068.groovy The system
> cannot find the file specified
> FATAL: command execution failed
> java.io.IOException: Cannot run program "groovy" (in directory
> "e:\hudson\workspace\envtest"): CreateProcess error=2, The system
> cannot find the file specified
>   at java.lang.ProcessBuilder.start(Unknown Source)
> [...]
> 
> (default) is the only option for the groovy version.


RE: Using svn export instead of svn checkout

2012-02-23 Thread Terry.Rankine
svn export would take less disk space, but switching to another VCS alltogether 
may be what you want for speed.

While I personally believe that svn forces you to get the governance of a code 
base right, I think git dodges that entirely (thats why linux kernel developers 
like it). However, git considerably outperforms svn in checkout speed and space 
needed on disk.

Its your call - if you are going for speed or space, is the minor step up from 
check out to export really helping that?

Terry Rankine


From: jenkinsci-users@googlegroups.com [jenkinsci-users@googlegroups.com] On 
Behalf Of Jim McCaskey [jim.mccas...@pervasive.com]
Sent: Friday, 24 February 2012 3:00 AM
To: 'jenkinsci-users@googlegroups.com'
Subject: RE: Using svn export instead of svn checkout

FWIW: This request has been open for a few years:

https://issues.jenkins-ci.org/browse/JENKINS-1304

Your concerns is disk space, my concern is speed of checkout.  Export can be 
much faster on a very large tree.  Like you I do clean checkouts so any of the 
other concerns don't apply for me.  Maybe make it an option only when clean 
checkouts are done?

-Jim


-Original Message-
From: jenkinsci-users@googlegroups.com 
[mailto:jenkinsci-users@googlegroups.com] On Behalf Of Asmann, Roland
Sent: Thursday, February 23, 2012 6:53 AM
To: jenkinsci-users@googlegroups.com
Subject: Re: Using svn export instead of svn checkout

Since we already use the clean checkout option, I don't see where the
performance can be gained.

As for tracing changes, I don't care about those on a build-server! The
only purpose of a build-server is to check out the code, build it and
report on that. If your build-server is making changes and checking
those in, you are not using it in the right way!

Disk space is cheap? I don't know in what company YOU work and if YOU
can decide on buying more space, I have to fight for every MB of extra
space I need and it takes months before it is finally decided IF I will
even get it.

I am not asking for the export option as the default or for getting rid
of the checkout, I am just asking to add it as an alternative -- just
like the other options that are already in the list!

Roland



On 23.02.2012 13:37, Didier Durand wrote:
> Hi,
>
> Even if checkout was possible, I don't think that it is a good idea
> from a perf standpoint: if you export a file, it gets out of svn
> control and the changes cannot be tracked.
>
> So, next time your run the job, you have to do a full export again
> even if the file didn't change inbetween: can take a long time for a
> big file.
>
> So, as disk space is cheap, I would prefer several copies rather than
> the network burden (and corresponding delay to start) of a big file
>
> regards
>
> didier
>
> On Feb 23, 12:40 pm, "Asmann, Roland"  wrote:
>  > Hi all,
>  >
>  > Would it be possible to use 'svn export' instead of 'svn checkout'?
>  > We have a couple of projects that contain very large files, which are
>  > then obviously saved twice on the Server -- once as the actual file and
>  > once as the bas-version for SVN.
>  >
>  > Since we don't check-in stuff from Jenkins, we would definitely benefit
>  > in both performance and disc usage when getting our project using 'svn
>  > export'. Can this be added to the svn-plugin as one of the options?
>  >
>  > Thanks,
>  >
>  > Roland
>  >
>  > --
>  > Roland Asmann
>  > Senior Software Engineer
>  >
>  > adesso Austria GmbH
>  > Floridotower 26. Stock  T +43 1 2198790-27
>  > Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
>  > A-1210 Wien M +43 664 88657566
>  > E roland.asm...@adesso.at
>  > Wwww.adesso.at
>  >
>  > -
>  > >>> business. people. technology. <<<
>  > -
>

--
Roland Asmann
Senior Software Engineer

adesso Austria GmbH
Floridotower 26. Stock  T +43 1 2198790-27
Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
A-1210 Wien M +43 664 88657566
E roland.asm...@adesso.at
W www.adesso.at

-
 >>> business. people. technology. <<<
-

Re: Mixing automatic and scheduled builds

2012-02-23 Thread John Vacz

On 23.02.2012 08:36, Sason wrote:

Hi there,

I'd like to set up two dependent build projects for the same software
product as follows:
- have a "quick" build run every time a developer commits changes,
i.e. using the SCM polling trigger. This will only be an incremental
build, followed by unit tests.
- run a scheduled full "nightly" build using the full test suite,
setup creation etc. once a day using the same SCM revision number as
the last successful/stable "quick" build (if there is one, and if that
revision number has increased since last time the "nightly" build
ran).

I wonder how this could be archived? My current understanding is that
it's hard to mix these two concepts in Jenkins. I know about the
Parameterized Trigger plugin which covers the "use the same SCM
revision number" requirement, but not the requirement of running only
once a day.

Thanks!
   
I think you can use copy artifacts plugin. The quick build job write its 
revision number in a file, which is archived as artifact. The nightly 
job just copy the archived file from the latest stable build of the 
quick job, and begin to build the same revision number. The nightly job 
may have some logic to check whether the latest stable revision number 
has been built (again, this can be done by archiving artifact and copy 
artifacts plugin). Or this logic can be isolated in an intermediate job 
that checkes the stable revision number of the quick job and trigger the 
nightly build if necessary.





groovy plugin?

2012-02-23 Thread Les Mikesell
Does the groovy plugin need anything special installed on the slaves?
 I can run the example 'println System.getenv("PATH")' in the jenkins
script console for a slave but if I put the same thing in an 'execute
groovy script''s groovy command box and run a build I get:

[envtest] $ groovy e:\hudson\workspace\envtest\hudson782241948209548068.groovy
The system cannot find the file specified
FATAL: command execution failed
java.io.IOException: Cannot run program "groovy" (in directory
"e:\hudson\workspace\envtest"): CreateProcess error=2, The system
cannot find the file specified
at java.lang.ProcessBuilder.start(Unknown Source)
[...]

(default) is the only option for the groovy version.

-- 
   Les Mikesell
lesmikes...@gmail.com


Where are archived artifacts following promotion?

2012-02-23 Thread Alan Jackoway
Hello,

I am trying to configure Jenkins to build and archive an artifact when
I promote a build. This artifact is not built until the project is
promoted. So my promotion actions are:

1. Execute shell scripts that build package-name-[whatever].tar.gz
2. Archive the artifacts with path package-name-*.tar.gz
3. Execute shell: ls -la package-name-*.tar.gz

My promotion succeeds, but I cannot find the archived artifacts. The
end of my promotion log reads:
build hudson.tasks.Shell@4d770d16 SUCCESS
Archiving artifacts
build hudson.tasks.ArtifactArchiver@29b836e9 SUCCESS
[package-name] $ /bin/sh -xe /tmp/hudson1077645600041923657.sh
+ ls -la package-name-[whatever].tar.gz
-rw-r--r-- 1 jenkins jenkins 80913057 2012-02-23 12:59 package-name-
[whatever].tar.gz
build hudson.tasks.Shell@6b9b1775 SUCCESS
Finished: SUCCESS

The archive does not show up on any of the pages I can think of to
look in (/job/package-name, /job/package-name/number, /job/package-
name/number/artifact, /job/package-name/number/promotion...). I also
have no idea how my action ls -la package-name-*.tar.gz got translated
into a command that actually put in the [whatever] part. I added it to
verify that the artifact I was trying to archive was present, which it
looks to me like it is.

I am working with Jenkins v1.444, Promoted Builds 1.9.

Thanks for any help you can give me finding my artifacts,
Alan


RE: Using svn export instead of svn checkout

2012-02-23 Thread Jim McCaskey
FWIW: This request has been open for a few years:

https://issues.jenkins-ci.org/browse/JENKINS-1304

Your concerns is disk space, my concern is speed of checkout.  Export can be 
much faster on a very large tree.  Like you I do clean checkouts so any of the 
other concerns don't apply for me.  Maybe make it an option only when clean 
checkouts are done?

-Jim


-Original Message-
From: jenkinsci-users@googlegroups.com 
[mailto:jenkinsci-users@googlegroups.com] On Behalf Of Asmann, Roland
Sent: Thursday, February 23, 2012 6:53 AM
To: jenkinsci-users@googlegroups.com
Subject: Re: Using svn export instead of svn checkout

Since we already use the clean checkout option, I don't see where the 
performance can be gained.

As for tracing changes, I don't care about those on a build-server! The 
only purpose of a build-server is to check out the code, build it and 
report on that. If your build-server is making changes and checking 
those in, you are not using it in the right way!

Disk space is cheap? I don't know in what company YOU work and if YOU 
can decide on buying more space, I have to fight for every MB of extra 
space I need and it takes months before it is finally decided IF I will 
even get it.

I am not asking for the export option as the default or for getting rid 
of the checkout, I am just asking to add it as an alternative -- just 
like the other options that are already in the list!

Roland



On 23.02.2012 13:37, Didier Durand wrote:
> Hi,
>
> Even if checkout was possible, I don't think that it is a good idea
> from a perf standpoint: if you export a file, it gets out of svn
> control and the changes cannot be tracked.
>
> So, next time your run the job, you have to do a full export again
> even if the file didn't change inbetween: can take a long time for a
> big file.
>
> So, as disk space is cheap, I would prefer several copies rather than
> the network burden (and corresponding delay to start) of a big file
>
> regards
>
> didier
>
> On Feb 23, 12:40 pm, "Asmann, Roland"  wrote:
>  > Hi all,
>  >
>  > Would it be possible to use 'svn export' instead of 'svn checkout'?
>  > We have a couple of projects that contain very large files, which are
>  > then obviously saved twice on the Server -- once as the actual file and
>  > once as the bas-version for SVN.
>  >
>  > Since we don't check-in stuff from Jenkins, we would definitely benefit
>  > in both performance and disc usage when getting our project using 'svn
>  > export'. Can this be added to the svn-plugin as one of the options?
>  >
>  > Thanks,
>  >
>  > Roland
>  >
>  > --
>  > Roland Asmann
>  > Senior Software Engineer
>  >
>  > adesso Austria GmbH
>  > Floridotower 26. Stock  T +43 1 2198790-27
>  > Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
>  > A-1210 Wien M +43 664 88657566
>  > E roland.asm...@adesso.at
>  > Wwww.adesso.at
>  >
>  > -
>  > >>> business. people. technology. <<<
>  > -
>

-- 
Roland Asmann
Senior Software Engineer

adesso Austria GmbH
Floridotower 26. Stock  T +43 1 2198790-27
Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
A-1210 Wien M +43 664 88657566
E roland.asm...@adesso.at
W www.adesso.at

-
 >>> business. people. technology. <<<
-




Re: Using svn export instead of svn checkout

2012-02-23 Thread Les Mikesell
On Thu, Feb 23, 2012 at 11:39 AM, Sami Tikka  wrote:
>
> I know disk space is not cheap if the disk is inside an expensive and slow 
> enterprise SAN. I know many teams that have gone rogue on their organization 
> and set up their own CI server outside of IT department control and have been 
> happy with it. If you buy an off the shelf disk, 1 TB really is cheap.

There's really not much reason to spend extra for reliability on the
slaves - everything should be in your SCM and the working copies are
disposable - a local SATA, or even a VM with the entire image on a
local SATA works fine.

-- 
   Les Mikesell
  lesmikes...@gmail.com


Re: Using svn export instead of svn checkout

2012-02-23 Thread Sami Tikka
It seems there aren't many people who have need for that feature. You can still 
open a ticket with a feature request in the Jenkins issue tracker. 

If no one steps up to the task, your only option is to implement it yourself or 
hire someone to do it for you. There are also commercial versions of Jenkins. 
Maybe the vendors are more receptive to your needs?

I know disk space is not cheap if the disk is inside an expensive and slow 
enterprise SAN. I know many teams that have gone rogue on their organization 
and set up their own CI server outside of IT department control and have been 
happy with it. If you buy an off the shelf disk, 1 TB really is cheap. 

Oh, by the way. You can configure a job to have no SCM. Then you can do the 
checkout yourself in the build step and use whatever command you want. 

-- Sami

"Asmann, Roland"  kirjoitti 23.2.2012 kello 14.53:

> Since we already use the clean checkout option, I don't see where the 
> performance can be gained.
> 
> As for tracing changes, I don't care about those on a build-server! The 
> only purpose of a build-server is to check out the code, build it and 
> report on that. If your build-server is making changes and checking 
> those in, you are not using it in the right way!
> 
> Disk space is cheap? I don't know in what company YOU work and if YOU 
> can decide on buying more space, I have to fight for every MB of extra 
> space I need and it takes months before it is finally decided IF I will 
> even get it.
> 
> I am not asking for the export option as the default or for getting rid 
> of the checkout, I am just asking to add it as an alternative -- just 
> like the other options that are already in the list!
> 
> Roland
> 
> 
> 
> On 23.02.2012 13:37, Didier Durand wrote:
>> Hi,
>> 
>> Even if checkout was possible, I don't think that it is a good idea
>> from a perf standpoint: if you export a file, it gets out of svn
>> control and the changes cannot be tracked.
>> 
>> So, next time your run the job, you have to do a full export again
>> even if the file didn't change inbetween: can take a long time for a
>> big file.
>> 
>> So, as disk space is cheap, I would prefer several copies rather than
>> the network burden (and corresponding delay to start) of a big file
>> 
>> regards
>> 
>> didier
>> 
>> On Feb 23, 12:40 pm, "Asmann, Roland"  wrote:
>>> Hi all,
>>> 
>>> Would it be possible to use 'svn export' instead of 'svn checkout'?
>>> We have a couple of projects that contain very large files, which are
>>> then obviously saved twice on the Server -- once as the actual file and
>>> once as the bas-version for SVN.
>>> 
>>> Since we don't check-in stuff from Jenkins, we would definitely benefit
>>> in both performance and disc usage when getting our project using 'svn
>>> export'. Can this be added to the svn-plugin as one of the options?
>>> 
>>> Thanks,
>>> 
>>> Roland
>>> 
>>> --
>>> Roland Asmann
>>> Senior Software Engineer
>>> 
>>> adesso Austria GmbH
>>> Floridotower 26. Stock  T +43 1 2198790-27
>>> Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
>>> A-1210 Wien M +43 664 88657566
>>>E roland.asm...@adesso.at
>>>Wwww.adesso.at
>>> 
>>> -
>> business. people. technology. <<<
>>> -
>> 
> 
> -- 
> Roland Asmann
> Senior Software Engineer
> 
> adesso Austria GmbH
> Floridotower 26. Stock  T +43 1 2198790-27
> Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
> A-1210 Wien M +43 664 88657566
>E roland.asm...@adesso.at
>W www.adesso.at
> 
> -
 business. people. technology. <<<
> -


Re: Using svn export instead of svn checkout

2012-02-23 Thread Les Mikesell
On Thu, Feb 23, 2012 at 6:53 AM, Asmann, Roland  wrote:
>
> As for tracing changes, I don't care about those on a build-server! The
> only purpose of a build-server is to check out the code, build it and
> report on that. If your build-server is making changes and checking
> those in, you are not using it in the right way!

Actually, tagging/promoting in jenkins _after_ successful automated
builds/tests is a pretty nice touch.

-- 
  Les Mikesell
 lesmikes...@gmail.com


Re: custom build environments?

2012-02-23 Thread Les Mikesell
On Thu, Feb 23, 2012 at 6:42 AM, Mandeville, Rob  wrote:
> Another possibility would be to put Boost in a non-standard location where
> autoconf/configure would never find it, install various versions of Boost
> that you need into various directories, and then pass command-line arguments
> to autoconf/configure specifying where to get your Boost library from.

We do this on windows where there is no "standard location" for boost.
 We have a common mapped drive with several versions and the
developers can set a variable for which one they want.   But now I'd
like to make a matrix build work across several versions of windows
and linux targets where one of the linux targets will have the
expected boost version installed natively but others will not. So
there are really two parts to the issue:  first is it sane to even
build something against the wrong libs on linux, and second, how do
you map something in a matrix job to things that are location-specific
per node?

-- 
   Les Mikesell
lesmikes...@gmail.com


Re: Using svn export instead of svn checkout

2012-02-23 Thread Didier Durand
Hi,

please, keep cool .

The reason for checkout rather than export is to track and obtain
changes in your big files from subversion to your jenkins server but
only when they've effectively changed not each time you run the build
as you will incurr with export. But, it seems you won't hear that.

by the way, don't worry for the quality of my build server: it works
just perfect with the appropriate use of svn  ;-)

regards

didier

On Feb 23, 1:53 pm, "Asmann, Roland"  wrote:
> Since we already use the clean checkout option, I don't see where the
> performance can be gained.
>
> As for tracing changes, I don't care about those on a build-server! The
> only purpose of a build-server is to check out the code, build it and
> report on that. If your build-server is making changes and checking
> those in, you are not using it in the right way!
>
> Disk space is cheap? I don't know in what company YOU work and if YOU
> can decide on buying more space, I have to fight for every MB of extra
> space I need and it takes months before it is finally decided IF I will
> even get it.
>
> I am not asking for the export option as the default or for getting rid
> of the checkout, I am just asking to add it as an alternative -- just
> like the other options that are already in the list!
>
> Roland
>
> On 23.02.2012 13:37, Didier Durand wrote:
>
>
>
>
>
>
>
>
>
> > Hi,
>
> > Even if checkout was possible, I don't think that it is a good idea
> > from a perf standpoint: if you export a file, it gets out of svn
> > control and the changes cannot be tracked.
>
> > So, next time your run the job, you have to do a full export again
> > even if the file didn't change inbetween: can take a long time for a
> > big file.
>
> > So, as disk space is cheap, I would prefer several copies rather than
> > the network burden (and corresponding delay to start) of a big file
>
> > regards
>
> > didier
>
> > On Feb 23, 12:40 pm, "Asmann, Roland"  wrote:
> >  > Hi all,
>
> >  > Would it be possible to use 'svn export' instead of 'svn checkout'?
> >  > We have a couple of projects that contain very large files, which are
> >  > then obviously saved twice on the Server -- once as the actual file and
> >  > once as the bas-version for SVN.
>
> >  > Since we don't check-in stuff from Jenkins, we would definitely benefit
> >  > in both performance and disc usage when getting our project using 'svn
> >  > export'. Can this be added to the svn-plugin as one of the options?
>
> >  > Thanks,
>
> >  > Roland
>
> >  > --
> >  > Roland Asmann
> >  > Senior Software Engineer
>
> >  > adesso Austria GmbH
> >  > Floridotower 26. Stock              T +43 1 2198790-27
> >  > Floridsdorfer Hauptstr. 1           F +43 1 2198790-927
> >  > A-1210 Wien                         M +43 664 88657566
> >  >                                     E roland.asm...@adesso.at
> >  >                                     Wwww.adesso.at
>
> >  > -
> >  > >>> business. people. technology. <<<
> >  > -
>
> --
> Roland Asmann
> Senior Software Engineer
>
> adesso Austria GmbH
> Floridotower 26. Stock              T +43 1 2198790-27
> Floridsdorfer Hauptstr. 1           F +43 1 2198790-927
> A-1210 Wien                         M +43 664 88657566
>                                     E roland.asm...@adesso.at
>                                     Wwww.adesso.at
>
> -
>              >>> business. people. technology. <<<
> -


Crowd 2 plugin makes too many REST API calls?

2012-02-23 Thread Uwe Stuehler
Hi list, hi Thorsten,

First of all, thanks Thorsten for your work on the Crowd 2 plugin! I decided to
give it a try, but I noticed that pages were loading really really
slow when I was
logged in. So I took a look at the communication between Jenkins and Crowd:

# ngrep HTTP 'host crowd and port 80' | egrep '^  (GET|POST)'

It looks like multiple Crowd REST API calls are made for _every_ request to
Jenkins. They look like this:

  POST /crowd/rest/usermanagement/1/session/SESSIONID ...
  GET /crowd/rest/usermanagement/1/session/SESSIONID?expand=user ...
  GET /crowd/rest/usermanagement/1/group?groupname=GROUPNAME ...
  GET 
/crowd/rest/usermanagement/1/group/user/direct?groupname=GROUPNAME&username=USERNAME
...
  GET 
/crowd/rest/usermanagement/1/user/group/direct?username=USERNAME&start-index=0&max-results=500&expand=group
...
  GET 
/crowd/rest/usermanagement/1/user/group/direct?username=USERNAME&start-index=500&max-results=500&expand=group
...
  GET 
/crowd/rest/usermanagement/1/user/group/nested?username=USERNAME&start-index=0&max-results=500&expand=group
...
  GET 
/crowd/rest/usermanagement/1/user/group/nested?username=USERNAME&start-index=500&max-results=500&expand=group
...

Could these requests come from a misconfiguration, or is that just how
the plugin currently works?  Should that information not be cached?

(The difference in the number of Crowd calls per HTTP requests with nested
groups disabled is negligible, by the way.)

Cheers,
Uwe


Re: Using svn export instead of svn checkout

2012-02-23 Thread Asmann, Roland
Since we already use the clean checkout option, I don't see where the 
performance can be gained.

As for tracing changes, I don't care about those on a build-server! The 
only purpose of a build-server is to check out the code, build it and 
report on that. If your build-server is making changes and checking 
those in, you are not using it in the right way!

Disk space is cheap? I don't know in what company YOU work and if YOU 
can decide on buying more space, I have to fight for every MB of extra 
space I need and it takes months before it is finally decided IF I will 
even get it.

I am not asking for the export option as the default or for getting rid 
of the checkout, I am just asking to add it as an alternative -- just 
like the other options that are already in the list!

Roland



On 23.02.2012 13:37, Didier Durand wrote:
> Hi,
>
> Even if checkout was possible, I don't think that it is a good idea
> from a perf standpoint: if you export a file, it gets out of svn
> control and the changes cannot be tracked.
>
> So, next time your run the job, you have to do a full export again
> even if the file didn't change inbetween: can take a long time for a
> big file.
>
> So, as disk space is cheap, I would prefer several copies rather than
> the network burden (and corresponding delay to start) of a big file
>
> regards
>
> didier
>
> On Feb 23, 12:40 pm, "Asmann, Roland"  wrote:
>  > Hi all,
>  >
>  > Would it be possible to use 'svn export' instead of 'svn checkout'?
>  > We have a couple of projects that contain very large files, which are
>  > then obviously saved twice on the Server -- once as the actual file and
>  > once as the bas-version for SVN.
>  >
>  > Since we don't check-in stuff from Jenkins, we would definitely benefit
>  > in both performance and disc usage when getting our project using 'svn
>  > export'. Can this be added to the svn-plugin as one of the options?
>  >
>  > Thanks,
>  >
>  > Roland
>  >
>  > --
>  > Roland Asmann
>  > Senior Software Engineer
>  >
>  > adesso Austria GmbH
>  > Floridotower 26. Stock  T +43 1 2198790-27
>  > Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
>  > A-1210 Wien M +43 664 88657566
>  > E roland.asm...@adesso.at
>  > Wwww.adesso.at
>  >
>  > -
>  > >>> business. people. technology. <<<
>  > -
>

-- 
Roland Asmann
Senior Software Engineer

adesso Austria GmbH
Floridotower 26. Stock  T +43 1 2198790-27
Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
A-1210 Wien M +43 664 88657566
E roland.asm...@adesso.at
W www.adesso.at

-
 >>> business. people. technology. <<<
-


RE: custom build environments?

2012-02-23 Thread Mandeville, Rob
Another possibility would be to put Boost in a non-standard location where 
autoconf/configure would never find it, install various versions of Boost that 
you need into various directories, and then pass command-line arguments to 
autoconf/configure specifying where to get your Boost library from.

A third one would be not to install Boost on your build host at all, but to 
throw the various versions into source control (or artifact repository) and 
pull them out at compile time as needed.

--Rob Mandeville
Litle & Co.
www.litle.com

From: jenkinsci-users@googlegroups.com 
[mailto:jenkinsci-users@googlegroups.com] On Behalf Of Dean Yu
Sent: Wednesday, February 22, 2012 8:05 PM
To: jenkinsci-users@googlegroups.com; Mark Waite
Subject: Re: custom build environments?

We have an internal plugin that manages chroots for exactly this scenario. We 
set up the chroot through a BuildWrapper, and we override the launch method so 
that each build step enters the chroot before it executes. There's a lot of 
internal-only code in here, so it's not something we can open source. However, 
if you want more information, I can sketch out some more detail for you.

  -- Dean


On 2/22/12 2:57 PM , "Mark Waite"  wrote:
I experimented once with a "chroot" environment as a way to have different 
configurations on the same Linux machine.  I found chroot to be more 
complicated than I was ready to use at the time, but I believe it can be used 
to provide different executable versions hosted over the same Linux kernel.

If you need different Linux kernels in addition to different libraries and 
tools, then I think you'll need separate machines (physical or virtual).

Mark Waite




 From: Les Mikesell 
 To: jenkinsci-users 
 Sent: Wednesday, February 22, 2012 1:19 PM
 Subject: custom build environments?


Does anyone have suggestions for how to get Jenkins to make Linux
builds that don't match the stock system environment that
autoconf/configure would find?  For example, if you want to have
multiple versions of boost installed and compile jobs that each need
some specific version.

The information in this message is for the intended recipient(s) only and may 
be the proprietary and/or confidential property of Litle & Co., LLC, and thus 
protected from disclosure. If you are not the intended recipient(s), or an 
employee or agent responsible for delivering this message to the intended 
recipient, you are hereby notified that any use, dissemination, distribution or 
copying of this communication is prohibited. If you have received this 
communication in error, please notify Litle & Co. immediately by replying to 
this message and then promptly deleting it and your reply permanently from your 
computer.


Re: Using svn export instead of svn checkout

2012-02-23 Thread Didier Durand
Hi,

Even if checkout was possible, I don't think that it is a good idea
from a perf standpoint: if you export a file, it gets out of svn
control and the changes cannot be tracked.

So, next time your run the job, you have to do a full export again
even if the file didn't change inbetween: can take a long time for a
big file.

So, as disk space is cheap, I would prefer several copies rather than
the network burden (and corresponding delay to start) of a big file

regards

didier

On Feb 23, 12:40 pm, "Asmann, Roland"  wrote:
> Hi all,
>
> Would it be possible to use 'svn export' instead of 'svn checkout'?
> We have a couple of projects that contain very large files, which are
> then obviously saved twice on the Server -- once as the actual file and
> once as the bas-version for SVN.
>
> Since we don't check-in stuff from Jenkins, we would definitely benefit
> in both performance and disc usage when getting our project using 'svn
> export'. Can this be added to the svn-plugin as one of the options?
>
> Thanks,
>
> Roland
>
> --
> Roland Asmann
> Senior Software Engineer
>
> adesso Austria GmbH
> Floridotower 26. Stock              T +43 1 2198790-27
> Floridsdorfer Hauptstr. 1           F +43 1 2198790-927
> A-1210 Wien                         M +43 664 88657566
>                                     E roland.asm...@adesso.at
>                                     Wwww.adesso.at
>
> -
>              >>> business. people. technology. <<<
> -


Using svn export instead of svn checkout

2012-02-23 Thread Asmann, Roland
Hi all,

Would it be possible to use 'svn export' instead of 'svn checkout'?
We have a couple of projects that contain very large files, which are 
then obviously saved twice on the Server -- once as the actual file and 
once as the bas-version for SVN.

Since we don't check-in stuff from Jenkins, we would definitely benefit 
in both performance and disc usage when getting our project using 'svn 
export'. Can this be added to the svn-plugin as one of the options?

Thanks,

Roland

-- 
Roland Asmann
Senior Software Engineer

adesso Austria GmbH
Floridotower 26. Stock  T +43 1 2198790-27
Floridsdorfer Hauptstr. 1   F +43 1 2198790-927
A-1210 Wien M +43 664 88657566
E roland.asm...@adesso.at
W www.adesso.at

-
 >>> business. people. technology. <<<
-


Error getting SSL context object

2012-02-23 Thread Pedro Lopez
Hello,

I am working on AIX with the jenkins version 1.444 and the java
version 1.6.0

I have the following error on stdout after launching jenkins
application.

[Winstone 2012/02/23 12:05:45] - Winstone shutdown successfully
[Winstone 2012/02/23 12:05:45] - Container startup failed
java.io.IOException: Failed to start a listener:
winstone.ssl.HttpsListener
at winstone.Launcher.spawnListener(Launcher.java:250)
at winstone.Launcher.(Launcher.java:206)
at winstone.Launcher.main(Launcher.java:398)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
48)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:
25)
at java.lang.reflect.Method.invoke(Method.java:600)
at Main._main(Main.java:268)
at Main.main(Main.java:96)
Caused by: winstone.WinstoneException: Error getting the SSL context
object
at winstone.ssl.HttpsListener.getSSLContext(HttpsListener.java:
290)
at
winstone.ssl.HttpsListener.getServerSocket(HttpsListener.java:196)
at winstone.HttpListener.start(HttpListener.java:70)
at winstone.Launcher.spawnListener(Launcher.java:241)
... 8 more

Feb 23, 2012 12:05:46 PM jenkins.InitReactorRunner$1 onAttained
INFO: Started initialization
Feb 23, 2012 12:05:46 PM hudson.WebAppMain$2 run
SEVERE: Failed to initialize Jenkins
Throwable occurred: java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:167)
at org.jvnet.hudson.reactor.Reactor.execute(Reactor.java:244)
at jenkins.InitReactorRunner.run(InitReactorRunner.java:43)
at jenkins.model.Jenkins.executeReactor(Jenkins.java:815)
at jenkins.model.Jenkins.(Jenkins.java:736)
at hudson.model.Hudson.(Hudson.java:81)
at hudson.model.Hudson.(Hudson.java:77)
at hudson.WebAppMain$2.run(WebAppMain.java:217)
Exception in thread "pool-2-thread-1" java.lang.NullPointerException
at org.jvnet.hudson.reactor.Reactor$2.run(Reactor.java:191)
at org.jvnet.hudson.reactor.Reactor$Node.run(Reactor.java:94)
at java.util.concurrent.ThreadPoolExecutor
$Worker.runTask(ThreadPoolExecutor.java:898)
at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor.java:920)
at java.lang.Thread.run(Thread.java:736)

To arrive at this error I make the following:

I create a private key with a self-signed certificate with the
command:
>keytool -genkey -alias self-signed -keyalg RSA -keystore security/keystore.jks 
>-dName "CN=Jenkins" -storepass [password] -keypass [password]
(the passwords are the same.)
I launch the jenkins to work with https with the command:
>java -Dhudson.Util.symlinkEscapeHatch=true -jar jenkins.war --httpPort=-1 
>--httpsPort=9443 --httpsKeyStore=security/keystore.jks 
>--httpsKeyStorePassword=[password] --ajp13Port=-1
(The password is the same as above).

And I get the error in the log: Caused by: winstone.WinstoneException:
Error getting the SSL context object...
I am not a specialist in security, maybe I do something wrong but did
you have any idea about the origin of my problem.

Thank's

Pedro


RE: custom build environments?

2012-02-23 Thread Nord, James
What we have done is use maven to setup the environment with some calls to tar 
etc.
We build boost and store it (versioned) in a maven repo (as tar.gz including 
object headers etc).
Then what needs boost downloades it and unpacks it into a workspace relative 
path.The make scrips are all configured to use workspace relative paths so to 
get a different version you change the maven dependency.

Its relatively simple - just make sure you use the platform tar not maven 
assembly plugin to create the archive (or you loose the symlinks).

As you're using autoconf I would guess you then need to pass in 
-with-boost=./boost or something equivellent

Hope that helps (although the chroot sounds much better :) )

/james

From: jenkinsci-users@googlegroups.com 
[mailto:jenkinsci-users@googlegroups.com] On Behalf Of Dean Yu
Sent: 23 February 2012 01:05
To: jenkinsci-users@googlegroups.com; Mark Waite
Subject: Re: custom build environments?

We have an internal plugin that manages chroots for exactly this scenario. We 
set up the chroot through a BuildWrapper, and we override the launch method so 
that each build step enters the chroot before it executes. There's a lot of 
internal-only code in here, so it's not something we can open source. However, 
if you want more information, I can sketch out some more detail for you.

  -- Dean


On 2/22/12 2:57 PM , "Mark Waite"  wrote:
I experimented once with a "chroot" environment as a way to have different 
configurations on the same Linux machine.  I found chroot to be more 
complicated than I was ready to use at the time, but I believe it can be used 
to provide different executable versions hosted over the same Linux kernel.

If you need different Linux kernels in addition to different libraries and 
tools, then I think you'll need separate machines (physical or virtual).

Mark Waite




 From: Les Mikesell 
 To: jenkinsci-users 
 Sent: Wednesday, February 22, 2012 1:19 PM
 Subject: custom build environments?


Does anyone have suggestions for how to get Jenkins to make Linux
builds that don't match the stock system environment that
autoconf/configure would find?  For example, if you want to have
multiple versions of boost installed and compile jobs that each need
some specific version.



**
This message is confidential and intended only for the addressee. If you have 
received this message in error, please immediately notify the 
postmas...@nds.com and delete it from your system as well as any copies. The 
content of e-mails as well as traffic data may be monitored by NDS for 
employment and security purposes. To protect the environment please do not 
print this e-mail unless necessary.

NDS Limited. Registered Office: One London Road, Staines, Middlesex, TW18 4EX, 
United Kingdom. A company registered in England and Wales. Registered no. 
3080780. VAT no. GB 603 8808 40-00
**


Re: Jenkins show wrong time?

2012-02-23 Thread Ed Bras
I finally changed it: UTC=false, but it made no difference, Jenkins keep
showing the time one hour ahead.. (strange..)
And now Maven shows one hour back.
So at the time of 10.00 (AM), jenkins shows 11:00 and Maven shows 9:00 in
the logging :(...

I am lost..
Ideas?

On Wed, Feb 15, 2012 at 8:14 AM, H3llGhost  wrote:

> Regarding the description your statement is correct, I don't give any
> cents on it.
> I would try it, perhahps it works for you, too.
>
> On Feb 14, 9:33 pm, Ed Bras  wrote:
> > Yes, but the bios contains the UTC time, so I think I should enable UTC,
> or
> > not?
> > I don't understand why I have to disable it, it's not logic in my
> case
> > .. (I could give it a try ofcourse)..
>


RE: Environment variable referencing to remote fs root

2012-02-23 Thread Matthew.Webber
That won’t work if you use a custom workspace for a job. The same probably 
applies if, under the global configuration, you have (under "Advanced") changed 
"Workspace Root Directory".
Matthew

> -Original Message-
> From: jenkinsci-users@googlegroups.com 
> [mailto:jenkinsci-users@googlegroups.com] On Behalf Of Sami
> Tikka
> Sent: 22 February 2012 22:26
> To: jenkinsci-users@googlegroups.com
> Subject: Re: Environment variable referencing to remote fs root
> 
> AFAIK such a variable does not exist but you can "cd .." starting from
> $WORKSPACE and eventually you should get to the directory that has
> slave.jar. I think that should be the directory that was configured as
> remote root directory.
> 
> -- Sami
> 

--
This e-mail and any attachments may contain confidential, copyright and or 
privileged material, and are for the use of the intended addressee only. If you 
are not the intended addressee or an authorised recipient of the addressee 
please notify us of receipt by returning the e-mail and do not use, copy, 
retain, distribute or disclose the information in or attached to the e-mail.
Any opinions expressed within this e-mail are those of the individual and not 
necessarily of Diamond Light Source Ltd.
Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments 
are free from viruses and we cannot accept liability for any damage which you 
may sustain as a result of software viruses which may be transmitted in or with 
the message.
Diamond Light Source Limited (company no. 4375679). Registered in England and 
Wales with its registered office at Diamond House, Harwell Science and 
Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom






Re: Problems with multiple java installations on a windows slave

2012-02-23 Thread Vincent Latombe
Did you declare your JDK in Jenkins' global settings? If you have done so,
you should be able to select for each job the JDK that you want to use.

Vincent


2012/2/22 Sami Tikka 

> I don't really use Maven that much but I do build Jenkins from time to
> time.
>
> Jenkins has at least two ways of doing a Maven build.
>
> 1) If you choose a "maven2/3 project" type when creating a job,
> Jenkins will not call mvn.bat when building. Instead it will load
> Maven classes and call them directly. I believe it will use the same
> jvm as is used to run Jenkins itself. I.e. use the same jvm for
> running Jenkins.
>
> 2) If you choose a freestyle project when creating a job, you can
> freely specify the command to run your build and set any environment
> variables the way you want. This would allow you to build your Maven
> project with a different jvm than used to run Jenkins. You will lose
> some things... you have to tell Jenkins where the test results are
> found and where are the build artifact to archive.
>
> -- Sami
>
> 2012/2/14 Dünnebeil Gerhard :
> > Hello everybody,
> >
> >
> >
> > recently I started using slave builds with jenkins.
> >
> >
> >
> > My configuration is Jenkins on a ubuntu (11.10) box and a slave with
> windows
> > XP.
> >
> >
> >
> > With that I ran into the following problem:
> >
> >
> >
> > I have two versions of java (one jre and one jdk) installed on my windows
> > machine. There are reasons I can’t stick with only one of them which are
> > beyond this discussion.
> >
> >
> >
> > Now when I run a maven job on this slave it chooses the jre as its java
> > location. This is a problem for me as the build needs tools.jar and some
> > other libs which are not found this way.
> >
> >
> >
> > I tried to force the use of the JDK by setting JAVA_HOME, JRE_HOME and by
> > manually setting the PATH to “” (empty).  Nothing helped.
> >
> > I also set MAVEN_BATCH_ECHO=on which had no obvious result.
> >
> >
> >
> > So I tried to debug maven by starting maven from a pre-start step (“mvn
> > –v”).
> >
> > The result was interesting as this maven instance reacted to
> > MAVEN_BATCH_ECHO and showed the correct java instance.
> >
> >
> >
> > So for me it seems that Jenkins somehow bypasses the maven batch
> (mvn.bat)
> > and/or ignores the environment variables set.
> >
> >
> >
> > Can somebody help me here?
> >
> >
> >
> > Thanks
> >
> > Gerhard Duennebeil
> >
> >
> >
> > __
> >
> > Gerhard Dünnebeil
> > Safety & Security Department
> > SIM
> >
> >
> > Bitte beachten Sie unseren neuen Firmennamen und neue Kontaktdaten!
> >
> > Please note our new company name and contact details!
> > AIT Austrian Institute of Technology GmbH
> > 2444 Seibersdorf | Austria
> > T +43(0) 50550-3173|  F +43(0) 50550-2813
> >
> > gerhard.duenneb...@ait.ac.at  |  http://www.ait.ac.at
> >
> > FN: 115980 i HG Wien  |  UID: ATU14703506
> > This email and any attachments thereto, is intended only for use by the
> > addressee(s) named herein and may contain legally privileged and/or
> > confidential information. If you are not the intended recipient, please
> > notify the sender by return e-mail or by telephone and delete this
> message
> > from your system and any printout thereof. Any unauthorized use,
> > reproduction, or dissemination of this message is strictly prohibited.
> > Please note that e-mails are susceptible to change. AIT Austrian
> Institute
> > of Technology GmbH shall not be liable for the improper or incomplete
> > transmission of the information contained in this communication, nor
> shall
> > it be liable for any delay in its receipt.
> >
> >
>