RE: Another LTS release needed

2013-01-23 Thread Sandell, Robert
"Fixed the lock contention problem on Queue.getItems()"

It is stated as a feature on 1.483 so I don't know if it can be considered a 
bugfix for LTS backporting, but if it can get in 1.480.3 we wouldn't need to 
maintain our internal fork with a similar fix anymore.


Robert Sandell
Software Tools Engineer - SW Environment and Product Configuration
Sony Mobile Communications

From: jenkinsci-dev@googlegroups.com [mailto:jenkinsci-dev@googlegroups.com] On 
Behalf Of Kohsuke Kawaguchi
Sent: den 22 januari 2013 19:51
To: jenkinsci-dev@googlegroups.com
Subject: Another LTS release needed

There were a number of fall-out issues after SECURITY-49. As Jesse found out, 
some of them are pretty bad, such as JENKINS-16319 and JENKINS-16278.

So I think we need to release 1.480.3.

Any other issues that we need to backport?

--
Kohsuke Kawaguchi


RE: [RFC] any idea for give-aways

2013-01-23 Thread Sandell, Robert
Pin badges aren't that expensive to make if you buy enough of them in bulk, 
like 1500+, depending on manufacturer. Then they should be in the cost range of 
stickers.

Small note blocks, or post it notes?

/B

From: jenkinsci-dev@googlegroups.com [mailto:jenkinsci-dev@googlegroups.com] On 
Behalf Of Kohsuke Kawaguchi
Sent: den 23 januari 2013 21:09
To: jenkinsci-dev@googlegroups.com; eve...@lists.jenkins-ci.org; 
jenkinsci-us...@googlegroups.com
Subject: [RFC] any idea for give-aways

In the project meeting today, we had a conversation about what give-aways to 
make for this year.

In the past several years we made 3"x3" stickers, and while those are still 
very popular, I thought it might be fun to see if we can make something else as 
well.

Ideally it'd be not too expensive, and it shouldn't be too bulky nor too heavy. 
Any discounts you can find would be greatly appreciated.

Some of the ideas include a pin badge, although I haven't found any price 
information on it.

If you have any thoughts, please let us know!

--
Kohsuke Kawaguchi


Re: AbstractTestResultAction#getFailedTests()

2013-01-23 Thread Nalin Makar
Thanks Dean. I'll create a pull request deprecating this method and
introducing a new one.


On Wed, Jan 23, 2013 at 10:56 AM, Dean Yu  wrote:

>  Here's the commit where this was added:
>
>
> https://github.com/jenkinsci/jenkins/commit/f9823e39d17debd2e914ce13cdeec3b43581f09e
>
>  I would call this a case of poor abstraction. Seems like the signature
> should return List.
>
>-- Dean
>
>   From: Nalin Makar 
> Reply-To: "jenkinsci-dev@googlegroups.com"  >
> Date: Wednesday, January 23, 2013 10:38 AM
> To: jenkinsci-dev , "
> jenkinsci-us...@googlegroups.com" 
> Subject: Re: AbstractTestResultAction#getFailedTests()
>
>   Ping! Any information/suggestions would help.
>
>
> On Mon, Jan 21, 2013 at 10:57 PM, Nalin Makar wrote:
>
>> Hi,
>>
>>  I have a question regarding
>> https://github.com/jenkinsci/jenkins/blob/master/core/src/main/java/hudson/tasks/test/AbstractTestResultAction.java#L191
>>
>>  AbstractTestResultAction is described as:
>>
>>
>> /**
>>  * Common base class for recording test result.
>>  *
>>  * 
>>  * {@link Project} and {@link Build} recognizes {@link Action}s that derive 
>> from this,
>>  * and displays it nicely (regardless of the underlying implementation.)
>>  *
>>  * @author Kohsuke Kawaguchi
>>  */
>>
>> But the method getFailedTests() in this class returns 
>> List
>> instead of something more generic like List
>>
>>  why is it done this way?
>>
>>  I have been updating TestNG plugin for Jenkins to fall in line with
>> other test reporting plugins and have it's BuildAction implement
>> AbstractTestResultAction, but I don't want to change the result classes to
>> also have to implement a Junit specific class 
>> (hudson.tasks.junit.CaseResult).
>> This means I still can't have email-ext plugin report on TestNG results in
>> a generic way.
>>
>>  Thanks!
>> --
>> -nalin
>>
>
>
>
>  --
> -nalin
>
>


-- 
-nalin


RE: [Jenkins-events] [RFC] any idea for give-aways

2013-01-23 Thread Sandell, Robert
Dreaming on: And the drive could be pre-flashed with a Linux-Jenkins Live CD 
(with the beer plugin installed as well)
Just put the beer opener into your computer an boot it up; Instant Jenkins and 
a reason to have a beer :D

/B
From: jenkinsci-dev@googlegroups.com [mailto:jenkinsci-dev@googlegroups.com] On 
Behalf Of Larry Shatzer, Jr.
Sent: den 23 januari 2013 21:31
To: jenkinsci-dev@googlegroups.com
Subject: Re: [Jenkins-events] [RFC] any idea for give-aways

At a No Fluff, Just Stuff confernce one year I got a keychain opener that also 
was a USB drive, and it was nice and metal. Found a similar one online: 
http://www.logotech.com/bottle-opener-usb-drive-fdmt161.html
Although that might be a bit expensive...


On Wed, Jan 23, 2013 at 1:23 PM, Lisa Wells 
mailto:lwe...@cloudbees.com>> wrote:
Beer is the first thing that comes to mind, but it's heavy, tough to ship, and 
short-lived... maybe keychain beer openers?

Opening your beer is the butler's job...
On Wed, Jan 23, 2013 at 2:09 PM, Kohsuke Kawaguchi 
mailto:k...@kohsuke.org>> wrote:
In the project meeting today, we had a conversation about what give-aways to 
make for this year.

In the past several years we made 3"x3" stickers, and while those are still 
very popular, I thought it might be fun to see if we can make something else as 
well.

Ideally it'd be not too expensive, and it shouldn't be too bulky nor too heavy. 
Any discounts you can find would be greatly appreciated.

Some of the ideas include a pin badge, although I haven't found any price 
information on it.

If you have any thoughts, please let us know!

--
Kohsuke Kawaguchi

___
Jenkins-events mailing list
jenkins-eve...@lists.jenkins-ci.org
http://lists.jenkins-ci.org/mailman/listinfo/jenkins-events



--

Lisa Wells
Partner Marketing Bee
www.CloudBees.com  |  
Blog.CloudBees.com  | +1 
512.751.8423  |  @productprincipl



Re: Re: Advice on developing HA solution

2013-01-23 Thread Vojtech Juranek
> At the same time, I felt that one step we can make toward that (and I've
> covered this in my JUC talks) is to start building channels between masters
> such that they can talk to each other.

IMHO another possible solution would be implement data layer and use some 
existing memory grid solution. But I've never done any investigation what 
would be more easy to implements




Re:Programmatically changing global object configuration

2013-01-23 Thread KEVIN FLEMING (BLOOMBERG/ 731 LEXIN)
Replying to my own question... Hudson.getInstance().save() does the trick.

- Original Message -
From: jenkinsci-dev@googlegroups.com
To: jenkinsci-dev@googlegroups.com
At: Jan 22 2013 16:22:47

I am working on a new feature in the EC2 plugin, and part of this feature 
involves making a change to an existing SlaveTemplate object. SlaveTemplate 
objects are owned by the EC2Cloud object, which inherit from the Jenkins Cloud 
class, are configured/instantiated in the global configuration page.

I've only been working with this a few weeks, but I believe I have a basic idea 
of how these objects get created, serialized and deserialized, and I've been 
able to add member variables and have them properly persisted and restored.

However, after reviewing the class heirarchy I don't see a way for objects of 
the SlaveTemplate class to 'save' themselves at their own request (which would 
result in updating the Jenkins config.xml). They don't implement the Saveable 
interface, nor do any of their parent classes, although it appears that their 
DescriptorImpl class does because it extends Descriptor.

Can someone give me a hint how to approach this?


Re: [RFC] any idea for give-aways

2013-01-23 Thread Daniel PETISME
What about a USB Jenkins kit :)
 - an USB stick with a Jenkins logo on it
 - the latest Jenkins version in it (the war or natives)
 - Some docs
  - The Jenkins manual
  - A Jenkins "Quick Win"/cheatsheet

Otherwise, some classics
- A shirt
- A (beer) bottle opener 
- A mug 
 

On Wednesday, January 23, 2013 9:09:08 PM UTC+1, Kohsuke Kawaguchi wrote:
>
> In the project meeting today, we had a conversation about what give-aways 
> to make for this year.
>
> In the past several years we made 3"x3" stickers, and while those are 
> still very popular, I thought it might be fun to see if we can make 
> something else as well.
>
> Ideally it'd be not too expensive, and it shouldn't be too bulky nor too 
> heavy. Any discounts you can find would be greatly appreciated.
>
> Some of the ideas include a pin badge, although I haven't found any price 
> information on it.
>
> If you have any thoughts, please let us know!
>
> -- 
> Kohsuke Kawaguchi 
>


Help troubleshooting Jenkins slow page load times.

2013-01-23 Thread Maxfield Stewart
Hello!

We recently upgraded our Jenkins deploy from 1.480 to 1.484. Technically we 
were trying to upgrade to 1.492 which was the latest at the time.  That 
upgrade failed for various plugin compatibility problems and we downgraded, 
Eventually settling on 1.484.  In the process we inherited terribly slow 
page load times and are having trouble figuring out how to 
troubleshoot/identify the cause.  Here's a list of what we know right now:

* CPU: The java process for jenkins sits around %4-%8 CPU utlization
* Memory: We have a 5GB heap allocated, which we use about 1.5GB.  We do 
have a memory leak, but page load times are slow even on initial restart, 
the leak takes about a week to become a problem.
* Garbage Collection: We're executing Full GC's rarely, maybe once every 
10-15 minutes, they last about a second until the memory leak hits capacity.
* Disk Utilization: Nominal, no obvious signs that the drives are I/O 
locking.

Page loads are intermittantly bad, and worse once we crest 20-30 http 
sessions on the box.  "Bad" is defined as we're often waiting 4-8 seconds 
for a page load, on any page in Jenkins.  Experimenting with the load 
times, it appears to be some kind of locking/resource contention as you can 
make many requests at once, they'll all "wait" and then load at the same 
time after 4-8 seconds.  When we ran 1.480 our page load times were under a 
second, extremely snappy.

I've looked at running java threads and nothing looks clearly locked. 
 There were some Jenkins patch notes indicating that the number of HTTP 
workers was reduced from 1000 to 10 between version 1.480 and 1.484 but I 
have no way of proving if that impacted us or not.

I'm looking for guidance on ways I can troubleshoot this problem and 
identify the issue.  This is an extremely active Jenkins environment and I 
cannot just do certain things, like unilaterally disable all plugins, or 
continuously restart Jenkins, we're running CI's here nearly 24/7.  I was 
hoping there was something specific I can look for either with the 
JavaMelody information or other monitoring tools.  Are there any best 
practices here?




Re: [Jenkins-events] [RFC] any idea for give-aways

2013-01-23 Thread Larry Shatzer, Jr.
At a No Fluff, Just Stuff confernce one year I got a keychain opener that
also was a USB drive, and it was nice and metal. Found a similar one
online: http://www.logotech.com/bottle-opener-usb-drive-fdmt161.html

Although that might be a bit expensive...



On Wed, Jan 23, 2013 at 1:23 PM, Lisa Wells  wrote:

> Beer is the first thing that comes to mind, but it's heavy, tough to ship,
> and short-lived... maybe keychain beer openers?
>
> Opening your beer is the butler's job...
>
> On Wed, Jan 23, 2013 at 2:09 PM, Kohsuke Kawaguchi  wrote:
>
>> In the project meeting today, we had a conversation about what give-aways
>> to make for this year.
>>
>> In the past several years we made 3"x3" stickers, and while those are
>> still very popular, I thought it might be fun to see if we can make
>> something else as well.
>>
>> Ideally it'd be not too expensive, and it shouldn't be too bulky nor too
>> heavy. Any discounts you can find would be greatly appreciated.
>>
>> Some of the ideas include a pin badge, although I haven't found any price
>> information on it.
>>
>> If you have any thoughts, please let us know!
>>
>> --
>> Kohsuke Kawaguchi
>>
>> ___
>> Jenkins-events mailing list
>> jenkins-eve...@lists.jenkins-ci.org
>> http://lists.jenkins-ci.org/mailman/listinfo/jenkins-events
>>
>>
>
>
> --
>
>  Lisa Wells
> Partner Marketing Bee
> www.CloudBees.com  |  Blog.CloudBees.com  | +1 512.751.8423  |
> @productprincipl
>


Re: [Jenkins-events] [RFC] any idea for give-aways

2013-01-23 Thread David Tolley
Oh SNAP! Best idea EVER.

On Wed, Jan 23, 2013 at 12:23 PM, Lisa Wells  wrote:
> Beer is the first thing that comes to mind, but it's heavy, tough to ship,
> and short-lived... maybe keychain beer openers?
>
> Opening your beer is the butler's job...
>
> On Wed, Jan 23, 2013 at 2:09 PM, Kohsuke Kawaguchi  wrote:
>>
>> In the project meeting today, we had a conversation about what give-aways
>> to make for this year.
>>
>> In the past several years we made 3"x3" stickers, and while those are
>> still very popular, I thought it might be fun to see if we can make
>> something else as well.
>>
>> Ideally it'd be not too expensive, and it shouldn't be too bulky nor too
>> heavy. Any discounts you can find would be greatly appreciated.
>>
>> Some of the ideas include a pin badge, although I haven't found any price
>> information on it.
>>
>> If you have any thoughts, please let us know!
>>
>> --
>> Kohsuke Kawaguchi
>>
>> ___
>> Jenkins-events mailing list
>> jenkins-eve...@lists.jenkins-ci.org
>> http://lists.jenkins-ci.org/mailman/listinfo/jenkins-events
>>
>
>
>
> --
>
> Lisa Wells
> Partner Marketing Bee
> www.CloudBees.com  |  Blog.CloudBees.com  | +1 512.751.8423  |
> @productprincipl



-- 
David Tolley
Engineer/Build & Release

600 W. Chicago Ave, Chicago, IL 60654
Mobile: 408-643-2424
Groupon II Grouponworks


Re: Wiki Schedulers & License

2013-01-23 Thread Larry Shatzer, Jr.
A restart wouldn't hurt... Let me know when it's restarted, and I know
quickly how to see if the scheduler is fixed...


On Wed, Jan 23, 2013 at 12:51 PM, Kohsuke Kawaguchi  wrote:

> I don't think we've changed anything. Should we just restart it?
>
> I'll put the new license in place, but it's not really a hurry because an
> expired license doesn't prevent Confluence/JIRA from operating. AFAIK, the
> only time the license is checked is when we upgrade.
>
>
> 2013/1/17 Larry Shatzer, Jr. 
>
> Kohsuke,
>>
>> I noticed that the Dashboard showing recent changes had not been updated
>> in a while. I had to manually fire off the Content Indexing task, and the
>> mail queue had backed up, and I had to manually flush that too. I've been
>> running those by hand on occasion.
>>
>> (https://wiki.jenkins-ci.org/admin/viewindexqueue.action and
>> https://wiki.jenkins-ci.org/admin/mail/viewmailqueue.action)
>>
>> It looks like we have a problem with the scheduler in Confluence. Did
>> anything recently change? The problem started to manifest itself weeks
>> after the latest restart, so I'm not sure what is causing it.
>>
>> It also looks like the license needs to be upgraded soon.
>>
>> -- Larry
>>
>
>
>
> --
> Kohsuke Kawaguchi
>


Re: [Jenkins-events] [RFC] any idea for give-aways

2013-01-23 Thread Lisa Wells
Beer is the first thing that comes to mind, but it's heavy, tough to ship,
and short-lived... maybe keychain beer openers?

Opening your beer is the butler's job...

On Wed, Jan 23, 2013 at 2:09 PM, Kohsuke Kawaguchi  wrote:

> In the project meeting today, we had a conversation about what give-aways
> to make for this year.
>
> In the past several years we made 3"x3" stickers, and while those are
> still very popular, I thought it might be fun to see if we can make
> something else as well.
>
> Ideally it'd be not too expensive, and it shouldn't be too bulky nor too
> heavy. Any discounts you can find would be greatly appreciated.
>
> Some of the ideas include a pin badge, although I haven't found any price
> information on it.
>
> If you have any thoughts, please let us know!
>
> --
> Kohsuke Kawaguchi
>
> ___
> Jenkins-events mailing list
> jenkins-eve...@lists.jenkins-ci.org
> http://lists.jenkins-ci.org/mailman/listinfo/jenkins-events
>
>


-- 

 Lisa Wells
Partner Marketing Bee
www.CloudBees.com  |  Blog.CloudBees.com  | +1 512.751.8423  |
@productprincipl


[RFC] any idea for give-aways

2013-01-23 Thread Kohsuke Kawaguchi
In the project meeting today, we had a conversation about what give-aways
to make for this year.

In the past several years we made 3"x3" stickers, and while those are still
very popular, I thought it might be fun to see if we can make something
else as well.

Ideally it'd be not too expensive, and it shouldn't be too bulky nor too
heavy. Any discounts you can find would be greatly appreciated.

Some of the ideas include a pin badge, although I haven't found any price
information on it.

If you have any thoughts, please let us know!

-- 
Kohsuke Kawaguchi


Re: Wiki Schedulers & License

2013-01-23 Thread Kohsuke Kawaguchi
I don't think we've changed anything. Should we just restart it?

I'll put the new license in place, but it's not really a hurry because an
expired license doesn't prevent Confluence/JIRA from operating. AFAIK, the
only time the license is checked is when we upgrade.


2013/1/17 Larry Shatzer, Jr. 

> Kohsuke,
>
> I noticed that the Dashboard showing recent changes had not been updated
> in a while. I had to manually fire off the Content Indexing task, and the
> mail queue had backed up, and I had to manually flush that too. I've been
> running those by hand on occasion.
>
> (https://wiki.jenkins-ci.org/admin/viewindexqueue.action and
> https://wiki.jenkins-ci.org/admin/mail/viewmailqueue.action)
>
> It looks like we have a problem with the scheduler in Confluence. Did
> anything recently change? The problem started to manifest itself weeks
> after the latest restart, so I'm not sure what is causing it.
>
> It also looks like the license needs to be upgraded soon.
>
> -- Larry
>



-- 
Kohsuke Kawaguchi


Re: AbstractTestResultAction#getFailedTests()

2013-01-23 Thread Dean Yu
Here's the commit where this was added:

https://github.com/jenkinsci/jenkins/commit/f9823e39d17debd2e914ce13cdeec3b43581f09e

I would call this a case of poor abstraction. Seems like the signature should 
return List.

  -- Dean

From: Nalin Makar mailto:nalin.ma...@gmail.com>>
Reply-To: 
"jenkinsci-dev@googlegroups.com" 
mailto:jenkinsci-dev@googlegroups.com>>
Date: Wednesday, January 23, 2013 10:38 AM
To: jenkinsci-dev 
mailto:jenkinsci-dev@googlegroups.com>>, 
"jenkinsci-us...@googlegroups.com" 
mailto:jenkinsci-us...@googlegroups.com>>
Subject: Re: AbstractTestResultAction#getFailedTests()

Ping! Any information/suggestions would help.


On Mon, Jan 21, 2013 at 10:57 PM, Nalin Makar 
mailto:nalin.ma...@gmail.com>> wrote:
Hi,

I have a question regarding 
https://github.com/jenkinsci/jenkins/blob/master/core/src/main/java/hudson/tasks/test/AbstractTestResultAction.java#L191

AbstractTestResultAction is described as:

/**
 * Common base class for recording test result.
 *
 * 
 * {@link Project} and {@link Build} recognizes {@link Action}s that derive 
from this,
 * and displays it nicely (regardless of the underlying implementation.)
 *
 * @author Kohsuke Kawaguchi
 */


But the method getFailedTests() in this class returns 
List instead of something more generic like 
List

why is it done this way?

I have been updating TestNG plugin for Jenkins to fall in line with other test 
reporting plugins and have it's BuildAction implement AbstractTestResultAction, 
but I don't want to change the result classes to also have to implement a Junit 
specific class (hudson.tasks.junit.CaseResult). This means I still can't have 
email-ext plugin report on TestNG results in a generic way.

Thanks!
--
-nalin



--
-nalin


Re: AbstractTestResultAction#getFailedTests()

2013-01-23 Thread Nalin Makar
Ping! Any information/suggestions would help.


On Mon, Jan 21, 2013 at 10:57 PM, Nalin Makar  wrote:

> Hi,
>
> I have a question regarding
> https://github.com/jenkinsci/jenkins/blob/master/core/src/main/java/hudson/tasks/test/AbstractTestResultAction.java#L191
>
> AbstractTestResultAction is described as:
>
>
> /**
>  * Common base class for recording test result.
>  *
>  * 
>  * {@link Project} and {@link Build} recognizes {@link Action}s that derive 
> from this,
>  * and displays it nicely (regardless of the underlying implementation.)
>  *
>  * @author Kohsuke Kawaguchi
>  */
>
> But the method getFailedTests() in this class returns 
> List
> instead of something more generic like List
>
> why is it done this way?
>
> I have been updating TestNG plugin for Jenkins to fall in line with other
> test reporting plugins and have it's BuildAction implement
> AbstractTestResultAction, but I don't want to change the result classes to
> also have to implement a Junit specific class (hudson.tasks.junit.CaseResult).
> This means I still can't have email-ext plugin report on TestNG results in
> a generic way.
>
> Thanks!
> --
> -nalin
>



-- 
-nalin


Re: Advice on developing HA solution

2013-01-23 Thread Andrew Melo
Hi Bruno

On Wed, Jan 23, 2013 at 10:46 AM, Bruno P. Kinoshita <
brunodepau...@yahoo.com.br> wrote:

> Hi Andrew!
>
> >That PBS plugin looks *amazing*. I have access to a sizable (~4000 core)
> PBS cluster and was debating asking for an upgrade to my jenkins box, but
> it looks like I can just farm out my long-running build tasks to the
> cluster :)
>
>
> That's the idea :o) I have _partial_ access to a small PBS cluster with 32
> nodes/8 core each, where I've tried submitting jobs with MPI and OpenMP.
>
> The PBS plug-in [1] is still under development and needs some adjustments.
> The researcher member of BioUno is relocating from Sao Paulo to New
> Orleans, so I'm waiting for him to continue the work on BioUno.


> But let me know if you are would like to try the plug-in. I could do some
> final adjustments and send you a packaged hpi file, probably before or
> during Carnival in February.
>

No rush, I've got plenty on my plate right now, but it would definitely
help in the future.

-Andrew


> Cheers
>
> [1] https://github.com/tupilabs/pbs-plugin
>
> Bruno P. Kinoshita
> http://kinoshita.eti.br
> http://tupilabs.com
>
>
> >
> > From: Andrew Melo 
> >To: jenkinsci-dev@googlegroups.com
> >Sent: Wednesday, January 23, 2013 2:33 PM
> >Subject: Re: Advice on developing HA solution
> >
> >
> >Hi bruno
> >
> >
> >On Wed, Jan 23, 2013 at 3:53 AM, Bruno P. Kinoshita <
> brunodepau...@yahoo.com.br> wrote:
> >
> >Morning Mikael!
> >>
> >>We have been working on a bioinformatics solution with Jenkins [1]. We
> are working to connect Jenkins with a PBS server. Similar to what is done
> with the EC2 plug-in, however, we are working to connect Jenkins build
> queue to PBS job queue.
> >>
> >>Our goal is provide a PBS Project, and let users submit jobs (or simply
> build steps) to PBS servers without having to write PBS scripts (this would
> be done via a plug-in).
> >>
> >>The PBS server and the job scheduler (either the native one or Maui)
> would then schedule the jobs/buildsteps to one of the PBS nodes.
> >>
> >>The jobs are handled in the PBS server by a job queue, similar to the
> build queue in Jenkins. We are now working to include the pbs jobs in the
> Jenkins build queue.
> >>
> >>This way, if you had a very long build step, like finding contigs in
> shotgun DNA sequences using some NGS program, you could schedule a job in
> Jenkins but run this long task in the PBS cluster and be notified once the
> program has finished.
> >>
> >>Just 0.02 cents to your research :o) All the best,
> >>
> >
> >
> >That PBS plugin looks *amazing*. I have access to a sizable (~4000 core)
> PBS cluster and was debating asking for an upgrade to my jenkins box, but
> it looks like I can just farm out my long-running build tasks to the
> cluster :)
> >
> >
> >-Andrew
> >
> >
> >>[1] biouno.org
> >>
> >>Bruno P. Kinoshita
> >>http://kinoshita.eti.br
> >>http://tupilabs.com
> >>
> >>
> >>>
> >>> From: Mikael Stockman 
> >>>To: jenkinsci-dev@googlegroups.com
> >>>Sent: Wednesday, January 23, 2013 6:55 AM
> >>>Subject: Advice on developing HA solution
> >>
> >>>
> >>>
> >>>Hi!
> >>>We are two thesis workers who have been assigned the task of
> investigating
> >>>possible high availability solutions for Jenkins.
> >>>
> >>>
> >>>We are aware of Cloudbees and their HA plugin, but the company that we
> are working
> >>>for is looking for a solution where two jenkins masters can run
> simultaneously, and
> >>>possibly share the load between each other.
> >>>The desired solution would not need the user to be aware of that there
> are several
> >>>Jenkins instances, but it should look like one Jenkins from the users
> perspective.
> >>>It is not necessary that the Jenkins instances share JENKINS_HOME.
> >>>
> >>>
> >>>We have been thinking about different possible ways to achieve this.
> But writing a plugin
> >>>seems promising. However there may be other solutions such as a plugin
> working with an external
> >>>program, or possibly an entirely external solution.
> >>>
> >>>
> >>>If anyone has has been working with this, we would be very happy to
> hear your
> >>>thoughts.
> >>>
> >>>
> >>>Also, we could really benefit from some advice on what to look out for,
> and
> >>>what can cause problems.
> >>>
> >>>
> >>>Actually any input on this topic will be valuable to us.
> >>>
> >>>
> >>>Thanks in advance!
> >>>
> >>>
> >>>Best regards
> >>>Mikael and Daniel
> >>>
> >>>
> >>
> >
> >
> >
> >--
> >--
> >Andrew Melo
> >
> >
> >
>



-- 
--
Andrew Melo


Re: Advice on developing HA solution

2013-01-23 Thread Bruno P. Kinoshita
Hi Andrew! 

>That PBS plugin looks *amazing*. I have access to a sizable (~4000 core) PBS 
>cluster and was debating asking for an upgrade to my jenkins box, but it looks 
>like I can just farm out my long-running build tasks to the cluster :)


That's the idea :o) I have _partial_ access to a small PBS cluster with 32 
nodes/8 core each, where I've tried submitting jobs with MPI and OpenMP. 

The PBS plug-in [1] is still under development and needs some adjustments. The 
researcher member of BioUno is relocating from Sao Paulo to New Orleans, so I'm 
waiting for him to continue the work on BioUno.

But let me know if you are would like to try the plug-in. I could do some final 
adjustments and send you a packaged hpi file, probably before or during 
Carnival in February.

Cheers

[1] https://github.com/tupilabs/pbs-plugin

Bruno P. Kinoshita
http://kinoshita.eti.br
http://tupilabs.com


>
> From: Andrew Melo 
>To: jenkinsci-dev@googlegroups.com 
>Sent: Wednesday, January 23, 2013 2:33 PM
>Subject: Re: Advice on developing HA solution
> 
>
>Hi bruno
>
>
>On Wed, Jan 23, 2013 at 3:53 AM, Bruno P. Kinoshita 
> wrote:
>
>Morning Mikael!
>>
>>We have been working on a bioinformatics solution with Jenkins [1]. We are 
>>working to connect Jenkins with a PBS server. Similar to what is done with 
>>the EC2 plug-in, however, we are working to connect Jenkins build queue to 
>>PBS job queue. 
>>
>>Our goal is provide a PBS Project, and let users submit jobs (or simply build 
>>steps) to PBS servers without having to write PBS scripts (this would be done 
>>via a plug-in). 
>>
>>The PBS server and the job scheduler (either the native one or Maui) would 
>>then schedule the jobs/buildsteps to one of the PBS nodes. 
>>
>>The jobs are handled in the PBS server by a job queue, similar to the build 
>>queue in Jenkins. We are now working to include the pbs jobs in the Jenkins 
>>build queue.
>>
>>This way, if you had a very long build step, like finding contigs in 
>>shotgun DNA sequences using some NGS program, you could schedule a job in 
>>Jenkins but run this long task in the PBS cluster and be notified once the 
>>program has finished.
>>
>>Just 0.02 cents to your research :o) All the best,
>>
>
>
>That PBS plugin looks *amazing*. I have access to a sizable (~4000 core) PBS 
>cluster and was debating asking for an upgrade to my jenkins box, but it looks 
>like I can just farm out my long-running build tasks to the cluster :)
>
>
>-Andrew
> 
>
>>[1] biouno.org
>>
>>Bruno P. Kinoshita
>>http://kinoshita.eti.br
>>http://tupilabs.com
>>
>>
>>>
>>> From: Mikael Stockman 
>>>To: jenkinsci-dev@googlegroups.com
>>>Sent: Wednesday, January 23, 2013 6:55 AM
>>>Subject: Advice on developing HA solution
>>
>>>
>>>
>>>Hi!
>>>We are two thesis workers who have been assigned the task of investigating
>>>possible high availability solutions for Jenkins.
>>>
>>>
>>>We are aware of Cloudbees and their HA plugin, but the company that we are 
>>>working
>>>for is looking for a solution where two jenkins masters can run 
>>>simultaneously, and 
>>>possibly share the load between each other.
>>>The desired solution would not need the user to be aware of that there are 
>>>several
>>>Jenkins instances, but it should look like one Jenkins from the users 
>>>perspective.
>>>It is not necessary that the Jenkins instances share JENKINS_HOME.
>>>
>>>
>>>We have been thinking about different possible ways to achieve this. But 
>>>writing a plugin
>>>seems promising. However there may be other solutions such as a plugin 
>>>working with an external
>>>program, or possibly an entirely external solution.
>>>
>>>
>>>If anyone has has been working with this, we would be very happy to hear your
>>>thoughts.
>>>
>>>
>>>Also, we could really benefit from some advice on what to look out for, and 
>>>what can cause problems.
>>>
>>>
>>>Actually any input on this topic will be valuable to us.
>>>
>>>
>>>Thanks in advance!
>>>
>>>
>>>Best regards
>>>Mikael and Daniel
>>>
>>> 
>>
>
>
>
>-- 
>--
>Andrew Melo
>
>
> 


Re: Advice on developing HA solution

2013-01-23 Thread Andrew Melo
Hi bruno

On Wed, Jan 23, 2013 at 3:53 AM, Bruno P. Kinoshita <
brunodepau...@yahoo.com.br> wrote:

> Morning Mikael!
>
> We have been working on a bioinformatics solution with Jenkins [1]. We are
> working to connect Jenkins with a PBS server. Similar to what is done with
> the EC2 plug-in, however, we are working to connect Jenkins build queue to
> PBS job queue.
>
> Our goal is provide a PBS Project, and let users submit jobs (or simply
> build steps) to PBS servers without having to write PBS scripts (this would
> be done via a plug-in).
>
> The PBS server and the job scheduler (either the native one or Maui) would
> then schedule the jobs/buildsteps to one of the PBS nodes.
>
> The jobs are handled in the PBS server by a job queue, similar to the
> build queue in Jenkins. We are now working to include the pbs jobs in the
> Jenkins build queue.
>
> This way, if you had a very long build step, like finding contigs in
> shotgun DNA sequences using some NGS program, you could schedule a job in
> Jenkins but run this long task in the PBS cluster and be notified once the
> program has finished.
>
> Just 0.02 cents to your research :o) All the best,
>

That PBS plugin looks *amazing*. I have access to a sizable (~4000 core)
PBS cluster and was debating asking for an upgrade to my jenkins box, but
it looks like I can just farm out my long-running build tasks to the
cluster :)

-Andrew


>
> [1] biouno.org
>
> Bruno P. Kinoshita
> http://kinoshita.eti.br
> http://tupilabs.com
>
>
> >
> > From: Mikael Stockman 
> >To: jenkinsci-dev@googlegroups.com
> >Sent: Wednesday, January 23, 2013 6:55 AM
> >Subject: Advice on developing HA solution
> >
> >
> >Hi!
> >We are two thesis workers who have been assigned the task of investigating
> >possible high availability solutions for Jenkins.
> >
> >
> >We are aware of Cloudbees and their HA plugin, but the company that we
> are working
> >for is looking for a solution where two jenkins masters can run
> simultaneously, and
> >possibly share the load between each other.
> >The desired solution would not need the user to be aware of that there
> are several
> >Jenkins instances, but it should look like one Jenkins from the users
> perspective.
> >It is not necessary that the Jenkins instances share JENKINS_HOME.
> >
> >
> >We have been thinking about different possible ways to achieve this. But
> writing a plugin
> >seems promising. However there may be other solutions such as a plugin
> working with an external
> >program, or possibly an entirely external solution.
> >
> >
> >If anyone has has been working with this, we would be very happy to hear
> your
> >thoughts.
> >
> >
> >Also, we could really benefit from some advice on what to look out for,
> and
> >what can cause problems.
> >
> >
> >Actually any input on this topic will be valuable to us.
> >
> >
> >Thanks in advance!
> >
> >
> >Best regards
> >Mikael and Daniel
> >
> >
>



-- 
--
Andrew Melo


Re: Advice on developing HA solution

2013-01-23 Thread Kohsuke Kawaguchi
If you have some idea about how to go about this, I'd love to hear. So far
I haven't managed to come up with a reliable scheme that keeps existing
plugins happy.

At the same time, I felt that one step we can make toward that (and I've
covered this in my JUC talks) is to start building channels between masters
such that they can talk to each other.

Such a general purpose communication channel can be then used for all kinds
of purposes, and anything that lets multiple masters work together brings
us closer to that direction.

If you are interested in joining hands on this effort, I'd love to.



2013/1/23 Mikael Stockman 

> Hi!
> We are two thesis workers who have been assigned the task of investigating
> possible high availability solutions for Jenkins.
>
> We are aware of Cloudbees and their HA plugin, but the company that we are
> working
> for is looking for a solution where two jenkins masters can run
> simultaneously, and
> possibly share the load between each other.
> The desired solution would not need the user to be aware of that there are
> several
> Jenkins instances, but it should look like one Jenkins from the users
> perspective.
> It is not necessary that the Jenkins instances share JENKINS_HOME.
>
> We have been thinking about different possible ways to achieve this. But
> writing a plugin
> seems promising. However there may be other solutions such as a plugin
> working with an external
> program, or possibly an entirely external solution.
>
> If anyone has has been working with this, we would be very happy to hear
> your
> thoughts.
>
> Also, we could really benefit from some advice on what to look out for,
> and
> what can cause problems.
>
> Actually any input on this topic will be valuable to us.
>
> Thanks in advance!
>
> Best regards
> Mikael and Daniel
>



-- 
Kohsuke Kawaguchi


promoted-builds-plugin - make meta-data available via remote api

2013-01-23 Thread Mark Nuttall-Smith
Hi,

I'm trying to export the state (build number/date) of promoted builds from 
Jenkins to the Atlassian Team Calendars (TC) product.

It's not possible to push data into TC due to limitations of their api, but 
you can subscribe to an ical formatted calendar available over http. 
Therefore I would like to expose the meta data of the promoted-build-plugin 
over the Jenkins remote api, and somehow iCal format this.

So, couple of questions:

1. Does the promoted-builds-plugin persist any meta data about the jobs 
that were promoted?

2. Does the remote api have any useful extension points? Is there any 
sample code available?

Many thanks,
Mark




Question on Jenkins plugins repository

2013-01-23 Thread Nickolay Rumyantsev
Hi!

I am working on a task where I need to be able to install different 
versions of different Jenkins plugins. So I need a plugins repository that:
 - is accessible most of the time (and recovers from failure in 1-2 days at 
max)
 - has stable structure (doesn't change often its directory layout, naming 
rules, etc)
 - doesn't remove old versions of plugins (or at least stores, say, 5 last 
versions)
I suppose that the common 
*http://updates.jenkins-ci.org/download/plugins/*meets my requirements but I 
have not found any document about its policies.

Can you tell me please could I use the repository at *jenkins-ci.org *or it 
would be better to create my own local repository?

Thanks,
Nikolay


Re: Advice on developing HA solution

2013-01-23 Thread Bruno P. Kinoshita
Morning Mikael!

We have been working on a bioinformatics solution with Jenkins [1]. We are 
working to connect Jenkins with a PBS server. Similar to what is done with the 
EC2 plug-in, however, we are working to connect Jenkins build queue to PBS job 
queue. 

Our goal is provide a PBS Project, and let users submit jobs (or simply build 
steps) to PBS servers without having to write PBS scripts (this would be done 
via a plug-in). 

The PBS server and the job scheduler (either the native one or Maui) would then 
schedule the jobs/buildsteps to one of the PBS nodes. 

The jobs are handled in the PBS server by a job queue, similar to the build 
queue in Jenkins. We are now working to include the pbs jobs in the Jenkins 
build queue.

This way, if you had a very long build step, like finding contigs in 
shotgun DNA sequences using some NGS program, you could schedule a job in 
Jenkins but run this long task in the PBS cluster and be notified once the 
program has finished.

Just 0.02 cents to your research :o) All the best,

[1] biouno.org

Bruno P. Kinoshita
http://kinoshita.eti.br
http://tupilabs.com


>
> From: Mikael Stockman 
>To: jenkinsci-dev@googlegroups.com 
>Sent: Wednesday, January 23, 2013 6:55 AM
>Subject: Advice on developing HA solution
> 
>
>Hi!
>We are two thesis workers who have been assigned the task of investigating
>possible high availability solutions for Jenkins.
>
>
>We are aware of Cloudbees and their HA plugin, but the company that we are 
>working
>for is looking for a solution where two jenkins masters can run 
>simultaneously, and 
>possibly share the load between each other.
>The desired solution would not need the user to be aware of that there are 
>several
>Jenkins instances, but it should look like one Jenkins from the users 
>perspective.
>It is not necessary that the Jenkins instances share JENKINS_HOME.
>
>
>We have been thinking about different possible ways to achieve this. But 
>writing a plugin
>seems promising. However there may be other solutions such as a plugin working 
>with an external
>program, or possibly an entirely external solution.
>
>
>If anyone has has been working with this, we would be very happy to hear your
>thoughts.
>
>
>Also, we could really benefit from some advice on what to look out for, and 
>what can cause problems.
>
>
>Actually any input on this topic will be valuable to us.
>
>
>Thanks in advance!
>
>
>Best regards
>Mikael and Daniel
>
> 


Re: Maintainer of Jenkins claim plugin

2013-01-23 Thread Ulli Hafner
Hi Christian,

I added you as committer and default assignee oft the claim pluig-in.
If you need anything else let us know…
(I think the maintainer section in the wiki is generated from the pom)

Welcome aboard!

Ulli 
Am 23.01.2013 um 08:07 schrieb christian åkerström :

> Hi,
> 
> I would like to be an maintainer of the Jenkins claim plugin.
> It looks like the plugin has no active maintainers. 
> https://wiki.jenkins-ci.org/display/JENKINS/Claim+plugin
> 
> My team has done enhancement to the claim plugin that we would like to pull 
> and I am also interesting in fixing open issues/bugs.
> 
> My github id: ki82
> 
> Kind regards,
> Christian Åkerström



Advice on developing HA solution

2013-01-23 Thread Mikael Stockman
Hi!
We are two thesis workers who have been assigned the task of investigating
possible high availability solutions for Jenkins.

We are aware of Cloudbees and their HA plugin, but the company that we are 
working
for is looking for a solution where two jenkins masters can run 
simultaneously, and 
possibly share the load between each other.
The desired solution would not need the user to be aware of that there are 
several
Jenkins instances, but it should look like one Jenkins from the users 
perspective.
It is not necessary that the Jenkins instances share JENKINS_HOME.

We have been thinking about different possible ways to achieve this. But 
writing a plugin
seems promising. However there may be other solutions such as a plugin 
working with an external
program, or possibly an entirely external solution.

If anyone has has been working with this, we would be very happy to hear 
your
thoughts.

Also, we could really benefit from some advice on what to look out for, and 
what can cause problems.

Actually any input on this topic will be valuable to us.

Thanks in advance!

Best regards
Mikael and Daniel