Re: Multi-process jobs in Windows

2012-06-14 Thread Aaron Ten Clay
gt; java.specification.version1.6java.vendorSun Microsystems Inc.java.vendor.url
> http://java.sun.com/java.vendor.url.bug
> http://java.sun.com/cgi-bin/bugreport.cgi 
> java.version1.6.0_26java.vm.infomixed
> modejava.vm.name Java HotSpot(TM) Client VMjava.vm.specification.nameJava
> Virtual Machine Specification java.vm.specification.vendorSun
> Microsystems Inc.java.vm.specification.version1.0java.vm.vendor Sun
> Microsystems Inc.java.vm.version20.1-b02line.separator
> os.archx86os.nameWindows 7os.version 6.1path.separator;sun.arch.data.model
> 32sun.boot.class.path
> E:\Jenkins\jre\lib\resources.jar;E:\Jenkins\jre\lib\rt.jar;E:\Jenkins\jre\lib\sunrsasign.jar;E:\Jenkins\jre\lib\jsse.jar;E:\Jenkins\jre\lib\jce.jar;E:\Jenkins\jre\lib\charsets.jar;E:\Jenkins\jre\lib\modules\jdk.boot.jar;E:\Jenkins\jre\classes
> sun.boot.library.pathE:\Jenkins\jre\binsun.cpu.endianlittlesun.cpu.isalistpentium_pro+mmx
>  pentium_pro pentium+mmx pentium i486 i386 i86
> sun.desktopwindowssun.io.unicode.encodingUnicodeLittle 
> sun.java.commandE:\Jenkins\jenkins.war
> --httpPort=8080sun.java.launcherSUN_STANDARDsun.jnu.encoding Cp1252
> sun.management.compilerHotSpot Client Compilersun.os.patch.levelService
> Pack 1 svnkit.http.methodsDigest,Basic,NTLM,Negotiate
> svnkit.ssh2.persistentfalseuser.country USuser.dirC:\Windows\system32
> user.homeC:\Users\[user]user.language enuser.namehaverkchuser.timezone
> America/Los_Angelesuser.variant
>
> *Plugins:*
> Name  ↓ <http://10.5.69.54:8080/systemInfo#> Version   
> <http://10.5.69.54:8080/systemInfo#>
> Enabled<http://10.5.69.54:8080/systemInfo#> Pinned   
> <http://10.5.69.54:8080/systemInfo#>
> ant1.1true falsejavadoc1.0truefalsecvs1.6true falseezwall0.2truefalse
> global-build-stats1.3 truefalsegreenballs1.12truefalsemaven-plugin1.467
> truefalseradiatorviewplugin1.13truefalsesectioned-view 1.16truefalse
> ssh-slaves0.21truefalse subversion1.34truefalsetfs1.20truefalsetimestamper
> 1.2.2truefalsetranslation
> *Build Information:*
>
> QNX Build:
>
>- restricted to run on a node configured to be the same as the one
>Jenkins is installed on (using the windows service)
>- source code management = TFS
>- Trigger = polling
>- adding timestamps to console output (through a plugin)
>- execute Windows batch commands...
>   - rm -rf Build_GT
>   - "C:\Program Files (x86)\Microsoft Visual Studio
>   10.0\Common7\IDE\tf" get $/Framework/ROOT/Framework/source/Shared /force
>   - xcopy "%WORKSPACE%\Framework\ROOT\*" "%WORKSPACE%\Root\" /S /Y /R
>   /I
>   - cd Root/GT/Firmware
>   - call prepare_to_build.bat localbuildonly
>   - @echo on
>   - set SHELL=cmd.exe
>   - cd %WORKSPACE%/Build_GT/QNX_ppcbe_Release
>   - C:/QNX650/host/win32/x86/usr/bin/make.exe -j24
>
>
>
> On Wed, Jun 13, 2012 at 12:51 PM, Slide  wrote:
>
>> What version of make is being used? You are going through cygwin? Can you
>> explain a little more about your environment?
>>
>> slide
>>
>>
>> On Wed, Jun 13, 2012 at 12:49 PM, chris wrote:
>>
>>> 
>>> So I realized that I did not respond to the list properly. Anyways, here
>>> is an update.
>>>
>>> Still no luck. I've been playing with Jenkins more and my system seems
>>> to briefly use more than one processor, but the utilization quickly goes
>>> back to 0% - 10%.
>>>
>>> Worse yet, The builds for QNX have only been slowing down. They started
>>> at about 6 minutes and have reached well over an hour per build now.
>>>
>>> 
>>>
>>>
>>> Yeah, freestyle.
>>> On Jun 1, 2012 4:48 PM, "Alex Earl"  wrote:
>>> I can't think of anything that would restrict this in Jenkins. What type
>>> of job are you using? Freestyle?
>>>
>>> Sent from my Windows Phone
>>> --
>>> From: Chris Haverkate
>>> Sent: 6/1/2012 4:47 PM
>>> To: Alex Earl
>>> Subject: RE: Multi-process jobs in Windows
>>>
>>> Yeah, I explicitly called it using the full path.
>>> On Jun 1, 2012 4:44 PM, "Alex Earl"  wrote:
>>> You are sure the same make is being used in both cases?
>>>
>>> Sent from my Windows Phone
>>> --
>>> From: Chris Haverkate
>>> Sent: 6/1/2012 4:43 PM
>>> To: Alex Earl
>>> Subject: RE: Multi-process jobs in Windows
>>>
>>> I'm using a version of make that is distributed with QNX. I've tried
>>> 

Re: Multi-process jobs in Windows

2012-06-14 Thread Chris Haverkate
s\jenkins.war
--httpPort=8080sun.java.launcherSUN_STANDARDsun.jnu.encodingCp1252
sun.management.compilerHotSpot Client Compilersun.os.patch.levelService
Pack 1svnkit.http.methodsDigest,Basic,NTLM,Negotiatesvnkit.ssh2.persistent
falseuser.countryUSuser.dirC:\Windows\system32user.homeC:\Users\[user]
user.languageenuser.namehaverkchuser.timezoneAmerica/Los_Angelesuser.variant

*Plugins:*
Name  ↓ <http://10.5.69.54:8080/systemInfo#>Version
<http://10.5.69.54:8080/systemInfo#>
Enabled<http://10.5.69.54:8080/systemInfo#>Pinned
<http://10.5.69.54:8080/systemInfo#>
ant1.1truefalsejavadoc1.0truefalsecvs1.6truefalseezwall0.2truefalse
global-build-stats1.3truefalsegreenballs1.12truefalsemaven-plugin1.467true
falseradiatorviewplugin1.13truefalsesectioned-view1.16truefalsessh-slaves
0.21truefalsesubversion1.34truefalsetfs1.20truefalsetimestamper1.2.2true
falsetranslation
*Build Information:*

QNX Build:

   - restricted to run on a node configured to be the same as the one
   Jenkins is installed on (using the windows service)
   - source code management = TFS
   - Trigger = polling
   - adding timestamps to console output (through a plugin)
   - execute Windows batch commands...
  - rm -rf Build_GT
  - "C:\Program Files (x86)\Microsoft Visual Studio
  10.0\Common7\IDE\tf" get $/Framework/ROOT/Framework/source/Shared /force
  - xcopy "%WORKSPACE%\Framework\ROOT\*" "%WORKSPACE%\Root\" /S /Y /R /I
  - cd Root/GT/Firmware
  - call prepare_to_build.bat localbuildonly
  - @echo on
  - set SHELL=cmd.exe
  - cd %WORKSPACE%/Build_GT/QNX_ppcbe_Release
  - C:/QNX650/host/win32/x86/usr/bin/make.exe -j24



On Wed, Jun 13, 2012 at 12:51 PM, Slide  wrote:

> What version of make is being used? You are going through cygwin? Can you
> explain a little more about your environment?
>
> slide
>
>
> On Wed, Jun 13, 2012 at 12:49 PM, chris  wrote:
>
>> 
>> So I realized that I did not respond to the list properly. Anyways, here
>> is an update.
>>
>> Still no luck. I've been playing with Jenkins more and my system seems to
>> briefly use more than one processor, but the utilization quickly goes back
>> to 0% - 10%.
>>
>> Worse yet, The builds for QNX have only been slowing down. They started
>> at about 6 minutes and have reached well over an hour per build now.
>>
>> 
>>
>>
>> Yeah, freestyle.
>> On Jun 1, 2012 4:48 PM, "Alex Earl"  wrote:
>> I can't think of anything that would restrict this in Jenkins. What type
>> of job are you using? Freestyle?
>>
>> Sent from my Windows Phone
>> --
>> From: Chris Haverkate
>> Sent: 6/1/2012 4:47 PM
>> To: Alex Earl
>> Subject: RE: Multi-process jobs in Windows
>>
>> Yeah, I explicitly called it using the full path.
>> On Jun 1, 2012 4:44 PM, "Alex Earl"  wrote:
>> You are sure the same make is being used in both cases?
>>
>> Sent from my Windows Phone
>> --
>> From: Chris Haverkate
>> Sent: 6/1/2012 4:43 PM
>> To: Alex Earl
>> Subject: RE: Multi-process jobs in Windows
>>
>> I'm using a version of make that is distributed with QNX. I've tried
>> "make -j12" with no luck.
>>
>> Outside of Jenkins the -j option works fine, with our without a number.
>>
>> On Friday, June 1, 2012 4:11:29 PM UTC-7, slide wrote:
>>>
>>> Are you running under cygwin or using a native win32 make? We run -j5
>>> with no problems for several jobs which run under cygwin.
>>>
>>> Sent from my Windows Phone
>>> From: chris
>>> Sent: 6/1/2012 3:42 PM
>>> To: Jenkins Users
>>> Subject: Multi-process jobs in Windows
>>> Hey,
>>>
>>> I am trying to setup a new job that uses make as the build tool. I
>>> want to use the "-j" option to spawn several parallel jobs. The
>>> problem is that the "-j" doesn't seem to have any effect on the speed.
>>> Based on the job log file, it does not appear that multiple process
>>> are running in parallel. If I manually run "make -j" in the workspace,
>>> it's obvious that multiple jobs are running in parallel because the
>>> output is intermixed and the CPU utilization for all cores is pegged.
>>>
>>> I've looked through environment variables, tried a using both shells
>>> to run make, tried running the job in both slave and in Jenkins and
>>> looked online, but have not found any information on the issue.
>>>
>>> Does anyone have any ideas about running parallel jobs using make in
>>> Jenkins on Windows?
>>>
>>> Thanks.
>>>
>>
>
>
> --
> Website: http://earl-of-code.com
>


Re: Multi-process jobs in Windows

2012-06-13 Thread Slide
What version of make is being used? You are going through cygwin? Can you
explain a little more about your environment?

slide

On Wed, Jun 13, 2012 at 12:49 PM, chris  wrote:

> 
> So I realized that I did not respond to the list properly. Anyways, here
> is an update.
>
> Still no luck. I've been playing with Jenkins more and my system seems to
> briefly use more than one processor, but the utilization quickly goes back
> to 0% - 10%.
>
> Worse yet, The builds for QNX have only been slowing down. They started at
> about 6 minutes and have reached well over an hour per build now.
>
> 
>
>
> Yeah, freestyle.
> On Jun 1, 2012 4:48 PM, "Alex Earl"  wrote:
> I can't think of anything that would restrict this in Jenkins. What type
> of job are you using? Freestyle?
>
> Sent from my Windows Phone
> --
> From: Chris Haverkate
> Sent: 6/1/2012 4:47 PM
> To: Alex Earl
> Subject: RE: Multi-process jobs in Windows
>
> Yeah, I explicitly called it using the full path.
> On Jun 1, 2012 4:44 PM, "Alex Earl"  wrote:
> You are sure the same make is being used in both cases?
>
> Sent from my Windows Phone
> ----------
> From: Chris Haverkate
> Sent: 6/1/2012 4:43 PM
> To: Alex Earl
> Subject: RE: Multi-process jobs in Windows
>
> I'm using a version of make that is distributed with QNX. I've tried "make
> -j12" with no luck.
>
> Outside of Jenkins the -j option works fine, with our without a number.
>
> On Friday, June 1, 2012 4:11:29 PM UTC-7, slide wrote:
>>
>> Are you running under cygwin or using a native win32 make? We run -j5
>> with no problems for several jobs which run under cygwin.
>>
>> Sent from my Windows Phone
>> From: chris
>> Sent: 6/1/2012 3:42 PM
>> To: Jenkins Users
>> Subject: Multi-process jobs in Windows
>> Hey,
>>
>> I am trying to setup a new job that uses make as the build tool. I
>> want to use the "-j" option to spawn several parallel jobs. The
>> problem is that the "-j" doesn't seem to have any effect on the speed.
>> Based on the job log file, it does not appear that multiple process
>> are running in parallel. If I manually run "make -j" in the workspace,
>> it's obvious that multiple jobs are running in parallel because the
>> output is intermixed and the CPU utilization for all cores is pegged.
>>
>> I've looked through environment variables, tried a using both shells
>> to run make, tried running the job in both slave and in Jenkins and
>> looked online, but have not found any information on the issue.
>>
>> Does anyone have any ideas about running parallel jobs using make in
>> Jenkins on Windows?
>>
>> Thanks.
>>
>


-- 
Website: http://earl-of-code.com


Re: Multi-process jobs in Windows

2012-06-13 Thread chris



So I realized that I did not respond to the list properly. Anyways, here is 
an update.

Still no luck. I've been playing with Jenkins more and my system seems to 
briefly use more than one processor, but the utilization quickly goes back 
to 0% - 10%.

Worse yet, The builds for QNX have only been slowing down. They started at 
about 6 minutes and have reached well over an hour per build now.




Yeah, freestyle.
On Jun 1, 2012 4:48 PM, "Alex Earl"  wrote:
I can't think of anything that would restrict this in Jenkins. What type of 
job are you using? Freestyle?

Sent from my Windows Phone
--
From: Chris Haverkate
Sent: 6/1/2012 4:47 PM
To: Alex Earl
Subject: RE: Multi-process jobs in Windows

Yeah, I explicitly called it using the full path.
On Jun 1, 2012 4:44 PM, "Alex Earl"  wrote:
You are sure the same make is being used in both cases?

Sent from my Windows Phone
--
From: Chris Haverkate
Sent: 6/1/2012 4:43 PM
To: Alex Earl
Subject: RE: Multi-process jobs in Windows

I'm using a version of make that is distributed with QNX. I've tried "make 
-j12" with no luck. 

Outside of Jenkins the -j option works fine, with our without a number.

On Friday, June 1, 2012 4:11:29 PM UTC-7, slide wrote:
>
> Are you running under cygwin or using a native win32 make? We run -j5 
> with no problems for several jobs which run under cygwin. 
>
> Sent from my Windows Phone 
> From: chris 
> Sent: 6/1/2012 3:42 PM 
> To: Jenkins Users 
> Subject: Multi-process jobs in Windows 
> Hey, 
>
> I am trying to setup a new job that uses make as the build tool. I 
> want to use the "-j" option to spawn several parallel jobs. The 
> problem is that the "-j" doesn't seem to have any effect on the speed. 
> Based on the job log file, it does not appear that multiple process 
> are running in parallel. If I manually run "make -j" in the workspace, 
> it's obvious that multiple jobs are running in parallel because the 
> output is intermixed and the CPU utilization for all cores is pegged. 
>
> I've looked through environment variables, tried a using both shells 
> to run make, tried running the job in both slave and in Jenkins and 
> looked online, but have not found any information on the issue. 
>
> Does anyone have any ideas about running parallel jobs using make in 
> Jenkins on Windows? 
>
> Thanks. 
>


RE: Multi-process jobs in Windows

2012-06-01 Thread Alex Earl
Are you running under cygwin or using a native win32 make? We run -j5
with no problems for several jobs which run under cygwin.

Sent from my Windows Phone
From: chris
Sent: 6/1/2012 3:42 PM
To: Jenkins Users
Subject: Multi-process jobs in Windows
Hey,

I am trying to setup a new job that uses make as the build tool. I
want to use the "-j" option to spawn several parallel jobs. The
problem is that the "-j" doesn't seem to have any effect on the speed.
Based on the job log file, it does not appear that multiple process
are running in parallel. If I manually run "make -j" in the workspace,
it's obvious that multiple jobs are running in parallel because the
output is intermixed and the CPU utilization for all cores is pegged.

I've looked through environment variables, tried a using both shells
to run make, tried running the job in both slave and in Jenkins and
looked online, but have not found any information on the issue.

Does anyone have any ideas about running parallel jobs using make in
Jenkins on Windows?

Thanks.


Multi-process jobs in Windows

2012-06-01 Thread chris
Hey,

I am trying to setup a new job that uses make as the build tool. I
want to use the "-j" option to spawn several parallel jobs. The
problem is that the "-j" doesn't seem to have any effect on the speed.
Based on the job log file, it does not appear that multiple process
are running in parallel. If I manually run "make -j" in the workspace,
it's obvious that multiple jobs are running in parallel because the
output is intermixed and the CPU utilization for all cores is pegged.

I've looked through environment variables, tried a using both shells
to run make, tried running the job in both slave and in Jenkins and
looked online, but have not found any information on the issue.

Does anyone have any ideas about running parallel jobs using make in
Jenkins on Windows?

Thanks.