Re: [Kicad-developers] Build Server for MacOS

2020-05-19 Thread Mark Roszko
> nickoe has something on azure running, but the MacOS build is currently
failing there:

Yea because its been low priority to get it working for either of us

I would suggest Azure Pipelines over semaphoreCI only because It includes
all platforms including Windows (which semaphore does not) and having CI
split across multiple services is rather a PITA.


On Tue, May 19, 2020 at 8:00 AM Stefan Weber  wrote:

> Sry. now again in non html format ;-)
>
> Hi Adam
>
> I now tested semaphoreci.com they provide free MacOS build for opensource
> projects on a buildserver macOS-4 4 vCPU 8GB RAM.
>
> This took about 1 hour, including packaging.
> ( ./build.py --target package-kicad-nightly )
>
> I used the setup from nickoe:
> https://github.com/nickoe/kicad-azure-test
>
> I added a build script for semaphoreci in my fork:
> https://github.com/nopeppermint/kicad-azure-test/tree/set-up-semaphore
>
> there is also a build badge on the readme (currently on cancel as I
> canceld the last build).
>
> You can find the last succesful build under:
>
> https://nopeppermint.semaphoreci.com/workflows/678f370a-a7b1-4936-972f-757ee838db66
>
> there is even a dmg artifact from the build, but somehow it's not
> accesible without login at the moment..
>
> https://nopeppermint.semaphoreci.com/artifacts/jobs/8bd9a827-dfe2-470d-839d-3ad3410269f5/kicad-nightly-20200519-042032-c57eadd1d.dmg
>
> but I uploded it on sendspace:
> https://www.sendspace.com/file/gxt23p
>
>
> @Nick
> > Do you have a macos yourself?
> no, but a free of charge building MacOS CI ;-)
>
> @Mark
> >An alternative, there's also the Azure Pipelines KiCad account
> nickoe has something on azure running, but the MacOS build is currently
> failing there:
> https://github.com/nickoe/kicad-azure-test/runs/603552073
>
> so maybe someone WITH a mac could test this dmg from the build server.
>
> Semaphoreci offers "unlimited CI/CD minutes" for building public
> repositories:
> https://semaphoreci.com/blog/free-open-source-cicd
>
> That might be an alternative/addition for the local server from Adam Wolf?
>
> I am not sure it's possible to trigger the semaphoreci build directly from
> gitlab, but it's possible from github.
> And since kicad still has his github mirror we might trigger the build
> from there.
>
> Stefan
>
>
> Gesendet: Montag, 18. Mai 2020 um 22:09 Uhr
> Von: "Adam Wolf" 
> An: "Mark Roszko" 
> Cc: "KiCad Developers" 
> Betreff: Re: [Kicad-developers] Build Server for MacOS
> I provide the release builder and nightlies builder for macOS for
> KiCad. I would love to have the macOS build cluster also provide CI
> checks for branches and builds!
>
> A few months ago, the second machine in the cluster broke. The first
> machine is able to keep up with nightlies, but cannot do any builds
> beyond that. I have purchased another (expensive...) system for the
> cluster. I'll be adding it into the cluster soon, but I am located in
> the United States and my business, where some of these machines are
> located, is not easily accessible due to the lockdown. Additionally,
> I have two young children who no longer have school or childcare, and
> my KiCad time has approached zero. I was able to get the 5.1.6
> release out last week on time, which, to non-parents right now, may
> seem like a regular accomplishment, but to me, this was a Herculean
> effort.
>
> kicad-mac-builder is primarily used for making release builds on
> macOS. These needs are similar but also much more extensive than the
> needs for development or "does this build/test fine". I've been doing
> this for quite a few years now, and I am continually impressed by the
> new and different ways that release builds of something of KiCad's
> magnitude can break on macOS. (Because of that, the nightly and
> release macOS builds are performed in their own VM, each time, with
> all the dependencies built each time. This sounds like dramatic
> overkill to everyone except for people who package and distribute
> macOS software outside of Xcode.)
>
> If you're interested in helping out, I would love some extra help. If
> you want to try some third-party services, awesome. It will be much
> easier to get kicad to build in a third-party CI service than to get
> kicad packaged, so I would suggest starting there.
>
> If you want to work on kicad-mac-builder so that I have more time for
> doing things like "setting up the build cluster", that's awesome too.
> There's a good balance of small and big issues on the issue tracker,
> and I can usually respond within a day, Monday through Thursday.
> nickoe has been helping out lately too, and he seems to be availab

Re: [Kicad-developers] Build Server for MacOS

2020-05-19 Thread Stefan Weber
Sry. now again in non html format ;-)

Hi Adam
 
I now tested semaphoreci.com they provide free MacOS build for opensource 
projects on a buildserver macOS-4 4 vCPU 8GB RAM.
 
This took about 1 hour, including packaging.
( ./build.py --target package-kicad-nightly )
 
I used the setup from nickoe:
https://github.com/nickoe/kicad-azure-test
 
I added a build script for semaphoreci in my fork:
https://github.com/nopeppermint/kicad-azure-test/tree/set-up-semaphore
 
there is also a build badge on the readme (currently on cancel as I canceld the 
last build).
 
You can find the last succesful build under:
https://nopeppermint.semaphoreci.com/workflows/678f370a-a7b1-4936-972f-757ee838db66
 
there is even a dmg artifact from the build, but somehow it's not accesible 
without login at the moment..
https://nopeppermint.semaphoreci.com/artifacts/jobs/8bd9a827-dfe2-470d-839d-3ad3410269f5/kicad-nightly-20200519-042032-c57eadd1d.dmg
 
but I uploded it on sendspace:
https://www.sendspace.com/file/gxt23p
 
 
@Nick
> Do you have a macos yourself?
no, but a free of charge building MacOS CI ;-)

@Mark 
>An alternative, there's also the Azure Pipelines KiCad account
nickoe has something on azure running, but the MacOS build is currently failing 
there:
https://github.com/nickoe/kicad-azure-test/runs/603552073
 
so maybe someone WITH a mac could test this dmg from the build server.
 
Semaphoreci offers "unlimited CI/CD minutes" for building public repositories:
https://semaphoreci.com/blog/free-open-source-cicd
 
That might be an alternative/addition for the local server from Adam Wolf?
 
I am not sure it's possible to trigger the semaphoreci build directly from 
gitlab, but it's possible from github.
And since kicad still has his github mirror we might trigger the build from 
there.
 
Stefan
 

Gesendet: Montag, 18. Mai 2020 um 22:09 Uhr
Von: "Adam Wolf" 
An: "Mark Roszko" 
Cc: "KiCad Developers" 
Betreff: Re: [Kicad-developers] Build Server for MacOS
I provide the release builder and nightlies builder for macOS for
KiCad. I would love to have the macOS build cluster also provide CI
checks for branches and builds!

A few months ago, the second machine in the cluster broke. The first
machine is able to keep up with nightlies, but cannot do any builds
beyond that. I have purchased another (expensive...) system for the
cluster. I'll be adding it into the cluster soon, but I am located in
the United States and my business, where some of these machines are
located, is not easily accessible due to the lockdown. Additionally,
I have two young children who no longer have school or childcare, and
my KiCad time has approached zero. I was able to get the 5.1.6
release out last week on time, which, to non-parents right now, may
seem like a regular accomplishment, but to me, this was a Herculean
effort.

kicad-mac-builder is primarily used for making release builds on
macOS. These needs are similar but also much more extensive than the
needs for development or "does this build/test fine". I've been doing
this for quite a few years now, and I am continually impressed by the
new and different ways that release builds of something of KiCad's
magnitude can break on macOS. (Because of that, the nightly and
release macOS builds are performed in their own VM, each time, with
all the dependencies built each time. This sounds like dramatic
overkill to everyone except for people who package and distribute
macOS software outside of Xcode.)

If you're interested in helping out, I would love some extra help. If
you want to try some third-party services, awesome. It will be much
easier to get kicad to build in a third-party CI service than to get
kicad packaged, so I would suggest starting there.

If you want to work on kicad-mac-builder so that I have more time for
doing things like "setting up the build cluster", that's awesome too.
There's a good balance of small and big issues on the issue tracker,
and I can usually respond within a day, Monday through Thursday.
nickoe has been helping out lately too, and he seems to be available
at all hours within a few seconds ;)

Adam Wolf

On Mon, May 18, 2020 at 2:31 PM Mark Roszko  wrote:
>
> 90% chance AppVeyor won't work because its build time restricted to 60 
> minutes. And KiCad builds quite slowly on the free services taht only provide 
> 1 or 2 cores.
>
>
> An alternative, there's also the Azure Pipelines KiCad account where I run 
> Coverity. It has unlimited minutes for open source project and provides 
> macOS/Linux/Windows VMs with up to 10 parallel jobs at a time.

___
Mailing list: 
https://launchpad.net/~kicad-developers[https://launchpad.net/~kicad-developers]
Post to : kicad-developers@lists.launchpad.net
Unsubscribe : 
https://launchpad.net/~kicad-developers[https://launchpad.net/~kicad-developers]
More help : 
https://help.launchpad.net/ListHelp[https

Re: [Kicad-developers] Build Server for MacOS

2020-05-19 Thread Stefan Weber

Hi Adam

 

I now tested semaphoreci.com they provide free MacOS build for opensource projects on a buildserver macOS-4 4 vCPU 8GB RAM.

 

This took about 1 hour, including packaging.

( ./build.py --target package-kicad-nightly )

 

I used the setup from nickoe:
https://github.com/nickoe/kicad-azure-test

 

I added a build script for semaphoreci in my fork:

https://github.com/nopeppermint/kicad-azure-test/tree/set-up-semaphore

 

there is also a build badge on the readme (currently on cancel as I canceld the last build).

 

You can find the last succesful build under:
https://nopeppermint.semaphoreci.com/workflows/678f370a-a7b1-4936-972f-757ee838db66

 

there is even a dmg artifact from the build, but somehow it's not accesible without login at the moment..

https://nopeppermint.semaphoreci.com/artifacts/jobs/8bd9a827-dfe2-470d-839d-3ad3410269f5/kicad-nightly-20200519-042032-c57eadd1d.dmg

 

but I uploded it on sendspace:

https://www.sendspace.com/file/gxt23p

 

 

@Nick
> Do you have a macos yourself?
no, but a free of charge building MacOS CI ;-)

 

so maybe someone WITH a mac could test this dmg from the build server.

 

Semaphoreci offers "unlimited CI/CD minutes" for building public repositories:
https://semaphoreci.com/blog/free-open-source-cicd

 

That might be an alternative/addition for the local server from Adam Wolf?

 

I am not sure it's possible to trigger the semaphoreci build directly from gitlab, but it's possible from github.

And since kicad still has his github mirror we might trigger the build from there.

 

Stefan

 



Gesendet: Montag, 18. Mai 2020 um 22:09 Uhr
Von: "Adam Wolf" 
An: "Mark Roszko" 
Cc: "KiCad Developers" 
Betreff: Re: [Kicad-developers] Build Server for MacOS

I provide the release builder and nightlies builder for macOS for
KiCad. I would love to have the macOS build cluster also provide CI
checks for branches and builds!

A few months ago, the second machine in the cluster broke. The first
machine is able to keep up with nightlies, but cannot do any builds
beyond that. I have purchased another (expensive...) system for the
cluster. I'll be adding it into the cluster soon, but I am located in
the United States and my business, where some of these machines are
located, is not easily accessible due to the lockdown. Additionally,
I have two young children who no longer have school or childcare, and
my KiCad time has approached zero. I was able to get the 5.1.6
release out last week on time, which, to non-parents right now, may
seem like a regular accomplishment, but to me, this was a Herculean
effort.

kicad-mac-builder is primarily used for making release builds on
macOS. These needs are similar but also much more extensive than the
needs for development or "does this build/test fine". I've been doing
this for quite a few years now, and I am continually impressed by the
new and different ways that release builds of something of KiCad's
magnitude can break on macOS. (Because of that, the nightly and
release macOS builds are performed in their own VM, each time, with
all the dependencies built each time. This sounds like dramatic
overkill to everyone except for people who package and distribute
macOS software outside of Xcode.)

If you're interested in helping out, I would love some extra help. If
you want to try some third-party services, awesome. It will be much
easier to get kicad to build in a third-party CI service than to get
kicad packaged, so I would suggest starting there.

If you want to work on kicad-mac-builder so that I have more time for
doing things like "setting up the build cluster", that's awesome too.
There's a good balance of small and big issues on the issue tracker,
and I can usually respond within a day, Monday through Thursday.
nickoe has been helping out lately too, and he seems to be available
at all hours within a few seconds ;)

Adam Wolf

On Mon, May 18, 2020 at 2:31 PM Mark Roszko  wrote:
>
> 90% chance AppVeyor won't work because its build time restricted to 60 minutes. And KiCad builds quite slowly on the free services taht only provide 1 or 2 cores.
>
>
> An alternative, there's also the Azure Pipelines KiCad account where I run Coverity. It has unlimited minutes for open source project and provides macOS/Linux/Windows VMs with up to 10 parallel jobs at a time.
>
>
> On Mon, May 18, 2020 at 1:23 PM Nick Østergaard  wrote:
>>
>> Hi Stefan
>>
>> Do you have a macos yourself? If yes, you are probably better off
>> starting with resolving issues at
>> https://gitlab.com/kicad/packaging/kicad-mac-builder/-/issues
>>
>> Adam Wolf got some new hardware for building for macos, the plan is to
>> add it as a gitlab runner. This has not been done yet.
>>
>> Nick
>>
>> On Mon, 18 May 2020 at 19:17, S.Weber  wrote:
>> >
>> > Hello KiCad team,
>> 

Re: [Kicad-developers] Build Server for MacOS

2020-05-18 Thread Adam Wolf
I provide the release builder and nightlies builder for macOS for
KiCad.  I would love to have the macOS build cluster also provide CI
checks for branches and builds!

A few months ago, the second machine in the cluster broke.  The first
machine is able to keep up with nightlies, but cannot do any builds
beyond that.  I have purchased another (expensive...) system for the
cluster.  I'll be adding it into the cluster soon, but I am located in
the United States and my business, where some of these machines are
located, is not easily accessible due to the lockdown.  Additionally,
I have two young children who no longer have school or childcare, and
my KiCad time has approached zero.  I was able to get the 5.1.6
release out last week on time, which, to non-parents right now, may
seem like a regular accomplishment, but to me, this was a Herculean
effort.

kicad-mac-builder is primarily used for making release builds on
macOS.  These needs are similar but also much more extensive than the
needs for development or "does this build/test fine".  I've been doing
this for quite a few years now, and I am continually impressed by the
new and different ways that release builds of something of KiCad's
magnitude can break on macOS.  (Because of that, the nightly and
release macOS builds are performed in their own VM, each time, with
all the dependencies built each time.  This sounds like dramatic
overkill to everyone except for people who package and distribute
macOS software outside of Xcode.)

If you're interested in helping out, I would love some extra help.  If
you want to try some third-party services, awesome.  It will be much
easier to get kicad to build in a third-party CI service than to get
kicad packaged, so I would suggest starting there.

If you want to work on kicad-mac-builder so that I have more time for
doing things like "setting up the build cluster", that's awesome too.
There's a good balance of small and big issues on the issue tracker,
and I can usually respond within a day, Monday through Thursday.
nickoe has been helping out lately too, and he seems to be available
at all hours within a few seconds ;)

Adam Wolf

On Mon, May 18, 2020 at 2:31 PM Mark Roszko  wrote:
>
> 90% chance AppVeyor won't work because its build time restricted to 60 
> minutes. And KiCad builds quite slowly on the free services taht only provide 
> 1 or 2 cores.
>
>
> An alternative, there's also the Azure Pipelines KiCad account where I run 
> Coverity. It has unlimited minutes for open source project and provides 
> macOS/Linux/Windows VMs with up to 10 parallel jobs at a time.
>
>
> On Mon, May 18, 2020 at 1:23 PM Nick Østergaard  wrote:
>>
>> Hi Stefan
>>
>> Do you have a macos yourself? If yes, you are probably better off
>> starting with resolving issues at
>> https://gitlab.com/kicad/packaging/kicad-mac-builder/-/issues
>>
>> Adam Wolf got some new hardware for building for macos, the plan is to
>> add it as a gitlab runner. This has not been done yet.
>>
>> Nick
>>
>> On Mon, 18 May 2020 at 19:17, S.Weber  wrote:
>> >
>> > Hello KiCad team,
>> >
>> > I am new to kicad and was thinking about helping with the MacOS CI.
>> >
>> > Ian McInerney was mentioning on 
>> > https://gitlab.com/kicad/code/kicad/-/merge_requests/218 that "currently 
>> > there are no reliable macOS CI solutions for KiCad".
>> >
>> > >We don't currently have a reliable macOS CI solution. GitLab doesn't 
>> > >provide one out of the box, and the nightly build server sometimes has 
>> > >issues that aren't related to the code, but instead to packaging.
>> >
>> > I am wondering if someone is working on a "new" macOS CI or do have some 
>> > experience there?
>> >
>> > I found two CIs provider which are free for MacOS open-source Projects:
>> >
>> > https://travis-ci.com/plans
>> >
>> > https://www.appveyor.com/pricing/
>> >
>> > => appveyor seems to directly support gitlab
>> > => travis only supports github => build needs to go over github mirror of 
>> > kicad repo..
>> >
>> > So I think appveyor might be worth a try.
>> >
>> > What do you think?
>> >
>> >
>> > Stefan
>> >
>> > ___
>> > Mailing list: https://launchpad.net/~kicad-developers
>> > Post to : kicad-developers@lists.launchpad.net
>> > Unsubscribe : https://launchpad.net/~kicad-developers
>> > More help   : https://help.launchpad.net/ListHelp
>>
>> ___
>> Mailing list: https://launchpad.net/~kicad-developers
>> Post to : kicad-developers@lists.launchpad.net
>> Unsubscribe : https://launchpad.net/~kicad-developers
>> More help   : https://help.launchpad.net/ListHelp
>
>
>
> --
> Mark
> ___
> Mailing list: https://launchpad.net/~kicad-developers
> Post to : kicad-developers@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~kicad-developers
> More help   : https://help.launchpad.net/ListHelp

___

Re: [Kicad-developers] Build Server for MacOS

2020-05-18 Thread Mark Roszko
90% chance AppVeyor won't work because its build time restricted to 60
minutes. And KiCad builds quite slowly on the free services taht only
provide 1 or 2 cores.


An alternative, there's also the Azure Pipelines KiCad account where I run
Coverity. It has unlimited minutes for open source project and provides
macOS/Linux/Windows VMs with up to 10 parallel jobs at a time.


On Mon, May 18, 2020 at 1:23 PM Nick Østergaard  wrote:

> Hi Stefan
>
> Do you have a macos yourself? If yes, you are probably better off
> starting with resolving issues at
> https://gitlab.com/kicad/packaging/kicad-mac-builder/-/issues
>
> Adam Wolf got some new hardware for building for macos, the plan is to
> add it as a gitlab runner. This has not been done yet.
>
> Nick
>
> On Mon, 18 May 2020 at 19:17, S.Weber  wrote:
> >
> > Hello KiCad team,
> >
> > I am new to kicad and was thinking about helping with the MacOS CI.
> >
> > Ian McInerney was mentioning on
> https://gitlab.com/kicad/code/kicad/-/merge_requests/218 that "currently
> there are no reliable macOS CI solutions for KiCad".
> >
> > >We don't currently have a reliable macOS CI solution. GitLab doesn't
> provide one out of the box, and the nightly build server sometimes has
> issues that aren't related to the code, but instead to packaging.
> >
> > I am wondering if someone is working on a "new" macOS CI or do have some
> experience there?
> >
> > I found two CIs provider which are free for MacOS open-source Projects:
> >
> > https://travis-ci.com/plans
> >
> > https://www.appveyor.com/pricing/
> >
> > => appveyor seems to directly support gitlab
> > => travis only supports github => build needs to go over github mirror
> of kicad repo..
> >
> > So I think appveyor might be worth a try.
> >
> > What do you think?
> >
> >
> > Stefan
> >
> > ___
> > Mailing list: https://launchpad.net/~kicad-developers
> > Post to : kicad-developers@lists.launchpad.net
> > Unsubscribe : https://launchpad.net/~kicad-developers
> > More help   : https://help.launchpad.net/ListHelp
>
> ___
> Mailing list: https://launchpad.net/~kicad-developers
> Post to : kicad-developers@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~kicad-developers
> More help   : https://help.launchpad.net/ListHelp
>


-- 
Mark
___
Mailing list: https://launchpad.net/~kicad-developers
Post to : kicad-developers@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kicad-developers
More help   : https://help.launchpad.net/ListHelp


Re: [Kicad-developers] Build Server for MacOS

2020-05-18 Thread Nick Østergaard
Hi Stefan

Do you have a macos yourself? If yes, you are probably better off
starting with resolving issues at
https://gitlab.com/kicad/packaging/kicad-mac-builder/-/issues

Adam Wolf got some new hardware for building for macos, the plan is to
add it as a gitlab runner. This has not been done yet.

Nick

On Mon, 18 May 2020 at 19:17, S.Weber  wrote:
>
> Hello KiCad team,
>
> I am new to kicad and was thinking about helping with the MacOS CI.
>
> Ian McInerney was mentioning on 
> https://gitlab.com/kicad/code/kicad/-/merge_requests/218 that "currently 
> there are no reliable macOS CI solutions for KiCad".
>
> >We don't currently have a reliable macOS CI solution. GitLab doesn't provide 
> >one out of the box, and the nightly build server sometimes has issues that 
> >aren't related to the code, but instead to packaging.
>
> I am wondering if someone is working on a "new" macOS CI or do have some 
> experience there?
>
> I found two CIs provider which are free for MacOS open-source Projects:
>
> https://travis-ci.com/plans
>
> https://www.appveyor.com/pricing/
>
> => appveyor seems to directly support gitlab
> => travis only supports github => build needs to go over github mirror of 
> kicad repo..
>
> So I think appveyor might be worth a try.
>
> What do you think?
>
>
> Stefan
>
> ___
> Mailing list: https://launchpad.net/~kicad-developers
> Post to : kicad-developers@lists.launchpad.net
> Unsubscribe : https://launchpad.net/~kicad-developers
> More help   : https://help.launchpad.net/ListHelp

___
Mailing list: https://launchpad.net/~kicad-developers
Post to : kicad-developers@lists.launchpad.net
Unsubscribe : https://launchpad.net/~kicad-developers
More help   : https://help.launchpad.net/ListHelp