Gitlab CI Dashboards and retirement of build.kde.org
Hi all, This evening I completed the necessary setup required to complete our Gitlab CI dashboards, which can now be found at https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer account login required) These allow any developer to get a view on the current CI status of projects and groups of projects on a branch and platform basis - and should hopefully provide useful insight into the overall status that can currently be obtained from Jenkins. As this was the last thing holding us back from shutting down build.kde.org, i'd like to proceed with retiring and shutting down build.kde.org as soon as possible so the capacity it occupies can be released and reallocated to Gitlab. If anyone would like to experiment with customised views for their own purposes (where the above provided ones are insufficient) please file a Sysadmin ticket. Please let me know if there are any questions on the above. Thanks, Ben
Re: Gitlab CI Dashboards and retirement of build.kde.org
El dissabte, 27 d’agost de 2022, a les 11:44:47 (CEST), Ben Cooksley va escriure: > Hi all, > > This evening I completed the necessary setup required to complete our > Gitlab CI dashboards, which can now be found at > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer > account login required) > > These allow any developer to get a view on the current CI status of > projects and groups of projects on a branch and platform basis - and should > hopefully provide useful insight into the overall status that can currently > be obtained from Jenkins. > > As this was the last thing holding us back from shutting down build.kde.org, > i'd like to proceed with retiring and shutting down build.kde.org as soon > as possible so the capacity it occupies can be released and reallocated to > Gitlab. > > If anyone would like to experiment with customised views for their own > purposes (where the above provided ones are insufficient) please file a > Sysadmin ticket. > > Please let me know if there are any questions on the above. Looks great. One thing that i'm not sure i understand correctly, currently in the General Overview, it says that there are 3 projects currently failing kwin, kpackage and kphotoalbum, but then if i go to the Per Platform View i get that rkward is failing on windows. Shouldn't rkward also be listed as failing on the general overview? Cheers, Albert > > Thanks, > Ben
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sun, Aug 28, 2022 at 4:40 AM Albert Astals Cid wrote: > El dissabte, 27 d’agost de 2022, a les 11:44:47 (CEST), Ben Cooksley va > escriure: > > Hi all, > > > > This evening I completed the necessary setup required to complete our > > Gitlab CI dashboards, which can now be found at > > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer > > account login required) > > > > These allow any developer to get a view on the current CI status of > > projects and groups of projects on a branch and platform basis - and > should > > hopefully provide useful insight into the overall status that can > currently > > be obtained from Jenkins. > > > > As this was the last thing holding us back from shutting down > build.kde.org, > > i'd like to proceed with retiring and shutting down build.kde.org as > soon > > as possible so the capacity it occupies can be released and reallocated > to > > Gitlab. > > > > If anyone would like to experiment with customised views for their own > > purposes (where the above provided ones are insufficient) please file a > > Sysadmin ticket. > > > > Please let me know if there are any questions on the above. > > Looks great. > Yay! > > One thing that i'm not sure i understand correctly, currently in the > General > Overview, it says that there are 3 projects currently failing kwin, > kpackage > and kphotoalbum, but then if i go to the Per Platform View i get that > rkward > is failing on windows. Shouldn't rkward also be listed as failing on the > general overview? > That is a rather curious bug, caused by the fact it was looking at things on a Pipeline vs. Job basis. The query you were looking at was looking at the list of most recent pipeline runs on a per project basis, which in the case of rkward means the last push by scripty - which was skipped (so not a failure). I've tweaked the query to look at things on a per job basis now, which skips over that issue. > > Cheers, > Albert > Cheers, Ben > > > > > Thanks, > > Ben > > > > >
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley wrote: > Hi all, > > This evening I completed the necessary setup required to complete our > Gitlab CI dashboards, which can now be found at > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer > account login required) > > These allow any developer to get a view on the current CI status of > projects and groups of projects on a branch and platform basis - and should > hopefully provide useful insight into the overall status that can currently > be obtained from Jenkins. > > As this was the last thing holding us back from shutting down > build.kde.org, i'd like to proceed with retiring and shutting down > build.kde.org as soon as possible so the capacity it occupies can be > released and reallocated to Gitlab. > As previously indicated, I have now shutdown build.kde.org along with the domain that supported it's version of the CI tooling. The repository containing that tooling has now also been archived, and the former build.kde.org domain has been redirected to metrics.kde.org. The server which was acting as a builder for build.kde.org will be rebuilt in the coming days and reallocated to support Gitlab CI workloads. > > If anyone would like to experiment with customised views for their own > purposes (where the above provided ones are insufficient) please file a > Sysadmin ticket. > > Please let me know if there are any questions on the above. > > Thanks, > Ben > Thanks, Ben
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley wrote: > > As previously indicated, I have now shutdown build.kde.org along with the > domain that supported it's version of the CI tooling. > The repository containing that tooling has now also been archived, and the > former build.kde.org domain has been redirected to metrics.kde.org. > > The server which was acting as a builder for build.kde.org will be rebuilt in > the coming days and reallocated to support Gitlab CI workloads. > > Thanks, > Ben What should be used instead of binary-factory? How do I transform this link? https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe
Re: Gitlab CI Dashboards and retirement of build.kde.org
Hi Ben, Thanks for the reminder! On a related note: would it be possible to add badges for CI/CD status to repositories? Quite a few projects (used to) have this in their README.md, but if I unterstand the situation correctly, Gitlab CI doesn't produce a build-status badge that one can link to. Examples: https://invent.kde.org/multimedia/kdenlive/-/blob/master/README.md[1] https://invent.kde.org/graphics/kphotoalbum/-/blob/master/README.md[2] https://invent.kde.org/graphics/digikam/-/blob/master/README.md[3] Cheers, Johannes Am Samstag, 3. September 2022, 06:45:31 CEST schrieb Ben Cooksley: > On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley wrote: > > Hi all, > > > > This evening I completed the necessary setup required to complete our > > Gitlab CI dashboards, which can now be found at > > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer > > account login required) > > > > These allow any developer to get a view on the current CI status of > > projects and groups of projects on a branch and platform basis - and > > should > > hopefully provide useful insight into the overall status that can > > currently > > be obtained from Jenkins. > > > > As this was the last thing holding us back from shutting down > > build.kde.org, i'd like to proceed with retiring and shutting down > > build.kde.org as soon as possible so the capacity it occupies can be > > released and reallocated to Gitlab. > > As previously indicated, I have now shutdown build.kde.org along with the > domain that supported it's version of the CI tooling. > The repository containing that tooling has now also been archived, and the > former build.kde.org domain has been redirected to metrics.kde.org. > > The server which was acting as a builder for build.kde.org will be rebuilt > in the coming days and reallocated to support Gitlab CI workloads. > > > If anyone would like to experiment with customised views for their own > > purposes (where the above provided ones are insufficient) please file a > > Sysadmin ticket. > > > > Please let me know if there are any questions on the above. > > > > Thanks, > > Ben > > Thanks, > Ben [1] https://invent.kde.org/multimedia/kdenlive/-/blob/master/README.md [2] https://invent.kde.org/graphics/kphotoalbum/-/blob/master/README.md [3] https://invent.kde.org/graphics/digikam/-/blob/master/README.md
Re: Gitlab CI Dashboards and retirement of build.kde.org
I now have no way to even test macosx builds for kdiff3, I have no access to a 64bit Intel mac. What are the plans for this and Windows builds. I have a functional windows based craft installed locally. Sep 3, 2022 12:47:06 AM Ben Cooksley : > On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley wrote: >> Hi all, >> >> This evening I completed the necessary setup required to complete our Gitlab >> CI dashboards, which can now be found at >> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer >> account login required) >> >> These allow any developer to get a view on the current CI status of projects >> and groups of projects on a branch and platform basis - and should hopefully >> provide useful insight into the overall status that can currently be >> obtained from Jenkins. >> >> As this was the last thing holding us back from shutting down >> build.kde.org[http://build.kde.org], i'd like to proceed with retiring and >> shutting down build.kde.org[http://build.kde.org] as soon as possible so the >> capacity it occupies can be released and reallocated to Gitlab. > > As previously indicated, I have now shutdown > build.kde.org[http://build.kde.org] along with the domain that supported it's > version of the CI tooling. > The repository containing that tooling has now also been archived, and the > former build.kde.org[http://build.kde.org] domain has been redirected to > metrics.kde.org[http://metrics.kde.org]. > > The server which was acting as a builder for > build.kde.org[http://build.kde.org] will be rebuilt in the coming days and > reallocated to support Gitlab CI workloads. > >> >> If anyone would like to experiment with customised views for their own >> purposes (where the above provided ones are insufficient) please file a >> Sysadmin ticket. >> >> Please let me know if there are any questions on the above. >> >> Thanks, >> Ben > > Thanks, > Ben signature.asc Description: PGP signature
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sat, Sep 3, 2022 at 9:29 PM Gleb Popov <6year...@gmail.com> wrote: > On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley wrote: > > > > As previously indicated, I have now shutdown build.kde.org along with > the domain that supported it's version of the CI tooling. > > The repository containing that tooling has now also been archived, and > the former build.kde.org domain has been redirected to metrics.kde.org. > > > > The server which was acting as a builder for build.kde.org will be > rebuilt in the coming days and reallocated to support Gitlab CI workloads. > > > > Thanks, > > Ben > > What should be used instead of binary-factory? How do I transform this > link? > > > https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe At this time the Binary Factory is not impacted by this. Regards, Ben
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sun, Sep 4, 2022 at 2:13 AM Michael Reeves wrote: > I now have no way to even test macosx builds for kdiff3, I have no access > to a 64bit Intel mac. What are the plans for this and Windows > builds. I have a functional windows based craft installed locally. > At this time the Binary Factory is unaffected by these changes, however steps will be made in the coming weeks/months to migrate away from the Binary Factory to equivalent Gitlab jobs (although they won't be available for Merge Requests due to various technical limitations) Regards, Ben > > > Sep 3, 2022 12:47:06 AM Ben Cooksley : > > On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley wrote: > >> Hi all, >> >> This evening I completed the necessary setup required to complete our >> Gitlab CI dashboards, which can now be found at >> https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer >> account login required) >> >> These allow any developer to get a view on the current CI status of >> projects and groups of projects on a branch and platform basis - and should >> hopefully provide useful insight into the overall status that can currently >> be obtained from Jenkins. >> >> As this was the last thing holding us back from shutting down >> build.kde.org, i'd like to proceed with retiring and shutting down >> build.kde.org as soon as possible so the capacity it occupies can be >> released and reallocated to Gitlab. >> > > As previously indicated, I have now shutdown build.kde.org along with the > domain that supported it's version of the CI tooling. > The repository containing that tooling has now also been archived, and the > former build.kde.org domain has been redirected to metrics.kde.org. > > The server which was acting as a builder for build.kde.org will be > rebuilt in the coming days and reallocated to support Gitlab CI workloads. > > >> >> If anyone would like to experiment with customised views for their own >> purposes (where the above provided ones are insufficient) please file a >> Sysadmin ticket. >> >> Please let me know if there are any questions on the above. >> >> Thanks, >> Ben >> > > Thanks, > Ben > >
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sat, Sep 3, 2022 at 10:12 PM Johannes Zarl-Zierl wrote: > Hi Ben, > Hey Johannes, > > Thanks for the reminder! > > On a related note: would it be possible to add badges for CI/CD status to > repositories? > > Quite a few projects (used to) have this in their README.md, but if I > unterstand the situation correctly, Gitlab CI doesn't produce a > build-status badge that one can link to. > > Examples: > > https://invent.kde.org/multimedia/kdenlive/-/blob/master/README.md > > https://invent.kde.org/graphics/kphotoalbum/-/blob/master/README.md > > https://invent.kde.org/graphics/digikam/-/blob/master/README.md > Gitlab provides a limited selection of badges - which can be found at: - https://invent.kde.org/multimedia/kdenlive/badges/master/pipeline.svg - https://invent.kde.org/multimedia/kdenlive/badges/master/coverage.svg - https://invent.kde.org/multimedia/kdenlive/-/badges/release.svg (replace project path and "master" as appropriate) Note that the Release badge relies on the Gitlab Releases feature being utilised, so that will likely not be usable for any of our projects. Likewise, our Cobertura coverage job currently doesn't have the necessary regular expression configured so that one also won't work - however the general "Pipeline" one should work fine. Unfortunately Gitlab does not support generating per job badges based on job names. > > > Cheers, > > Johannes > Regards, Ben > > Am Samstag, 3. September 2022, 06:45:31 CEST schrieb Ben Cooksley: > > > On Sat, Aug 27, 2022 at 9:44 PM Ben Cooksley wrote: > > > > Hi all, > > > > > > > > This evening I completed the necessary setup required to complete our > > > > Gitlab CI dashboards, which can now be found at > > > > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE > Developer > > > > account login required) > > > > > > > > These allow any developer to get a view on the current CI status of > > > > projects and groups of projects on a branch and platform basis - and > > > > should > > > > hopefully provide useful insight into the overall status that can > > > > currently > > > > be obtained from Jenkins. > > > > > > > > As this was the last thing holding us back from shutting down > > > > build.kde.org, i'd like to proceed with retiring and shutting down > > > > build.kde.org as soon as possible so the capacity it occupies can be > > > > released and reallocated to Gitlab. > > > > > > As previously indicated, I have now shutdown build.kde.org along with > the > > > domain that supported it's version of the CI tooling. > > > The repository containing that tooling has now also been archived, and > the > > > former build.kde.org domain has been redirected to metrics.kde.org. > > > > > > The server which was acting as a builder for build.kde.org will be > rebuilt > > > in the coming days and reallocated to support Gitlab CI workloads. > > > > > > > If anyone would like to experiment with customised views for their own > > > > purposes (where the above provided ones are insufficient) please file a > > > > Sysadmin ticket. > > > > > > > > Please let me know if there are any questions on the above. > > > > > > > > Thanks, > > > > Ben > > > > > > Thanks, > > > Ben > > >
Re: Gitlab CI Dashboards and retirement of build.kde.org
Le sam. 3 sept. 2022 à 21:28, Ben Cooksley a écrit : > On Sat, Sep 3, 2022 at 9:29 PM Gleb Popov <6year...@gmail.com> wrote: > >> On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley wrote: >> > >> > As previously indicated, I have now shutdown build.kde.org along with >> the domain that supported it's version of the CI tooling. >> > The repository containing that tooling has now also been archived, and >> the former build.kde.org domain has been redirected to metrics.kde.org. >> > >> > The server which was acting as a builder for build.kde.org will be >> rebuilt in the coming days and reallocated to support Gitlab CI workloads. >> > >> > Thanks, >> > Ben >> >> What should be used instead of binary-factory? How do I transform this >> link? >> >> >> https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe > > > At this time the Binary Factory is not impacted by this. > > Regards, > Ben > Hi, I think the issue mentioned by Glen is that this link (and all other artifacts from binary-factory) is redirected to https://build-artifacts.kde.org/binary-factory/Kate_Release_win64/1762/kate-22.08.0-1762-windows-msvc2019_64-cl.exe which does not exist. Cheers, Johnny
Re: Gitlab CI Dashboards and retirement of build.kde.org
Hi Ben, Am Samstag, 3. September 2022, 21:37:53 CEST schrieb Ben Cooksley: > On Sat, Sep 3, 2022 at 10:12 PM Johannes Zarl-Zierl > wrote: > > On a related note: would it be possible to add badges for CI/CD status to > > repositories? > > Gitlab provides a limited selection of badges - which can be found at: > - https://invent.kde.org/multimedia/kdenlive/badges/master/pipeline.svg > - https://invent.kde.org/multimedia/kdenlive/badges/master/coverage.svg > - https://invent.kde.org/multimedia/kdenlive/-/badges/release.svg > > (replace project path and "master" as appropriate) Cool, thanks for the quick and detailed reply! > Note that the Release badge relies on the Gitlab Releases feature being > utilised, so that will likely not be usable for any of our projects. > Likewise, our Cobertura coverage job currently doesn't have the necessary > regular expression configured so that one also won't work - however the > general "Pipeline" one should work fine. Good to know. > Unfortunately Gitlab does not support generating per job badges based on > job names. Not what I wanted to hear, but also not a deal-breaker... Cheers, and keep up the good work ;-) Johannes
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sun, Sep 4, 2022 at 7:54 AM Johnny Jazeix wrote: > > > Le sam. 3 sept. 2022 à 21:28, Ben Cooksley a écrit : > >> On Sat, Sep 3, 2022 at 9:29 PM Gleb Popov <6year...@gmail.com> wrote: >> >>> On Sat, Sep 3, 2022 at 7:46 AM Ben Cooksley wrote: >>> > >>> > As previously indicated, I have now shutdown build.kde.org along with >>> the domain that supported it's version of the CI tooling. >>> > The repository containing that tooling has now also been archived, and >>> the former build.kde.org domain has been redirected to metrics.kde.org. >>> > >>> > The server which was acting as a builder for build.kde.org will be >>> rebuilt in the coming days and reallocated to support Gitlab CI workloads. >>> > >>> > Thanks, >>> > Ben >>> >>> What should be used instead of binary-factory? How do I transform this >>> link? >>> >>> >>> https://binary-factory.kde.org/view/Windows%2064-bit/job/Kate_Release_win64/1762/artifact/kate-22.08.0-1762-windows-msvc2019_64-cl.exe >> >> >> At this time the Binary Factory is not impacted by this. >> >> Regards, >> Ben >> > > Hi, > > I think the issue mentioned by Glen is that this link (and all other > artifacts from binary-factory) is redirected to > https://build-artifacts.kde.org/binary-factory/Kate_Release_win64/1762/kate-22.08.0-1762-windows-msvc2019_64-cl.exe > which does not exist. > Oops. That is an oversight on my part - apologies - and has now been corrected (although the URLs will have changed) Cheers, Ben > > > Cheers, > Johnny >
Re: Gitlab CI Dashboards and retirement of build.kde.org
Hi Ben, With build/binary-factory , it was possible to get an Embeddable Build Status Icon as this one : https://binary-factory.kde.org/view/AppImage/job/Digikam_Nightly_appimage-centos7/badge/ Does this feature still exist with Gitlab infrastructure ? Thanks Gilles Le sam. 27 août 2022 à 11:45, Ben Cooksley a écrit : > > Hi all, > > This evening I completed the necessary setup required to complete our Gitlab > CI dashboards, which can now be found at > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer > account login required) > > These allow any developer to get a view on the current CI status of projects > and groups of projects on a branch and platform basis - and should hopefully > provide useful insight into the overall status that can currently be obtained > from Jenkins. > > As this was the last thing holding us back from shutting down build.kde.org, > i'd like to proceed with retiring and shutting down build.kde.org as soon as > possible so the capacity it occupies can be released and reallocated to > Gitlab. > > If anyone would like to experiment with customised views for their own > purposes (where the above provided ones are insufficient) please file a > Sysadmin ticket. > > Please let me know if there are any questions on the above. > > Thanks, > Ben
Re: Gitlab CI Dashboards and retirement of build.kde.org
On Sun, Sep 4, 2022 at 8:51 PM Gilles Caulier wrote: > Hi Ben, > HI Gilles, > > With build/binary-factory , it was possible to get an Embeddable Build > Status Icon as this one : > > > https://binary-factory.kde.org/view/AppImage/job/Digikam_Nightly_appimage-centos7/badge/ > > Does this feature still exist with Gitlab infrastructure ? > Yes, quoting my earlier email: [quote] Gitlab provides a limited selection of badges - which can be found at: - https://invent.kde.org/multimedia/kdenlive/badges/master/pipeline.svg - https://invent.kde.org/multimedia/kdenlive/badges/master/coverage.svg - https://invent.kde.org/multimedia/kdenlive/-/badges/release.svg [/quote] You'll need to swap multimedia/kdenlive to graphics/digikam but otherwise that should work fine. Please note that the Binary Factory is not impacted by this, so anything relating to the Binary Factory is unchanged at this time. > > Thanks > > Gilles > Regards, Ben > > Le sam. 27 août 2022 à 11:45, Ben Cooksley a écrit : > > > > Hi all, > > > > This evening I completed the necessary setup required to complete our > Gitlab CI dashboards, which can now be found at > https://metrics.kde.org/dashboards/f/aNxvXJW4k/gitlab-ci (KDE Developer > account login required) > > > > These allow any developer to get a view on the current CI status of > projects and groups of projects on a branch and platform basis - and should > hopefully provide useful insight into the overall status that can currently > be obtained from Jenkins. > > > > As this was the last thing holding us back from shutting down > build.kde.org, i'd like to proceed with retiring and shutting down > build.kde.org as soon as possible so the capacity it occupies can be > released and reallocated to Gitlab. > > > > If anyone would like to experiment with customised views for their own > purposes (where the above provided ones are insufficient) please file a > Sysadmin ticket. > > > > Please let me know if there are any questions on the above. > > > > Thanks, > > Ben >