Re: Is the MBS (Module Build Service ?) alright?
On Thu, 2019-11-21 at 07:25 +0100, Nicolas Mailhot via devel wrote: > Le jeudi 21 novembre 2019 à 01:02 +0100, Kevin Kofler a écrit : > > Fabio Valentini wrote: > > > Today, builds submitted by MBS made up more than 80% of total > > > builds, > > > or over 5x the number of "normal" builds. > > > What an incredible waste of resources. > > > > Especially considering what small percentage of the packages is > > actually in > > modules. If more packages modularize, Koji will break down > > completely. > > Especially since the *actual* request made by language SIGs was to > provide a way infra side to make mass rebuilds faster, because > compiler/interpreter language changes require rebuilding everything > periodically, and the rebuild window is a period where things scrawl to > a halt for new language packages. > > MBS achieves the exact reverse: rebuild everything when there’s no deep > need, removing infra resources that could be used to make actual mass > rebuilds, triggered by upstream changes, faster. I seem to remember from early modularity demos that MBS dis some pretty elaborate caching of builds. Is that not applicable here or did it never end up in production MBS deployment ? > > regards, > > -- > Nicolas Mailhot > ___ > devel mailing list -- devel@lists.fedoraproject.org > To unsubscribe send an email to devel-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: Is the MBS (Module Build Service ?) alright?
Le jeudi 21 novembre 2019 à 01:02 +0100, Kevin Kofler a écrit : > Fabio Valentini wrote: > > Today, builds submitted by MBS made up more than 80% of total > > builds, > > or over 5x the number of "normal" builds. > > What an incredible waste of resources. > > Especially considering what small percentage of the packages is > actually in > modules. If more packages modularize, Koji will break down > completely. Especially since the *actual* request made by language SIGs was to provide a way infra side to make mass rebuilds faster, because compiler/interpreter language changes require rebuilding everything periodically, and the rebuild window is a period where things scrawl to a halt for new language packages. MBS achieves the exact reverse: rebuild everything when there’s no deep need, removing infra resources that could be used to make actual mass rebuilds, triggered by upstream changes, faster. regards, -- Nicolas Mailhot ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: Is the MBS (Module Build Service ?) alright?
Fabio Valentini wrote: > Today, builds submitted by MBS made up more than 80% of total builds, > or over 5x the number of "normal" builds. > What an incredible waste of resources. Especially considering what small percentage of the packages is actually in modules. If more packages modularize, Koji will break down completely. Kevin Kofler ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: Is the MBS (Module Build Service ?) alright?
On Wed, Nov 20, 2019 at 12:10 PM Mikolaj Izdebski wrote: > > On Wed, Nov 20, 2019 at 11:43 AM Fabio Valentini wrote: > > I've been noticing irregular, weird surges in koji activity for the > > past few weeks, and today, another one happened. Within 2 hours (8AM > > and 10AM UTC), MBS submitted ±350 builds to koji (of which almost half > > failed), drowning out any other build activity: > > > > koji list-builds --after=2019-11-20 --before=2019-11-21 --sort-key=-build-id > > On November 20, 2019, 07:35:08 UTC I submitted module build #7074 [1], > which completed successfully. > On November 20, 2019, 09:33:54 UTC I submitted module build #7079 [2], > which failed. > > [1] https://release-engineering.github.io/mbs-ui/module/7074 > [2] https://release-engineering.github.io/mbs-ui/module/7079 > > > Previous occurrences of these surges (at least the ones I noticed, > > because koji was awfully slow to schedule any of my builds) were on > > Nov 6, Nov 8, and Nov 12. > > See: https://twitter.com/decathorpe/status/1192061920829984768 > > Whenever someone submits a big module build, MBS can submit hundreds > of individual component builds to Koji. In case of javapackages-tools > module it is ~168 components. Koji builds are picked up and processed > in FCFS order, meaning that any builds submitted after module > component builds will be picked up after modular builds. > > > I hope that's some sign that something is not working as intended? > > This is expected behaviour of MBS. Today, builds submitted by MBS made up more than 80% of total builds, or over 5x the number of "normal" builds. What an incredible waste of resources. > -- > Mikolaj Izdebski > ___ > devel mailing list -- devel@lists.fedoraproject.org > To unsubscribe send an email to devel-le...@lists.fedoraproject.org > Fedora Code of Conduct: > https://docs.fedoraproject.org/en-US/project/code-of-conduct/ > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Re: Is the MBS (Module Build Service ?) alright?
On Wed, Nov 20, 2019 at 11:43 AM Fabio Valentini wrote: > I've been noticing irregular, weird surges in koji activity for the > past few weeks, and today, another one happened. Within 2 hours (8AM > and 10AM UTC), MBS submitted ±350 builds to koji (of which almost half > failed), drowning out any other build activity: > > koji list-builds --after=2019-11-20 --before=2019-11-21 --sort-key=-build-id On November 20, 2019, 07:35:08 UTC I submitted module build #7074 [1], which completed successfully. On November 20, 2019, 09:33:54 UTC I submitted module build #7079 [2], which failed. [1] https://release-engineering.github.io/mbs-ui/module/7074 [2] https://release-engineering.github.io/mbs-ui/module/7079 > Previous occurrences of these surges (at least the ones I noticed, > because koji was awfully slow to schedule any of my builds) were on > Nov 6, Nov 8, and Nov 12. > See: https://twitter.com/decathorpe/status/1192061920829984768 Whenever someone submits a big module build, MBS can submit hundreds of individual component builds to Koji. In case of javapackages-tools module it is ~168 components. Koji builds are picked up and processed in FCFS order, meaning that any builds submitted after module component builds will be picked up after modular builds. > I hope that's some sign that something is not working as intended? This is expected behaviour of MBS. -- Mikolaj Izdebski ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Is the MBS (Module Build Service ?) alright?
Hi everybody, I've been noticing irregular, weird surges in koji activity for the past few weeks, and today, another one happened. Within 2 hours (8AM and 10AM UTC), MBS submitted ±350 builds to koji (of which almost half failed), drowning out any other build activity: koji list-builds --after=2019-11-20 --before=2019-11-21 --sort-key=-build-id Previous occurrences of these surges (at least the ones I noticed, because koji was awfully slow to schedule any of my builds) were on Nov 6, Nov 8, and Nov 12. See: https://twitter.com/decathorpe/status/1192061920829984768 I hope that's some sign that something is not working as intended? Fabio ___ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-le...@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
