Re: Copr - look back at 2021

[Pavel Raiskup]

On Monday, January 3, 2022 11:30:42 AM CET Tomas Tomecek wrote:
> On Thu, Dec 30, 2021 at 3:35 PM Miroslav Suchý  wrote:
> 
> >
> >-
> >
> >Statistics:
> >-
> >
> >   Copr run 2,900,000 builds.
> >   -
> >
> >   People created 15 731 new projects.
> >
> >
> Whaaat! The whole list of things you have achieved is mega impressive but
> this one totally caught my eye: doing millions of builds per year.
> 
> I'm wondering how many of those projects were created by packit.

Frontend footer links this: https://copr.fedorainfracloud.org/db_dumps/
In case anyone wanted to do more analysis ...

coprdb=# select count(*) from copr where created_on > 1609459200 and created_on 
< 1640995200;
┌───┐
│ count │
├───┤
│ 15760 │
└───┘
(1 row)

coprdb=# select count(*) from copr where created_on > 1609459200 and created_on 
< 1640995200 and user_id = 5576;
┌───┐
│ count │
├───┤
│ 10037 │
└───┘
(1 row)

Most of the projects is from Packit.  Packit has though quite unusual use-case;
those projects are used for a short period of time (usually new project for
every PR), and contain only a few builds.

Builds statistics for Packit are not easy to get..  The old removed
projects (deleted=true, temporary projects...) have all the related Build
instances removed from DB.  But due to the nature of the CI builds I
suppose it will be somewhere below 100k.

Pavel


___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Re: Copr - look back at 2021

[Tomas Tomecek]

On Thu, Dec 30, 2021 at 3:35 PM Miroslav Suchý  wrote:

>
>-
>
>Statistics:
>-
>
>   Copr run 2,900,000 builds.
>   -
>
>   People created 15 731 new projects.
>
>
Whaaat! The whole list of things you have achieved is mega impressive but
this one totally caught my eye: doing millions of builds per year.

I'm wondering how many of those projects were created by packit.


Tomas
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Re: Copr - look back at 2021

[Kevin Fenzi]

On Thu, Dec 30, 2021 at 03:33:05PM +0100, Miroslav Suchý wrote:
> Let me sum up what the Copr team did during 2021:

Thanks so much for all your work in the last year!

kevin


signature.asc
Description: PGP signature
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Re: Copr - look back at 2021

[Zbigniew Jędrzejewski-Szmek]

On Thu, Dec 30, 2021 at 03:33:05PM +0100, Miroslav Suchý wrote:
> Let me sum up what the Copr team did during 2021:

Lots of great stuff, thanks!

>We had an initial meeting about rebase-helper automatically opening PR in 
> src.fedoraproject.org. There is even some
>code written (by 
> Michal Konečný), but the code is not
>integrated yet and no user-visible outcome was done yet. ETA is the first 
> half of 2022.

That'd would be super cool.

Zbyszek
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Re: Copr - look back at 2021

[Fabio Valentini]

On Fri, Dec 31, 2021 at 9:20 AM Benson Muite  wrote:
>
> On 12/30/21 5:33 PM, Miroslav Suchý wrote:
> > Let me sum up what the Copr team did during 2021:
> >
> Awesome work. Looking forward to a great 2022!

Let me second that. Thank you all for working on COPR and related projects.
I use those services and programs almost on a daily basis, and they
continue to get better. :)

> availability of native s390x builders in the early months of 2022

Having a big-endian architecture available for (native) COPR builds
would be great. Thanks for working on it!

Fabio
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Re: Copr - look back at 2021

[Benson Muite]

On 12/30/21 5:33 PM, Miroslav Suchý wrote:

Let me sum up what the Copr team did during 2021:


Awesome work. Looking forward to a great 2022!
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Copr - look back at 2021

[Miroslav Suchý]

Let me sum up what the Copr team did during 2021:

Mock:

 *

   We did eight releases of Mock

 *

   We moved Mock’s wiki to GitHub Pages to allow indexing by search engines
   https://rpm-software-management.github.io/mock/ 
and created a
   Fedora-based Jekyll container for local documentation testing
   (https://github.com/praiskup/jekyll-github-pages-fedora-container
   ).

 *

   We initiated the discussion about default epel-8-* config


Copr:

 *

   We did six releases of Copr and upgraded Copr servers to Fedora 35.

 *

   We wrote three “4 cool new projects to try in Copr” articles for Fedora 
Magazine

 *

   We rebuilt all gems from Rubygems.org for Fedora Rawhide
   http://frostyx.cz/posts/rebuilding-the-entire-rubygems-in-copr
   

 *

   We started to use AWS Spot instances for builders 
https://pavel.raiskup.cz/blog/aws-instances.html
   

 *

   We started to decommission APIv1 and APIv2 
https://fedora-copr.github.io/posts/EOL-APIv1-APIv2-pt2
   

 *

   You have an option to run a fedora-review after each build
   http://frostyx.cz/posts/running-fedora-review-after-copr-build
   

 *

   We created a new Ansible module `copr` which is available in community 
general collection
   https://fedora-copr.github.io/posts/new-ansible-module-copr
   

 *

   You can order your builds using batches now 
https://pavel.raiskup.cz/blog/build-ordering-by-batches-in-copr.html
   

 *

   People started using discussion under projects. There are more than one 
hundred active discussions
   https://discussion.fedoraproject.org/c/projects-in-copr/54 


 *

   We redesigned Copr’s home page

 *

   We worked on clean-up scripts resulting in 5+ TB cleaned from our backends.

 *

   We did six releases of `resalloc` with improvements for better throughput 
and reactions during peeks.
   https://github.com/praiskup/resalloc/ 

 *

   Copr’s servers got IPv6 
https://pavel.raiskup.cz/blog/switch-fedora-box-to-ipv6-in-aws.html
   

 *

   We did three releases of `prunerepo` https://pagure.io/prunerepo 


 *

   We added lots of builders and some architectures 
https://pavel.raiskup.cz/blog/copr-farm-of-builders.html
   and later we 
re-add ppc64le architecture, and started
   using spot AWS instances

 *

   We implemented Error Budget 
and our goal 
is:

 o

   97 % of builds of copr-ping package is finished within 6 minutes (this 
monitor length of queue and speed of
   builders)

 o

   99,3 % uptime of CDN

 o

   99,3 % uptime of copr-backend (dnf repositories) (cca 5h/month)

 o

   97.5 % uptime of copr-frontend (WebUI) (cca 18h/month)

 *

   There is work in progress on Kerberos authentication in copr-cli.

 *

   Statistics:

 o

   Copr run 2,900,000 builds.

 o

   People created 15 731 new projects.



Fedora:

 *

   We created a Fedora Sponsor site to easy find of a sponsor 
https://docs.pagure.org/fedora-sponsors/
   

 *

   We created a video explaining a dist-git https://youtu.be/VsnJymZRQOM 


 *

   We proposed Retired Packages change 
https://fedoraproject.org/wiki/Changes/RetiredPackages
   and it got accepted.

 *

   We created license-validate tool https://pagure.io/copr/license-validate/ 



Others:

 *

   We did four releases of Tito

 *

   We wrote an article about activating no-cost RHEL
   
https://developers.redhat.com/blog/2021/02/10/how-to-activate-your-no-cost-red-hat-enterprise-linux-subscription
   


 *

   We wrote three articles about storing GPG keys in DNS persuaded several 
distributions to put the records in DNS
   https://github.com/xsuchy/distribution-gpg-keys/#storing-keys-in-dns
   

 *

   New `modulemd-tools` release with "bld2repo" tool.


Outlook for 2022

 *

   We are in the middle of talking with IBM, which should result in the 
availability of native s390x builders