Re: Heads up - AWS Snapshots cleanup

2023-12-02 Thread Miroslav Suchý

Dne 29. 11. 23 v 8:36 Miroslav Suchý napsal(a):

On Friday (2023-12-01) I plan to delete all Snapshots that were created before 
2019 and do not have tag FedoraGroup.

On next Friday (2023-12-08) I plan to delete all Snapshots that were created in 2021 and earlier and do not have tag 
Fedora Group.


I started with the cleanup. I started with 2018 and older. The script is running right now. It found lots of snapshots 
in eu-central-1. But surprisingly just few snapshots in ap-south-1 - most snapshots AWS rejected to delete because they 
were linked to AMI - mostly Fedora-AtomicHost-29-* We have plenty of them. See this screenshot:


  https://k00.fr/o0hxjyd0

I wonder - do we have written retention policy for our images? Do we want to 
keep the old one? Public ones? Private ones?

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


Re: Heads up - AWS Snapshots cleanup

2023-12-02 Thread Miroslav Suchý

Dne 02. 12. 23 v 22:45 Miroslav Suchý napsal(a):
I wonder - do we have written retention policy for our images? Do we want to keep the old one? Public ones? Private ones? 


It seems that Fedora Atomic Host is EOLed since 2019-11-26 
https://projectatomic.io/blog/2019/11/fedora-atomic-host-nearing-eol/


The images for historical purposes are available at 
https://dl.fedoraproject.org/pub/alt/atomic/stable/

So it seems to me that we can safely delete all AMIs with name 
"Fedora-AtomicHost*'

--
Miroslav Suchy, RHCA
Red Hat, Manager, Packit and CPT, #brno, #fedora-buildsys
--
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue


AWS usage per group (November)

2023-12-02 Thread Miroslav Suchý

Here comes November edition of resources running in AWS. It's a snapshot of 
resources running today.

FedoraGroup: respins

 Region: us-east-1
   Volume Type: gp3 - Total Size: 500 GiB

FedoraGroup: ci
 Region: us-east-1
   Instance Type: c5.2xlarge - Count: 3
   Volume Type: gp3 - Total Size: 1540 GiB
 Region: us-east-2
   Instance Type: m5a.4xlarge - Count: 1
   Instance Type: r5.large - Count: 4
   Instance Type: i3.2xlarge - Count: 6
   Instance Type: r5.xlarge - Count: 2
   Instance Type: c5.2xlarge - Count: 1
   Instance Type: c6a.large - Count: 17
   Volume Type: gp3 - Total Size: 11654 GiB

FedoraGroup: centos-stream-build
 Region: us-east-2
   Instance Type: t2.micro - Count: 1

FedoraGroup: garbage-collector
 Region: ap-southeast-1
   Volume Type: standard - Total Size: 6 GiB

FedoraGroup: centos-stream-osci
 Region: ca-central-1
   Instance Type: m5d.large - Count: 5
   Instance Type: t2.micro - Count: 1
   Volume Type: gp3 - Total Size: 36 GiB

FedoraGroup: abrt
 Region: us-east-1
   Instance Type: t3a.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 10 GiB

FedoraGroup: infra
 Region: ap-south-1
   Instance Type: c5d.xlarge - Count: 1
   Volume Type: gp3 - Total Size: 8 GiB
 Region: eu-central-1
   Instance Type: c5d.xlarge - Count: 1
   Instance Type: c5n.2xlarge - Count: 1
   Instance Type: m5.xlarge - Count: 1
   Instance Type: m6gd.4xlarge - Count: 1
   Volume Type: gp3 - Total Size: 16223 GiB
 Region: us-west-1
   Instance Type: t3.medium - Count: 1
   Volume Type: gp3 - Total Size: 40 GiB
 Region: us-west-2
   Instance Type: m5.large - Count: 4
   Instance Type: m6g.large - Count: 1
   Instance Type: t3.large - Count: 1
   Instance Type: c5n.2xlarge - Count: 1
   Instance Type: c6gd.xlarge - Count: 1
   Volume Type: standard - Total Size: 100 GiB
   Volume Type: gp3 - Total Size: 900 GiB
 Region: af-south-1
   Instance Type: c5d.xlarge - Count: 2
   Volume Type: gp3 - Total Size: 25 GiB
 Region: eu-west-2
   Instance Type: c5d.xlarge - Count: 1
   Volume Type: gp3 - Total Size: 20 GiB
 Region: ap-northeast-2
   Instance Type: c5n.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 196 GiB
 Region: sa-east-1
   Instance Type: c5.2xlarge - Count: 1
   Instance Type: c5n.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 200 GiB
 Region: ap-southeast-1
   Instance Type: c5d.xlarge - Count: 1
   Instance Type: c5n.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 108 GiB
 Region: us-east-1
   Instance Type: t3.medium - Count: 1
   Instance Type: t3.small - Count: 1
   Instance Type: c5.xlarge - Count: 2
   Instance Type: t2.medium - Count: 2
   Instance Type: c5.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 330 GiB
 Region: us-east-2
   Instance Type: c5d.large - Count: 1
   Instance Type: t2.micro - Count: 1
   Instance Type: t3.medium - Count: 1
   Volume Type: gp3 - Total Size: 63 GiB

FedoraGroup: min
 Region: eu-central-1
   Instance Type: t3.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 1000 GiB

FedoraGroup: copr
 Region: us-east-1
   Instance Type: t3a.xlarge - Count: 6
   Instance Type: m5a.4xlarge - Count: 2
   Instance Type: c7i.xlarge - Count: 14
   Instance Type: c7g.xlarge - Count: 89
   Instance Type: t3a.medium - Count: 5
   Instance Type: t3a.small - Count: 1
   Instance Type: t2.medium - Count: 1
   Volume Type: st1 - Total Size: 6000 GiB
   Volume Type: gp3 - Total Size: 4172 GiB
   Volume Type: io2 - Total Size: 20 GiB
   Volume Type: sc1 - Total Size: 81652 GiB

FedoraGroup: centos
 Region: ap-south-1
   Instance Type: t3.2xlarge - Count: 3
   Instance Type: t3.large - Count: 1
   Instance Type: m6i.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 4570 GiB
 Region: eu-central-1
   Instance Type: t2.small - Count: 1
   Instance Type: t2.large - Count: 2
   Instance Type: r5b.8xlarge - Count: 1
   Instance Type: m6i.2xlarge - Count: 1
   Instance Type: t3.xlarge - Count: 1
   Volume Type: gp3 - Total Size: 13200 GiB
 Region: us-west-2
   Instance Type: m6i.2xlarge - Count: 2
   Instance Type: t3.small - Count: 1
   Instance Type: t3.xlarge - Count: 1
   Volume Type: gp3 - Total Size: 13145 GiB
 Region: af-south-1
   Instance Type: m6i.2xlarge - Count: 1
   Volume Type: gp3 - Total Size: 4050 GiB
 Region: eu-west-3
   Instance Type: t2.large - Count: 2
   Instance Type: t2.2xlarge - Count: 1
   Instance Type: t3a.xlarge - Count: 1
   Instance Type: t2.small - Count: 2
   Instance Type: t3.xlarge - Count: 1
   Instance Type: t3.large - Count: 1
   Volume Type: gp3 - Total Size: 2917 GiB
 Region: eu-west-2
   Instance Type: t2.small - Count: 1
   Instance Type: t2.large - Count: 1