Re: Freeze Break Request: fix up registry

2018-10-16 Thread Mohan Boddu
LGTM +1

On Tue, Oct 16, 2018 at 3:12 PM Patrick マルタインアンドレアス Uiterwijk <
puiterw...@redhat.com> wrote:

> +1
> ___
> infrastructure mailing list -- infrastructure@lists.fedoraproject.org
> To unsubscribe send an email to
> infrastructure-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
>
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: Freeze Break Request: fix up registry

2018-10-16 Thread Patrick マルタインアンドレアス Uiterwijk
+1
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: Freeze Break Request: fix up registry

2018-10-16 Thread Mikolaj Izdebski
+1

- Original Message -
> Greetings.
> 
> I would like to do the following:
> 
> * Apply the attached ansible diff. This changes things to run the new
> 'reg' (which just has a 'server' subcommand, not a reg-server binary),
> and also fixes varnish to not eat the requests to show more than 100
> items from our registry. It also fixes some sync jobs where the flatpak
> info would 'disappear' for 10min at a time due to a --delete that
> shouldn't have been there.
> 
> * Upgrade 'reg' on sundries01.phx2 (prod). I've already tested this
> version in staging and it works.
> 
> * Run playbooks: sundries, and proxies
> 
> The only thing that could affect things much here is the varnish change,
> but it's one line and contained to the registry block.
> 
> This would make our registry nice and pretty before release.
> 
> +1s?
> 
> kevin
> 
> ___
> infrastructure mailing list -- infrastructure@lists.fedoraproject.org
> To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
> 
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Freeze Break Request: fix up registry

2018-10-16 Thread Kevin Fenzi
Greetings.

I would like to do the following:

* Apply the attached ansible diff. This changes things to run the new
'reg' (which just has a 'server' subcommand, not a reg-server binary),
and also fixes varnish to not eat the requests to show more than 100
items from our registry. It also fixes some sync jobs where the flatpak
info would 'disappear' for 10min at a time due to a --delete that
shouldn't have been there.

* Upgrade 'reg' on sundries01.phx2 (prod). I've already tested this
version in staging and it works.

* Run playbooks: sundries, and proxies

The only thing that could affect things much here is the varnish change,
but it's one line and contained to the registry block.

This would make our registry nice and pretty before release.

+1s?

kevin
From 89d55ff50825c83f658257cb12a25c89a9ce1f09 Mon Sep 17 00:00:00 2001
From: Kevin Fenzi 
Date: Tue, 16 Oct 2018 18:53:51 +
Subject: [PATCH] Fix up registry

* Move to new reg binary.
* Fix --delete on rsync that was blowing away flatpak indexes.
* Fix varnish to not drop requests for pagination on the registry
* Make cron jobs not email maxamillion directly.
* Make cron job ignore INFO output.

Signed-off-by: Kevin Fenzi 
---
 files/reg-server/cron-prod   | 5 +
 files/reg-server/cron-stg| 5 +
 roles/fedora-web/registry/files/cron-sync-registry-index | 6 +++---
 roles/varnish/templates/proxies.vcl.j2   | 1 -
 tasks/reg-server.yml | 8 
 5 files changed, 5 insertions(+), 20 deletions(-)

diff --git a/files/reg-server/cron-prod b/files/reg-server/cron-prod
index aa92020..154ea1c 100644
--- a/files/reg-server/cron-prod
+++ b/files/reg-server/cron-prod
@@ -1,5 +1,2 @@
 SHELL=/bin/bash
-MAILTO=maxamill...@fedoraproject.org
-
-#*/5 * * * * root cd /var/lib/reg-server/ && reg-server -r registry.fedoraproject.org --once
-
+*/5 * * * * root cd /var/lib/reg-server/ && reg server -r registry.fedoraproject.org --once | grep -v INFO
diff --git a/files/reg-server/cron-stg b/files/reg-server/cron-stg
index bb73dbb..3173d16 100644
--- a/files/reg-server/cron-stg
+++ b/files/reg-server/cron-stg
@@ -1,5 +1,2 @@
 SHELL=/bin/bash
-MAILTO=maxamill...@fedoraproject.org
-
-#*/5 * * * * root cd /var/lib/reg-server/ && reg-server -r registry.stg.fedoraproject.org --once
-
+*/5 * * * * root cd /var/lib/reg-server/ && reg server -r registry.stg.fedoraproject.org --once | grep -v INFO
diff --git a/roles/fedora-web/registry/files/cron-sync-registry-index b/roles/fedora-web/registry/files/cron-sync-registry-index
index a647963..2c73156 100644
--- a/roles/fedora-web/registry/files/cron-sync-registry-index
+++ b/roles/fedora-web/registry/files/cron-sync-registry-index
@@ -1,3 +1,3 @@
-30 * * * *  root /usr/bin/rsync --delete -a --no-owner --no-group sundries01::registry-index/ /srv/web/registry-index/
-40 * * * *  root /usr/bin/rsync --delete -a --no-owner --no-group sundries01::regindexer/index/ /srv/web/registry-index/index/
-45 * * * *  root /usr/bin/rsync --delete -a --no-owner --no-group sundries01::regindexer/icons/ /srv/web/registry-index/icons/
+30 * * * *  root /usr/bin/rsync -a --no-owner --no-group sundries01::registry-index/ /srv/web/registry-index/
+31 * * * *  root /usr/bin/rsync --delete -a --no-owner --no-group sundries01::regindexer/index/ /srv/web/registry-index/index/
+32 * * * *  root /usr/bin/rsync --delete -a --no-owner --no-group sundries01::regindexer/icons/ /srv/web/registry-index/icons/
diff --git a/roles/varnish/templates/proxies.vcl.j2 b/roles/varnish/templates/proxies.vcl.j2
index 9515988..48c73d6 100644
--- a/roles/varnish/templates/proxies.vcl.j2
+++ b/roles/varnish/templates/proxies.vcl.j2
@@ -184,7 +184,6 @@ sub vcl_recv {
 set req.backend_hint = registry;
 unset req.http.cookie;
 set req.http.clear-cookies = "yes";
-set req.url = regsub(req.url, "\?.*", "");
 if (req.url ~ "/blobs/") {
 return(pass);
 }
diff --git a/tasks/reg-server.yml b/tasks/reg-server.yml
index 7f9187b..6fb6b04 100644
--- a/tasks/reg-server.yml
+++ b/tasks/reg-server.yml
@@ -1,16 +1,8 @@
 - name: install reg-server
   package:
-name: reg-server
-  tags:
-  - regserver
-  when: env != 'staging'
-
-- name: install reg-server
-  package:
 name: reg
   tags:
   - regserver
-  when: env == 'staging'
 
 - name: Copy reg-server repositories html template
   copy:
-- 
1.8.3.1



signature.asc
Description: OpenPGP digital signature
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: [Freeze Break Request: ] Enable fpdc scopes in ipsilon. Ticket 7299.

2018-10-16 Thread Rick Elrod
+1
-re

On 10/16/18 12:50 PM, ke...@scrye.com wrote:
> From: Kevin Fenzi 
>
> This simply installs the ipsilon plugin for fpdc scopes and
> restarts it. If there's an issue we can easily remove it to
> roll back to where we were.
>
> +1s?
>
> Signed-off-by: Kevin Fenzi 
> ---
>  roles/ipsilon/tasks/main.yml | 1 +
>  1 file changed, 1 insertion(+)
>
> diff --git a/roles/ipsilon/tasks/main.yml b/roles/ipsilon/tasks/main.yml
> index 9bbccbf..ab2f0a7 100644
> --- a/roles/ipsilon/tasks/main.yml
> +++ b/roles/ipsilon/tasks/main.yml
> @@ -50,6 +50,7 @@
>- wiki
>- freshmaker
>- src
> +  - fpdc
>notify:
>- reload apache
>tags:




signature.asc
Description: OpenPGP digital signature
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: [Freeze Break Request: ] Enable fpdc scopes in ipsilon. Ticket 7299.

2018-10-16 Thread Stephen John Smoogen
+1

On Tue, 16 Oct 2018 at 12:50,  wrote:

> From: Kevin Fenzi 
>
> This simply installs the ipsilon plugin for fpdc scopes and
> restarts it. If there's an issue we can easily remove it to
> roll back to where we were.
>
> +1s?
>
> Signed-off-by: Kevin Fenzi 
> ---
>  roles/ipsilon/tasks/main.yml | 1 +
>  1 file changed, 1 insertion(+)
>
> diff --git a/roles/ipsilon/tasks/main.yml b/roles/ipsilon/tasks/main.yml
> index 9bbccbf..ab2f0a7 100644
> --- a/roles/ipsilon/tasks/main.yml
> +++ b/roles/ipsilon/tasks/main.yml
> @@ -50,6 +50,7 @@
>- wiki
>- freshmaker
>- src
> +  - fpdc
>notify:
>- reload apache
>tags:
> --
> 1.8.3.1
> ___
> infrastructure mailing list -- infrastructure@lists.fedoraproject.org
> To unsubscribe send an email to
> infrastructure-le...@lists.fedoraproject.org
> Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
>


-- 
Stephen J Smoogen.
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


[Freeze Break Request: ] Enable fpdc scopes in ipsilon. Ticket 7299.

2018-10-16 Thread kevin
From: Kevin Fenzi 

This simply installs the ipsilon plugin for fpdc scopes and
restarts it. If there's an issue we can easily remove it to
roll back to where we were.

+1s?

Signed-off-by: Kevin Fenzi 
---
 roles/ipsilon/tasks/main.yml | 1 +
 1 file changed, 1 insertion(+)

diff --git a/roles/ipsilon/tasks/main.yml b/roles/ipsilon/tasks/main.yml
index 9bbccbf..ab2f0a7 100644
--- a/roles/ipsilon/tasks/main.yml
+++ b/roles/ipsilon/tasks/main.yml
@@ -50,6 +50,7 @@
   - wiki
   - freshmaker
   - src
+  - fpdc
   notify:
   - reload apache
   tags:
-- 
1.8.3.1
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: [Freeze Break Request: ] Also install the username/pass for pushing to the stg candidate registery.

2018-10-16 Thread Pierre-Yves Chibon
On Mon, Oct 15, 2018 at 06:05:59PM +, ke...@scrye.com wrote:
> From: Kevin Fenzi 
> 
> Signed-off-by: Kevin Fenzi 
> ---
>  playbooks/groups/releng-compose.yml | 1 -
>  1 file changed, 1 deletion(-)
> 
> diff --git a/playbooks/groups/releng-compose.yml 
> b/playbooks/groups/releng-compose.yml
> index e0df083..4a16924 100644
> --- a/playbooks/groups/releng-compose.yml
> +++ b/playbooks/groups/releng-compose.yml
> @@ -71,7 +71,6 @@
>candidate_registry: "candidate-registry.stg.fedoraproject.org",
>candidate_registry_osbs_username: 
> "{{candidate_registry_osbs_stg_username}}",
>candidate_registry_osbs_password: 
> "{{candidate_registry_osbs_stg_password}}",
> -when: env == "staging"
>}
>- {
>  role: push-docker,
> -- 
> 1.8.3.1

+1 for me

Pierre


signature.asc
Description: PGP signature
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org


Re: Storage at copr-be

2018-10-16 Thread Miroslav Suchý
Dne 12.10.2018 v 22:11 Kevin Fenzi napsal(a):
> How much do we have left on that device?

At the end I added 1TB. Now we have:

/dev/vdc1   7.5T  6.2T  1.3T  83% /var/lib/copr/public_html

I attached the graph showing the history (sorry for the gap in 2015,2016).
But the end of the story is that we consumed 2 TB during last year and we are 
accelerating.

So my question is - can Copr consume additional cca 3 TB of storage next year 
from fedora-infra resources? Or should I
start planning to get money for a storage?

Miroslav


signature.asc
Description: OpenPGP digital signature
___
infrastructure mailing list -- infrastructure@lists.fedoraproject.org
To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org