[PATCH] Add CDN testing cloudfront redirect for atomic repo
Hi, Currently, we are using two different cloudfront distributions to CDN content for /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup we see an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome this issue and provide faster delivery of ostree content, we have created a cloudfront distribution where we CDN /atomic/repo/ . This patch (available in attachment) adds some redirect rules to use new cloudfront urls for testing purpose and see how much improvement we get in content delivery. This patch shouldn't impact existing infra setup. Thanks, Sinny -- http://sinny.io/ From e42132ff2f5d5935cd2b0124091201d6a6cf2a9f Mon Sep 17 00:00:00 2001 From: Sinny Kumari Date: Thu, 3 Jan 2019 20:57:01 +0530 Subject: [PATCH] Add CDN testing cloudfront redirect for atomic repo Signed-off-by: Sinny Kumari --- roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf | 4 1 file changed, 4 insertions(+) diff --git a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf index 1f39e6c5d..8fa8a3420 100644 --- a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf +++ b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf @@ -23,5 +23,9 @@ RedirectMatch 302 ^/atomic/repo/deltas/(.*) https://d14lrfjen188b1.cloudfront.ne RedirectMatch 302 ^/atomic/repo/objects/(.*) https://d2os45suu8yck8.cloudfront.net/$1 RedirectMatch 302 ^/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1 +RedirectMatch 302 ^/cdn-testing/atomic/repo/deltas/(.*) http://d1dgksnh07m2j5.cloudfront.net/deltas/$1 +RedirectMatch 302 ^/cdn-testing/atomic/repo/objects/(.*) http://d1dgksnh07m2j5.cloudfront.net/objects/$1 +RedirectMatch 302 ^/cdn-testing/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1 + RedirectMatch 302 ^/iot/repo/objects/(.*) https://d35xkejx7yn5rc.cloudfront.net/$1 RedirectMatch 302 ^/iot/repo/(.*) https://kojipkgs.fedoraproject.org/compose/iot/repo/$1 -- 2.20.1 ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo
On 1/3/19 10:40 AM, Sinny Kumari wrote: > Hi, > > Currently, we are using two different cloudfront distributions to CDN content > for > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup we see > an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome this > issue and provide faster delivery of ostree content, we have created a > cloudfront distribution where we CDN /atomic/repo/ . > > This patch (available in attachment) adds some redirect rules to use new > cloudfront urls for testing purpose and see how much improvement we get in > content delivery. This patch shouldn't impact existing infra setup. > I'd like to highlight this is for testing purposes only and should have a short life. We just wanted to make sure the "redirect penalty" that we experience with our prod redirects is also reflected in our testing so we can get more accurate results. Sinny, One thing we might want to do is use https for the cloudfron URLs like we are for the prod redirects. Otherwise LGTM. Dusty ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo
On Thu, Jan 3, 2019 at 9:16 PM Dusty Mabe wrote: > > > On 1/3/19 10:40 AM, Sinny Kumari wrote: > > Hi, > > > > Currently, we are using two different cloudfront distributions to CDN > content for > > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup > we see > > an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome > this > > issue and provide faster delivery of ostree content, we have created a > > cloudfront distribution where we CDN /atomic/repo/ . > > > > This patch (available in attachment) adds some redirect rules to use new > > cloudfront urls for testing purpose and see how much improvement we get > in > > content delivery. This patch shouldn't impact existing infra setup. > > > > I'd like to highlight this is for testing purposes only and should have a > short > life. We just wanted to make sure the "redirect penalty" that we > experience with > our prod redirects is also reflected in our testing so we can get more > accurate > results. > > Sinny, > > One thing we might want to do is use https for the cloudfron URLs like we > are for > the prod redirects. Otherwise LGTM. > Ah yes, nice catch. Updated patch is available in the attachment. This is the sad part part of doing copy paste :/ > Dusty > > > -- http://sinny.io/ From 420894ee34e7561d134bc3713801c9ec3edde5cd Mon Sep 17 00:00:00 2001 From: Sinny Kumari Date: Thu, 3 Jan 2019 20:57:01 +0530 Subject: [PATCH] Add CDN testing cloudfront redirect for atomic repo Signed-off-by: Sinny Kumari --- roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf | 4 1 file changed, 4 insertions(+) diff --git a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf index 1f39e6c5d..63c97568b 100644 --- a/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf +++ b/roles/download/files/httpd/dl.fedoraproject.org/rewrite.conf @@ -23,5 +23,9 @@ RedirectMatch 302 ^/atomic/repo/deltas/(.*) https://d14lrfjen188b1.cloudfront.ne RedirectMatch 302 ^/atomic/repo/objects/(.*) https://d2os45suu8yck8.cloudfront.net/$1 RedirectMatch 302 ^/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1 +RedirectMatch 302 ^/cdn-testing/atomic/repo/deltas/(.*) https://d1dgksnh07m2j5.cloudfront.net/deltas/$1 +RedirectMatch 302 ^/cdn-testing/atomic/repo/objects/(.*) https://d1dgksnh07m2j5.cloudfront.net/objects/$1 +RedirectMatch 302 ^/cdn-testing/atomic/repo/(.*) https://kojipkgs.fedoraproject.org/atomic/repo/$1 + RedirectMatch 302 ^/iot/repo/objects/(.*) https://d35xkejx7yn5rc.cloudfront.net/$1 RedirectMatch 302 ^/iot/repo/(.*) https://kojipkgs.fedoraproject.org/compose/iot/repo/$1 -- 2.20.1 ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo
I've applied the patch and deployed it in production. On Thu, Jan 3, 2019 at 4:55 PM Sinny Kumari wrote: > > > > On Thu, Jan 3, 2019 at 9:16 PM Dusty Mabe wrote: >> >> >> >> On 1/3/19 10:40 AM, Sinny Kumari wrote: >> > Hi, >> > >> > Currently, we are using two different cloudfront distributions to CDN >> > content for >> > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current setup we >> > see >> > an issue https://github.com/ostreedev/ostree/issues/1541 . To overcome this >> > issue and provide faster delivery of ostree content, we have created a >> > cloudfront distribution where we CDN /atomic/repo/ . >> > >> > This patch (available in attachment) adds some redirect rules to use new >> > cloudfront urls for testing purpose and see how much improvement we get in >> > content delivery. This patch shouldn't impact existing infra setup. >> > >> >> I'd like to highlight this is for testing purposes only and should have a >> short >> life. We just wanted to make sure the "redirect penalty" that we experience >> with >> our prod redirects is also reflected in our testing so we can get more >> accurate >> results. >> >> Sinny, >> >> One thing we might want to do is use https for the cloudfron URLs like we >> are for >> the prod redirects. Otherwise LGTM. > > > Ah yes, nice catch. Updated patch is available in the attachment. > This is the sad part part of doing copy paste :/ > > >> >> Dusty >> >> > > > -- > http://sinny.io/ > ___ > infrastructure mailing list -- infrastructure@lists.fedoraproject.org > To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org
Re: [PATCH] Add CDN testing cloudfront redirect for atomic repo
On Fri, Jan 4, 2019 at 9:16 PM Mikolaj Izdebski wrote: > I've applied the patch and deployed it in production. > Thanks a lot Mikolaj! On Thu, Jan 3, 2019 at 4:55 PM Sinny Kumari wrote: > > > > > > > > On Thu, Jan 3, 2019 at 9:16 PM Dusty Mabe wrote: > >> > >> > >> > >> On 1/3/19 10:40 AM, Sinny Kumari wrote: > >> > Hi, > >> > > >> > Currently, we are using two different cloudfront distributions to CDN > content for > >> > /atomic/repo/objects/ and /atomic/repo/deltas/ . With the current > setup we see > >> > an issue https://github.com/ostreedev/ostree/issues/1541 . To > overcome this > >> > issue and provide faster delivery of ostree content, we have created a > >> > cloudfront distribution where we CDN /atomic/repo/ . > >> > > >> > This patch (available in attachment) adds some redirect rules to use > new > >> > cloudfront urls for testing purpose and see how much improvement we > get in > >> > content delivery. This patch shouldn't impact existing infra setup. > >> > > >> > >> I'd like to highlight this is for testing purposes only and should have > a short > >> life. We just wanted to make sure the "redirect penalty" that we > experience with > >> our prod redirects is also reflected in our testing so we can get more > accurate > >> results. > >> > >> Sinny, > >> > >> One thing we might want to do is use https for the cloudfron URLs like > we are for > >> the prod redirects. Otherwise LGTM. > > > > > > Ah yes, nice catch. Updated patch is available in the attachment. > > This is the sad part part of doing copy paste :/ > > > > > >> > >> Dusty > >> > >> > > > > > > -- > > http://sinny.io/ > > ___ > > infrastructure mailing list -- infrastructure@lists.fedoraproject.org > > To unsubscribe send an email to > infrastructure-le...@lists.fedoraproject.org > > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > > List Archives: > https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org > ___ > infrastructure mailing list -- infrastructure@lists.fedoraproject.org > To unsubscribe send an email to > infrastructure-le...@lists.fedoraproject.org > Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines > List Archives: > https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org > -- http://sinny.io/ ___ infrastructure mailing list -- infrastructure@lists.fedoraproject.org To unsubscribe send an email to infrastructure-le...@lists.fedoraproject.org Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/infrastructure@lists.fedoraproject.org