Re: Diagnosing Ask Fedora sluggishness
Hi Anshu, Kevin, On Sun, 2013-09-08 at 10:07 -0600, Kevin Fenzi wrote: > On Sun, 8 Sep 2013 14:19:20 +0530 > Anshu Prateek wrote: > > > The generic yslow grades suggest couple of improvements: > > > > Grade F on Add Expires headers > > > > There are 55 static components without a far-future expiration date. > > Grade F on Configure entity tags (ETags) There are 27 components with > > misconfigured ETags > > > > Grade E on Use cookie-free domainsThere are 9 components that are not > > cookie-free > > > > And some more. > > > > All of these for https://ask.fedoraproject.org/questions/ Can you tell if these are issues limited to our deployment, or if they are things upstream needs to correct, in which case we can go ahead and file bugs? > > Yeah, askbot is using our haproxy/varnish setup as well as memcached, so > if upstream can tweak things to be more caching friendly that would help > for sure. I compared the pingdom tests for our askbot instance, against the one that upstream has deployed: http://tools.pingdom.com/fpt/#!/bFd18x/http://askbot.org/en/questions/ http://tools.pingdom.com/fpt/#!/dmLsqz/http://ask.fedoraproject.org/questions/ Upstream's deployment takes 1.07 seconds, while ours takes 3.07. Would this imply that we can at least tweak our deployment to perform as quick as upstream's? (Upstream's comment posting etc. doesn't lag at all either. The comment is posted as soon as one clicks "post".) > > Actually in this case you might want to look at the django level one? > modules/askbot/templates/settings.erb: > > MIDDLEWARE_CLASSES = ( > #'django.middleware.gzip.GZipMiddleware', > > There may also be some other caching stuff there we should or shouldn't > enable... not sure anyone has fully investigated all those. > I'll look into these, see if there's one we can use. -- Thanks, Warm regards, Ankur (FranciscoD) http://fedoraproject.org/wiki/User:Ankursinha Join Fedora! Come talk to us! http://fedoraproject.org/wiki/Fedora_Join_SIG signature.asc Description: This is a digitally signed message part ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: freeze break request - update mediawiki-FedoraBadges
On Sun, Sep 08, 2013 at 12:26:34PM -0400, Ricky Elrod wrote: > On 09/08/2013 12:07 PM, Kevin Fenzi wrote: > > On Sun, 08 Sep 2013 11:15:11 -0400 > > Ricky Elrod wrote: > > ...snip... > > > >> +1s? > > > > Does this require a httpd restart too? > > It shouldn't - updating the package should be enough. Seems reasonnable and easy enough to reverse, +1 Pierre pgpmVGLpMPVvG.pgp Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: freeze break request - update mediawiki-FedoraBadges
On 09/08/2013 12:07 PM, Kevin Fenzi wrote: > On Sun, 08 Sep 2013 11:15:11 -0400 > Ricky Elrod wrote: > ...snip... > >> +1s? > > Does this require a httpd restart too? It shouldn't - updating the package should be enough. -Ricky signature.asc Description: OpenPGP digital signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: change freeze request
On Sat, 7 Sep 2013 17:36:01 -0700 Toshio Kuratomi wrote: > On Sep 7, 2013 11:24 AM, "Dennis Gilmore" wrote: > > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA1 > > > > I want to change sudoer on the compose boxes to enable members of > > the releng group to run "sudo cp -l" without a password this is to > > enable easily putting the livecds and disk images in place when > > staging a compose > > > > could I get some +1's please > > > > I think I'm -1 to this. > > Is this something we can script to constrain which directories to > copy to? It seems like unrestricted cp would allow overwriting any > file on the system. sudo nopasswd would mean that you no longer need > your second factor to authenticate. So that would mean we're down to > releng ssh key passphrases being our only protection for the boxes > which was a previous problem vector. We could/should restrict it to specific command line arguments I think, yes. kevin signature.asc Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: freeze break request - update mediawiki-FedoraBadges
On Sun, 08 Sep 2013 11:15:11 -0400 Ricky Elrod wrote: ...snip... > +1s? Does this require a httpd restart too? In any case +1, and if it does need httpd restart, roll them one at a time. kevin signature.asc Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
On Sun, 8 Sep 2013 14:19:20 +0530 Anshu Prateek wrote: > The generic yslow grades suggest couple of improvements: > > Grade F on Add Expires headers > > There are 55 static components without a far-future expiration date. > Grade F on Configure entity tags (ETags) There are 27 components with > misconfigured ETags > > Grade E on Use cookie-free domainsThere are 9 components that are not > cookie-free > > And some more. > > All of these for https://ask.fedoraproject.org/questions/ Yeah, askbot is using our haproxy/varnish setup as well as memcached, so if upstream can tweak things to be more caching friendly that would help for sure. > > >>Oh, and can we enable gzip compression on the ask hosts? (I don't > > >>know > > how to do it yet.) > > > > Its in the apache config file. > > > > http://httpd.apache.org/docs/2.2/mod/mod_deflate.html#enable Actually in this case you might want to look at the django level one? modules/askbot/templates/settings.erb: MIDDLEWARE_CLASSES = ( #'django.middleware.gzip.GZipMiddleware', There may also be some other caching stuff there we should or shouldn't enable... not sure anyone has fully investigated all those. kevin signature.asc Description: PGP signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
freeze break request - update mediawiki-FedoraBadges
I'd like to update mediawiki-FedoraBadges in production. The new code is running in staging and can be seen working here: https://stg.fedoraproject.org/wiki/User:Codeblock and here: https://stg.fedoraproject.org/wiki/User:Ralph The biggest change is that it makes the 'title' attribute work so you can hover over a badge to see which badge it is, without having to click on it. This is already in the infra repo, so I'm requesting +1's to do this following: sudo -i ansible app\* -m shell -a "yum clean expire-cache; yum -y update mediawiki-FedoraBadges" If anything were to fail, it should only affect user pages and is easily revertable by downgrading to the old version (i.e., remove the new RPM from the infra repo, yum remove mediawiki-FedoraBadges, yum clean expire-cache, yum install mediawiki-FedoraBadges). +1s? signature.asc Description: OpenPGP digital signature ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Meeting Agenda Item: Introduction Anshu Prateek
hi all, My name is Anshu Prateek (anshprat on freenode). I am from Bangalore, India. I have been a Fedora user since Fedora Core 2/FC3. I have learnt almost eveything thanks to Fedora (managing about a dozen nodes in college lab and later hundreds to thousands of RHEL nodes at work). I would like to contribute to the infrastructure team @ Fedora so that I can give back what I have learnt and also to learn the latest in tech. I had worked for Drupal as a part of GSOC (OpenID AX implementation)[1] and I report bugs for firefox nightly. At my day work, I am a devops. Earlier I was with the search ops team at Yahoo! and have a pretty good knowledge of large scale production environments. Presently am also dabbling into release and QA environments. I am good at bash and php with moderate skills at perl,python and mysql. I have experience with svn and git as an end-user. I have been playing around a bit with ansible. IPv6 is one of my fields of interest.[2] The GettingSponsored doc talks about picking only one FIG. I can contribute the most with least onboarding time to sysadmin-web FIG. I can also contribute to the sysadmin-hosted and sysadmin-tools FIG as required later on. I will pitch in for a sponsorship request later but for the time being I will like to work on these https://fedorahosted.org/fedora-infrastructure/ticket/3617 https://fedorahosted.org/fedora-infrastructure/ticket/3936 https://fedorahosted.org/fedora-infrastructure/ticket/3984 https://fedorahosted.org/fedora-infrastructure/ticket/3987 I can contribute about 4 hours per week on the least. And more as it gets going. I blog at http://hackalyst.info. My name is unique enough that a decent search engine will get you to me. http://about.me/anshuprateek https://badges.fedoraproject.org/user/anshprat Looking forward to working with the Fedora community! regards Anshu Prateek [1] https://drupal.org/project/openid_ax [2] http://www.slideshare.net/anshprat/whatwhyhow-of-ipv6-2002323943c31 ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
On 08/09/13 09:49, Anshu Prateek wrote: > Also, I was about to send a similar mail about site being slow for the > badges. Are these two sharing the hosts? I asked Ralph about Badge slowness the other day. Ralph wrote: > there are fixes in git -- some merged, some still under review -- > that address the speed issue. > I think this is the last one standing - > https://github.com/fedora-infra/tahrir/pull/211 Kind regards, -- Jamie Nguyen ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
The generic yslow grades suggest couple of improvements: Grade F on Add Expires headers There are 55 static components without a far-future expiration date. Grade F on Configure entity tags (ETags) There are 27 components with misconfigured ETags Grade E on Use cookie-free domainsThere are 9 components that are not cookie-free And some more. All of these for https://ask.fedoraproject.org/questions/ Also, I was about to send a similar mail about site being slow for the badges. Are these two sharing the hosts? On Sun, Sep 8, 2013 at 2:09 PM, Anshu Prateek wrote: > >>Oh, and can we enable gzip compression on the ask hosts? (I don't know > how to do it yet.) > > Its in the apache config file. > > http://httpd.apache.org/docs/2.2/mod/mod_deflate.html#enable > > > On Sun, Sep 8, 2013 at 1:58 PM, Ankur Sinha wrote: > >> On Sun, 2013-09-08 at 08:08 +0530, Aditya Patawari wrote: >> > Hi Ankur, >> >> Hi Aditya, >> >> > >> > From what I see, after comparing the time used to load each asset, >> > there are a couple of java scripts, util.js and less.min.js, on Ask >> > Fedora, which takes quite a bit to load. Could it be because of this? >> >> I'm really not sure. I did some random checking and found a few hints, >> but nothing concret: >> >> >> http://tools.pingdom.com/fpt/dmLsqz/http://ask.fedoraproject.org/questions/ >> >> http://askbot.org/en/question/3172/how-to-improve-the-speed-of-askbot/ >> >> > >> > Although there seems to be a varnish cache to deliver it quicker but >> > somehow the load time runs in many seconds. >> >> It probably is the JS, since it's the commenting and voting etc part >> that takes time, and this seems to be JS controlled. >> >> http://askbot.org/en/question/8514/why-does-askbot-require-javascript/ >> >> Any ideas on how we could speed this up? >> >> Oh, and can we enable gzip compression on the ask hosts? (I don't know >> how to do it yet.) >> -- >> Thanks, >> Warm regards, >> Ankur (FranciscoD) >> >> http://fedoraproject.org/wiki/User:Ankursinha >> >> Join Fedora! Come talk to us! >> http://fedoraproject.org/wiki/Fedora_Join_SIG >> >> >> ___ >> infrastructure mailing list >> infrastructure@lists.fedoraproject.org >> https://admin.fedoraproject.org/mailman/listinfo/infrastructure >> > > ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
On Sun, 2013-09-08 at 14:09 +0530, Anshu Prateek wrote: > Its in the apache config file. > > http://httpd.apache.org/docs/2.2/mod/mod_deflate.html#enable > I figured. Not the big issue here though. -- Thanks, Warm regards, Ankur (FranciscoD) http://fedoraproject.org/wiki/User:Ankursinha Join Fedora! Come talk to us! http://fedoraproject.org/wiki/Fedora_Join_SIG signature.asc Description: This is a digitally signed message part ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
>>Oh, and can we enable gzip compression on the ask hosts? (I don't know how to do it yet.) Its in the apache config file. http://httpd.apache.org/docs/2.2/mod/mod_deflate.html#enable On Sun, Sep 8, 2013 at 1:58 PM, Ankur Sinha wrote: > On Sun, 2013-09-08 at 08:08 +0530, Aditya Patawari wrote: > > Hi Ankur, > > Hi Aditya, > > > > > From what I see, after comparing the time used to load each asset, > > there are a couple of java scripts, util.js and less.min.js, on Ask > > Fedora, which takes quite a bit to load. Could it be because of this? > > I'm really not sure. I did some random checking and found a few hints, > but nothing concret: > > http://tools.pingdom.com/fpt/dmLsqz/http://ask.fedoraproject.org/questions/ > > http://askbot.org/en/question/3172/how-to-improve-the-speed-of-askbot/ > > > > > Although there seems to be a varnish cache to deliver it quicker but > > somehow the load time runs in many seconds. > > It probably is the JS, since it's the commenting and voting etc part > that takes time, and this seems to be JS controlled. > > http://askbot.org/en/question/8514/why-does-askbot-require-javascript/ > > Any ideas on how we could speed this up? > > Oh, and can we enable gzip compression on the ask hosts? (I don't know > how to do it yet.) > -- > Thanks, > Warm regards, > Ankur (FranciscoD) > > http://fedoraproject.org/wiki/User:Ankursinha > > Join Fedora! Come talk to us! > http://fedoraproject.org/wiki/Fedora_Join_SIG > > > ___ > infrastructure mailing list > infrastructure@lists.fedoraproject.org > https://admin.fedoraproject.org/mailman/listinfo/infrastructure > ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
On Sun, 2013-09-08 at 18:28 +1000, Ankur Sinha wrote: > http://tools.pingdom.com/fpt/dmLsqz/http://ask.fedoraproject.org/questions/ The flags seem to take quite a while, and yes, the JS too. -- Thanks, Warm regards, Ankur (FranciscoD) http://fedoraproject.org/wiki/User:Ankursinha Join Fedora! Come talk to us! http://fedoraproject.org/wiki/Fedora_Join_SIG signature.asc Description: This is a digitally signed message part ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
Re: Diagnosing Ask Fedora sluggishness
On Sun, 2013-09-08 at 08:08 +0530, Aditya Patawari wrote: > Hi Ankur, Hi Aditya, > > From what I see, after comparing the time used to load each asset, > there are a couple of java scripts, util.js and less.min.js, on Ask > Fedora, which takes quite a bit to load. Could it be because of this? I'm really not sure. I did some random checking and found a few hints, but nothing concret: http://tools.pingdom.com/fpt/dmLsqz/http://ask.fedoraproject.org/questions/ http://askbot.org/en/question/3172/how-to-improve-the-speed-of-askbot/ > > Although there seems to be a varnish cache to deliver it quicker but > somehow the load time runs in many seconds. It probably is the JS, since it's the commenting and voting etc part that takes time, and this seems to be JS controlled. http://askbot.org/en/question/8514/why-does-askbot-require-javascript/ Any ideas on how we could speed this up? Oh, and can we enable gzip compression on the ask hosts? (I don't know how to do it yet.) -- Thanks, Warm regards, Ankur (FranciscoD) http://fedoraproject.org/wiki/User:Ankursinha Join Fedora! Come talk to us! http://fedoraproject.org/wiki/Fedora_Join_SIG signature.asc Description: This is a digitally signed message part ___ infrastructure mailing list infrastructure@lists.fedoraproject.org https://admin.fedoraproject.org/mailman/listinfo/infrastructure
