Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-10 Thread Radomir Dopieralski
On Tue, Jul 10, 2012 at 12:23 AM,  mar...@v.loewis.de wrote:
  Hopefully by migrating it to the new infrastructure.

 It appears it didn't help. Creating of a new page took 35seconds,
 which is twice the worst editing operation that I personally
 experienced with previous install.

 Did we look into the potential problem with mail notifications...?

 No, we didn't look into this at all.

Actually I did, and I tried to find a way of deleting the unused user
accounts to alleviate the problem, but it's not easy to determine
which accounts are unused with the current moin.

I will look at that patch, but I have my doubts about how much can be
cached with the current architecture. Also, it will no longer be
moinmoin as provided by the system package, unless I find a way to
monkey-patch that code from the configuration (it can still break on
updates then).

-- 
Radomir Dopieralski, http://sheep.art.pl
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-09 Thread anatoly techtonik
On Sat, Jun 16, 2012 at 1:27 PM, Martin v. Löwis mar...@v.loewis.de wrote:
 Is it possible to speed up wiki.python.org somehow?

 Hopefully by migrating it to the new infrastructure.

It appears it didn't help. Creating of a new page took 35seconds,
which is twice the worst editing operation that I personally
experienced with previous install.

Page.execute = 0.001s
antispam = 5.375s
getACL = 0.010s
init = 0.012s
load_multi_cfg = 0.000s
parsePageLinks = 0.021s
run = 35.269s
send_page = 0.393s
send_page_content = 0.027s
total = 35.281s
--
anatoly t.
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-09 Thread anatoly techtonik
On Mon, Jul 9, 2012 at 9:04 PM, Ralf Hildebrandt
ralf.hildebra...@charite.de wrote:
 * anatoly techtonik techto...@gmail.com:
 On Sat, Jun 16, 2012 at 1:27 PM, Martin v. Löwis mar...@v.loewis.de 
 wrote:
  Is it possible to speed up wiki.python.org somehow?
 
  Hopefully by migrating it to the new infrastructure.

 It appears it didn't help. Creating of a new page took 35seconds,
 which is twice the worst editing operation that I personally
 experienced with previous install.

 Page.execute = 0.001s
 antispam = 5.375s
 getACL = 0.010s
 init = 0.012s
 load_multi_cfg = 0.000s
 parsePageLinks = 0.021s
 run = 35.269s
 send_page = 0.393s
 send_page_content = 0.027s
 total = 35.281s

 Looks like a 30s DNS tiemout if you ask me.

 (Basically 5s for antispam and the 30s of basically nothing)

Disk I/O?
--
anatoly t.
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


[pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-09 Thread Paul Boddie
anatoly techtonik wrote:
 On Sat, Jun 16, 2012 at 1:27 PM, Martin v. Löwis martin at v.loewis.de 
wrote:
  Is it possible to speed up wiki.python.org somehow?
 
  Hopefully by migrating it to the new infrastructure.

 It appears it didn't help. Creating of a new page took 35seconds,
 which is twice the worst editing operation that I personally
 experienced with previous install.

Did we look into the potential problem with mail notifications...?

http://mail.python.org/pipermail/pydotorg-www/2012-June/001841.html

See also this:

http://moinmo.in/MoinMoinBugs/GetSubscribersSlow

Paul
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-09 Thread martin

 Hopefully by migrating it to the new infrastructure.

It appears it didn't help. Creating of a new page took 35seconds,
which is twice the worst editing operation that I personally
experienced with previous install.


Did we look into the potential problem with mail notifications...?


No, we didn't look into this at all.

Regards,
Martin


___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-09 Thread martin

total = 35.281s


I can't reproduce this. I got

total = 9.319s


I don't understand what do you mean by can't reproduce. Do you want
to say that 10s is ok?


No, I want to say that 10s is significantly less than 30s; I was not
able to reproduce a run-time of 30s.

Regards,
Martin


___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-07-09 Thread anatoly techtonik
On Tue, Jul 10, 2012 at 1:28 AM,  mar...@v.loewis.de wrote:
 total = 35.281s


 I can't reproduce this. I got

 total = 9.319s


 I don't understand what do you mean by can't reproduce. Do you want
 to say that 10s is ok?


 No, I want to say that 10s is significantly less than 30s; I was not
 able to reproduce a run-time of 30s.

Ok. So the performance question stays open.

 Is it possible to speed up wiki.python.org somehow?

 Hopefully by migrating it to the new infrastructure.

 It appears it didn't help.

What's next?
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


[pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-06-16 Thread anatoly techtonik
Hi guys,

Is it possible to speed up wiki.python.org somehow?
Do we have any public monitoring/metrics about how long it takes to
make a request?
Can we enable this info in the footer?


-- Forwarded message --
From: Winston Wolff winstonwo...@gmail.com
Date: Fri, Jun 15, 2012 at 8:13 PM
Subject: Re: 1.2 beta release date/roadmap
To: pyglet-us...@googlegroups.com


wiki.python.org/moin is too slow. It takes 10 seconds each time I want
to save my page. Can someone give me permission for editing
http://code.google.com/p/pyglet/wiki and I can put stuff there?

I'm going to post:
 - a To Do list so we can coordinate who is doing what
 - A list of configurations to be tested, with how has tested them and
the outcomes.



On Jun 15, 2012, at 9:46 AM, Winston Wolff wrote:

 Friday is my 20% day so I'm going to do some stuff to help release Pyglet.

 I'm taking Anatoly's to-do list and posting it on this wiki page as a central 
 coordinating point. Anybody who wants to do an item, put your name next to 
 it. When it's done, put a DONE next to it.

  http://wiki.python.org/moin/Pyglet

 -Winston

 On Jun 13, 2012, at 12:27 AM, anatoly techtonik wrote:

 Pri-1---
 [ ] update web site
 [ ] fix epydoc
   [ ] add an issue to tracker
 [ ] move web site to Bitbucket
   [ ] create group 'pyglet'
     [ ] add repository pyglet.bitbucket.org
         (see 
 https://confluence.atlassian.com/display/BITBUCKET/Publishing+a+Website+on+bitbucket)
     [ ] add CNAME for pyglet.org to pyglet.bitbucket.org
         (I am not sure, but it should work)
 [ ] mention 1.2
 [ ] direct link to Google Code from top menu
 [ ] update Contribute to be clear
   [ ] send patches
     [ ] site in repository is broken
 http://code.google.com/p/pyglet/source/browse/#hg%2Fwebsite
       [ ] write instructions / fix it to work from checkout
 (s) Richard needs time

 [ ] merge cocoa port

 [ ] write README
 (s) how is pyglet 1.2 different from 1.1?
   [ ] support 64bit Python
 [ ] write ANNOUNCEMENT
 (s) what's new?

 ---Pri-2---
 [ ] update wiki pages
 [ ] draw a line on http://code.google.com/p/pyglet/wiki/ReleaseSchedule
 [ ] integrate patches
   (s) Richard

 [ ] update issue tracker
 [ ] add website label to issue tracker
 [ ] allow users to assign labels when creating new issues
 [ ] add 1.2 milestone
   (s) Richard

 ---Pri-3---
 [ ] build a windows installer
 [ ] try
   [ ] list problems


 So, who can help with any of the stuff above?
 Is there anything is missing?
 Is there anybody besides Richard with an access to wiki?
 Or we can use http://wiki.python.org/moin/Pyglet, because:
 1. it is free-for-all
 2. you can subscribe to pages to be notified about changes

 Yes/No?


--
You received this message because you are subscribed to the Google
Groups pyglet-users group.
To post to this group, send email to pyglet-us...@googlegroups.com.
To unsubscribe from this group, send email to
pyglet-users+unsubscr...@googlegroups.com.
For more options, visit this group at
http://groups.google.com/group/pyglet-users?hl=en.
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-06-16 Thread Martin v. Löwis
 Is it possible to speed up wiki.python.org somehow?

Hopefully by migrating it to the new infrastructure.

Regards,
Martin

___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-06-16 Thread anatoly techtonik
On Sat, Jun 16, 2012 at 1:27 PM, Martin v. Löwis mar...@v.loewis.de wrote:
 Is it possible to speed up wiki.python.org somehow?

 Hopefully by migrating it to the new infrastructure.

And still - that's the cause of the bottleneck?
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www


Re: [pydotorg-www] Wiki is too slow (Fwd: 1.2 beta release date/roadmap)

2012-06-16 Thread anatoly techtonik
On Sat, Jun 16, 2012 at 1:46 PM, Radomir Dopieralski sh...@sheep.art.pl wrote:
 On Sat, Jun 16, 2012 at 12:31 PM, anatoly techtonik techto...@gmail.com 
 wrote:
 On Sat, Jun 16, 2012 at 1:27 PM, Martin v. Löwis mar...@v.loewis.de 
 wrote:
 Is it possible to speed up wiki.python.org somehow?

 Hopefully by migrating it to the new infrastructure.

 And still - that's the cause of the bottleneck?

 I enabled the timing information.

 I'm not 100% sure here, but on other large wikis the long saving times
 were usualy due to having to process a lot of regular expressions from
 all the user preferences in order to see whether the page title
 matches their mail notification patterns.

The results of write operations are very sad - 14 seconds.
Is it possible to postpone mail notifications or do them asyncronously?

Page.execute = 0.000s
antispam = 1.281s
getACL = 0.003s
init = 0.001s
load_multi_cfg = 0.000s
parsePageLinks = 0.010s
run = 13.566s
send_page = 0.050s
send_page_content = 0.006s
total = 13.567s

If we're going to stick these stats (they're worthy to have at hand)
then rendering it in one line that expanded if clicked for copy/paste
would make pages look as good as before.
___
pydotorg-www mailing list
pydotorg-www@python.org
http://mail.python.org/mailman/listinfo/pydotorg-www