You are right, I was going to add that feature and then forgot about
it. Someone reported a PyPI bug over the weekend (it would not affect
web2py). I'll see if I can make the logging a bit more flexible and
release a 1.1 in the next few days.
In the meantime, look into the cron thing.
-tim
Thanks guys. Each time I run a test, though, it costs me money
because I'm paying people on mechanical turk. And if it's slow, it
gives me a bad reputation. So I don't want to run more slow tests
unless we have good request time logging in place and a good
hypothesis to test.
Wouldn't cron
and I'm using postgres not sqlite.
On Apr 5, 12:44 pm, Michael Toomim too...@gmail.com wrote:
Thanks guys. Each time I run a test, though, it costs me money
because I'm paying people on mechanical turk. And if it's slow, it
gives me a bad reputation. So I don't want to run more slow tests
yes. good point.
Massimo
On Apr 5, 2:44 pm, Michael Toomim too...@gmail.com wrote:
Thanks guys. Each time I run a test, though, it costs me money
because I'm paying people on mechanical turk. And if it's slow, it
gives me a bad reputation. So I don't want to run more slow tests
unless we
Can you elaborate how can cron cause database locking issues (apart
from such issues being caused by child processes)?
The content of the crontab is irrelevant, whether you only have
@reboot or more makes no difference. If there would be no check, you
could not change cron parameters without
As far as I know cron cannot lock. Only child processes can lock. As
far as I know cron works fine. Yet I am trying to isolate the problem
cron is one of those few things that may differ when running with
apache or its own web server.
Massimo
On Apr 5, 3:20 pm, AchipA attila.cs...@gmail.com
I see, thank you. I want to measure the web server's response time
when I deploy this on turk... Unfortunately the rocket log does not
report time to serve a request. Do you think it is easy to get that
information from rocket? Do you store the start and stop times for
each request? I see
You are both right that I do not know where the slowness is coming
from. My goal is to measure it so that I can narrow in on the
problem. So far I know that it is external to web2py because it does
not show up in httpserver.log, so my reasoning is to look at rocket
which wraps the web2py part.
Let us know if you discover anything or if we can help with tests.
Can anybody else reproduce this problem?
On Apr 4, 6:46 pm, Michael Toomim too...@gmail.com wrote:
You are both right that I do not know where the slowness is coming
from. My goal is to measure it so that I can narrow in on the
Some more questions:
how much ram?
can you check memory usage? A memory leak may cause slowness.
are you using cron? when cron starts it may spike memory usage.
are you experience the slowness from localhost or from remote
machines?
On Apr 4, 6:46 pm, Michael Toomim too...@gmail.com wrote:
I started using apache with mod_wsgi, and now it's fast! So this
indicates it's a problem that only occurs when using rocket or
cherrypy, but again I'm only measuring it with firebug in my browser.
I have 768MB of ram, ~500MB free. I use cron for @reboot only.
I only run it on a remote machine
I don't think upgrading will help much since Cherrypy was also slow.
However, doing so would help cover all your bases.
If you want to use the http log from Rocket you can do this. I'm
assuming you invoke web2py.py from a bash script or just run it
manually. Paste the following code into
Perhaps a simpler set of questions:
Did you have this working with Cherrypy beforehand?
If so, is Rocket the only thing to have changed?
The latest changes to Rocket were committed to the Mercurial web2py repo
on March 18th. I'm assuming you've run a checkout since then.
-tim
On 3/28/2010
I was having slowness problems with cherrypy too! That's why I
switched to rocket. So perhaps it's something common to cherrypy and
rocket, or perhaps they are both slow in their own ways?
This is using web2py from march 16th, so it's not the latest rocket.
Do you think something important
On 3/29/2010 1:39 PM, Michael Toomim wrote:
I was having slowness problems with cherrypy too! That's why I
switched to rocket. So perhaps it's something common to cherrypy and
rocket, or perhaps they are both slow in their own ways?
This is using web2py from march 16th, so it's not the latest
Yes, this is on linux! Do you recommend upgrading and trying again?
mturk doesn't affect anything, I am just serving webpages that appear
in iframes on the mturk website. From our perspective, I'm serving
webpages.
Do you have a method of logging how much time it takes to serve a page
with
On Mar 29, 7:59 pm, Michael Toomim too...@gmail.com wrote:
Yes, this is on linux! Do you recommend upgrading and trying again?
mturk doesn't affect anything, I am just serving webpages that appear
in iframes on the mturk website. From our perspective, I'm serving
webpages.
Do you have a
Any idea why there is a discrepancy between Firebug and
httpserver.log?
I am using postgresql. What would indicate model complexity? I
have around 9 tables, but most of the requests just do single-object
selects and inserts. No complex joins are in public-facing pages, but
myself as an
On Mar 28, 3:46 pm, Michael Toomim too...@gmail.com wrote:
Any idea why there is a discrepancy between Firebug and
httpserver.log?
httpserver.log logs the time spend in web2py, not including the time
for sending and receiving the http request/response.
firebug logs the the total time,
One more thing. You ask
But a single process doing complex joins should not slow down
all other simple selects and inserts, right?
no, except for sqlite. sqlite serializes all requests because locks
the db. That could explain the 0.20s if you have lots of queries per
request, but not the 54s
Mind that if you use sqlite there is no concurrency. Still these
numbers are very low.
Are your models very complex?
On 27 Mar, 00:06, Michael Toomim too...@gmail.com wrote:
I'm using web2py+rocket to serve jobs on mechanical turk. The server
probably gets a hit per second or so by workers on
Actually it's handling about 5 requests per second, so there is def
some concurrency.
On Mar 26, 10:06 pm, Michael Toomim too...@gmail.com wrote:
I'm using web2py+rocket to serve jobs on mechanical turk. The server
probably gets a hit per second or so by workers on mechanical turk
using it.
22 matches
Mail list logo
