Thanks Graham, the stack traces now show file names correctly. It turned out, our processes were waiting for a database connection from the connection pool. Something we can fix. Thank you so much for your help!
On Wednesday, November 11, 2015 at 2:53:06 PM UTC+13, Graham Dumpleton wrote: > > Install latest development version by running: > > pip install -U > https://github.com/GrahamDumpleton/mod_wsgi/archive/develop.zip > > That will fix the display of “null” in logged messages. > > That “null” was shown was a bug in mod_wsgi code for Python 3. Was working > okay on Python 2. > > With the stack traces then correctly displayed, post them if it isn’t then > obvious to you where things are getting stuck. > > Graham > > On 10 Nov 2015, at 12:06 pm, Michael Miller <[email protected] > <javascript:>> wrote: > > Hello, > > I am trying to debug a "Timeout when reading response headers from daemon > process" issue that appears somewhat randomly. There doesn't seem to be any > consistency to when the issue happens. There are no long running processes > in the web application when this happens. I have been reading a bit about > debugging this issue, but have now become stuck. > > I am using the mod_wsgi 4.4.21 (express) and the apache 2.2.15 that comes > with CentOS 6.7. This is to closely match the version of Apache that our > production servers run and that is enforced by our system engineers. This > issue is happening regularly locally and sporadically on production > (although production is running mod_wsgi 4.2.7). Anyway I want to > concentrate on what is happening locally and fix it before I upgrade > production. > > My problems are 1) "Timeout when reading response headers from daemon > process" and I don't know why and 2) the python traceback is showing > "(null)" rather than a filename which makes it hard to try and pinpoint the > issue. > > The logs and version information is listed below. Any help would be > grateful appreciated. > > Thanks, > Michael Miller > > > [dev@localhost ~]$ httpd -v > Server version: Apache/2.2.15 (Unix) > Server built: Aug 24 2015 17:52:49 > [dev@localhost ~]$ uname -a > Linux localhost.localdomain 2.6.32-573.7.1.el6.x86_64 #1 SMP Tue Sep 22 > 22:00:00 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux > [dev@localhost ~]$ cat /proc/version > Linux version 2.6.32-573.7.1.el6.x86_64 ([email protected] > <javascript:>) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-16) (GCC) ) #1 > SMP Tue Sep 22 22:00:00 UTC 2015 > [dev@localhost ~]$ cat /etc/issue > CentOS release 6.7 (Final) > Kernel \r on an \m > > [dev@localhost ~]$ > > > Python 3.4.3 (compiled from source) > > > python manage.py runmodwsgi --reload-on-changes --locale=en_NZ.UTF-8 > --mount-point=/casper --settings=config.settings.gary_local > --passenv=CASPER_SETTINGS --passenv=OTAGO_DJANGO_CREDENTIAL_PATH > --port=8080 --log-to-terminal --log-level=DEBUG > > > (casper)[dev@localhost base]$ pip freeze > CairoSVG==1.0.13 > Django==1.7.10 > Jinja2==2.7.3 > MarkupSafe==0.23 > PyYAML==3.11 > Pygments==2.0.2 > Pyphen==0.9.1 > Sphinx==1.1.3 > WeasyPrint==0.24 > cairocffi==0.6 > cffi==0.9.2 > coverage==3.6b1 > crispy-forms-extensions==0.1.7 > cssselect==0.9.1 > cx-Oracle==5.2 > django-auth-ldap==1.2.0 > django-braces==1.8.1 > django-crispy-forms==1.4.0 > django-debug-panel==0.8.1 > django-debug-toolbar==1.4 > django-extra-views==0.6.5 > django-grappelli==2.6.2 > django-model-utils==2.2 > django-oraclepool==1.3 > django-pure-pagination==0.2.1 > django-tables2==1.0.4 > django-user-agents==0.3.0 > docutils==0.12 > factory-boy==2.4.1 > fake-factory==0.5.2 > freezegun==0.1.19 > html5lib==0.99999 > ldap3==0.9.9.2 > lxml==3.4.4 > mock==1.0.1 > mock-django==0.6.5 > mod-wsgi==4.4.21 > mod-wsgi-metrics==1.1.1 > otago-email==0.3.0 > otago-finance==0.4.3 > otago-hr==0.4.15 > otago-oracle==1.1.3 > otago-session==0.2.0 > otago-sms==0.2.3 > otago-user==1.3.6 > otago-utilities==1.0.2 > psutil==2.2.1 > pyasn1==0.1.9 > pycountry==1.10 > pycparser==2.13 > python-dateutil==2.2 > python-ldap==2.4.14 > pytz==2015.2 > raven==3.5.2 > requests==2.6.0 > selenium==2.46.0 > six==1.9.0 > sqlparse==0.1.15 > tinycss==0.3 > ua-parser==0.3.6 > user-agents==0.3.0 > virtualenv==1.11.6 > webdriverplus==0.1.5 > > > Error on Tuesday > > > [Tue Nov 10 13:29:45 2015] [error] ERROR 2015-11-10 13:29:45,865 > /wip/environments/casper/lib/python3.4/site-packages/raven/base.py base > send_remote 511 Internal Server Error: > /casper/requisition/new/CASUAL/AGREED_FEE/ > [Tue Nov 10 13:30:42 2015] [error] [client 192.168.31.1] client denied by > server configuration: /tmp/mod_wsgi-localhost:8080:500/htdocs/ > [Tue Nov 10 13:30:45 2015] [error] > /wip/environments/casper/lib/python3.4/site-packages/django/template/base.py:290: > > RemovedInDjango18Warning: 'The `cycle` template tag is changing to escape > its arguments; the non-autoescaping version is deprecated. Load it from the > `future` tag library to start using the new behavior. > [Tue Nov 10 13:30:45 2015] [error] compiled_result = compile_func(self, > token) > [Tue Nov 10 13:30:45 2015] [error] > [Tue Nov 10 13:30:46 2015] [error] [client 192.168.31.1] client denied by > server configuration: /tmp/mod_wsgi-localhost:8080:500/htdocs/new, referer: > http://192.168.31.129:8080/casper/dashboard/ > [Tue Nov 10 13:30:46 2015] [error] DEBUG 2015-11-10 13:30:46,860 > /wip/environments/casper/lib/python3.4/site-packages/raven/base.py base > send_remote 514 Sending message of length 4104 to > https://sentry.its.otago.ac.nz/api/17/store/ > [Tue Nov 10 13:30:47 2015] [error] Internal Server Error: > /casper/requisition/new/CASUAL/AWARD_GRADE/ > [Tue Nov 10 13:30:47 2015] [error] Traceback (most recent call last): > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/django/core/handlers/base.py", > > line 111, in get_response > [Tue Nov 10 13:30:47 2015] [error] response = > wrapped_callback(request, *callback_args, **callback_kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/django/views/generic/base.py", > > line 69, in view > [Tue Nov 10 13:30:47 2015] [error] return self.dispatch(request, > *args, **kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/projects/casper/base/casper/offer/views.py", line 166, in dispatch > [Tue Nov 10 13:30:47 2015] [error] dispatch_result = > super().dispatch(request, *args, **kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/braces/views/_access.py", > > line 98, in dispatch > [Tue Nov 10 13:30:47 2015] [error] request, *args, **kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/braces/views/_access.py", > > line 197, in dispatch > [Tue Nov 10 13:30:47 2015] [error] request, *args, **kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/django/views/generic/base.py", > > line 87, in dispatch > [Tue Nov 10 13:30:47 2015] [error] return handler(request, *args, > **kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/extra_views/advanced.py", > > line 122, in get > [Tue Nov 10 13:30:47 2015] [error] return > super(BaseCreateWithInlinesView, self).get(request, *args, **kwargs) > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/environments/casper/lib/python3.4/site-packages/extra_views/advanced.py", > > line 82, in get > [Tue Nov 10 13:30:47 2015] [error] form_class = self.get_form_class() > [Tue Nov 10 13:30:47 2015] [error] File > "/wip/projects/casper/base/casper/offer/views.py", line 182, in > get_form_class > [Tue Nov 10 13:30:47 2015] [error] return > OFFER_EDIT_FORMS[self.contract_type] > [Tue Nov 10 13:30:47 2015] [error] KeyError: None > [Tue Nov 10 13:30:47 2015] [error] > [Tue Nov 10 13:30:47 2015] [error] DEBUG 2015-11-10 13:30:47,060 > /wip/environments/casper/lib/python3.4/site-packages/raven/base.py base > send_remote 514 Sending message of length 4312 to > https://sentry.its.otago.ac.nz/api/17/store/ > [Tue Nov 10 13:30:48 2015] [error] [client 192.168.31.1] client denied by > server configuration: /tmp/mod_wsgi-localhost:8080:500/htdocs/ > [Tue Nov 10 13:30:49 2015] [error] > /wip/environments/casper/lib/python3.4/site-packages/django/template/base.py:290: > > RemovedInDjango18Warning: 'The `cycle` template tag is changing to escape > its arguments; the non-autoescaping version is deprecated. Load it from the > `future` tag library to start using the new behavior. > [Tue Nov 10 13:30:49 2015] [error] compiled_result = compile_func(self, > token) > [Tue Nov 10 13:30:49 2015] [error] > [Tue Nov 10 13:31:17 2015] [error] monitor (pid=29035): Change detected to > "/wip/projects/casper/base/casper/offer/views.py". > [Tue Nov 10 13:31:17 2015] [error] monitor (pid=29035): Triggering process > restart. > [Tue Nov 10 13:31:17 2015] [info] mod_wsgi (pid=29035): Shutdown requested > 'localhost:8080'. > [Tue Nov 10 13:31:17 2015] [info] mod_wsgi (pid=29035): Stopping process > 'localhost:8080'. > [Tue Nov 10 13:31:17 2015] [info] mod_wsgi (pid=29035): Destroying > interpreters. > [Tue Nov 10 13:31:17 2015] [info] mod_wsgi (pid=29035): Cleanup > interpreter ''. > [Tue Nov 10 13:31:17 2015] [debug] src/server/mod_wsgi.c(8398): mod_wsgi > (pid=29035): Exiting thread 3 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:17 2015] [debug] src/server/mod_wsgi.c(8398): mod_wsgi > (pid=29035): Exiting thread 2 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:17 2015] [debug] src/server/mod_wsgi.c(8398): mod_wsgi > (pid=29035): Exiting thread 1 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:17 2015] [debug] src/server/mod_wsgi.c(8398): mod_wsgi > (pid=29035): Exiting thread 0 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:17 2015] [info] mod_wsgi (pid=29035): Terminating Python. > [Tue Nov 10 13:31:21 2015] [error] [client 192.168.31.1] client denied by > server configuration: /tmp/mod_wsgi-localhost:8080:500/htdocs/new, referer: > http://192.168.31.129:8080/casper/dashboard/ > [Tue Nov 10 13:31:21 2015] [debug] src/server/mod_wsgi.c(8398): mod_wsgi > (pid=29035): Exiting thread 4 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29035): Aborting process > 'localhost:8080'. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29035): Exiting process > 'localhost:8080'. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29035): Process > 'localhost:8080' has died, deregister and restart it. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29035): Process > 'localhost:8080' has been deregistered and will no longer be monitored. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29109): Starting process > 'localhost:8080' with threads=5. > [Tue Nov 10 13:31:22 2015] [debug] src/server/mod_wsgi.c(9445): mod_wsgi > (pid=29109): Setting lang to en_NZ.UTF-8 for daemon process group > localhost:8080. > [Tue Nov 10 13:31:22 2015] [debug] src/server/mod_wsgi.c(9458): mod_wsgi > (pid=29109): Setting locale to en_NZ.UTF-8 for daemon process group > localhost:8080. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29109): Python home > /wip/environments/casper. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29109): Initializing > Python. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29109): Attach interpreter > ''. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29109): Imported > 'mod_wsgi'. > [Tue Nov 10 13:31:22 2015] [info] mod_wsgi (pid=29109, > process='localhost:8080', application=''): Loading WSGI script > '/tmp/mod_wsgi-localhost:8080:500/handler.wsgi'. > [Tue Nov 10 13:31:23 2015] [error] monitor (pid=29109): Starting change > monitor. > [Tue Nov 10 13:31:23 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29109): Started thread 0 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:23 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29109): Started thread 1 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:23 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29109): Started thread 2 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:23 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29109): Started thread 3 in daemon process 'localhost:8080'. > [Tue Nov 10 13:31:23 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29109): Started thread 4 in daemon process 'localhost:8080'. > [Tue Nov 10 13:32:23 2015] [error] [client 192.168.31.1] Timeout when > reading response headers from daemon process 'localhost:8080': > /tmp/mod_wsgi-localhost:8080:500/htdocs/casper/requisition, referer: > http://192.168.31.129:8080/casper/dashboard/ > [Tue Nov 10 13:34:29 2015] [error] [client 192.168.31.1] client denied by > server configuration: /tmp/mod_wsgi-localhost:8080:500/htdocs/ > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Daemon process > request time limit exceeded, stopping process 'localhost:8080'. > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Shutdown requested > 'localhost:8080'. > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Dumping stack > trace for active Python threads. > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Thread > 139978218649344 executing file "(null)", line 118, in (null) > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 109, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 143, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 137, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 159, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 540, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 155, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 148, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 85, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 83, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 21, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 760, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 694, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 205, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 964, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 121, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 340, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 91, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 17, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 170, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 59, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 474, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 187, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 28, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 73, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 160, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 8, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 29, in (null). > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Thread > 139978185090816 executing file "(null)", line 118, in (null) > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 109, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 143, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 137, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 159, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 540, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 155, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 148, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 85, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 83, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 21, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 760, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 694, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 205, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 964, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 121, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 340, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 91, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 17, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 170, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 59, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 474, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 187, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 28, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 73, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 160, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 8, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 29, in (null). > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Thread > 139978515728128 executing file "(null)", line 258, in (null) > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 150, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 1027, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 857, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 905, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 874, in (null). > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Thread > 139978285766400 executing file "(null)", line 118, in (null) > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 109, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 143, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 137, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 159, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 540, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 155, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 148, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 85, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 83, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 21, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 760, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 694, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 205, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 964, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 121, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 340, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 41, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 550, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 222, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 751, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 730, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 593, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 88, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 78, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 840, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 300, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 78, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 840, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 82, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 103, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 78, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 840, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 82, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 144, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 69, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 94, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 73, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 160, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 8, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 29, in (null). > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): Thread > 139978319324928 executing file "(null)", line 118, in (null) > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 109, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 143, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 137, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 159, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 540, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 155, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 148, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 85, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 75, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 83, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 21, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 760, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 694, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 205, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 964, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 121, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 340, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 41, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 550, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 222, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 751, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 730, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 593, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 88, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 78, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 840, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 300, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 78, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 840, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 82, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 103, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 78, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 840, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 82, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 144, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 69, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 94, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 73, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 160, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 8, in (null), > [Tue Nov 10 13:35:20 2015] [info] mod_wsgi (pid=29109): called from file > "(null)", line 29, in (null). > [Tue Nov 10 13:35:25 2015] [info] mod_wsgi (pid=29109): Aborting process > 'localhost:8080'. > [Tue Nov 10 13:35:25 2015] [info] mod_wsgi (pid=29109): Exiting process > 'localhost:8080'. > [Tue Nov 10 13:35:25 2015] [error] [client 192.168.31.1] Truncated or > oversized response headers received from daemon process 'localhost:8080': > /tmp/mod_wsgi-localhost:8080:500/htdocs/casper/ > [Tue Nov 10 13:35:25 2015] [error] [client 192.168.31.1] Truncated or > oversized response headers received from daemon process 'localhost:8080': > /tmp/mod_wsgi-localhost:8080:500/htdocs/casper/ > [Tue Nov 10 13:35:25 2015] [error] [client 192.168.31.1] Truncated or > oversized response headers received from daemon process 'localhost:8080': > /tmp/mod_wsgi-localhost:8080:500/htdocs/casper/dashboard > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29109): Process > 'localhost:8080' has died, deregister and restart it. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29109): Process > 'localhost:8080' has been deregistered and will no longer be monitored. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29181): Starting process > 'localhost:8080' with threads=5. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(9445): mod_wsgi > (pid=29181): Setting lang to en_NZ.UTF-8 for daemon process group > localhost:8080. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(9458): mod_wsgi > (pid=29181): Setting locale to en_NZ.UTF-8 for daemon process group > localhost:8080. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29181): Python home > /wip/environments/casper. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29181): Initializing > Python. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29181): Attach interpreter > ''. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29181): Imported > 'mod_wsgi'. > [Tue Nov 10 13:35:26 2015] [info] mod_wsgi (pid=29181, > process='localhost:8080', application=''): Loading WSGI script > '/tmp/mod_wsgi-localhost:8080:500/handler.wsgi'. > [Tue Nov 10 13:35:26 2015] [error] monitor (pid=29181): Starting change > monitor. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29181): Started thread 0 in daemon process 'localhost:8080'. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29181): Started thread 1 in daemon process 'localhost:8080'. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29181): Started thread 2 in daemon process 'localhost:8080'. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29181): Started thread 3 in daemon process 'localhost:8080'. > [Tue Nov 10 13:35:26 2015] [debug] src/server/mod_wsgi.c(8417): mod_wsgi > (pid=29181): Started thread 4 in daemon process 'localhost:8080'. > > > And additionally from when this happened on Monday, although with less > surrounding information. > > > [Mon Nov 09 13:06:18 2015] [error] [client 192.168.31.1] client denied by > server configuration: /tmp/mod_wsgi-localhost:8080:500/htdocs/82, referer: > http://192.168.31.129:8080/casper/requisition/82/applicant-prefill/ > [Mon Nov 09 13:07:18 2015] [error] [client 192.168.31.1] Timeout when > reading response headers from daemon process 'localhost:8080': > /tmp/mod_wsgi-localhost:8080:500/htdocs/casper/requisition, referer: > > ... -- You received this message because you are subscribed to the Google Groups "modwsgi" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/modwsgi. For more options, visit https://groups.google.com/d/optout.
