Some notes on a high-performance Python application.

2008-03-26 Thread John Nagle
I run SiteTruth (sitetruth.com), which rates web sites for legitimacy, based on what information it can find out about the business behind the web site. I'm going to describe here how the machinery behind this is organized, because I had to solve some problems in Python that I haven't seen

Re: Some notes on a high-performance Python application.

2008-03-26 Thread Heiko Wundram
Am Mittwoch, 26. März 2008 17:33:43 schrieb John Nagle: ... Using MySQL as a queueing engine across multiple servers is unusual, but it works well. It has the nice feature that the queue ordering can be anything you can write in a SELECT statement. So we put fair queueing in the rating

Re: Some notes on a high-performance Python application.

2008-03-26 Thread Michael Ströder
Heiko Wundram wrote: Am Mittwoch, 26. März 2008 17:33:43 schrieb John Nagle: ... Using MySQL as a queueing engine across multiple servers is unusual, but it works well. It has the nice feature that the queue ordering can be anything you can write in a SELECT statement. So we put fair

Re: Some notes on a high-performance Python application.

2008-03-26 Thread Heiko Wundram
Am Mittwoch, 26. März 2008 18:54:29 schrieb Michael Ströder: Heiko Wundram wrote: Am Mittwoch, 26. März 2008 17:33:43 schrieb John Nagle: ... Using MySQL as a queueing engine across multiple servers is unusual, but it works well. It has the nice feature that the queue ordering

Re: Some notes on a high-performance Python application.

2008-03-26 Thread John Nagle
Heiko Wundram wrote: Am Mittwoch, 26. März 2008 18:54:29 schrieb Michael Ströder: Heiko Wundram wrote: Am Mittwoch, 26. März 2008 17:33:43 schrieb John Nagle: I didn't say it was unusual or frowned upon (and I was also taught this at uni IIRC as a means to easily distribute systems which