Re: is Django OK for parallelized computations?

2008-04-02 Thread Valery
Hi Karen sound reasonable. Look, but Malcolm actually means "there should be no problem with multiple processes, this is the way all web server stuff works". Contradiction? I guess, the contradiction is actually in the initialization of connection to DB that every app process does after being ini

Re: is Django OK for parallelized computations?

2008-04-02 Thread Karen Tracey
On Wed, Apr 2, 2008 at 5:16 AM, Valery <[EMAIL PROTECTED]> wrote: > > Hi Malcolm, > > many thanks for your reply. Let me give some more details. > > I use parallelized fetching of database objects like this: > > my_dictionaries = pprocess.pmap( fetch_object, ["serchterm1", > "searchterm2", "search

Re: UPDATE: is Django OK for parallelized computations? (both psql and mysql won't work when parallelized)

2008-04-02 Thread Valery
Hi message "no results to fetch" is typical for psycopg. So, I decided to try mysql. Now the sporadic mesage is: : (2013, 'Lost connection to MySQL server during query') and in 10% cases the application simply hungs up. Maybe the number of connections/cursors gets to high? Anyway, it is all str

Re: is Django OK for parallelized computations?

2008-04-02 Thread Valery
Hi Malcolm, many thanks for your reply. Let me give some more details. I use parallelized fetching of database objects like this: my_dictionaries = pprocess.pmap( fetch_object, ["serchterm1", "searchterm2", "searchterm3"]) where fetch_object function is not read-only, but smth like this: from

Re: is Django OK for parallelized computations?

2008-04-02 Thread Malcolm Tredinnick
On Wed, 2008-04-02 at 01:21 -0700, Valery wrote: > Hi > > did anyone here use Django in parallelized computations? > > I use for about a year a great parallelization approach based on > 'pmap' function from 'pprocess' module: > http://www.boddie.org.uk/python/pprocess.html > > My own code is d

is Django OK for parallelized computations?

2008-04-02 Thread Valery
Hi did anyone here use Django in parallelized computations? I use for about a year a great parallelization approach based on 'pmap' function from 'pprocess' module: http://www.boddie.org.uk/python/pprocess.html My own code is designed to be strongly side-effect-free, however I am experiencing s