Re: Multiprocessing.Queue deadlock

2009-10-08 Thread Felix Schlesinger
On Oct 8, 3:21 am, Dennis Lee Bieber wrote: > On Wed, 7 Oct 2009 10:24:08 -0700 (PDT), Felix Schlesinger > > A bunch of workers push an unknown number of results into a queue. The > > main process needs to collect all those results. > > > What is the right way to implement that with multiprocessin

Re: Multiprocessing.Queue deadlock

2009-10-07 Thread Felix Schlesinger
On Oct 7, 12:16 pm, MRAB wrote: > Felix wrote: > > Hello, > > > I keep running into a deadlock in a fairly simple parallel script > > using Multiprocessing.Queue for sending tasks and receiving results. > > It seems to be the workers cannot finish pusing buffered results into > > the output queue

Re: Multiprocessing.Queue deadlock

2009-10-07 Thread MRAB
Felix wrote: Hello, I keep running into a deadlock in a fairly simple parallel script using Multiprocessing.Queue for sending tasks and receiving results. From the documentation I cannot figure out what is happening and none of the examples seem to cover quite what I am doing. The main code is

Multiprocessing.Queue deadlock

2009-10-06 Thread Felix
Hello, I keep running into a deadlock in a fairly simple parallel script using Multiprocessing.Queue for sending tasks and receiving results. >From the documentation I cannot figure out what is happening and none of the examples seem to cover quite what I am doing. The main code is results = mp.Q