On Monday, March 13, 2023 at 11:32:23 PM UTC-7, Clint Olsen wrote:
> We have an application that involves submitting hundreds to thousands of jobs
> to a shared computing resource, and we're using asyncio to do so because it
> is far less overhead than threading or multiprocessing for the bookkee
On Monday, March 13, 2023 at 11:55:22 PM UTC-7, gst wrote:
> Le mardi 14 mars 2023 à 02:32:23 UTC-4, Clint Olsen a écrit :
> I'm not asyncio expert or even not advanced user, but using a simple list to
> hold the jobs to execute and fill it as necessary after results gathering is
> not good ?
>
We have an application that involves submitting hundreds to thousands of jobs
to a shared computing resource, and we're using asyncio to do so because it is
far less overhead than threading or multiprocessing for the bookkeeping
required to keep track of all these jobs. It makes extensive use of
Le mardi 14 mars 2023 à 02:32:23 UTC-4, Clint Olsen a écrit :
> We have an application that involves submitting hundreds to thousands of jobs
> to a shared computing resource, and we're using asyncio to do so because it
> is far less overhead than threading or multiprocessing for the bookkeeping