[gdal-dev] gdal_rasterize in multiple processes

2015-07-14 Thread jramm
I have a number of vector datasets to rasterize. I am finding that when the datasets are small, I have no problem starting multiple gdal_rasterize processes (using python). If my datasets are large (I'm trying to create rasters with millions of pixels), I'm finding that I can only start one gda

Re: [gdal-dev] gdal_rasterize in multiple processes

2015-07-14 Thread Even Rouault
Perhaps that at that point you've already saturated the bandwidth of your storage device ? 2015-07-14 17:25 GMT+02:00 jramm : > I have a number of vector datasets to rasterize. > > I am finding that when the datasets are small, I have no problem starting > multiple gdal_rasterize processes (using

Re: [gdal-dev] gdal_rasterize in multiple processes

2015-07-16 Thread Nicolas Cadieux
Hi, Are you launching multiple at the same time or are you looping and treating one file at a time? If so, your computer is just waiting to the last file to finish before it starts the next. When the file are smaller, they appear to be running at the same time but when the files get bigger, t