Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-05-05 Thread Graeme B. Bell
Gdal doesn't do well with ultra-large rasters in my experience. Locally we split our rasters up into tiles, process tiles in parallel with Gnu Parallel, then use gdal_merge or gdalwarp to join them back together (usually gdal_merge is faster). This usually brings our processing times on high re

Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-04-28 Thread Even Rouault
Le mardi 28 avril 2015 08:25:57, jramm a écrit : > By tiled do you mean split into N seperate TIFF files (in which case the > answer is no), or can a single TIFF contain a tiling scheme? Yes a TIFF can be tiled internally. > If so, is this > some option I need to pass to the driver when creating

Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-04-27 Thread jramm
David, there should be no compression, but I will try setting it explicitly in the driver... -- View this message in context: http://osgeo-org.1560.x6.nabble.com/GDAL-slow-to-write-GeoTIFF-tp5203128p5203203.html Sent from the GDAL - Dev mailing list archive at Nabble.com. __

Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-04-27 Thread jramm
By tiled do you mean split into N seperate TIFF files (in which case the answer is no), or can a single TIFF contain a tiling scheme? If so, is this some option I need to pass to the driver when creating the output? -- View this message in context: http://osgeo-org.1560.x6.nabble.com/GDAL-slow-

Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-04-27 Thread Jean-Claude Repetto
Le 27/04/2015 16:55, jramm a écrit : I'm writing a custom processing program using GDAL in C. Have you tried gdal_translate on the same raster ? Jean-Claude ___ gdal-dev mailing list gdal-dev@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/g

Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-04-27 Thread David Strip
On 4/27/2015 9:11 AM, Even Rouault wrote: > Le lundi 27 avril 2015 16:55:24, jramm a écrit : >> > I'm writing a custom processing program using GDAL in C. >> > >> > I'm processing a raster of roughly 150 000 * 200 000 pixels in windows of >> > 256 * 256 pixels. > Is the TIFF tiled ? If it is not,

Re: [gdal-dev] GDAL slow to write GeoTIFF?

2015-04-27 Thread Even Rouault
Le lundi 27 avril 2015 16:55:24, jramm a écrit : > I'm writing a custom processing program using GDAL in C. > > I'm processing a raster of roughly 150 000 * 200 000 pixels in windows of > 256 * 256 pixels. Is the TIFF tiled ? If it is not, this should help. And/or you could perhaps try increasin

[gdal-dev] GDAL slow to write GeoTIFF?

2015-04-27 Thread jramm
I'm writing a custom processing program using GDAL in C. I'm processing a raster of roughly 150 000 * 200 000 pixels in windows of 256 * 256 pixels. I'm finding that traversing the raster and applying some basic processing to each of the windows takes very little time; about 10 minutes on my mac