Ciao Russel, one thing, if you check the block size it is still not optimal as it is 4000x2 which means that your geotiff are saved on disk in stripes as large as the image itself but only 2 pixel tall. This is bad for performance as you'll end up reading much more data than needed for many requests. I would suggest to retile your geotiff images (with deflate compression) using a tile size (block size) of 256 or 512 pixels.
Regards, Simone Giannecchini == Our support, Your Success! Visit http://opensdi.geo-solutions.it for more information. == Ing. Simone Giannecchini @simogeo Founder/Director GeoSolutions S.A.S. Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 962313 mob: +39 333 8128928 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- On Fri, Aug 3, 2012 at 8:57 AM, Russell Hore <r...@russ-hore.co.uk> wrote: > Thanks Simone, > > The tif files now show > > Driver: GTiff/GeoTIFF > Files: sy88.tif > Size is 4000, 4000 > Coordinate System is: > PROJCS["OSGB 1936 / British National Grid", > GEOGCS["OSGB 1936", > DATUM["OSGB_1936", > SPHEROID["Airy 1830",6377563.396,299.3249646000043, > AUTHORITY["EPSG","7001"]], > AUTHORITY["EPSG","6277"]], > PRIMEM["Greenwich",0], > UNIT["degree",0.0174532925199433], > AUTHORITY["EPSG","4277"]], > PROJECTION["Transverse_Mercator"], > PARAMETER["latitude_of_origin",49], > PARAMETER["central_meridian",-2], > PARAMETER["scale_factor",0.9996012717], > PARAMETER["false_easting",400000], > PARAMETER["false_northing",-100000], > UNIT["metre",1, > AUTHORITY["EPSG","9001"]], > AUTHORITY["EPSG","27700"]] > Origin = (380000.000000000000000,90000.000000000000000) > Pixel Size = (2.500000000000000,-2.500000000000000) > Metadata: > TIFFTAG_IMAGEDESCRIPTION=1:25000 TILE SY88 > TIFFTAG_DATETIME=2006:09:12 16:39:46 > TIFFTAG_COPYRIGHT=ORDNANCE SURVEY CROWN COPYRIGHT 2005 > TIFFTAG_XRESOLUTION=254 > TIFFTAG_YRESOLUTION=254 > TIFFTAG_RESOLUTIONUNIT=2 (pixels/inch) > AREA_OR_POINT=Area > Image Structure Metadata: > COMPRESSION=DEFLATE > INTERLEAVE=BAND > Corner Coordinates: > Upper Left ( 380000.000, 90000.000) ( 2d16'59.81"W, 50d42'31.38"N) > Lower Left ( 380000.000, 80000.000) ( 2d16'57.87"W, 50d37'7.60"N) > Upper Right ( 390000.000, 90000.000) ( 2d 8'29.91"W, 50d42'32.31"N) > Lower Right ( 390000.000, 80000.000) ( 2d 8'28.94"W, 50d37'8.53"N) > Center ( 385000.000, 85000.000) ( 2d12'44.13"W, 50d39'50.03"N) > Band 1 Block=4000x2 Type=Byte, ColorInterp=Palette > Overviews: 4000x4000, 2000x2000, 1000x1000, 500x500, 250x250, 125x125, > 63x63, 32x32 > Color Table (RGB with 256 entries) > > Seems to work fairly quickly. I should be putting it on the physical server > soon. > > Thanks for your help > > Russ > On 2 Aug 2012, at 14:41, Simone Giannecchini > <simone.giannecch...@geo-solutions.it> wrote: > > Ciao Russell, > as Andrea suggested, I would check the gs on steroids presentation, > especially slide 10 to 19. > > Long story short, with gdal_transalte you can, in one step, > - add inner tiling > - fix CRS > - fix georeferencing > - compress > > Then you need to run the gdaladdo command to add overviews. > Make sure you use the nearest algorithm as your data has a palette. > > If you want to merge your tiles into larger chunks, after the > gdal_translate step, you can do a gdal_merge and create larger > bigtiff. > Anyway, the last step is always to add overviews to your files to > speed things up. > > Long story short, read the presentation carefully make some tests and > then if you still have questions come back to us. > > Regards, > Simone Giannecchini > == > Our support, Your Success! Visit http://opensdi.geo-solutions.it for > more information. > == > > Ing. Simone Giannecchini > @simogeo > Founder/Director > > GeoSolutions S.A.S. > Via Poggio alle Viti 1187 > 55054 Massarosa (LU) > Italy > phone: +39 0584 962313 > fax: +39 0584 962313 > mob: +39 333 8128928 > > http://www.geo-solutions.it > http://twitter.com/geosolutions_it > > ------------------------------------------------------- > > > On Tue, Jul 31, 2012 at 12:35 PM, Russell Hore <r...@russ-hore.co.uk> wrote: > > After my gdal_translate it looks like > > Driver: GTiff/GeoTIFF > Files: sh67.tif > Size is 4000, 4000 > Coordinate System is: > PROJCS["OSGB 1936 / British National Grid", > GEOGCS["OSGB 1936", > DATUM["OSGB_1936", > SPHEROID["Airy 1830",6377563.396,299.3249646000044, > AUTHORITY["EPSG","7001"]], > AUTHORITY["EPSG","6277"]], > PRIMEM["Greenwich",0], > UNIT["degree",0.0174532925199433], > AUTHORITY["EPSG","4277"]], > PROJECTION["Transverse_Mercator"], > PARAMETER["latitude_of_origin",49], > PARAMETER["central_meridian",-2], > PARAMETER["scale_factor",0.9996012717], > PARAMETER["false_easting",400000], > PARAMETER["false_northing",-100000], > UNIT["metre",1, > AUTHORITY["EPSG","9001"]], > AUTHORITY["EPSG","27700"]] > Origin = (260000.000000000000000,380000.000000000000000) > Pixel Size = (2.500000000000000,-2.500000000000000) > Metadata: > AREA_OR_POINT=Area > TIFFTAG_COPYRIGHT=ORDNANCE SURVEY CROWN COPYRIGHT 2006 > TIFFTAG_DATETIME=2006:09:12 19:00:55 > TIFFTAG_IMAGEDESCRIPTION=1:25000 TILE SH67 > TIFFTAG_RESOLUTIONUNIT=2 (pixels/inch) > TIFFTAG_XRESOLUTION=254 > TIFFTAG_YRESOLUTION=254 > Image Structure Metadata: > COMPRESSION=DEFLATE > INTERLEAVE=BAND > Corner Coordinates: > Upper Left ( 260000.000, 380000.000) > Lower Left ( 260000.000, 370000.000) > Upper Right ( 270000.000, 380000.000) > Lower Right ( 270000.000, 370000.000) > Center ( 265000.000, 375000.000) > Band 1 Block=4000x2 Type=Byte, ColorInterp=Palette > Color Table (RGB with 256 entries) > … > … > > Russ > > > On 31 Jul 2012, at 11:29, Andrea Aime <andrea.a...@geo-solutions.it> wrote: > > On Tue, Jul 31, 2012 at 9:56 AM, Russell Hore <r...@russ-hore.co.uk> wrote: > > > OK > > The Ordnance Survey (OS) have released huge amounts of data over the past > few years. 1:250k, 1:10k etc. > > The first dataset I want to publish is called StreetView. > > It contains 21k tiles. These are not GeoTIFFs (but not a problem, I have > the world files and can convert them) > Each tile is between 1 and 5 Mb. > > gdalinfo gives > MacPro:data russ$ gdalinfo sj/sj55ne.tif > Driver: GTiff/GeoTIFF > Files: sj55ne.tif > Size is 5000, 5000 > Coordinate System is `' > Metadata: > TIFFTAG_COPYRIGHT=ORDNANCE SURVEY CROWN COPYRIGHT 2009 > TIFFTAG_DATETIME=2009:09:11 04:41:38 > TIFFTAG_IMAGEDESCRIPTION=OS Street View SJ55NE > TIFFTAG_RESOLUTIONUNIT=2 (pixels/inch) > TIFFTAG_XRESOLUTION=254 > TIFFTAG_YRESOLUTION=254 > Image Structure Metadata: > COMPRESSION=LZW > INTERLEAVE=BAND > Corner Coordinates: > Upper Left ( 0.0, 0.0) > Lower Left ( 0.0, 5000.0) > Upper Right ( 5000.0, 0.0) > Lower Right ( 5000.0, 5000.0) > Center ( 2500.0, 2500.0) > Band 1 Block=5000x1 Type=Byte, ColorInterp=Palette > Color Table (RGB with 256 entries) > > > > Ugh, no CRS, no overviews, no inner tiling... Have a look at this > presentation and then > try to fix your data: > http://demo.geo-solutions.it/share/foss4g2011/gs_steroids_sgiannec_foss4g2011.pdf > > > > I had finally got my head round creating a large TIFF then allowing GS to > 'cookie cut and then tried the ImageMosaic and it saved lots of time. > But I need this to perform well and don't know which will be more > 'performant' > > > > It really boils down to which scale you want to show that data. If your > worst request just needs to put togheter a few tiles > then the large number of tiles is not an issue, but if you want to keep on > displaying your data as you zoom out you need > to reduce the number of files, otherwise in order to show the whole mosaic > in a single image GS will have to open 21K files, > which btw won't work due to the max number of open file limit imposed by the > operating system. > > In such case you might want to look at gdalmerge to fuse togheter bunch of > tiles, or look at the pyramid plugin > > Cheers > Andrea > > -- > == > Our support, Your Success! Visit http://opensdi.geo-solutions.it for more > information. > == > > Ing. Andrea Aime > @geowolf > Technical Lead > > GeoSolutions S.A.S. > Via Poggio alle Viti 1187 > 55054 Massarosa (LU) > Italy > phone: +39 0584 962313 > fax: +39 0584 962313 > mob: +39 339 8844549 > > http://www.geo-solutions.it > http://twitter.com/geosolutions_it > > ------------------------------------------------------- > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/geoserver-users > > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > Geoserver-users mailing list > Geoserver-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/geoserver-users > ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
