Russ,
Glad to hear you had both approaches working for you. I usually stick to using
the ImageMosaic plug-in as it saves indeed a lot of time. Have you come across
http://osgbwebmaptools.sourceforge.net/OSGBWebMapTools.html already? In these
pages, OS describes how to set up a GeoServer instance with the data and also
has some tools you can use (mainly Windows wrappers around gdal utilities), but
maybe it helps you on your way.
Regards,
E
From: r...@russ-hore.co.uk
Date: Tue, 31 Jul 2012 08:56:10 +0100
To: geoserver-users@lists.sourceforge.net
Subject: Re: [Geoserver-users] What to do if gdal_merge make too large a file
OK
The Ordnance Survey (OS) have released huge amounts of data over the past few
years. 1:250k, 1:10k etc.
The first dataset I want to publish is called StreetView.
It contains 21k tiles. These are not GeoTIFFs (but not a problem, I have the
world files and can convert them)Each tile is between 1 and 5 Mb.
gdalinfo givesMacPro:data russ$ gdalinfo sj/sj55ne.tifDriver:
GTiff/GeoTIFFFiles: sj55ne.tifSize is 5000, 5000Coordinate System is
`'Metadata: TIFFTAG_COPYRIGHT=ORDNANCE SURVEY CROWN COPYRIGHT 2009
TIFFTAG_DATETIME=2009:09:11 04:41:38 TIFFTAG_IMAGEDESCRIPTION=OS Street View
SJ55NE TIFFTAG_RESOLUTIONUNIT=2 (pixels/inch) TIFFTAG_XRESOLUTION=254
TIFFTAG_YRESOLUTION=254Image Structure Metadata: COMPRESSION=LZW
INTERLEAVE=BANDCorner Coordinates:Upper Left ( 0.0, 0.0)Lower Left (
0.0, 5000.0)Upper Right ( 5000.0, 0.0)Lower Right ( 5000.0, 5000.0)Center
( 2500.0, 2500.0)Band 1 Block=5000x1 Type=Byte, ColorInterp=Palette Color
Table (RGB with 256 entries)
The data is broken down into 100km squares and depending on the
Easting/Northing gets a two letter code (the 'SJ' bit in the filename)Each
square may contain an average of 250 tiles (It depends on if it is by the coast
or not)
I am currently running GS 2.1.4 in a Linux VM on my Mac Pro but it will go on a
real server in the future, probably with GS2.2+
The server will be running Linux (Not sure which but a Debian variant)
I had finally got my head round creating a large TIFF then allowing GS to
'cookie cut and then tried the ImageMosaic and it saved lots of time.But I need
this to perform well and don't know which will be more 'performant'
Thanks for your time
Russ
On 30 Jul 2012, at 16:08, Simone Giannecchini
<simone.giannecch...@geo-solutions.it> wrote:Well, it depends :)
Really, with the latest change we have prepared for tiff I would go
for a small number of very large bigtiff files. It is easier to
handle, you open a small number of file on the server
and can be used to serve data at all resolutions if you have a small
number of files (like < 16/32) since you can add embedded overviews.
If your data is high res and you want to to show it only at small
scales, then you can even use a mosaic with a relative large number of
files since you will never open too many of them.
Summarising:
-1- we need to know more about what you are doing, or actually about
the data (#files, size of individual files, etc..)
-2- I believe some tests on your infrastructure would help (this type
of performances depepnd a lot on the the HW set up and the underlying
file system).
Regards,
Simone Giannecchini
==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.
==
Ing. Simone Giannecchini
@simogeo
Founder/Director
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 962313
mob: +39 333 8128928
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
On Mon, Jul 30, 2012 at 4:53 PM, Russell Hore <r...@russ-hore.co.uk> wrote:
Thanks for the excellent pointer Simone and Edward.
Which would perform better, or os that s difficult question and the answer is "
It depends"
Russ
On 30 Jul 2012, at 15:46, Simone Giannecchini
<simone.giannecch...@geo-solutions.it> wrote:
Ciao a tutti,
one thing, depending on the GeoServer version you use there is support
for BigTiff (actually when 2.1.5 will be out this support will also be
much better).
Regards,
Simone Giannecchini
==
Our support, Your Success! Visit http://opensdi.geo-solutions.it for
more information.
==
Ing. Simone Giannecchini
@simogeo
Founder/Director
GeoSolutions S.A.S.
Via Poggio alle Viti 1187
55054 Massarosa (LU)
Italy
phone: +39 0584 962313
fax: +39 0584 962313
mob: +39 333 8128928
http://www.geo-solutions.it
http://twitter.com/geosolutions_it
-------------------------------------------------------
On Mon, Jul 30, 2012 at 3:43 PM, Edward Mac Gillavry
<emacgilla...@hotmail.com> wrote:
Hi there,
Check out the ImageMosaic plugin
http://docs.geoserver.org/latest/en/user/tutorials/image_mosaic_plugin/imagemosaic.html.
No need to create one single GeoTIFF beforehand as GeoServer will compute a
sheet index itself (as an ESRI Shape file).
HTH
Edward
From: r...@russ-hore.co.uk
Date: Mon, 30 Jul 2012 14:32:03 +0100
To: geoserver-users@lists.sourceforge.net
Subject: [Geoserver-users] What to do if gdal_merge make too large a file
I am using gdal_merge to merge sections of the OS tile sod the UK into
large tiff files ready for GeoServer.
(For those that know the OS' StreetView data I am taking al the SH tiles
and making one large SH tile.)
Some of them are failing. I suspect that it is due to the size of the
resulting TIF file being over 4Gb
I have heard of 'big' geoTIFFS but would e better approach be to split the
failing areas into four smaller areas (SHNW, SHNE, SHSW, SHSE)?
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users
