Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-04-01 Thread Stephen V. Mather
Interesting that the nightly build I used really didn't work.  I'll try a
more recent one and let you know how it goes.

I understand the performance issue.  I'll add internal tiling to  the tiffs
in place, do some tests with our other software that accesses it, and if
everything checks out, I won't have to duplicate the dataset.  As this is a
static dataset, I wasn't too worried about performance-- once I have the
cache populated, I never have to populate it again, but that may be
short-sighted if I end up combining the aerials imagery with other overlays
that do change sometime down the road.

Thanks again,
Steve

Stephen Mather, GIS Manager
Cleveland Metroparks
4101 Fulton Pkwy
Cleveland, OH 44144
s...@clevelandmetroparks.com
Phone:  (216) 635-3243
FAX: (216) 635-3286

-Original Message-
From: Andrea Aime [mailto:aa...@opengeo.org] 
Sent: Thursday, April 01, 2010 2:32 AM
To: s...@clevelandmetroparks.com
Cc: 'Simone Giannecchini'; geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


Stephen V. Mather ha scritto:
 Hmm, the embarassment of naïve configuration... .  :D  Let me do some 
 additional testing on my end.  I assume then that you got the image 
 pyramid plugin to work without a special version of GeoServer?

Correct, just took a nightly build, pointed it at the cleaned up test
directory (the first one that has tiles inside), after removing all
shapefiles, all property files.

However performance wise the result is not really usable, the reprojection
is quite heavy

Cheers
Andrea


-- 
Andrea Aime
OpenGeo - http://opengeo.org
Expert service straight from the developers.




--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel


Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-31 Thread Stephen V. Mather
Hmm, the embarassment of naïve configuration... .  :D  Let me do some
additional testing on my end.  I assume then that you got the image pyramid
plugin to work without a special version of GeoServer?

Thanks,
Steve
 

 



-Original Message-
From: Andrea Aime [mailto:aa...@opengeo.org] 
Sent: Monday, March 29, 2010 2:25 PM
To: s...@clevelandmetroparks.com
Cc: 'Simone Giannecchini'; geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


Stephen V. Mather ha scritto:
 Hi Simone,
   The correct CRS is EPSG:3728, 
 http://spatialreference.org/ref/epsg/3728/, although EPSG:102722 is 
 pretty close.
   The size of the tiff is, well, either cheapness or laziness.  The 
 current format, naming convention and size is what has been used by 
 our engineers in CAD for 8 years, and is referenced by all their CAD 
 drawings, and I'm trying to not have two copies of a 160GB dataset.  
 That said, if there's a strong performance gain to be had by retiling 
 to a smaller size, I can squeeze more space out of our RAID.

Hi Stephen,
tried another time, and I could also build the pyramid correctly, though
first I wiped out all the shapefiles and property files you did attach so
that the pyramd plugin could perform its job.

I can see the data just fine after that, though the rendering is quite slow.
The TIFFs are not really very well setup, they do have no inner tiling, yet,
I'm a bit surprised about the slowness. Looked into it and the reason is
that a reprojection is happening, this is due to the native definition
inside the GeoTiff not matching the official EPSG one.

gdalinfo reports:

PROJCS[NAD_1983_StatePlane_Ohio_North_FIPS_3401_Feet,
 GEOGCS[NAD83,
 DATUM[North_American_Datum_1983,
 SPHEROID[GRS 1980,6378137,298.2572221010002,
 AUTHORITY[EPSG,7019]],
 AUTHORITY[EPSG,6269]],
 PRIMEM[Greenwich,0],
 UNIT[degree,0.0174532925199433],
 AUTHORITY[EPSG,4269]],
 PROJECTION[Lambert_Conformal_Conic_2SP],
 PARAMETER[standard_parallel_1,40.43],
 PARAMETER[standard_parallel_2,41.7],
 PARAMETER[latitude_of_origin,39.66],
 PARAMETER[central_meridian,-82.5],
 PARAMETER[false_easting,1968500],
 PARAMETER[false_northing,0],
 UNIT[US survey foot,0.3048006096012192,
 AUTHORITY[EPSG,9003]]]

whilst the EPSG database contains:

PROJCS[NAD83(NSRS2007) / Ohio North (ftUS),
   GEOGCS[NAD83(NSRS2007),
 DATUM[NAD83 (National Spatial Reference System 2007),
   SPHEROID[GRS 1980, 6378137.0, 298.257222101, 
AUTHORITY[EPSG,7019]],
   TOWGS84[0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0],
   AUTHORITY[EPSG,6759]],
 PRIMEM[Greenwich, 0.0, AUTHORITY[EPSG,8901]],
 UNIT[degree, 0.017453292519943295],
 AXIS[Geodetic longitude, EAST],
 AXIS[Geodetic latitude, NORTH],
 AUTHORITY[EPSG,4759]],
   PROJECTION[Lambert Conic Conformal (2SP), AUTHORITY[EPSG,9802]],
   PARAMETER[central_meridian, -82.5],
   PARAMETER[latitude_of_origin, 39.664],
   PARAMETER[standard_parallel_1, 41.7],
   PARAMETER[false_easting, 1968500.0],
   PARAMETER[false_northing, 0.0],
   PARAMETER[scale_factor, 1.0],
   PARAMETER[standard_parallel_2, 40.43],
   UNIT[foot_survey_us, 0.30480060960121924],
   AXIS[Easting, EAST],
   AXIS[Northing, NORTH],
   AUTHORITY[EPSG,3728]]

As you can see there are quite a bit of parameters that are not equal. To
get decent performance you'd need to reproject the tiles to an 
officially supported EPSG code, or create a new one in 
$GEOSERVER_DATA_DIR/user_projections/epsg.properties that matches 1-1 the
WKT of your data

Cheers
Andrea


-- 
Andrea Aime
OpenGeo - http://opengeo.org
Expert service straight from the developers.




--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel


Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-24 Thread Stephen V. Mather
Hi Simone,
The correct CRS is EPSG:3728,
http://spatialreference.org/ref/epsg/3728/, although EPSG:102722 is pretty
close.
The size of the tiff is, well, either cheapness or laziness.  The
current format, naming convention and size is what has been used by our
engineers in CAD for 8 years, and is referenced by all their CAD drawings,
and I'm trying to not have two copies of a 160GB dataset.  That said, if
there's a strong performance gain to be had by retiling to a smaller size, I
can squeeze more space out of our RAID.

Steve


Stephen Mather, GIS Manager
Cleveland Metroparks
4101 Fulton Pkwy
Cleveland, OH 44144
s...@clevelandmetroparks.com
Phone:  (216) 635-3243
FAX: (216) 635-3286 

 



-Original Message-
From: simbo...@gmail.com [mailto:simbo...@gmail.com] On Behalf Of Simone
Giannecchini
Sent: Wednesday, March 24, 2010 5:31 AM
To: s...@clevelandmetroparks.com
Cc: geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


Ciao Stephen,
I downloaded the data and ran a quick test.
The pyramid creation was smooth, although I noticed that the geotiff files
you have provided us with do not contain a proper EPSG code for the CRS. I
picked one that was close enough and forced a reprojection (not the best
thing performance wise). Things worked for me in the end (although as I said
I have a few local changes that might have helped)

My questions for you are as follows:

- do you know a valid EPSG code for this dataset?
- why you using tiff that big for the single granule/tiles?

Ciao,
Simone.
---
Ing. Simone Giannecchini
GeoSolutions S.A.S.
Founder - Software Engineer
Via Carignoni 51
55041  Camaiore (LU)
Italy

phone: +39 0584983027
fax:  +39 0584983027
mob:+39 333 8128928


http://www.geo-solutions.it
http://geo-solutions.blogspot.com/
http://www.linkedin.com/in/simonegiannecchini
http://twitter.com/simogeo

---



On Tue, Mar 23, 2010 at 3:00 PM, Stephen V. Mather
s...@clevelandmetroparks.com wrote:
 I should say, the file in question is called retile_test1.zip.

 Steve





 -Original Message-
 From: Stephen V. Mather [mailto:s...@clevelandmetroparks.com]
 Sent: Monday, March 22, 2010 5:11 PM
 To: 'Simone Giannecchini'
 Cc: 'geoserver-devel@lists.sourceforge.net'
 Subject: RE: [Geoserver-devel] Image pyramid improvements and tutorial


 The test data are a little bigger than expected-- 195MB.  They will be 
 available shortly at the following FTP site:

 ftp://ftp.clevelandmetroparks.com/pdnr/out

 Thanks,
 Steve

 Stephen Mather, GIS Manager
 Cleveland Metroparks
 4101 Fulton Pkwy
 Cleveland, OH 44144
 s...@clevelandmetroparks.com
 Phone:  (216) 635-3243
 FAX:     (216) 635-3286







 -Original Message-
 From: simbo...@gmail.com [mailto:simbo...@gmail.com] On Behalf Of 
 Simone Giannecchini
 Sent: Saturday, March 20, 2010 10:16 AM
 To: s...@clevelandmetroparks.com
 Cc: geoserver-devel@lists.sourceforge.net
 Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


 I guess that doing some testing with your data could be helpful. I 
 have some uncommitted fixes/improvements that might solve these 
 issues.

 Simone

 On 3/19/10, Stephen V. Mather s...@clevelandmetroparks.com wrote:
 Qcuik questions:
 - are you adding a reprojection in the mix while you are doing this 
 tests?

 I have tried it both with and without reprojection, to the same 
 effect.

 - are all your granules of the same resolution?

 Yes, they are all 0.15m pixels in 5000x4000 images.  I have tried 
 both leaving the existing 0 level images at 5000x4000 (-pyramidOnly) 
 and retiling to 2048x2048, both with the same result.

 Steve


 On Tue, Mar 16, 2010 at 1:13 PM, Stephen Mather 
 s...@clevelandmetroparks.com wrote:

 Hi Andrea,
      I've been working on giving it a spin with our own data.  The 
 tutorial is excellent.  Easy to read and follow.
      I'm currently testing it on a Windows 2003 server with nightly 
 build geoserver-2.0.x-2010-03-03-bin.zip, and 
 geoserver-2.0.2-SNAPSHOT-pyramid-plugin.zip
      The test I've been doing is with 0.5ft (0.15m) color 
 orthophotos that sum to about 150GB as TIFFs.  They are currently 
 tiled as 5000x4000 images. I've retiled them with gdal_retile as 
 2048x2048 images with overviews with the following command:

 gdal_retile -v -s_srs EPSG:102722 -levels 5 -ps 2048 2048 
 -targetdir test3 --optfile tilelist.txt

 I'm currently working on a subset of the data for testing. Checking 
 all the tiles generated from gdal_retile, they all look fine in an 
 image viewer, and check out  (with a spot check) with gdalinfo.

 When I load them in GeoServer, I get a strange effect.  Some of the 
 tiles never render at their full resolution for a given zoom level, 
 but at a reduced resolution.  If I load ~16 tiles vs. loading e.g.
 40+ tiles the places where this happens shifts, i.e

Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-23 Thread Stephen V. Mather
I should say, the file in question is called retile_test1.zip.

Steve

 



-Original Message-
From: Stephen V. Mather [mailto:s...@clevelandmetroparks.com] 
Sent: Monday, March 22, 2010 5:11 PM
To: 'Simone Giannecchini'
Cc: 'geoserver-devel@lists.sourceforge.net'
Subject: RE: [Geoserver-devel] Image pyramid improvements and tutorial


The test data are a little bigger than expected-- 195MB.  They will be
available shortly at the following FTP site:

ftp://ftp.clevelandmetroparks.com/pdnr/out

Thanks,
Steve

Stephen Mather, GIS Manager
Cleveland Metroparks
4101 Fulton Pkwy
Cleveland, OH 44144
s...@clevelandmetroparks.com
Phone:  (216) 635-3243
FAX: (216) 635-3286

 

 



-Original Message-
From: simbo...@gmail.com [mailto:simbo...@gmail.com] On Behalf Of Simone
Giannecchini
Sent: Saturday, March 20, 2010 10:16 AM
To: s...@clevelandmetroparks.com
Cc: geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


I guess that doing some testing with your data could be helpful. I have some
uncommitted fixes/improvements that might solve these issues.

Simone

On 3/19/10, Stephen V. Mather s...@clevelandmetroparks.com wrote:
 Qcuik questions:
 - are you adding a reprojection in the mix while you are doing this
 tests?

 I have tried it both with and without reprojection, to the same
 effect.

 - are all your granules of the same resolution?

 Yes, they are all 0.15m pixels in 5000x4000 images.  I have tried both
 leaving the existing 0 level images at 5000x4000 (-pyramidOnly) and 
 retiling to 2048x2048, both with the same result.

 Steve


 On Tue, Mar 16, 2010 at 1:13 PM, Stephen Mather
 s...@clevelandmetroparks.com wrote:

 Hi Andrea,
  I've been working on giving it a spin with our own data.  The
 tutorial is excellent.  Easy to read and follow.
  I'm currently testing it on a Windows 2003 server with nightly 
 build geoserver-2.0.x-2010-03-03-bin.zip, and 
 geoserver-2.0.2-SNAPSHOT-pyramid-plugin.zip
  The test I've been doing is with 0.5ft (0.15m) color orthophotos 
 that sum to about 150GB as TIFFs.  They are currently tiled as 
 5000x4000 images. I've retiled them with gdal_retile as 2048x2048 
 images with overviews with the following command:

 gdal_retile -v -s_srs EPSG:102722 -levels 5 -ps 2048 2048
 -targetdir test3 --optfile tilelist.txt

 I'm currently working on a subset of the data for testing. Checking
 all the tiles generated from gdal_retile, they all look fine in an 
 image viewer, and check out  (with a spot check) with gdalinfo.

 When I load them in GeoServer, I get a strange effect.  Some of the
 tiles never render at their full resolution for a given zoom level, 
 but at a reduced resolution.  If I load ~16 tiles vs. loading e.g. 
 40+ tiles the places where this happens shifts, i.e. tiles that were
 a problem before stop being a problem, while other tiles exhibit the
 same behavior.

 Does this make sense, is this an effect you've seen, and would images
 and log files be helpful?

 Thanks,
 Steve



 Andrea Aime-4 wrote:

 Hi all,
 lately I've been working, under OpenGeo request, to improve the
 situation vs image pyramids, in particular, making it easier to 
 configure a file based one.

 ...

 Is anyone interested to give the tutorial a spin, a review? Is there
 anything missing or that could be done better?

 Cheers
 Andrea

 --
 Andrea Aime
 OpenGeo - http://opengeo.org
 Expert service straight from the developers.

 
 -
 -
 SOLARIS 10 is the OS for Data Centers - provides features such as 
 DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 
 10 NOW http://p.sf.net/sfu/solaris-dev2dev
 ___
 Geoserver-devel mailing list Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel



 --
 View this message in context:

 http://old.nabble.com/Image-pyramid-improvements-and-tutorial-tp276086
 54p279
 10740.html
 Sent from the GeoServer - Dev mailing list archive at Nabble.com.


 -
 -
 
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs 
 proactively, and fine-tune applications for parallel performance. See 
 why Intel Parallel Studio got high marks during beta. 
 http://p.sf.net/sfu/intel-sw-dev 
 ___
 Geoserver-devel mailing list Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel





 --
 
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs 
 proactively, and fine-tune applications for parallel performance. See 
 why Intel Parallel Studio got high marks during beta

Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-23 Thread Stephen V. Mather
Hi Andrea,
I sent the whole tree of data, rather than just the raw data.  If I
check my 0 level tier for pixel size, here's what I get (please excuse the
DOS, I do so miss Linux and System 5 Unix)

FOR %f IN (*.tif) DO gdalinfo %f | grep Pixel  temp.txt
 more temp.txt

Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)

If I instead decend the file hierarchy, like find does:

for /R %f in (*.tif) do gdalinfo %f | grep Pixel  temp1.txt
 more temp1.txt

Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (1.000,-1.000)
Pixel Size = (2.000,-2.000)
Pixel Size = (2.000,-2.000)
Pixel Size = (4.000,-4.000)
Pixel Size = (8.000,-8.000)
Pixel Size = (16.000,-16.000)

I get a range of pixel sizes from my 0 level tier at 0.5 feet to my 5th
level tier at 16 feet.

This is the result I expect when I run gdal_retile.  Is this not what the
extension expects to see?

Thanks,
Steve


Stephen Mather, GIS Manager
Cleveland Metroparks
4101 Fulton Pkwy
Cleveland, OH 44144
s...@clevelandmetroparks.com
Phone:  (216) 635-3243
FAX: (216) 635-3286


-Original Message-
From: Andrea Aime [mailto:aa...@opengeo.org] 
Sent: Tuesday, March 23, 2010 10:48 AM
To: s...@clevelandmetroparks.com
Cc: 'Simone Giannecchini'; geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


Stephen V. Mather ha scritto:
 I should say, the file in question is called retile_test1.zip.

I looked into this file briefly and found the issue, the files at the lowest
level have different pixel resolutions.

I can be seen by running on a Linux/Unix command line the following command,
which extracts the pixel size from the gdalinfo output on each of the tiff
files in the root directory.

find . -name *.tif -exec gdalinfo {} \; | grep Pixel Size

The result is:

Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size = (0.500,-0.500)
Pixel Size

Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-22 Thread Stephen V. Mather
The test data are a little bigger than expected-- 195MB.  They will be
available shortly at the following FTP site:

ftp://ftp.clevelandmetroparks.com/pdnr/out

Thanks,
Steve

Stephen Mather, GIS Manager
Cleveland Metroparks
4101 Fulton Pkwy
Cleveland, OH 44144
s...@clevelandmetroparks.com
Phone:  (216) 635-3243
FAX: (216) 635-3286

 

 



-Original Message-
From: simbo...@gmail.com [mailto:simbo...@gmail.com] On Behalf Of Simone
Giannecchini
Sent: Saturday, March 20, 2010 10:16 AM
To: s...@clevelandmetroparks.com
Cc: geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


I guess that doing some testing with your data could be helpful. I have some
uncommitted fixes/improvements that might solve these issues.

Simone

On 3/19/10, Stephen V. Mather s...@clevelandmetroparks.com wrote:
 Qcuik questions:
 - are you adding a reprojection in the mix while you are doing this 
 tests?

 I have tried it both with and without reprojection, to the same 
 effect.

 - are all your granules of the same resolution?

 Yes, they are all 0.15m pixels in 5000x4000 images.  I have tried both 
 leaving the existing 0 level images at 5000x4000 (-pyramidOnly) and 
 retiling to 2048x2048, both with the same result.

 Steve


 On Tue, Mar 16, 2010 at 1:13 PM, Stephen Mather 
 s...@clevelandmetroparks.com wrote:

 Hi Andrea,
  I've been working on giving it a spin with our own data.  The 
 tutorial is excellent.  Easy to read and follow.
  I'm currently testing it on a Windows 2003 server with nightly 
 build geoserver-2.0.x-2010-03-03-bin.zip, and 
 geoserver-2.0.2-SNAPSHOT-pyramid-plugin.zip
  The test I've been doing is with 0.5ft (0.15m) color orthophotos 
 that sum to about 150GB as TIFFs.  They are currently tiled as 
 5000x4000 images. I've retiled them with gdal_retile as 2048x2048 
 images with overviews with the following command:

 gdal_retile -v -s_srs EPSG:102722 -levels 5 -ps 2048 2048 
 -targetdir test3 --optfile tilelist.txt

 I'm currently working on a subset of the data for testing. Checking 
 all the tiles generated from gdal_retile, they all look fine in an 
 image viewer, and check out  (with a spot check) with gdalinfo.

 When I load them in GeoServer, I get a strange effect.  Some of the 
 tiles never render at their full resolution for a given zoom level, 
 but at a reduced resolution.  If I load ~16 tiles vs. loading e.g. 
 40+ tiles the places where this happens shifts, i.e. tiles that were 
 a problem before stop being a problem, while other tiles exhibit the 
 same behavior.

 Does this make sense, is this an effect you've seen, and would images 
 and log files be helpful?

 Thanks,
 Steve



 Andrea Aime-4 wrote:

 Hi all,
 lately I've been working, under OpenGeo request, to improve the 
 situation vs image pyramids, in particular, making it easier to 
 configure a file based one.

 ...

 Is anyone interested to give the tutorial a spin, a review? Is there 
 anything missing or that could be done better?

 Cheers
 Andrea

 --
 Andrea Aime
 OpenGeo - http://opengeo.org
 Expert service straight from the developers.

 
 -
 -
 SOLARIS 10 is the OS for Data Centers - provides features such as
DTrace,
 Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
 http://p.sf.net/sfu/solaris-dev2dev
 ___
 Geoserver-devel mailing list
 Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel



 --
 View this message in context:

 http://old.nabble.com/Image-pyramid-improvements-and-tutorial-tp276086
 54p279
 10740.html
 Sent from the GeoServer - Dev mailing list archive at Nabble.com.


 -
 -
 
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Geoserver-devel mailing list
 Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel





 --
 
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Geoserver-devel mailing list
 Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel



-- 
---
Ing. Simone Giannecchini
GeoSolutions S.A.S.
Founder - Software

Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-19 Thread Stephen V. Mather
Hi Andrea,
I've submitted a bug report on JIRA.  I have a ~80MB example zip.
How would you prefer I send that to you?

Steve

Stephen Mather, GIS Manager
Cleveland Metroparks
4101 Fulton Pkwy
Cleveland, OH 44144
s...@clevelandmetroparks.com
Phone:  (216) 635-3243
FAX: (216) 635-3286




-Original Message-
From: Andrea Aime [mailto:aa...@opengeo.org] 
Sent: Thursday, March 18, 2010 11:22 AM
To: Stephen Mather
Cc: geoserver-devel@lists.sourceforge.net
Subject: Re: [Geoserver-devel] Image pyramid improvements and tutorial


Stephen Mather ha scritto:
 Hi Andrea,
   I've been working on giving it a spin with our own data.  The 
 tutorial is excellent.  Easy to read and follow.
   I'm currently testing it on a Windows 2003 server with nightly 
 build geoserver-2.0.x-2010-03-03-bin.zip, and 
 geoserver-2.0.2-SNAPSHOT-pyramid-plugin.zip
   The test I've been doing is with 0.5ft (0.15m) color orthophotos 
 that sum to about 150GB as TIFFs.  They are currently tiled as 
 5000x4000 images. I've retiled them with gdal_retile as 2048x2048 
 images with overviews with the following command:
 
 gdal_retile -v -s_srs EPSG:102722 -levels 5 -ps 2048 2048 -targetdir 
 test3 --optfile tilelist.txt
 
 I'm currently working on a subset of the data for testing. Checking 
 all the tiles generated from gdal_retile, they all look fine in an 
 image viewer, and check out  (with a spot check) with gdalinfo.
 
 When I load them in GeoServer, I get a strange effect.  Some of the 
 tiles never render at their full resolution for a given zoom level, 
 but at a reduced resolution.  If I load ~16 tiles vs. loading e.g. 40+ 
 tiles the places where this happens shifts, i.e. tiles that were a 
 problem before stop being a problem, while other tiles exhibit the 
 same behavior.
 
 Does this make sense, is this an effect you've seen, and would images 
 and log files be helpful?

I actually never seen this effect.
Can you open a report on Jira?
To be effective we should also be able to reproduce the problem. Can you
generate it with any freely available imagery set?

Cheers
Andrea


-- 
Andrea Aime
OpenGeo - http://opengeo.org
Expert service straight from the developers.




--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel


Re: [Geoserver-devel] Image pyramid improvements and tutorial

2010-03-19 Thread Stephen V. Mather
 Qcuik questions:
 - are you adding a reprojection in the mix while you are doing this tests?

I have tried it both with and without reprojection, to the same effect.

 - are all your granules of the same resolution?

Yes, they are all 0.15m pixels in 5000x4000 images.  I have tried both
leaving the existing 0 level images at 5000x4000 (-pyramidOnly) and retiling
to 2048x2048, both with the same result.

Steve


On Tue, Mar 16, 2010 at 1:13 PM, Stephen Mather
s...@clevelandmetroparks.com wrote:

 Hi Andrea,
      I've been working on giving it a spin with our own data.  The 
 tutorial is excellent.  Easy to read and follow.
      I'm currently testing it on a Windows 2003 server with nightly 
 build geoserver-2.0.x-2010-03-03-bin.zip, and 
 geoserver-2.0.2-SNAPSHOT-pyramid-plugin.zip
      The test I've been doing is with 0.5ft (0.15m) color orthophotos 
 that sum to about 150GB as TIFFs.  They are currently tiled as 
 5000x4000 images. I've retiled them with gdal_retile as 2048x2048 
 images with overviews with the following command:

 gdal_retile -v -s_srs EPSG:102722 -levels 5 -ps 2048 2048 -targetdir 
 test3 --optfile tilelist.txt

 I'm currently working on a subset of the data for testing. Checking 
 all the tiles generated from gdal_retile, they all look fine in an 
 image viewer, and check out  (with a spot check) with gdalinfo.

 When I load them in GeoServer, I get a strange effect.  Some of the 
 tiles never render at their full resolution for a given zoom level, 
 but at a reduced resolution.  If I load ~16 tiles vs. loading e.g. 40+ 
 tiles the places where this happens shifts, i.e. tiles that were a 
 problem before stop being a problem, while other tiles exhibit the 
 same behavior.

 Does this make sense, is this an effect you've seen, and would images 
 and log files be helpful?

 Thanks,
 Steve



 Andrea Aime-4 wrote:

 Hi all,
 lately I've been working, under OpenGeo request, to improve the 
 situation vs image pyramids, in particular, making it easier to 
 configure a file based one.

 ...

 Is anyone interested to give the tutorial a spin, a review? Is there 
 anything missing or that could be done better?

 Cheers
 Andrea

 --
 Andrea Aime
 OpenGeo - http://opengeo.org
 Expert service straight from the developers.

 -
 -
 SOLARIS 10 is the OS for Data Centers - provides features such as DTrace,
 Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW
 http://p.sf.net/sfu/solaris-dev2dev
 ___
 Geoserver-devel mailing list
 Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel



 --
 View this message in context: 

http://old.nabble.com/Image-pyramid-improvements-and-tutorial-tp27608654p279
10740.html
 Sent from the GeoServer - Dev mailing list archive at Nabble.com.


 --
 
 Download Intel#174; Parallel Studio Eval
 Try the new software tools for yourself. Speed compiling, find bugs
 proactively, and fine-tune applications for parallel performance.
 See why Intel Parallel Studio got high marks during beta.
 http://p.sf.net/sfu/intel-sw-dev
 ___
 Geoserver-devel mailing list
 Geoserver-devel@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/geoserver-devel





--
Download Intel#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
___
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel