Hi All,

First off, sorry this is really long with all the gdalinfo pasted into it, but I thought is might be more useful to have real information to look at.

I have been running down a problem caused by upgrading a server to a newer version of gdal. Here are the details:

old server: GDAL 1.6.0dev, FWTools 2.0.6, released 2008/02/03
new server: GDAL 1.9.2, released 2012/10/08

My process is:

wget 'http://cyclops.marine.usf.edu/modis/level3/husf/fullpass/2014/061/1km/pass/final/MODIS.2014061.194420.fullpass.rgb.hdf'

old server:
gdal_translate -of GTiff -ot Int16 -a_srs EPSG:32662 -a_ullr -13914936.3491592 6094982.02936303 -5009377.08569731 -560262.454244465 HDF4_SDS:UNKNOWN:MODIS.2014061.194420.fullpass.rgb.hdf:0 temp.tif

new server:
gdal_translate -of GTiff -ot Int16 -a_srs EPSG:32662 -a_ullr -13914936.3491592 6115512.02936303 -5009377.08569731 -539731.454244465 HDF4_SDS:UNKNOWN:MODIS.2014061.194420.fullpass.rgb.hdf:0 temp.tif

I have verified that gdalinfo -mm -stats temp.tif looks equivalent for the two generated temp.tif images. The -a_ullr are different because proj4 is shifting the image 20530m south so I'm correcting here for that.

summary old:
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
  Min=377.000 Max=32767.000   Computed Min/Max=377.000,32767.000
  Minimum=377.000, Maximum=32767.000, Mean=27526.311, StdDev=11176.835

summary new:
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
  Min=377.000 Max=32767.000   Computed Min/Max=377.000,32767.000
  Minimum=377.000, Maximum=32767.000, Mean=27526.311, StdDev=11176.835

---------------------- full output --------------------------------
old server:
# /opt/FWTools/bin_safe/gdalinfo -mm -stats temp.tif
Driver: GTiff/GeoTIFF
Files: temp.tif
Size is 8800, 6600
Coordinate System is:
PROJCS["WGS 84 / Plate Carree",
    GEOGCS["WGS 84",
        DATUM["WGS_1984",
            SPHEROID["WGS 84",6378137,298.2572235629972,
                AUTHORITY["EPSG","7030"]],
            AUTHORITY["EPSG","6326"]],
        PRIMEM["Greenwich",0],
        UNIT["degree",0.0174532925199433],
        AUTHORITY["EPSG","4326"]],
    UNIT["metre",1,
        AUTHORITY["EPSG","9001"]],
    AUTHORITY["EPSG","32662"]]
Origin = (-13914936.349159199744463,6094982.029363029636443)
Pixel Size = (1011.995370847942013,-1008.370376304165802)
Metadata:
  AREA_OR_POINT=Area
  Collection Location=USF Institute for Marine Remote Sensing
  Data Source Type=Direct Broadcast
Input File(s)=/tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.194420.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.194650.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.194920.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.195150.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.195420.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.194420.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.194650.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.194920.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.195150.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.195420.hdf
  L3 Software Name=/usr/bin/map_modis.pl
  L3 Software Version=4.2
  Map Limit=-5, -125, 55, -45
  Map Projection Category=Proj 4.4.7
  Map Projection Name=eqc
  Proj Projection Parameters=#Equidistant Cylindrical (Plate Caree)
#       Cyl, Sph
#       lat_ts=
# +proj=eqc +ellps=WGS84
  Processing Status=final
  Satellite=aqua
  Spatial Resolution=1km
  Temporal Resolution=pass
  _FillValue=[65535]
  band_name=1
  corrected_counts_offset=-0
  corrected_counts_scale=0.124973
  corrected_counts_units=counts
long_name=Earth View 250M Aggregated 1km Reflective Solar Bands Scaled Integers Band 1
  radiance_offset=-0
  radiance_scale=0.0246418
  radiance_units=Watts/m^2/micrometer/steradian
  reflectance_offset=-0
  reflectance_scale=4.72967e-05
  reflectance_units=none
  units=none
  valid_range=[0 32767]
Image Structure Metadata:
  INTERLEAVE=BAND
Corner Coordinates:
Upper Left  (-13914936.349, 6094982.029)
Lower Left  (-13914936.349, -560262.454)
Upper Right (-5009377.086, 6094982.029)
Lower Right (-5009377.086, -560262.454)
Center      (-9462156.717, 2767359.788)
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
    Computed Min/Max=377.000,32767.000
  Minimum=377.000, Maximum=32767.000, Mean=27526.311, StdDev=11176.835
  Metadata:
    STATISTICS_MINIMUM=377
    STATISTICS_MAXIMUM=32767
    STATISTICS_MEAN=27526.311392114
    STATISTICS_STDDEV=11176.834697473


new server:
# gdalinfo -mm -stats temp.tif
Driver: GTiff/GeoTIFF
Files: temp.tif
       temp.tif.aux.xml
Size is 8800, 6600
Coordinate System is:
LOCAL_CS["WGS 84 / Plate Carree",
    GEOGCS["WGS 84",
        DATUM["WGS_1984",
            SPHEROID["WGS 84",6378137,298.257223563,
                AUTHORITY["EPSG","7030"]],
            AUTHORITY["EPSG","6326"]],
        PRIMEM["Greenwich",0],
        UNIT["degree",0.0174532925199433],
        AUTHORITY["EPSG","4326"]],
    AUTHORITY["EPSG","32662"],
    UNIT["metre",1]]
Origin = (-13914936.349159199744463,6115512.029363029636443)
Pixel Size = (1011.995370847942013,-1008.370224789014287)
Metadata:
  _FillValue=[65535]
  AREA_OR_POINT=Area
  band_name=1
  Collection Location=USF Institute for Marine Remote Sensing
  corrected_counts_offset=-0
  corrected_counts_scale=0.124973
  corrected_counts_units=counts
  Data Source Type=Direct Broadcast
Input File(s)=/tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.194420.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.194650.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.194920.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.195150.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD021KM.2014061.195420.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.194420.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.194650.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.194920.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.195150.hdf, /tmp/s4p_run_map_modis_2.3_2HwoEbWy/MYD03.2014061.195420.hdf
  L3 Software Name=/usr/bin/map_modis.pl
  L3 Software Version=4.2
long_name=Earth View 250M Aggregated 1km Reflective Solar Bands Scaled Integers Band 1
  Map Limit=-5, -125, 55, -45
  Map Projection Category=Proj 4.4.7
  Map Projection Name=eqc
  Processing Status=final
  Proj Projection Parameters=#Equidistant Cylindrical (Plate Caree)
#       Cyl, Sph
#       lat_ts=
# +proj=eqc +ellps=WGS84
  radiance_offset=-0
  radiance_scale=0.0246418
  radiance_units=Watts/m^2/micrometer/steradian
  reflectance_offset=-0
  reflectance_scale=4.72967e-05
  reflectance_units=none
  Satellite=aqua
  Spatial Resolution=1km
  Temporal Resolution=pass
  units=none
  valid_range=[0 32767]
Image Structure Metadata:
  INTERLEAVE=BAND
Corner Coordinates:
Upper Left  (-13914936.349, 6115512.029)
Lower Left  (-13914936.349, -539731.454)
Upper Right (-5009377.086, 6115512.029)
Lower Right (-5009377.086, -539731.454)
Center      (-9462156.717, 2787890.288)
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
  Min=377.000 Max=32767.000   Computed Min/Max=377.000,32767.000
  Minimum=377.000, Maximum=32767.000, Mean=27526.311, StdDev=11176.835
  Metadata:
    STATISTICS_MAXIMUM=32767
    STATISTICS_MEAN=27526.311392114
    STATISTICS_MINIMUM=377
    STATISTICS_STDDEV=11176.834697473
-------------------------------------------------------------------------


This is the problem step:

gdalwarp -rcs -ts 8800 6600 -s_srs EPSG:32662 -t_srs EPSG:4326 temp.tif target.tif

gdalinfo -mm -stats target.tif

is showing that the range of values in the image are dramatically different on the two servers!

summary old:
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
    Computed Min/Max=-3877.000,32767.000
  Minimum=-3877.000, Maximum=32767.000, Mean=25235.731, StdDev=10612.642


summary new:
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
  Min=-9314.000 Max=32561.000   Computed Min/Max=-9314.000,32561.000
  Minimum=-9314.000, Maximum=32561.000, Mean=19166.800, StdDev=7786.806


Ok, so you can see that the values are radically different. My question is how do I get values like the old system? These values represent temperatures and I need to get the same values.

My one thought on this is that if is another side effrct of proj4 behaving differently as I had to adjust the position above to get it to align. So maybe the gdalwarp is messing up the pixel values when it reprojects it also. But I'm totally lost on how make this work correctly.

Any thoughts on how to fix this?


Thanks,
  -Steve

--------------------------- full output -------------------------------
old server:
# /opt/FWTools/bin_safe/gdalinfo -mm -stats target.tif
Driver: GTiff/GeoTIFF
Files: target.tif
Size is 8800, 6600
Coordinate System is:
GEOGCS["WGS 84",
    DATUM["WGS_1984",
        SPHEROID["WGS 84",6378137,298.2572235629972,
            AUTHORITY["EPSG","7030"]],
        AUTHORITY["EPSG","6326"]],
    PRIMEM["Greenwich",0],
    UNIT["degree",0.0174532925199433],
    AUTHORITY["EPSG","4326"]]
Origin = (-125.000000000000128,54.752155134106310)
Pixel Size = (0.009090909090909,-0.009058345210874)
Metadata:
  AREA_OR_POINT=Area
Image Structure Metadata:
  INTERLEAVE=BAND
Corner Coordinates:
Upper Left  (-125.0000000,  54.7521551) (125d 0'0.00"W, 54d45'7.76"N)
Lower Left  (-125.0000000,  -5.0329233) (125d 0'0.00"W,  5d 1'58.52"S)
Upper Right ( -45.0000000,  54.7521551) ( 45d 0'0.00"W, 54d45'7.76"N)
Lower Right ( -45.0000000,  -5.0329233) ( 45d 0'0.00"W,  5d 1'58.52"S)
Center      ( -85.0000000,  24.8596159) ( 85d 0'0.00"W, 24d51'34.62"N)
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
    Computed Min/Max=-3877.000,32767.000
  Minimum=-3877.000, Maximum=32767.000, Mean=25235.731, StdDev=10612.642
  Metadata:
    STATISTICS_MINIMUM=-3877
    STATISTICS_MAXIMUM=32767
    STATISTICS_MEAN=25235.730898691
    STATISTICS_STDDEV=10612.642070873



new server:
# gdalinfo -mm -stats target2.tif
Driver: GTiff/GeoTIFF
Files: target2.tif
Size is 8800, 6600
Coordinate System is:
GEOGCS["WGS 84",
    DATUM["WGS_1984",
        SPHEROID["WGS 84",6378137,298.257223563,
            AUTHORITY["EPSG","7030"]],
        AUTHORITY["EPSG","6326"]],
    PRIMEM["Greenwich",0],
    UNIT["degree",0.0174532925199433],
    AUTHORITY["EPSG","4326"]]
Origin = (-125.000000000000000,54.936579261935996)
Pixel Size = (0.009090548058866,-0.009058564516722)
Metadata:
  AREA_OR_POINT=Area
Image Structure Metadata:
  INTERLEAVE=BAND
Corner Coordinates:
Upper Left  (-125.0000000,  54.9365793) (125d 0' 0.00"W, 54d56'11.69"N)
Lower Left  (-125.0000000,  -4.8499465) (125d 0' 0.00"W,  4d50'59.81"S)
Upper Right ( -45.0031771,  54.9365793) ( 45d 0'11.44"W, 54d56'11.69"N)
Lower Right ( -45.0031771,  -4.8499465) ( 45d 0'11.44"W,  4d50'59.81"S)
Center      ( -85.0015885,  25.0433164) ( 85d 0' 5.72"W, 25d 2'35.94"N)
Band 1 Block=8800x1 Type=Int16, ColorInterp=Gray
    Computed Min/Max=-9314.000,32561.000
  Minimum=-9314.000, Maximum=32561.000, Mean=19166.800, StdDev=7786.806
  Metadata:
    STATISTICS_MAXIMUM=32561
    STATISTICS_MEAN=19166.799570351
    STATISTICS_MINIMUM=-9314
    STATISTICS_STDDEV=7786.8063693375
_______________________________________________
gdal-dev mailing list
gdal-dev@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/gdal-dev

Reply via email to