Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-07-08 Thread Matt.Wilkie
cogger v0.0.5 now supports .ovr external overviews. It will automatically set 
the output cog to bigtiff if required, so your use-case should now be covered.

Oh that’s great, thank you!
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-28 Thread thomas bonfort
cogger v0.0.5 now supports .ovr external overviews. It will automatically
set the output cog to bigtiff if required, so your use-case should now be
covered.

--
Thomas


Le lun. 14 juin 2021 à 22:12,  a écrit :

> > You can create external overviews with the -ro switch
>
> Yeah, I have those. I was trying to create internal ones instead in order
> to use cogger ;-)
>
> (And behind all of this, a weeping and wailing and gnashing of teeth at
> the upstream person or persons who decided that creating jpegs and throwing
> away the originals was "good enough". Oh well, my history is littered with
> bad calls too.)
>
> Matt
>
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-28 Thread Andrew C Aitchison

On Mon, 14 Jun 2021, matt.wil...@yukon.ca wrote:


Your initial test.tif file needs to be a bigtiff, i.e. have been
created with -co "BIGTIFF=YES". you can then drop the bigtiff
config arguments of your gdaladdo call.


Ahh, thanks Thomas, that indeed is the problem.

Unfortunately for me it means in this case I'm stuck,
as the original is jpeg-tiff and I don't want to pay the penalty
of another decompress-recompress cycle to change to big tiff.
However at least I know what's going on now.


The description at http://bigtiff.org strongly suggests that
you can convert a tiff to a bigtiff without decompressing.
I do not have a pointer to code or an application (beyond
the BigTIFF version of libtiff) but some of the people named
as involved with the design are on this list.

--
Andrew C. Aitchison Kendal, UK
and...@aitchison.me.uk
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-14 Thread Matt.Wilkie
> You can create external overviews with the -ro switch

Yeah, I have those. I was trying to create internal ones instead in order to 
use cogger ;-)

(And behind all of this, a weeping and wailing and gnashing of teeth at the 
upstream person or persons who decided that creating jpegs and throwing away 
the originals was "good enough". Oh well, my history is littered with bad calls 
too.)

Matt
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-14 Thread Even Rouault

Matt,

You can create external overviews with the -ro switch

Even

Le 14/06/2021 à 21:12, matt.wil...@yukon.ca a écrit :

Your initial test.tif file needs to be a bigtiff, i.e. have been
created with -co "BIGTIFF=YES". you can then drop the bigtiff
config arguments of your gdaladdo call.

Ahh, thanks Thomas, that indeed is the problem.

Unfortunately for me it means in this case I'm stuck, as the original is 
jpeg-tiff and I don't want to pay the penalty of another decompress-recompress 
cycle to change to big tiff. However at least I know what's going on now.

-Matt
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


--
http://www.spatialys.com
My software is free, but my time generally not.

___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-14 Thread Matt.Wilkie
> Your initial test.tif file needs to be a bigtiff, i.e. have been
> created with -co "BIGTIFF=YES". you can then drop the bigtiff 
> config arguments of your gdaladdo call.

Ahh, thanks Thomas, that indeed is the problem. 

Unfortunately for me it means in this case I'm stuck, as the original is 
jpeg-tiff and I don't want to pay the penalty of another decompress-recompress 
cycle to change to big tiff. However at least I know what's going on now.

-Matt
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


Re: [gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-09 Thread thomas bonfort
Your initial test.tif file needs to be a bigtiff, i.e. have been
created with -co "BIGTIFF=YES". you can then drop the bigtiff config
arguments of your gdaladdo call.

--
thomas

On Wed, Jun 9, 2021 at 5:39 PM  wrote:
>
> I am getting tiff file size exceeded error but am using bigtiff creation 
> options.
>
>
>
> ~~~
>
> $ gdaladdo -r gauss ^
>
> --config COMPRESS_OVERVIEW WEBP ^
>
> --config PHOTOMETRIC_OVERVIEW YCBCR ^
>
> --config INTERLEAVE_OVERVIEW PIXEL ^
>
> --config QUALITY 87 ^
>
> --config BIGTIFF YES ^
>
> --config BIGTIFF_OVERVIEW YES ^
>
> test.tif
>
>
>
> 0...10...20...ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use 
> BIGTIFF=YES creation option.
>
> ERROR 1: An error occurred while writing a dirty block from 
> GDALRasterBand::RasterIO
>
> ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use BIGTIFF=YES 
> creation option.
>
> ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use BIGTIFF=YES 
> creation option.
>
> ERROR 1: WriteEncodedTile/Strip() failed.
>
> 30...40...50...60...70...80...90...100 - done.
>
> ~~~
>
>
>
> ~~~
>
> 2021-06-09  08:35 AM 4,294,967,034 test.tif
>
> 2021-03-16  09:14 AM21,765,697 test.tif.msk
>
> ~~~
>
>
>
> Gdalinfo report attached.
>
>
>
> GDAL 3.1.4, released 2020/10/20, Win10.
>
>
>
> ___
> gdal-dev mailing list
> gdal-dev@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


[gdal-dev] gdaladdo bigtiff err but --config BIGTIFF was used

2021-06-09 Thread Matt.Wilkie
I am getting tiff file size exceeded error but am using bigtiff creation 
options.

~~~
$ gdaladdo -r gauss ^
--config COMPRESS_OVERVIEW WEBP ^
--config PHOTOMETRIC_OVERVIEW YCBCR ^
--config INTERLEAVE_OVERVIEW PIXEL ^
--config QUALITY 87 ^
--config BIGTIFF YES ^
--config BIGTIFF_OVERVIEW YES ^
test.tif

0...10...20...ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use 
BIGTIFF=YES creation option.
ERROR 1: An error occurred while writing a dirty block from 
GDALRasterBand::RasterIO
ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use BIGTIFF=YES 
creation option.
ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use BIGTIFF=YES 
creation option.
ERROR 1: WriteEncodedTile/Strip() failed.
30...40...50...60...70...80...90...100 - done.
~~~

~~~
2021-06-09  08:35 AM 4,294,967,034 test.tif
2021-03-16  09:14 AM21,765,697 test.tif.msk
~~~

Gdalinfo report attached.

GDAL 3.1.4, released 2020/10/20, Win10.

Driver: GTiff/GeoTIFF
Files: test.tif
   test.tif.msk
Size is 126015, 68149
Coordinate System is:
PROJCRS["NAD_1983_Yukon_Albers",
BASEGEOGCRS["NAD83",
DATUM["North American Datum 1983",
ELLIPSOID["GRS 1980",6378137,298.257222101004,
LENGTHUNIT["metre",1]]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
ID["EPSG",4269]],
CONVERSION["Albers Equal Area",
METHOD["Albers Equal Area",
ID["EPSG",9822]],
PARAMETER["Latitude of false origin",59,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8821]],
PARAMETER["Longitude of false origin",-132.5,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8822]],
PARAMETER["Latitude of 1st standard parallel",61.7,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8823]],
PARAMETER["Latitude of 2nd standard parallel",68,
ANGLEUNIT["degree",0.0174532925199433],
ID["EPSG",8824]],
PARAMETER["Easting at false origin",50,
LENGTHUNIT["metre",1],
ID["EPSG",8826]],
PARAMETER["Northing at false origin",50,
LENGTHUNIT["metre",1],
ID["EPSG",8827]]],
CS[Cartesian,2],
AXIS["easting",east,
ORDER[1],
LENGTHUNIT["metre",1]],
AXIS["northing",north,
ORDER[2],
LENGTHUNIT["metre",1]],
ID["EPSG",3578]]
Data axis to CRS axis mapping: 1,2
Origin = (293217.000,1126371.000)
Pixel Size = (1.500,-1.500)
Metadata:
  AREA_OR_POINT=Area
  DataType=Processed
Image Structure Metadata:
  COMPRESSION=JPEG
  INTERLEAVE=PIXEL
Corner Coordinates:
Upper Left  (  293217.000, 1126371.000) (136d49'19.22"W, 64d33'30.27"N)
Lower Left  (  293217.000, 1024147.500) (136d40'52.72"W, 63d38'41.16"N)
Upper Right (  482239.500, 1126371.000) (132d52'18.43"W, 64d37'15.93"N)
Lower Right (  482239.500, 1024147.500) (132d51'34.73"W, 63d42'19.54"N)
Center  (  387728.250, 1075259.250) (134d48'36.81"W, 64d 8'43.57"N)
Band 1 Block=128x128 Type=Byte, ColorInterp=Red
  Min=0.000 Max=255.000 
  Minimum=0.000, Maximum=255.000, Mean=50.198, StdDev=75.457
  NoData Value=256
  Overviews: 63008x34075, 31504x17038, 15752x8519, 7876x4260, 3938x2130, 
1969x1065, 985x533, 493x267, 247x134
  Mask Flags: PER_DATASET 
  Metadata:
RepresentationType=ATHEMATIC
STATISTICS_MAXIMUM=255
STATISTICS_MEAN=50.197691262641
STATISTICS_MINIMUM=0
STATISTICS_SKIPFACTORX=1
STATISTICS_SKIPFACTORY=1
STATISTICS_STDDEV=75.456911360778
Band 2 Block=128x128 Type=Byte, ColorInterp=Green
  Min=0.000 Max=255.000 
  Minimum=0.000, Maximum=255.000, Mean=50.863, StdDev=75.993
  NoData Value=256
  Overviews: 63008x34075, 31504x17038, 15752x8519, 7876x4260, 3938x2130, 
1969x1065, 985x533, 493x267, 247x134
  Mask Flags: PER_DATASET 
  Metadata:
RepresentationType=ATHEMATIC
STATISTICS_MAXIMUM=255
STATISTICS_MEAN=50.862667930779
STATISTICS_MINIMUM=0
STATISTICS_SKIPFACTORX=1
STATISTICS_SKIPFACTORY=1
STATISTICS_STDDEV=75.993162525726
Band 3 Block=128x128 Type=Byte, ColorInterp=Blue
  Min=0.000 Max=255.000 
  Minimum=0.000, Maximum=255.000, Mean=44.089, StdDev=71.226
  NoData Value=256
  Overviews: 63008x34075, 31504x17038, 15752x8519, 7876x4260, 3938x2130, 
1969x1065, 985x533, 493x267, 247x134
  Mask Flags: PER_DATASET 
  Metadata:
RepresentationType=ATHEMATIC
STATISTICS_MAXIMUM=255
STATISTICS_MEAN=44.08913515331
STATISTICS_MINIMUM=0
STATISTICS_SKIPFACTORX=1
STATISTICS_SKIPFACTORY=1
STATISTICS_STDDEV=71.225888610331
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev