date:20221020

Re: [gdal-dev] ogr SSL errors on ubuntu

2022-10-20 Thread Jorge Gustavo Rocha


Hi Even,

Thank you so much for addressing this issue in so short time.

I've checked out your pr. It runs fine on my side.

Regards,

Jorge

On 20/10/22 20:58, Even Rouault wrote:

Jorge,

Fix/workaround and links to related issues in 
https://github.com/OSGeo/gdal/pull/6561


The curl binary manages to ignore that, but I couldn't easily spot 
how/where in its source code.


The difference in errors are due to your curl versions using different 
backends: gnutls vs openssl.


Even

Le 20/10/2022 à 20:35, Jorge Gustavo Rocha a écrit :

Hi,

Lately, I have problems opening some datasets using ogr2ogr or ogrinfo 
due to SSL errors.


I think others tools like curl had the same kind of problems, but now 
they seem to work well.


Problems with ogr
=

Example (GDAL 3.6.0dev-f033e1fa1e, released 2022/08/04):

ogrinfo 
'https://wssig3.azores.gov.pt/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=ge:GE.Borehole&outputFormat=application/json&EXCEPTIONS=application/json&srsname=EPSG:5013'


ERROR 1: OpenSSL SSL_read: error:0A000126:SSL routines::unexpected eof 
while reading, errno 0


Example (GDAL 3.4.3, released 2022/04/22):

ogrinfo 
'https://wssig3.azores.gov.pt/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=ge:GE.Borehole&outputFormat=application/json&EXCEPTIONS=application/json&srsname=EPSG:5013'


ERROR 1: GnuTLS recv error (-110): The TLS connection was non-properly 
terminated.


maybe related: https://github.com/openssl/openssl/issues/18574

Has someone a nice workaround? Do we need to change ogr code to handle 
this?


Regards,

Jorge




--
OSGeo Portugal
NIF: 509588190
email: ge...@osgeopt.pt
https://www.osgeopt.pt/

Próximo evento: SASIG 2017, 20 a 22 de novembro, Porto
Mais informações: http://osgeopt.pt/sasig2017/
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] ogr SSL errors on ubuntu

2022-10-20 Thread Even Rouault


Jorge,

Fix/workaround and links to related issues in 
https://github.com/OSGeo/gdal/pull/6561


The curl binary manages to ignore that, but I couldn't easily spot 
how/where in its source code.


The difference in errors are due to your curl versions using different 
backends: gnutls vs openssl.


Even

Le 20/10/2022 à 20:35, Jorge Gustavo Rocha a écrit :

Hi,

Lately, I have problems opening some datasets using ogr2ogr or ogrinfo 
due to SSL errors.


I think others tools like curl had the same kind of problems, but now 
they seem to work well.


Problems with ogr
=

Example (GDAL 3.6.0dev-f033e1fa1e, released 2022/08/04):

ogrinfo 
'https://wssig3.azores.gov.pt/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=ge:GE.Borehole&outputFormat=application/json&EXCEPTIONS=application/json&srsname=EPSG:5013'


ERROR 1: OpenSSL SSL_read: error:0A000126:SSL routines::unexpected eof 
while reading, errno 0


Example (GDAL 3.4.3, released 2022/04/22):

ogrinfo 
'https://wssig3.azores.gov.pt/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=ge:GE.Borehole&outputFormat=application/json&EXCEPTIONS=application/json&srsname=EPSG:5013'


ERROR 1: GnuTLS recv error (-110): The TLS connection was non-properly 
terminated.


maybe related: https://github.com/openssl/openssl/issues/18574

Has someone a nice workaround? Do we need to change ogr code to handle 
this?


Regards,

Jorge


--
http://www.spatialys.com
My software is free, but my time generally not.

___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] Python API docs

2022-10-20 Thread Even Rouault


https://gdal.org/api/python/osgeo.html

Le 20/10/2022 à 21:13, Chaitanya kumar CH a écrit :

Hi all,

Does anyone know where the python api docs are moved? I can't find 
them at "gdal.org/python ".

Thank you

Best regards,
Chaitanya Kumar CH.


___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


--
http://www.spatialys.com
My software is free, but my time generally not.
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] Python API docs

2022-10-20 Thread Alan Snow

They are now here: https://gdal.org/api/python/osgeo.html

On Thu, Oct 20, 2022, 2:14 PM Chaitanya kumar CH 
wrote:

> Hi all,
>
> Does anyone know where the python api docs are moved? I can't find them at
> "gdal.org/python".
> Thank you
>
> Best regards,
> Chaitanya Kumar CH.
>
> ___
> gdal-dev mailing list
> gdal-dev@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev
>
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

[gdal-dev] Python API docs

2022-10-20 Thread Chaitanya kumar CH

Hi all,

Does anyone know where the python api docs are moved? I can't find them at "
gdal.org/python".
Thank you

Best regards,
Chaitanya Kumar CH.
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

[gdal-dev] ogr SSL errors on ubuntu

2022-10-20 Thread Jorge Gustavo Rocha


Hi,

Lately, I have problems opening some datasets using ogr2ogr or ogrinfo 
due to SSL errors.


I think others tools like curl had the same kind of problems, but now 
they seem to work well.


Problems with ogr
=

Example (GDAL 3.6.0dev-f033e1fa1e, released 2022/08/04):

ogrinfo 
'https://wssig3.azores.gov.pt/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=ge:GE.Borehole&outputFormat=application/json&EXCEPTIONS=application/json&srsname=EPSG:5013'


ERROR 1: OpenSSL SSL_read: error:0A000126:SSL routines::unexpected eof 
while reading, errno 0


Example (GDAL 3.4.3, released 2022/04/22):

ogrinfo 
'https://wssig3.azores.gov.pt/geoserver/ows?service=WFS&version=2.0.0&request=GetFeature&typename=ge:GE.Borehole&outputFormat=application/json&EXCEPTIONS=application/json&srsname=EPSG:5013'


ERROR 1: GnuTLS recv error (-110): The TLS connection was non-properly 
terminated.


maybe related: https://github.com/openssl/openssl/issues/18574

Has someone a nice workaround? Do we need to change ogr code to handle this?

Regards,

Jorge
--
OSGeo Portugal
NIF: 509588190
email: ge...@osgeopt.pt
https://www.osgeopt.pt/

Próximo evento: SASIG 2017, 20 a 22 de novembro, Porto
Mais informações: http://osgeopt.pt/sasig2017/
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] gdal_calc output to multiband nedcdf ?

2022-10-20 Thread Laurențiu Nicola via gdal-dev

Hello,

I've never tried it, but I believe you can describe some computations in a VRT. 
But gdal_calc can't do this, so you'd need to write the VRT directly as XML. 
That's probably not much easier than writing some Python or C++ to perform the 
same computation.

Laurentiu

On Thu, Oct 20, 2022, at 21:06, Jonas Ardö via gdal-dev wrote:
> Dear gdal-gurus,
> 
> Trying to use* gdal_calc* to  do the same calculation for tow 366 band (daily 
> data) files and store it in a *.nc file with the same dimensions as the input 
> files. 
> 
> This works OK (output to 366 tiff files):
> for i in {1..366} # One band per day output to tif
> do
>   gdal_calc.py   --calc="exp( (17.625*D) /(243.04+D) ) / exp( 
> (17.625*T)/(243.04+T) ) * 100" --outfile=Rh_2020_day$i.tif -D 
> DPTa_dayavg_C_2020.nc -T Ta_dayavg_C_2020.nc  --D_band=$i --T_band=$i
> done
> 
> 
> This do not work (output to one netcdf file):
> for i in {1..366} # One band per day output to tif
> do
>   gdal_calc.py   --calc="exp( (17.625*D) /(243.04+D) ) / exp( 
> (17.625*T)/(243.04+T) ) * 100" --outfile=Rh_2020.nc -D DPTa_dayavg_C_2020.nc 
> -T Ta_dayavg_C_2020.nc  --D_band=$i --T_band=$i
> done
> 
> yields:
> Error! Output exists, but is the wrong geotransform.  Use the --overwrite 
> option to automatically overwrite the existing file
> Error! Output exists, but is the wrong geotransform.  Use the --overwrite 
> option to automatically overwrite the existing file
> 
> Any suggestions how to make the output into a 366-band netcdf file?
> using on Cygwin:
> gdalinfo.exe --version
> GDAL 3.5.1, released 2022/06/30
> 
> Regards
> /Jonas, Lund University, Sweden
> 
> ___
> gdal-dev mailing list
> gdal-dev@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev
> ___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

[gdal-dev] gdal_calc output to multiband nedcdf ?

2022-10-20 Thread Jonas Ardö via gdal-dev


Dear gdal-gurus,

Trying to use*gdal_calc* to  do the same calculation for tow 366 band 
(daily data) files and store it in a *.nc file with the same dimensions 
as the input files.


This works OK (output to 366 tiff files):
for i in {1..366} # One band per day output to tif
do
  gdal_calc.py   --calc="exp( (17.625*D) /(243.04+D) ) / exp( 
(17.625*T)/(243.04+T) ) * 100" --outfile=Rh_2020_day$i.tif -D 
DPTa_dayavg_C_2020.nc -T Ta_dayavg_C_2020.nc  --D_band=$i --T_band=$i

done


This do not work (output to one netcdf file):
for i in {1..366} # One band per day output to tif
do
  gdal_calc.py   --calc="exp( (17.625*D) /(243.04+D) ) / exp( 
(17.625*T)/(243.04+T) ) * 100" --outfile=Rh_2020.nc -D 
DPTa_dayavg_C_2020.nc -T Ta_dayavg_C_2020.nc  --D_band=$i --T_band=$i

done

yields:
Error! Output exists, but is the wrong geotransform.  Use the 
--overwrite option to automatically overwrite the existing file
Error! Output exists, but is the wrong geotransform.  Use the 
--overwrite option to automatically overwrite the existing file


Any suggestions how to make the output into a 366-band netcdf file?

using on Cygwin: gdalinfo.exe --version GDAL 3.5.1, released 2022/06/30 
Regards /Jonas, Lund University, Sweden
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server

2022-10-20 Thread Andrea Giudiceandrea via gdal-dev


Hi Michael,
the GDAL/OGR library needs the "ogr_MSSQLSpatial.dll" file to properly 
activate the MSSQLSpatial GDAL/OGR driver ("MSSQL:").


You can check if the MSSQLSpatial GDAL/OGR driver is supported by your 
ogr2ogr tool using the following command in the OSGeo4W Shell:


ogr2ogr --formats | find "MSSQL"

If it outputs the string "MSSQLSpatial -vector- (rw+): Microsoft SQL 
Server Spatial Database (BCP)", then it means such driver is supported, 
otherwise not.


If you cannot use the OSGeo4W "Setup" program to install such file, you 
can try to fix the issue just downloading the "gdal-mss" OSGeo4W package 
from [1] and extracting from it the "ogr_MSSQLSpatial.dll" file to the 
"\apps\gdal\lib\gdalplugins\" folder in your QGIS installation dir.
The exact "gdal-mss" OSGeo4W package to download depends on the exact 
GDAL version installed with QGIS.


Best regards.

[1] 
https://download.osgeo.org/osgeo4w/v2/x86_64/release/gdal/gdal-mss/?C=M&O=D



Il 20/10/2022 16:56, Reetz, Michael (NLPV) ha scritto:


I’ve found msodbcsql17.dll in C:\Program Files\QGIS 3.22.8\bin\1033 
and C:\Program Files\QGIS 3.22.8\bin.


Gdal-mss seems not to be on my computer. But since SQL Server Native 
Client isn’t supported by MS SQL Server 2019 , this shouldn’t be a 
Problem.
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server

2022-10-20 Thread Reetz, Michael (NLPV)

Hi Pedro,

I’ve found msodbcsql17.dll in C:\Program Files\QGIS 3.22.8\bin\1033 and 
C:\Program Files\QGIS 3.22.8\bin.
Gdal-mss seems not to be on my computer. But since SQL Server Native Client 
isn’t supported by MS SQL Server 2019 , this shouldn’t be a Problem.

I have only the OSGeo4W Shell shipped installed with QGIS. So, the nice setup 
frontend is missing.

Best regards

Michael

Von: Pedro Venâncio 
Gesendet: Donnerstag, 20. Oktober 2022 16:31
An: Reetz, Michael (NLPV) 
Cc: gdal-dev@lists.osgeo.org
Betreff: Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server


ACHTUNG!! Diese E-Mail erreicht Sie von einem Absender außerhalb der 
niedersächsischen Landesverwaltungs-Infrastruktur mit TLS-Verschlüsselung. 
Bitte klicken Sie auf keine Links oder öffnen Sie keine E-Mail-Anhänge, falls 
Sie den Absender nicht kennen und nicht wissen, ob der Inhalt sicher ist.
Michael,

Check if you have gdal-mss and msodbcsql libs installed, like here: 
https://github.com/PedroVenancio/export_to_sql_server/issues/2#issuecomment-1240675079

Best regards,
Pedro



Reetz, Michael (NLPV) 
mailto:michael.re...@nlpvw.niedersachsen.de>>
 escreveu no dia quinta, 20/10/2022 à(s) 15:13:
Dear members of the GDAL-DEV group,

we are using MS SQL Server 2019 as basis for Geoserver and GIS software. There 
are a lot of tables that have attributes of the types geometry and/or 
geography. I can load these tables into QGIS (3.22.8) projects without any 
problems.

Now I’m asked to add an geography attribute to one table that has already an 
geometry attribute and populate it with coordinates by transforming the 
geometry values. I’ve found code how to do this with ogr2ogr here:

https://social.msdn.microsoft.com/Forums/sqlserver/en-US/335d3f6b-11f4-4e02-8d6d-b49cb59ed98d/using-ogr2ogr-to-reproject-within-a-sql-table?forum=sqlspatial


Since ogr2ogr is part of the OSGeo4W Shell installed with QGIS, I’ve tried to 
run this command there.

ogr2ogr -f "MSSQLSpatial" "MSSQL:server=;driver=ODBC Driver 17 
for SQL Server;database=;trusted_connection=yes;" 
"MSSQL:server=;driver=ODBC Driver 17 for SQL Server;database=;trusted_connection=yes;" -sql "SELECT , 
GEOM.STAsBinary(), WGS84 FROM " -s_srs "EPSG:25832" -t_srs 
"EPSG:4326" -update -lco "GEOM_TYPE=geography" -lco "GEOM_NAME=WGS84" -nln ""

But I receive the error message:

“Unable to open datasource `MSSQL:server=;driver=ODBC Driver 17 
for SQL Server;database=;trusted_connection=yes;' with the 
following drivers. …”

MSSQLSpatial is not listed.


I’ve tried some other commands but all with MSSQL in it leads to an error.

Any idea what I can do to make it run?

Thanks in advance and best regards,

Michael


Mit freundlichen Grüßen
Im Auftrag

Michael Reetz

*
Michael Reetz
Datenbanken und Anwendungsentwicklung
Nationalpark-Verwaltung Niedersächsisches Wattenmeer
Virchowstr. 1 | 26382 Wilhelmshaven
Tel.: +49 (0) 4421 911 291
e-mail: 
michael.re...@nlpvw.niedersachsen.de
Web: 
https://www.nationalpark-wattenmeer.de
[cid:image001.png@01D8E4A4.399CB390]

___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server

2022-10-20 Thread Pedro Venâncio

Michael,

Check if you have gdal-mss and msodbcsql libs installed, like here:
https://github.com/PedroVenancio/export_to_sql_server/issues/2#issuecomment-1240675079

Best regards,
Pedro



Reetz, Michael (NLPV)  escreveu no
dia quinta, 20/10/2022 à(s) 15:13:

> Dear members of the GDAL-DEV group,
>
>
>
> we are using MS SQL Server 2019 as basis for Geoserver and GIS software.
> There are a lot of tables that have attributes of the types geometry and/or
> geography. I can load these tables into QGIS (3.22.8) projects without any
> problems.
>
>
>
> Now I’m asked to add an geography attribute to one table that has already
> an geometry attribute and populate it with coordinates by transforming the
> geometry values. I’ve found code how to do this with ogr2ogr here:
>
>
>
>
> https://social.msdn.microsoft.com/Forums/sqlserver/en-US/335d3f6b-11f4-4e02-8d6d-b49cb59ed98d/using-ogr2ogr-to-reproject-within-a-sql-table?forum=sqlspatial
>
>
>
>
>
> Since ogr2ogr is part of the OSGeo4W Shell installed with QGIS, I’ve tried
> to run this command there.
>
>
>
> ogr2ogr -f "MSSQLSpatial" "MSSQL:server=;driver=ODBC Driver
> 17 for SQL Server;database=;trusted_connection=yes;"
> "MSSQL:server=;driver=ODBC Driver 17 for SQL
> Server;database=;trusted_connection=yes;" -sql "SELECT  attributes>, GEOM.STAsBinary(), WGS84 FROM " -s_srs "EPSG:25832"
> -t_srs "EPSG:4326" -update -lco "GEOM_TYPE=geography" -lco
> "GEOM_NAME=WGS84" -nln ""
>
>
>
> But I receive the error message:
>
>
>
> “Unable to open datasource `MSSQL:server=;driver=ODBC Driver
> 17 for SQL Server;database=;trusted_connection=yes;' with the
> following drivers. …”
>
>
>
> MSSQLSpatial is not listed.
>
>
>
>
>
> I’ve tried some other commands but all with MSSQL in it leads to an error.
>
>
>
> Any idea what I can do to make it run?
>
>
>
> Thanks in advance and best regards,
>
>
>
> Michael
>
>
>
>
>
> Mit freundlichen Grüßen
>
> Im Auftrag
>
>
>
> Michael Reetz
>
>
>
> *
>
> Michael Reetz
>
> Datenbanken und Anwendungsentwicklung
> Nationalpark-Verwaltung Niedersächsisches Wattenmeer
> Virchowstr. 1 | 26382 Wilhelmshaven
> Tel.: +49 (0) 4421 911 291
> e-mail: michael.re...@nlpvw.niedersachsen.de
> 
> Web: https://www.*nationalpark-wattenmeer.de
> *
>
>
> ___
> gdal-dev mailing list
> gdal-dev@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev
>
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

[gdal-dev] ogr2ogr doesn't connect to MS SQL Server

2022-10-20 Thread Reetz, Michael (NLPV)

Dear members of the GDAL-DEV group,

we are using MS SQL Server 2019 as basis for Geoserver and GIS software. There 
are a lot of tables that have attributes of the types geometry and/or 
geography. I can load these tables into QGIS (3.22.8) projects without any 
problems.

Now I'm asked to add an geography attribute to one table that has already an 
geometry attribute and populate it with coordinates by transforming the 
geometry values. I've found code how to do this with ogr2ogr here:

https://social.msdn.microsoft.com/Forums/sqlserver/en-US/335d3f6b-11f4-4e02-8d6d-b49cb59ed98d/using-ogr2ogr-to-reproject-within-a-sql-table?forum=sqlspatial


Since ogr2ogr is part of the OSGeo4W Shell installed with QGIS, I've tried to 
run this command there.

ogr2ogr -f "MSSQLSpatial" "MSSQL:server=;driver=ODBC Driver 17 
for SQL Server;database=;trusted_connection=yes;" 
"MSSQL:server=;driver=ODBC Driver 17 for SQL Server;database=;trusted_connection=yes;" -sql "SELECT , 
GEOM.STAsBinary(), WGS84 FROM " -s_srs "EPSG:25832" -t_srs 
"EPSG:4326" -update -lco "GEOM_TYPE=geography" -lco "GEOM_NAME=WGS84" -nln ""

But I receive the error message:

"Unable to open datasource `MSSQL:server=;driver=ODBC Driver 17 
for SQL Server;database=;trusted_connection=yes;' with the 
following drivers. ..."

MSSQLSpatial is not listed.


I've tried some other commands but all with MSSQL in it leads to an error.

Any idea what I can do to make it run?

Thanks in advance and best regards,

Michael


Mit freundlichen Grüßen
Im Auftrag

Michael Reetz

*
Michael Reetz
Datenbanken und Anwendungsentwicklung
Nationalpark-Verwaltung Niedersächsisches Wattenmeer
Virchowstr. 1 | 26382 Wilhelmshaven
Tel.: +49 (0) 4421 911 291
e-mail: 
michael.re...@nlpvw.niedersachsen.de
Web: https://www.nationalpark-wattenmeer.de
[cid:image001.png@01D8E49E.8F2A2820]

___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

2022-10-20 Thread Rahkonen Jukka

Hi,

There are some performance hints in
https://gdal.org/drivers/vector/sqlite.html#target-drivers-vector-sqlite-performance-hints
but everything in SQLite is stored into one single file that must have a
proper organization all the time and that inevitably sets some limits. Ogr2ogr
is made to use automatically the most obvious tricks for increasing the
performance, like creating a new table first and indexing it afterwards. You
may find other hints from SQLite forums, for example this looks interesting
https://stackoverflow.com/questions/1711631/improve-insert-per-second-performance-of-sqlite
but some tricks like "without_rowid" cannot be used for GeoPackage because the
GeoPackage standard does not allow that.

If would help to evaluate if the speed that you have now is reasonable or not
if you could provide some metrics like inserted features or megabytes per
second.

-Jukka Rahkonen-

Lähettäjä: gdal-dev Puolesta Dennis Burgess
Lähetetty: torstai 20. lokakuuta 2022 15.07
Vastaanottaja: gdal-dev@lists.osgeo.org
Aihe: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

We have a large table in MSSQL, this table we extract data from and drop it
into a GeoPackage for further processing. However, the extraction can take
some time, its only using 5% of the CPU available, and pulling the data is
fairly quick in debug mode, its really its generation and index creation that
is slow. Any tips on speeding this up? We have SSDs and NVME drives, 10gig
networking etc.. So. It should be as quick as it can be, but the 5% CPU is
what I think the killer is. On this server 24 cores, so 5% would be right at
one core.. Is there no multi-threading or other options here?

[LTI-Full_175px]
Dennis Burgess, Mikrotik Certified Trainer
MTCNA, MTCRE, MTCWE, MTCTCE, MTCINE, MTCSE, HE IPv6 Sage, Cambium ePMP Certified
Author of "Learn RouterOS- Second Edition"
Link Technologies, Inc -- Mikrotik & WISP Support Services
Office: 314-735-0270 Website:
http://www.linktechs.net
Need to Automate MikroTik Backups:
https://cloud.linktechs.net
Create Wireless Coverage's with
www.towercoverage.com

___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

2022-10-20 Thread Laurențiu Nicola via gdal-dev

Hi,

https://gdal.org/drivers/vector/gpkg.html#configuration-options has a couple of 
options that can help with performance. See also 
https://gdal.org/drivers/vector/sqlite.html#target-drivers-vector-sqlite-performance-hints.

But I don't recall them helping that much. YMMV.

Regards,
Laurentiu

On Thu, Oct 20, 2022, at 15:06, Dennis Burgess wrote:
> We have a large table in MSSQL, this table we extract data from and drop it 
> into a GeoPackage for further processing.  However, the extraction can take 
> some time, its only using 5% of the CPU available, and pulling the data is 
> fairly quick in debug mode, its really its generation and index creation that 
> is slow.  Any tips on speeding this up?  We have SSDs and NVME drives, 10gig 
> networking etc..  So.  It should be as quick as it can be, but the 5% CPU is 
> what I think the killer is.  On this server 24 cores, so 5% would be right at 
> one core..  Is there no multi-threading or other options here? 
>  
>  
> *LTI-Full_175px*
> *Dennis Burgess, Mikrotik Certified Trainer
> MTCNA, MTCRE, MTCWE, MTCTCE, MTCINE, MTCSE, HE IPv6 Sage, Cambium ePMP 
> Certified*
> Author of "Learn RouterOS- Second Edition”
> *Link Technologies, Inc* -- Mikrotik & WISP Support Services
> *Office*: 314-735-0270  Website: http://www.linktechs.net
> Need to Automate MikroTik Backups:  https://cloud.linktechs.net
> Create Wireless Coverage’s with www.towercoverage.com
>  
> ___
> gdal-dev mailing list
> gdal-dev@lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev
> 
___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

[gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

2022-10-20 Thread Dennis Burgess

We have a large table in MSSQL, this table we extract data from and drop it 
into a GeoPackage for further processing.  However, the extraction can take 
some time, its only using 5% of the CPU available, and pulling the data is 
fairly quick in debug mode, its really its generation and index creation that 
is slow.  Any tips on speeding this up?  We have SSDs and NVME drives, 10gig 
networking etc..  So.  It should be as quick as it can be, but the 5% CPU is 
what I think the killer is.  On this server 24 cores, so 5% would be right at 
one core..  Is there no multi-threading or other options here?


[LTI-Full_175px]
Dennis Burgess, Mikrotik Certified Trainer
MTCNA, MTCRE, MTCWE, MTCTCE, MTCINE, MTCSE, HE IPv6 Sage, Cambium ePMP Certified
Author of "Learn RouterOS- Second Edition"
Link Technologies, Inc -- Mikrotik & WISP Support Services
Office: 314-735-0270  Website: 
http://www.linktechs.net
Need to Automate MikroTik Backups:  https://cloud.linktechs.net
Create Wireless Coverage's with www.towercoverage.com

___
gdal-dev mailing list
gdal-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev

Re: [gdal-dev] ogr SSL errors on ubuntu

Re: [gdal-dev] ogr SSL errors on ubuntu

Re: [gdal-dev] Python API docs

Re: [gdal-dev] Python API docs

[gdal-dev] Python API docs

[gdal-dev] ogr SSL errors on ubuntu

Re: [gdal-dev] gdal_calc output to multiband nedcdf ?

[gdal-dev] gdal_calc output to multiband nedcdf ?

Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server

Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server

Re: [gdal-dev] ogr2ogr doesn't connect to MS SQL Server

[gdal-dev] ogr2ogr doesn't connect to MS SQL Server

Re: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

Re: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

[gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation

15 matches

Site Navigation

Mail list logo

Footer information