Re: [GRASS-dev] A load of updates in OSGeo4W

[Nicklas Larsson via grass-dev]

Jürgen,

Thank you very much for this gigantic task of putting all these pieces together,
I’m sure the Windows users will be delighted!

Best,
Nicklas


> On 15 Apr 2024, at 01:02, Jürgen E. Fischer via grass-dev 
>  wrote:
> 
> Hi there,
> 
> I just uploaded an update to OSGeo4W.   It is basically a rebuild of 
> everything
> with a newer compiler (Visual C++ 2022) and updates of almost all versions.
> The update should work cleanly and cause no visual changes.
> 
> The main change is the move from Python 3.9.18 to 3.12.3.  But there's also an
> update to Qt 5.15.13, OpenSSL 3.   Qt6 was also added enabling an experimental
> build of QGIS master with Qt6. Based on that there is also an experimental
> version of QField.
> 
> GDAL and PROJ also were updated to the latest version.
> 
> The legacy GRASS 7 was removed because it doesn't support Python 3.12.  GRASS 
> 8
> was already available and QGIS switch to it long before this update.
> 
> Please test and report.
> 
> 
> Jürgen
> 
> 
> More details in the commit message:
> 
> A load of updates (fixes #788, #810, #816, #819, #820, #823, closes 
> jef-n/OSGeo4W#21, refs qgis/QGIS#54491, qgis/QGIS#56499)
> 
> Highlights:
>  Switched to Visual Studio 2022
>  Qt6 6.6.3, PyQt6 6.6.1
>  Qt5 5.15.13, PyQt5 5.15.10
>  Python 3.12.3
>  OpenSSL 3.0.13
>  PROJ 9.4.0
>  GDAL 3.8.5
>  qgis-qt6-dev based on Qt6 next to qgis-dev based on Qt5
>  experimental QField based on Qt6 / qgis-qt6-dev
> 
> Details:
>  Removed:
>libjpeg (already replaced with libjpeg-turbo earlier)
>python3-clcache (replaced by ccache)
>python3-pyuv (dependency of python3-clcache)
> 
>  Updated:
>apache 2.4.52 -> 2.4.58
>arrow-cpp 7.0.0 -> 15.0.2
>boost 1.74.0 -> 1.84.0
>brotli 1.0.9 -> 1.1.0
>curl 8.4.0 -> 8.6.0
>draco 1.5.6 -> 1.5.7
>exiv2 0.27.3 -> 0.28.2
>expat 2.2.10 -> 2.6.2
>ffmpeg 5.1 -> 6.1.1
>freetype 2.10.2 -> 2.13.2
>gdal 3.8.4 -> 3.8.5
>gpsbabel 1.8.0 -> 1.9.0
>grass 7.8.8 -> 8.3.2
>grass8 8.3.2 -> 99 (transitional; depends on grass)
>gsl 2.6 -> 2.7.1+
>hdf4 4.2.16 -> 4.3.0
>hdf5 1.14.0 -> 1.14.3
>kealib 1.4.14 -> 1.5.3
>lerc 3.0 -> 4.0.0
>libharu 2.3.0 -> 2.4.4
>libiconv 1.16 -> 1.17
>libjpeg-turbo 2.0.7-esr -> 3.0.2
>libjxl 0.8.1 -> 0.10.2
>libmysql 8.0.21 -> 8.2.0
>libosmium-devel 2.18.0 -> 2.20.0
>libpng 1.6.37 -> 1.6.43
>libtiff 4.5.1 -> 4.6.0
>libxml2 2.9.10 -> 2.12.5
>libxslt 1.1.34 -> 1.1.39
>libzip 1.7.3 -> 1.10.1
>lua 5.4.4 -> 5.4.6
>lz4 1.9.3 -> 1.9.4
>minizip-ng-devel 3.0.2 -> 4.0.4
>node 16.14.0 -> 20.11.1
>oci 19.11 -> 21.13
>ogdi 4.1.0 -> 4.1.1
>opencl 2.0.10 -> 2023.12.14
>openfyba-devel 20150103 -> 20240408
>openjpeg 2.4.0 -> 2.5.2
>openssl 1.1.1w -> 3.0.13
>osm2pgsql 1.8.1 -> 1.11.0
>osmium 1.15.0 -> 1.16.0
>pdal 2.6.0 -> 2.6.3
>poppler 23.07.0 -> 24.04.0
>proj 9.3.1 -> 9.4.0
>proj-data 1.16 -> 1.17
>python3 3.9.18 -> 3.12.3
>protobuf-devel 3.13.0 -> 25.3
>qca 2.3.1 -> 2.3.8
>qscintilla 2.13.4 -> 2.14.1
>qt5 5.15.3 -> 5.15.13
>qtkeychain 0.13.2 -> 0.14.2
>qwc2 20220311-671a6e7 -> 20240408-3d95409
>qwt 6.1.6 -> 6.2.0
>saga 7.8.2 -> 9.3.1
>saga9 9.2.0 -> 99 (transitional; depends on saga)
>snappy-devel 1.1.9 -> 1.1.10
>spdlog-devel 1.10.0 -> 1.13.0
>sqlite3 3.41.1 -> 3.45.1
>swig 4.0.2 -> 4.2.1
>thrift 0.16.0 -> 0.20.0
>transifex-cli 1.6.5 -> 1.6.10
>utf8proc 2.7.0 -> 2.9.0
>wxwidgets 3.2.1 -> 3.2.4
>xerces-c 3.2.3 -> 3.2.5
>xz 5.2.5 -> 5.4.5
>yarnpkg 1.22.17 -> 1.22.21
>zlib 1.2.12 -> 1.3.1
>zstd 1.4.5 -> 1.5.5
> 
>  Updated Python extensions:
>python3-access 1.1.1 -> 1.1.9
>python3-affine 2.3.0 -> 2.4.0
>python3-alabaster 0.7.12 -> 0.7.16
>python3-argon2-cffi 20.1.0 -> 23.1.0
>python3-atomicwrites 1.4.0 -> 1.4.1
>python3-attrdict 2.0.1 -> python3-attrdict3 2.0.2
>python3-attrs 20.2.0 -> 23.2.0
>python3-autopep8 2.0.1 -> 2.1.0
>python3-babel 2.8.0 -> 2.14.0
>python3-backports.entry-points-selectable 1.1.0 -> 1.3.0
>python3-beautifulsoup4 4.9.3 -> 4.12.3
>python3-bleach 3.2.1 -> 6.1.0
>python3-certifi 2020.6.20 -> 2024.2.2
>python3-cffi 1.14.3 -> 1.16.0
>python3-cftime 1.2.1 -> 1.6.3
>python3-chardet 3.0.4 -> 5.2.0
>python3-click 7.1.2 -> 8.1.7
>python3-cligj 0.7.0 -> 0.7.2
>python3-colorama 0.4.4 -> 0.4.6
>python3-coverage 5.3 -> 7.4.4
>python3-cycler 0.10.0 -> 0.12.1
>python3-decorator 4.4.2 -> 5.1.1
>python3-defusedxml 0.6.0 -> 0.7.1
>python3-distlib 0.3.2 -> 0.3.8
>python3-docutils 0.16 -> 0.20.1
>python3-entrypoints 0.3 -> 0.4
>python3-esda 2.3.1 -> 2.5.1
>python3-exifread 2.3.2 -> 3.0.0
>python3-filelock 3.0.12 -> 3.13.3
>python3-fiona 1.9.5 -> 1.9.6
>python3-fonttools 4.28.5 -> 4.51.0
>python3-future 0.18.2 -> 1.0.0
>python3-gdal 3.8.4 -> 3.8.5
>

Re: [GRASS-dev] A load of updates in OSGeo4W

[Jürgen E . Fischer via grass-dev]

Hi Edouard,

On Sun, 14. Apr 2024 at 23:34:39 +, Edouard Choinière wrote:
> That new build also fails, since it looks for Python 3.9 specifically, was
> there a patch that was needed for the official grass osgeo4w build?

No, the patch didn't change, but was moved from grass8/osgeo4w/patch to
grass/osgeo4w/patch.

But OSGeo4W uses mswindows/osgeo4w/package.sh not build_osgeo4w.sh.  So it runs
o4w_env.bat which in turn runs etc/ini/python.bat, which sets PYTHONHOME.


Jürgen

-- 
Jürgen E. Fischer   norBIT GmbH Tel. +49-4931-918175-31
Dipl.-Inf. (FH) Rheinstraße 13  Fax. +49-4931-918175-50
Software Engineer   D-26506 Nordenhttps://www.norbit.de
QGIS release manager (PSC)  Germany IRC: jef on Libera|OFTC


signature.asc
Description: PGP signature
___
grass-dev mailing list
grass-dev@lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/grass-dev

Re: [GRASS-dev] A load of updates in OSGeo4W

[Edouard Choinière via grass-dev]

Thanks a lot for the heads up!
So we’ll now be more strict with Python 3.12 syntax warnings and others. 
Assuring Python 3.12 compatibility was already started, but never officialized. 
(No responses on https://github.com/OSGeo/grass/issues/3285)

However, I launched a CI build for a PR a couple minutes ago, and usually 
installing the OSGeo4W packages takes about 2 minutes, now took 5min15. Is it 
just the server that is slower now? I was tracing with xperf this week the 
build process on windows CI, getting ETW files (1.6 Gb once extracted). I was 
trying to find out what was slow on our side, but noticed that the 2 minutes 
for OSGeo4W package installation wasn’t optimal: not CPU limited, not I/O 
limited, and not memory limited (compared to steps before and after, like 
msys2). I didn’t search more closely though.


That new build also fails, since it looks for Python 3.9 specifically, was 
there a patch that was needed for the official grass osgeo4w build?


Edouard Choinière

Le 14 avr. 2024 à 19:02, Jürgen E. Fischer via grass-dev 
 a écrit :

Hi there,

I just uploaded an update to OSGeo4W.   It is basically a rebuild of everything
with a newer compiler (Visual C++ 2022) and updates of almost all versions.
The update should work cleanly and cause no visual changes.

The main change is the move from Python 3.9.18 to 3.12.3.  But there's also an
update to Qt 5.15.13, OpenSSL 3.   Qt6 was also added enabling an experimental
build of QGIS master with Qt6. Based on that there is also an experimental
version of QField.

GDAL and PROJ also were updated to the latest version.

The legacy GRASS 7 was removed because it doesn't support Python 3.12.  GRASS 8
was already available and QGIS switch to it long before this update.

Please test and report.


Jürgen


More details in the commit message:

A load of updates (fixes #788, #810, #816, #819, #820, #823, closes 
jef-n/OSGeo4W#21, refs qgis/QGIS#54491, qgis/QGIS#56499)

Highlights:
 Switched to Visual Studio 2022
 Qt6 6.6.3, PyQt6 6.6.1
 Qt5 5.15.13, PyQt5 5.15.10
 Python 3.12.3
 OpenSSL 3.0.13
 PROJ 9.4.0
 GDAL 3.8.5
 qgis-qt6-dev based on Qt6 next to qgis-dev based on Qt5
 experimental QField based on Qt6 / qgis-qt6-dev

Details:
 Removed:
   libjpeg (already replaced with libjpeg-turbo earlier)
   python3-clcache (replaced by ccache)
   python3-pyuv (dependency of python3-clcache)

 Updated:
   apache 2.4.52 -> 2.4.58
   arrow-cpp 7.0.0 -> 15.0.2
   boost 1.74.0 -> 1.84.0
   brotli 1.0.9 -> 1.1.0
   curl 8.4.0 -> 8.6.0
   draco 1.5.6 -> 1.5.7
   exiv2 0.27.3 -> 0.28.2
   expat 2.2.10 -> 2.6.2
   ffmpeg 5.1 -> 6.1.1
   freetype 2.10.2 -> 2.13.2
   gdal 3.8.4 -> 3.8.5
   gpsbabel 1.8.0 -> 1.9.0
   grass 7.8.8 -> 8.3.2
   grass8 8.3.2 -> 99 (transitional; depends on grass)
   gsl 2.6 -> 2.7.1+
   hdf4 4.2.16 -> 4.3.0
   hdf5 1.14.0 -> 1.14.3
   kealib 1.4.14 -> 1.5.3
   lerc 3.0 -> 4.0.0
   libharu 2.3.0 -> 2.4.4
   libiconv 1.16 -> 1.17
   libjpeg-turbo 2.0.7-esr -> 3.0.2
   libjxl 0.8.1 -> 0.10.2
   libmysql 8.0.21 -> 8.2.0
   libosmium-devel 2.18.0 -> 2.20.0
   libpng 1.6.37 -> 1.6.43
   libtiff 4.5.1 -> 4.6.0
   libxml2 2.9.10 -> 2.12.5
   libxslt 1.1.34 -> 1.1.39
   libzip 1.7.3 -> 1.10.1
   lua 5.4.4 -> 5.4.6
   lz4 1.9.3 -> 1.9.4
   minizip-ng-devel 3.0.2 -> 4.0.4
   node 16.14.0 -> 20.11.1
   oci 19.11 -> 21.13
   ogdi 4.1.0 -> 4.1.1
   opencl 2.0.10 -> 2023.12.14
   openfyba-devel 20150103 -> 20240408
   openjpeg 2.4.0 -> 2.5.2
   openssl 1.1.1w -> 3.0.13
   osm2pgsql 1.8.1 -> 1.11.0
   osmium 1.15.0 -> 1.16.0
   pdal 2.6.0 -> 2.6.3
   poppler 23.07.0 -> 24.04.0
   proj 9.3.1 -> 9.4.0
   proj-data 1.16 -> 1.17
   python3 3.9.18 -> 3.12.3
   protobuf-devel 3.13.0 -> 25.3
   qca 2.3.1 -> 2.3.8
   qscintilla 2.13.4 -> 2.14.1
   qt5 5.15.3 -> 5.15.13
   qtkeychain 0.13.2 -> 0.14.2
   qwc2 20220311-671a6e7 -> 20240408-3d95409
   qwt 6.1.6 -> 6.2.0
   saga 7.8.2 -> 9.3.1
   saga9 9.2.0 -> 99 (transitional; depends on saga)
   snappy-devel 1.1.9 -> 1.1.10
   spdlog-devel 1.10.0 -> 1.13.0
   sqlite3 3.41.1 -> 3.45.1
   swig 4.0.2 -> 4.2.1
   thrift 0.16.0 -> 0.20.0
   transifex-cli 1.6.5 -> 1.6.10
   utf8proc 2.7.0 -> 2.9.0
   wxwidgets 3.2.1 -> 3.2.4
   xerces-c 3.2.3 -> 3.2.5
   xz 5.2.5 -> 5.4.5
   yarnpkg 1.22.17 -> 1.22.21
   zlib 1.2.12 -> 1.3.1
   zstd 1.4.5 -> 1.5.5

 Updated Python extensions:
   python3-access 1.1.1 -> 1.1.9
   python3-affine 2.3.0 -> 2.4.0
   python3-alabaster 0.7.12 -> 0.7.16
   python3-argon2-cffi 20.1.0 -> 23.1.0
   python3-atomicwrites 1.4.0 -> 1.4.1
   python3-attrdict 2.0.1 -> python3-attrdict3 2.0.2
   python3-attrs 20.2.0 -> 23.2.0
   python3-autopep8 2.0.1 -> 2.1.0
   python3-babel 2.8.0 -> 2.14.0
   python3-backports.entry-points-selectable 1.1.0 -> 1.3.0
   python3-beautifulsoup4 4.9.3 -> 4.12.3
   python3-bleach 3.2.1 -> 6.1.0
   python3-certifi 2020.6.20 -> 2024.2.2
   python3-cffi 1.14.3 -> 1.16.0
   python3-cftime 1.2.1 -> 1.6.3
   python3-chardet 3.0.4 -> 5.2.0
   python3-click 7.1.2 -> 8.1.7
   python3-cligj 

[GRASS-dev] A load of updates in OSGeo4W

[Jürgen E . Fischer via grass-dev]

Hi there,

I just uploaded an update to OSGeo4W.   It is basically a rebuild of everything
with a newer compiler (Visual C++ 2022) and updates of almost all versions.
The update should work cleanly and cause no visual changes.

The main change is the move from Python 3.9.18 to 3.12.3.  But there's also an
update to Qt 5.15.13, OpenSSL 3.   Qt6 was also added enabling an experimental
build of QGIS master with Qt6. Based on that there is also an experimental
version of QField.

GDAL and PROJ also were updated to the latest version.

The legacy GRASS 7 was removed because it doesn't support Python 3.12.  GRASS 8
was already available and QGIS switch to it long before this update.

Please test and report.


Jürgen


More details in the commit message:

A load of updates (fixes #788, #810, #816, #819, #820, #823, closes 
jef-n/OSGeo4W#21, refs qgis/QGIS#54491, qgis/QGIS#56499)

Highlights:
  Switched to Visual Studio 2022
  Qt6 6.6.3, PyQt6 6.6.1
  Qt5 5.15.13, PyQt5 5.15.10
  Python 3.12.3
  OpenSSL 3.0.13
  PROJ 9.4.0
  GDAL 3.8.5
  qgis-qt6-dev based on Qt6 next to qgis-dev based on Qt5
  experimental QField based on Qt6 / qgis-qt6-dev

Details:
  Removed:
libjpeg (already replaced with libjpeg-turbo earlier)
python3-clcache (replaced by ccache)
python3-pyuv (dependency of python3-clcache)

  Updated:
apache 2.4.52 -> 2.4.58
arrow-cpp 7.0.0 -> 15.0.2
boost 1.74.0 -> 1.84.0
brotli 1.0.9 -> 1.1.0
curl 8.4.0 -> 8.6.0
draco 1.5.6 -> 1.5.7
exiv2 0.27.3 -> 0.28.2
expat 2.2.10 -> 2.6.2
ffmpeg 5.1 -> 6.1.1
freetype 2.10.2 -> 2.13.2
gdal 3.8.4 -> 3.8.5
gpsbabel 1.8.0 -> 1.9.0
grass 7.8.8 -> 8.3.2
grass8 8.3.2 -> 99 (transitional; depends on grass)
gsl 2.6 -> 2.7.1+
hdf4 4.2.16 -> 4.3.0
hdf5 1.14.0 -> 1.14.3
kealib 1.4.14 -> 1.5.3
lerc 3.0 -> 4.0.0
libharu 2.3.0 -> 2.4.4
libiconv 1.16 -> 1.17
libjpeg-turbo 2.0.7-esr -> 3.0.2
libjxl 0.8.1 -> 0.10.2
libmysql 8.0.21 -> 8.2.0
libosmium-devel 2.18.0 -> 2.20.0
libpng 1.6.37 -> 1.6.43
libtiff 4.5.1 -> 4.6.0
libxml2 2.9.10 -> 2.12.5
libxslt 1.1.34 -> 1.1.39
libzip 1.7.3 -> 1.10.1
lua 5.4.4 -> 5.4.6
lz4 1.9.3 -> 1.9.4
minizip-ng-devel 3.0.2 -> 4.0.4
node 16.14.0 -> 20.11.1
oci 19.11 -> 21.13
ogdi 4.1.0 -> 4.1.1
opencl 2.0.10 -> 2023.12.14
openfyba-devel 20150103 -> 20240408
openjpeg 2.4.0 -> 2.5.2
openssl 1.1.1w -> 3.0.13
osm2pgsql 1.8.1 -> 1.11.0
osmium 1.15.0 -> 1.16.0
pdal 2.6.0 -> 2.6.3
poppler 23.07.0 -> 24.04.0
proj 9.3.1 -> 9.4.0
proj-data 1.16 -> 1.17
python3 3.9.18 -> 3.12.3
protobuf-devel 3.13.0 -> 25.3
qca 2.3.1 -> 2.3.8
qscintilla 2.13.4 -> 2.14.1
qt5 5.15.3 -> 5.15.13
qtkeychain 0.13.2 -> 0.14.2
qwc2 20220311-671a6e7 -> 20240408-3d95409
qwt 6.1.6 -> 6.2.0
saga 7.8.2 -> 9.3.1
saga9 9.2.0 -> 99 (transitional; depends on saga)
snappy-devel 1.1.9 -> 1.1.10
spdlog-devel 1.10.0 -> 1.13.0
sqlite3 3.41.1 -> 3.45.1
swig 4.0.2 -> 4.2.1
thrift 0.16.0 -> 0.20.0
transifex-cli 1.6.5 -> 1.6.10
utf8proc 2.7.0 -> 2.9.0
wxwidgets 3.2.1 -> 3.2.4
xerces-c 3.2.3 -> 3.2.5
xz 5.2.5 -> 5.4.5
yarnpkg 1.22.17 -> 1.22.21
zlib 1.2.12 -> 1.3.1
zstd 1.4.5 -> 1.5.5

  Updated Python extensions:
python3-access 1.1.1 -> 1.1.9
python3-affine 2.3.0 -> 2.4.0
python3-alabaster 0.7.12 -> 0.7.16
python3-argon2-cffi 20.1.0 -> 23.1.0
python3-atomicwrites 1.4.0 -> 1.4.1
python3-attrdict 2.0.1 -> python3-attrdict3 2.0.2
python3-attrs 20.2.0 -> 23.2.0
python3-autopep8 2.0.1 -> 2.1.0
python3-babel 2.8.0 -> 2.14.0
python3-backports.entry-points-selectable 1.1.0 -> 1.3.0
python3-beautifulsoup4 4.9.3 -> 4.12.3
python3-bleach 3.2.1 -> 6.1.0
python3-certifi 2020.6.20 -> 2024.2.2
python3-cffi 1.14.3 -> 1.16.0
python3-cftime 1.2.1 -> 1.6.3
python3-chardet 3.0.4 -> 5.2.0
python3-click 7.1.2 -> 8.1.7
python3-cligj 0.7.0 -> 0.7.2
python3-colorama 0.4.4 -> 0.4.6
python3-coverage 5.3 -> 7.4.4
python3-cycler 0.10.0 -> 0.12.1
python3-decorator 4.4.2 -> 5.1.1
python3-defusedxml 0.6.0 -> 0.7.1
python3-distlib 0.3.2 -> 0.3.8
python3-docutils 0.16 -> 0.20.1
python3-entrypoints 0.3 -> 0.4
python3-esda 2.3.1 -> 2.5.1
python3-exifread 2.3.2 -> 3.0.0
python3-filelock 3.0.12 -> 3.13.3
python3-fiona 1.9.5 -> 1.9.6
python3-fonttools 4.28.5 -> 4.51.0
python3-future 0.18.2 -> 1.0.0
python3-gdal 3.8.4 -> 3.8.5
python3-geoalchemy2 0.12.5 -> 0.14.7
python3-geographiclib 1.50 -> 2.0
python3-geopandas 0.14.1 -> 0.14.3
python3-giddy 2.3.3 -> 2.3.5
python3-greenlet 1.1.1 -> 3.0.3
python3-h5py 3.8.0 -> 3.10.0
python3-httplib2 0.18.1 -> 0.22.0
python3-idna 2.10 -> 3.6
python3-imagesize 1.2.0 -> 1.4.1
python3-importlib-metadata 2.0.0 -> 7.1.0
python3-inequality 1.0.0 -> 1.0.1