Re: [Qgis-user] A load of updates in OSGeo4W
Hi Pedro, On Mon, 07. Oct 2024 at 20:14:11 +1000, Pedro Camargo via QGIS-User wrote: > I did install using pip. > The fact that QGIS uses custom-compiled binaries could be a complicating > factor, as we compile our binaries against pyArrow. You mean arrow-cpp? That's in OSGeo4W too and GDAL is built against it too. > Are there plans for QGIS to ship with PyArrow and/or to use standard > binaries for it? No, https://github.com/jef-n/OSGeo4W/commit/f87b98ab292595a97b13f98cdd5cb02cd1f2c5a5 Jürgen -- Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-31 Dipl.-Inf. (FH) Rheinstraße 13 Fax. +49-4931-918175-50 Software Engineer D-26506 Nordenhttps://www.norbit.de QGIS release manager (PSC) Germany IRC: jef on Libera|OFTC signature.asc Description: PGP signature ___ QGIS-User mailing list QGIS-User@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] A load of updates in OSGeo4W
Hi Jürgen, I did install using pip. The fact that QGIS uses custom-compiled binaries could be a complicating factor, as we compile our binaries against pyArrow. Are there plans for QGIS to ship with PyArrow and/or to use standard binaries for it? Cheers, Pedro On Mon, Oct 7, 2024 at 5:18 PM Pedro Camargo wrote: > Following up on the issue of updating Python and its dependencies. > > I develop a plugin for Transportation planning/modelling/forecasting > called QAequilibraE, so I am interested in the impact of Python changes on > plugins that have strict dependency requirements, particularly those > compiled against NumPy and PyArrow (trying to narrow the issue here). > > We have recently started having problems with the installation of the > plugin on Windows, where the problem seems to be PyArrow compatibility. > > As far as I can tell, Pyarrow is not installed on the Windows distribution > of QGIS 3.38.3. However, whenever I install it on a user/plugin-specific > path, it starts throwing the error below. > > In that context, I have three questions: > > * Does anyone know what's going on here? Is this an incompatibility with > Arrow binaries (the plugin installs 15.0.2) > * Where do I find the exact list of Python packages installed/shipped in > QGIS so I can track it and keep the plugin and its dependencies updated? > * Does anyone have a suggestion on a better process to keep plugins > up-to-date with QGIS and ensure a more robust experience for users? > > Thanks, > Pedro > ___ QGIS-User mailing list QGIS-User@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] A load of updates in OSGeo4W
Hi Pedro, On Mon, 07. Oct 2024 at 17:18:31 +1000, Pedro Camargo via QGIS-User wrote: > * Does anyone know what's going on here? Is this an incompatibility with > Arrow binaries (the plugin installs 15.0.2) Probably. Did you install pyarrow with pip instead of from osgeo4w? Jürgen [0] https://download.osgeo.org/osgeo4w/v2/x86_64/release/python3/python3-pyarrow/ -- Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-31 Dipl.-Inf. (FH) Rheinstraße 13 Fax. +49-4931-918175-50 Software Engineer D-26506 Nordenhttps://www.norbit.de QGIS release manager (PSC) Germany IRC: jef on Libera|OFTC signature.asc Description: PGP signature ___ QGIS-User mailing list QGIS-User@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] A load of updates in OSGeo4W
Following up on the issue of updating Python and its dependencies. I develop a plugin for Transportation planning/modelling/forecasting called QAequilibraE, so I am interested in the impact of Python changes on plugins that have strict dependency requirements, particularly those compiled against NumPy and PyArrow (trying to narrow the issue here). We have recently started having problems with the installation of the plugin on Windows, where the problem seems to be PyArrow compatibility. As far as I can tell, Pyarrow is not installed on the Windows distribution of QGIS 3.38.3. However, whenever I install it on a user/plugin-specific path, it starts throwing the error below. In that context, I have three questions: * Does anyone know what's going on here? Is this an incompatibility with Arrow binaries (the plugin installs 15.0.2) * Where do I find the exact list of Python packages installed/shipped in QGIS so I can track it and keep the plugin and its dependencies updated? * Does anyone have a suggestion on a better process to keep plugins up-to-date with QGIS and ensure a more robust experience for users? Thanks, Pedro ___ QGIS-User mailing list QGIS-User@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] A load of updates in OSGeo4W
Alister Hood alister.hood at gmail.com Mon Apr 15 21:10:37 PDT 2024 Also, be prepared to wait - it took a long time here to download the updates. Hi Alister, the download speed depends also on the download site chosen: try using a different download site. Best regards. Andrea ___ QGIS-User mailing list QGIS-User@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] A load of updates in OSGeo4W
A tip: use a new qgis profile if you try the new qt6 build. Most plugins do not yet claim compatibility with it, so if you don't use a new profile your plugins will be automatically disabled, then when you reuse the qt5 build you'll need to reenable them all. Also, be prepared to wait - it took a long time here to download the updates. Regards, Alister Date: Mon, 15 Apr 2024 01:02:46 +0200 > From: J?rgen E. Fischer > To: osgeo4w-...@lists.osgeo.org, qgis-user@lists.osgeo.org, > qgis-develo...@lists.osgeo.org, grass-...@lists.osgeo.org > Subject: [Qgis-user] A load of updates in OSGeo4W > Message-ID: <20240414230246.rvykko63wunec...@norbit.de> > Content-Type: text/plain; charset="utf-8" > > Hi there, > > I just uploaded an update to OSGeo4W. It is basically a rebuild of > everything > with a newer compiler (Visual C++ 2022) and updates of almost all versions. > The update should work cleanly and cause no visual changes. > > The main change is the move from Python 3.9.18 to 3.12.3. But there's > also an > update to Qt 5.15.13, OpenSSL 3. Qt6 was also added enabling an > experimental > build of QGIS master with Qt6. Based on that there is also an experimental > version of QField. > > GDAL and PROJ also were updated to the latest version. > > The legacy GRASS 7 was removed because it doesn't support Python 3.12. > GRASS 8 > was already available and QGIS switch to it long before this update. > > Please test and report. > > > J?rgen > > > More details in the commit message: > > A load of updates (fixes #788, #810, #816, #819, #820, #823, closes > jef-n/OSGeo4W#21, refs qgis/QGIS#54491, qgis/QGIS#56499) > > Highlights: > Switched to Visual Studio 2022 > Qt6 6.6.3, PyQt6 6.6.1 > Qt5 5.15.13, PyQt5 5.15.10 > Python 3.12.3 > OpenSSL 3.0.13 > PROJ 9.4.0 > GDAL 3.8.5 > qgis-qt6-dev based on Qt6 next to qgis-dev based on Qt5 > experimental QField based on Qt6 / qgis-qt6-dev > > Details: > Removed: > libjpeg (already replaced with libjpeg-turbo earlier) > python3-clcache (replaced by ccache) > python3-pyuv (dependency of python3-clcache) > > Updated: > apache 2.4.52 -> 2.4.58 > arrow-cpp 7.0.0 -> 15.0.2 > boost 1.74.0 -> 1.84.0 > brotli 1.0.9 -> 1.1.0 > curl 8.4.0 -> 8.6.0 > draco 1.5.6 -> 1.5.7 > exiv2 0.27.3 -> 0.28.2 > expat 2.2.10 -> 2.6.2 > ffmpeg 5.1 -> 6.1.1 > freetype 2.10.2 -> 2.13.2 > gdal 3.8.4 -> 3.8.5 > gpsbabel 1.8.0 -> 1.9.0 > grass 7.8.8 -> 8.3.2 > grass8 8.3.2 -> 99 (transitional; depends on grass) > gsl 2.6 -> 2.7.1+ > hdf4 4.2.16 -> 4.3.0 > hdf5 1.14.0 -> 1.14.3 > kealib 1.4.14 -> 1.5.3 > lerc 3.0 -> 4.0.0 > libharu 2.3.0 -> 2.4.4 > libiconv 1.16 -> 1.17 > libjpeg-turbo 2.0.7-esr -> 3.0.2 > libjxl 0.8.1 -> 0.10.2 > libmysql 8.0.21 -> 8.2.0 > libosmium-devel 2.18.0 -> 2.20.0 > libpng 1.6.37 -> 1.6.43 > libtiff 4.5.1 -> 4.6.0 > libxml2 2.9.10 -> 2.12.5 > libxslt 1.1.34 -> 1.1.39 > libzip 1.7.3 -> 1.10.1 > lua 5.4.4 -> 5.4.6 > lz4 1.9.3 -> 1.9.4 > minizip-ng-devel 3.0.2 -> 4.0.4 > node 16.14.0 -> 20.11.1 > oci 19.11 -> 21.13 > ogdi 4.1.0 -> 4.1.1 > opencl 2.0.10 -> 2023.12.14 > openfyba-devel 20150103 -> 20240408 > openjpeg 2.4.0 -> 2.5.2 > openssl 1.1.1w -> 3.0.13 > osm2pgsql 1.8.1 -> 1.11.0 > osmium 1.15.0 -> 1.16.0 > pdal 2.6.0 -> 2.6.3 > poppler 23.07.0 -> 24.04.0 > proj 9.3.1 -> 9.4.0 > proj-data 1.16 -> 1.17 > python3 3.9.18 -> 3.12.3 > protobuf-devel 3.13.0 -> 25.3 > qca 2.3.1 -> 2.3.8 > qscintilla 2.13.4 -> 2.14.1 > qt5 5.15.3 -> 5.15.13 > qtkeychain 0.13.2 -> 0.14.2 > qwc2 20220311-671a6e7 -> 20240408-3d95409 > qwt 6.1.6 -> 6.2.0 > saga 7.8.2 -> 9.3.1 > saga9 9.2.0 -> 99 (transitional; depends on saga) > snappy-devel 1.1.9 -> 1.1.10 > spdlog-devel 1.10.0 -> 1.13.0 > sqlite3 3.41.1 -> 3.45.1 > swig 4.0.2 -> 4.2.1 > thrift 0.16.0 -> 0.20.0 > transifex-cli 1.6.5 -> 1.6.10 > utf8proc 2.7.0 -> 2.9.0 > wxwidgets 3.2.1 -> 3.2.4 > xerces-c 3.2.3 -> 3.2.5 > xz 5.2.5 -> 5.4.5 > yarnpkg 1.22.17 -> 1.22.21 > zlib 1.2.12 -> 1.3.1 > zstd 1.4.5 -> 1.5.5 > > Updated Python extensions: > python3-access 1.1.1 -> 1.1.9 > python3-affine 2.3.0 -> 2.4.0 >
[Qgis-user] A load of updates in OSGeo4W
Hi there, I just uploaded an update to OSGeo4W. It is basically a rebuild of everything with a newer compiler (Visual C++ 2022) and updates of almost all versions. The update should work cleanly and cause no visual changes. The main change is the move from Python 3.9.18 to 3.12.3. But there's also an update to Qt 5.15.13, OpenSSL 3. Qt6 was also added enabling an experimental build of QGIS master with Qt6. Based on that there is also an experimental version of QField. GDAL and PROJ also were updated to the latest version. The legacy GRASS 7 was removed because it doesn't support Python 3.12. GRASS 8 was already available and QGIS switch to it long before this update. Please test and report. Jürgen More details in the commit message: A load of updates (fixes #788, #810, #816, #819, #820, #823, closes jef-n/OSGeo4W#21, refs qgis/QGIS#54491, qgis/QGIS#56499) Highlights: Switched to Visual Studio 2022 Qt6 6.6.3, PyQt6 6.6.1 Qt5 5.15.13, PyQt5 5.15.10 Python 3.12.3 OpenSSL 3.0.13 PROJ 9.4.0 GDAL 3.8.5 qgis-qt6-dev based on Qt6 next to qgis-dev based on Qt5 experimental QField based on Qt6 / qgis-qt6-dev Details: Removed: libjpeg (already replaced with libjpeg-turbo earlier) python3-clcache (replaced by ccache) python3-pyuv (dependency of python3-clcache) Updated: apache 2.4.52 -> 2.4.58 arrow-cpp 7.0.0 -> 15.0.2 boost 1.74.0 -> 1.84.0 brotli 1.0.9 -> 1.1.0 curl 8.4.0 -> 8.6.0 draco 1.5.6 -> 1.5.7 exiv2 0.27.3 -> 0.28.2 expat 2.2.10 -> 2.6.2 ffmpeg 5.1 -> 6.1.1 freetype 2.10.2 -> 2.13.2 gdal 3.8.4 -> 3.8.5 gpsbabel 1.8.0 -> 1.9.0 grass 7.8.8 -> 8.3.2 grass8 8.3.2 -> 99 (transitional; depends on grass) gsl 2.6 -> 2.7.1+ hdf4 4.2.16 -> 4.3.0 hdf5 1.14.0 -> 1.14.3 kealib 1.4.14 -> 1.5.3 lerc 3.0 -> 4.0.0 libharu 2.3.0 -> 2.4.4 libiconv 1.16 -> 1.17 libjpeg-turbo 2.0.7-esr -> 3.0.2 libjxl 0.8.1 -> 0.10.2 libmysql 8.0.21 -> 8.2.0 libosmium-devel 2.18.0 -> 2.20.0 libpng 1.6.37 -> 1.6.43 libtiff 4.5.1 -> 4.6.0 libxml2 2.9.10 -> 2.12.5 libxslt 1.1.34 -> 1.1.39 libzip 1.7.3 -> 1.10.1 lua 5.4.4 -> 5.4.6 lz4 1.9.3 -> 1.9.4 minizip-ng-devel 3.0.2 -> 4.0.4 node 16.14.0 -> 20.11.1 oci 19.11 -> 21.13 ogdi 4.1.0 -> 4.1.1 opencl 2.0.10 -> 2023.12.14 openfyba-devel 20150103 -> 20240408 openjpeg 2.4.0 -> 2.5.2 openssl 1.1.1w -> 3.0.13 osm2pgsql 1.8.1 -> 1.11.0 osmium 1.15.0 -> 1.16.0 pdal 2.6.0 -> 2.6.3 poppler 23.07.0 -> 24.04.0 proj 9.3.1 -> 9.4.0 proj-data 1.16 -> 1.17 python3 3.9.18 -> 3.12.3 protobuf-devel 3.13.0 -> 25.3 qca 2.3.1 -> 2.3.8 qscintilla 2.13.4 -> 2.14.1 qt5 5.15.3 -> 5.15.13 qtkeychain 0.13.2 -> 0.14.2 qwc2 20220311-671a6e7 -> 20240408-3d95409 qwt 6.1.6 -> 6.2.0 saga 7.8.2 -> 9.3.1 saga9 9.2.0 -> 99 (transitional; depends on saga) snappy-devel 1.1.9 -> 1.1.10 spdlog-devel 1.10.0 -> 1.13.0 sqlite3 3.41.1 -> 3.45.1 swig 4.0.2 -> 4.2.1 thrift 0.16.0 -> 0.20.0 transifex-cli 1.6.5 -> 1.6.10 utf8proc 2.7.0 -> 2.9.0 wxwidgets 3.2.1 -> 3.2.4 xerces-c 3.2.3 -> 3.2.5 xz 5.2.5 -> 5.4.5 yarnpkg 1.22.17 -> 1.22.21 zlib 1.2.12 -> 1.3.1 zstd 1.4.5 -> 1.5.5 Updated Python extensions: python3-access 1.1.1 -> 1.1.9 python3-affine 2.3.0 -> 2.4.0 python3-alabaster 0.7.12 -> 0.7.16 python3-argon2-cffi 20.1.0 -> 23.1.0 python3-atomicwrites 1.4.0 -> 1.4.1 python3-attrdict 2.0.1 -> python3-attrdict3 2.0.2 python3-attrs 20.2.0 -> 23.2.0 python3-autopep8 2.0.1 -> 2.1.0 python3-babel 2.8.0 -> 2.14.0 python3-backports.entry-points-selectable 1.1.0 -> 1.3.0 python3-beautifulsoup4 4.9.3 -> 4.12.3 python3-bleach 3.2.1 -> 6.1.0 python3-certifi 2020.6.20 -> 2024.2.2 python3-cffi 1.14.3 -> 1.16.0 python3-cftime 1.2.1 -> 1.6.3 python3-chardet 3.0.4 -> 5.2.0 python3-click 7.1.2 -> 8.1.7 python3-cligj 0.7.0 -> 0.7.2 python3-colorama 0.4.4 -> 0.4.6 python3-coverage 5.3 -> 7.4.4 python3-cycler 0.10.0 -> 0.12.1 python3-decorator 4.4.2 -> 5.1.1 python3-defusedxml 0.6.0 -> 0.7.1 python3-distlib 0.3.2 -> 0.3.8 python3-docutils 0.16 -> 0.20.1 python3-entrypoints 0.3 -> 0.4 python3-esda 2.3.1 -> 2.5.1 python3-exifread 2.3.2 -> 3.0.0 python3-filelock 3.0.12 -> 3.13.3 python3-fiona 1.9.5 -> 1.9.6 python3-fonttools 4.28.5 -> 4.51.0 python3-future 0.18.2 -> 1.0.0 python3-gdal 3.8.4 -> 3.8.5 python3-geoalchemy2 0.12.5 -> 0.14.7 python3-geographiclib 1.50 -> 2.0 python3-geopandas 0.14.1 -> 0.14.3 python3-giddy 2.3.3 -> 2.3.5 python3-greenlet 1.1.1 -> 3.0.3 python3-h5py 3.8.0 -> 3.10.0 python3-httplib2 0.18.1 -> 0.22.0 python3-idna 2.10 -> 3.6 python3-imagesize 1.2.0 -> 1.4.1 python3-importlib-metadata 2.0.0 -> 7.1.0 python3-inequality 1.0.0 -> 1.0.1