Re: [Qgis-user] Project takes very long to load
Hi Andreas On 28 Apr 2009, at 10:14 AM, Andreas Neumann wrote: Hello, I'd like to inform you that Jürgen provided a fix for the problem, which is now in trunk. Thank you Jürgen! The problem really was the primary key detection, which was checked with every project load and took very long for complex views/tables. Now the pkey check is done with the initial layer loading and stored in the project file. When loading the layer it seems like it first starts the primary key detection with the stored key attribute from the project files and stops searching for further keys after it confirmed that the suggested key works - at least this is how I understand the current behavior in trunk - Jürgen - please correct me if I am wrong. Anyway - the project that previously loaded in 3-4 minutes now loads in approx. 10 seconds. I hope that this can still make it into the 1.1 release, as this is a big problem for people with more complex tables/views. I think we will need to put out a 1.1.1 release to address this since packaging has already started and in some cases the packages are in use via repos etc already. I am happy to do the 1.1.1 release as an immediate follow on from the 1.1.0 release. Juergen is it possible to backport this fix to stable branch too if it is not an invasive change? It sounds like maybe the project file format is getting changed so maybe it is quite invasive? Regards Tim Thanks, Andreas On Fri, April 24, 2009 10:59 am, Paolo Cavallini wrote: Andreas Neumann ha scritto: Here is what I did so far: I saved the project as a different name. So far this did not speed things up. I did a project file comparison in the OxygenXML editor. There are only minor differences, like Very detailed report, thanks a lot Andreas! Hopefully jef will be able to understand what's going on. If I can help with testing, just let me know. All the best. -- Paolo Cavallini: http://www.faunalia.it/pc -- Andreas Neumann http://www.carto.net/neumann/ http://www.svgopen.org/ ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Hello, I'd like to inform you that Jürgen provided a fix for the problem, which is now in trunk. Thank you Jürgen! The problem really was the primary key detection, which was checked with every project load and took very long for complex views/tables. Now the pkey check is done with the initial layer loading and stored in the project file. When loading the layer it seems like it first starts the primary key detection with the stored key attribute from the project files and stops searching for further keys after it confirmed that the suggested key works - at least this is how I understand the current behavior in trunk - Jürgen - please correct me if I am wrong. Anyway - the project that previously loaded in 3-4 minutes now loads in approx. 10 seconds. I hope that this can still make it into the 1.1 release, as this is a big problem for people with more complex tables/views. Thanks, Andreas On Fri, April 24, 2009 10:59 am, Paolo Cavallini wrote: Andreas Neumann ha scritto: Here is what I did so far: I saved the project as a different name. So far this did not speed things up. I did a project file comparison in the OxygenXML editor. There are only minor differences, like Very detailed report, thanks a lot Andreas! Hopefully jef will be able to understand what's going on. If I can help with testing, just let me know. All the best. -- Paolo Cavallini: http://www.faunalia.it/pc -- Andreas Neumann http://www.carto.net/neumann/ http://www.svgopen.org/ ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Juergen, Andreas, Andreas: Did you re-save the project in another name or saved it again? I loaded (waiting... watiting...), saved with a _pan_1.1.qgs suffix, closed and re-openned the project. It still takes _too_ much. But, it might be (also) another issue? This project loads a grass-raster rgb composite (20888276 cell count for _each_ band) and gives in the terminal some Warnings [1]. In any case, I would open the project file in a text/XML editor and make sure that the key='gid' (or similar column name) is present in the datasource element. I just searched in my *_pan_1.1.qgs files and there is not a single key string. Here is an example: datasourcedbname='world' host=localhost port=5432 user='an' sslmode=disable key='gid' table=countries.country_border (the_geom) sql=/datasource Maybe you need to manually introduce the key='somekey' in a text/XML editor. Can you test again and report if this helped? I' ll try first with another very BIG project (mutltiple grass rasters-vectors, shapefiles, styling, etc.). Thanks, Nikos --- [1] Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::setPen: Painter not active Warning: QPainter::setFont: Painter not active Warning: QPainter::end: Painter not active, aborted Warning: QPixmap::scaled: Pixmap is a null pixmap Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::setPen: Painter not active Warning: QPainter::setFont: Painter not active Warning: QPainter::end: Painter not active, aborted Warning: QPixmap::scaled: Pixmap is a null pixmap Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Nikos, As far as I know the improvements only cover Postgis layers - is this correct, Jürgen? Andreas On Tue, April 28, 2009 12:40 pm, Nikos Alexandris wrote: Juergen, Andreas, Andreas: Did you re-save the project in another name or saved it again? I loaded (waiting... watiting...), saved with a _pan_1.1.qgs suffix, closed and re-openned the project. It still takes _too_ much. But, it might be (also) another issue? This project loads a grass-raster rgb composite (20888276 cell count for _each_ band) and gives in the terminal some Warnings [1]. In any case, I would open the project file in a text/XML editor and make sure that the key='gid' (or similar column name) is present in the datasource element. I just searched in my *_pan_1.1.qgs files and there is not a single key string. Here is an example: datasourcedbname='world' host=localhost port=5432 user='an' sslmode=disable key='gid' table=countries.country_border (the_geom) sql=/datasource Maybe you need to manually introduce the key='somekey' in a text/XML editor. Can you test again and report if this helped? I' ll try first with another very BIG project (mutltiple grass rasters-vectors, shapefiles, styling, etc.). Thanks, Nikos --- [1] Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::setPen: Painter not active Warning: QPainter::setFont: Painter not active Warning: QPainter::end: Painter not active, aborted Warning: QPixmap::scaled: Pixmap is a null pixmap Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted Warning: QPainter::end: Painter not active, aborted Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::setPen: Painter not active Warning: QPainter::setFont: Painter not active Warning: QPainter::end: Painter not active, aborted Warning: QPixmap::scaled: Pixmap is a null pixmap Warning: QPainter::begin: Cannot paint on a null pixmap Warning: QPainter::end: Painter not active, aborted -- Andreas Neumann http://www.carto.net/neumann/ http://www.svgopen.org/ ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Hi Andreas, On Tue, 28. Apr 2009 at 13:12:50 +0200, Andreas Neumann wrote: As far as I know the improvements only cover Postgis layers - is this correct, Jürgen? Sure - and there only views. Jürgen -- Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-20 Dipl.-Inf. (FH) Rheinstraße 13Fax. +49-4931-918175-50 Software Engineer D-26506 Norden http://www.norbit.de -- norBIT Gesellschaft fuer Unternehmensberatung und Informationssysteme mbH Rheinstrasse 13, 26506 Norden GF: Jelto Buurman, HR: Amtsgericht Emden, HRB 5502 ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Hi Nikos, Did you re-save the project in another name or saved it again? In any case, I would open the project file in a text/XML editor and make sure that the key='gid' (or similar column name) is present in the datasource element. Here is an example: datasourcedbname='world' host=localhost port=5432 user='an' sslmode=disable key='gid' table=countries.country_border (the_geom) sql=/datasource Maybe you need to manually introduce the key='somekey' in a text/XML editor. Can you test again and report if this helped? Thanks, Andreas On Tue, April 28, 2009 12:08 pm, Nikos Alexandris wrote: Andreas: I'd like to inform you that Jürgen provided a fix for the problem, which is now in trunk. Thank you Jürgen! The problem really was the primary key detection, which was checked with every project load and took very long for complex views/tables. Now the pkey check is done with the initial layer loading and stored in the project file. When loading the layer it seems like it first starts the primary key detection with the stored key attribute from the project files and stops searching for further keys after it confirmed that the suggested key works - at least this is how I understand the current behavior in trunk - Jürgen - please correct me if I am wrong. Anyway - the project that previously loaded in 3-4 minutes now loads in approx. 10 seconds. Hi Andreas, I just recompiled qgis_unstable. Unfortunately for me it doesn't improve load time of old(er) projects. [...] Nikos --- Ubuntu Jaunty 64-bit -- Andreas Neumann http://www.carto.net/neumann/ http://www.svgopen.org/ ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
On Tue, 2009-04-28 at 13:53 +0200, Jürgen E. Fischer wrote: Hi Andreas, On Tue, 28. Apr 2009 at 13:49:00 +0200, Jürgen E. Fischer wrote: Sure - and there only views. See http://trac.osgeo.org/qgis/changeset/10657 for the change itself and http://trac.osgeo.org/qgis/ticket/1535#comment:6 for some discussion. Jürgen My apologies for the traffic! My bad. Kindest regards, Nikos ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Hi Nikos, On Tue, 28. Apr 2009 at 12:08:52 +0200, Nikos Alexandris wrote: I just recompiled qgis_unstable. Unfortunately for me it doesn't improve load time of old(er) projects. You need to save the project after updating. Jürgen -- Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-20 Dipl.-Inf. (FH) Rheinstraße 13Fax. +49-4931-918175-50 Software Engineer D-26506 Norden http://www.norbit.de -- norBIT Gesellschaft fuer Unternehmensberatung und Informationssysteme mbH Rheinstrasse 13, 26506 Norden GF: Jelto Buurman, HR: Amtsgericht Emden, HRB 5502 ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Hi Andreas, On Tue, 28. Apr 2009 at 13:49:00 +0200, Jürgen E. Fischer wrote: Sure - and there only views. See http://trac.osgeo.org/qgis/changeset/10657 for the change itself and http://trac.osgeo.org/qgis/ticket/1535#comment:6 for some discussion. Jürgen -- Jürgen E. Fischer norBIT GmbH Tel. +49-4931-918175-20 Dipl.-Inf. (FH) Rheinstraße 13Fax. +49-4931-918175-50 Software Engineer D-26506 Norden http://www.norbit.de -- norBIT Gesellschaft fuer Unternehmensberatung und Informationssysteme mbH Rheinstrasse 13, 26506 Norden GF: Jelto Buurman, HR: Amtsgericht Emden, HRB 5502 ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Andreas Neumann ha scritto: I hope that we can find a solution - because in case I want to do a presentation of QGIS I cannot afford to wait 3-4 minutes for the project to start up. Also, I was planning to use this project as a quick viewing and printing solution. If I cannot get it to load in 10-30 seconds I won't get acceptance from my work colleagues. I wrote a few suggestions in an earlier mail: did you check? Please do and report the results. Thanks. -- Paolo Cavallini: http://www.faunalia.it/pc ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] Project takes very long to load
Andreas Neumann ha scritto: Here is what I did so far: I saved the project as a different name. So far this did not speed things up. I did a project file comparison in the OxygenXML editor. There are only minor differences, like Very detailed report, thanks a lot Andreas! Hopefully jef will be able to understand what's going on. If I can help with testing, just let me know. All the best. -- Paolo Cavallini: http://www.faunalia.it/pc ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
[Qgis-user] Project takes very long to load
Hi, I have a QGIS project (current trunk (1.1)) which takes 3-4 minutes for loading. There is no indication of what QGIS is doing during this time. This is on recent hardware (tested on Linux and Windows (behaves the same)). The project has 25 layers to load (point, line and polygon). All data loads from Postgis. Once the project is loaded it works very fast and snappy. Means that I'm quite happy with QGIS performance, except for loading this project. I hoped that the project loading would be somewhere around 20-30 seconds. 3-4 minutes is way too long I think. Is there something that I (as the project author) or you as QGIS-developers could do about the slow project loading? If you want the project for testing, I can try to make it available to developers (through my own webserver). I would have to transfer the database (or I could make the database available for testing purposes). Andreas -- Andreas Neumann http://www.carto.net/neumann/ http://www.svgopen.org/ ___ Qgis-user mailing list Qgis-user@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/qgis-user
