Re: [QGIS-Developer] [Qgis-developer] [Server] performance questions

Hi Régis, Is this work, about "Speed up project loading by skipping data checks. Useful in qgis server context or project with huge database views or materialized view.", still relevant ? https://github.com/pblottiere/QGIS/tree/trust Regards, René-Luc Le 15/02/2017 à 18:48, Régis Haubourg

Re: [Qgis-developer] [Server] performance questions

Hi, Thanks for this work. I heard in a recent PR that Richard Duivenvoorde is struggling with big PostgreSQL datasets (see [1] ) [1] https://github.com/qgis/QGIS-Enhancement-Proposals/issues/79#issuecomment-279628851 Michaël 2017-02-16 11:04 GMT+01:00 Luca Manganelli : > >

Re: [Qgis-developer] [Server] performance questions

On Wed, Feb 15, 2017 at 6:48 PM, Régis Haubourg wrote: > So Paul introduced an option to avoid unecessary checks on startup called > "Trust project when datasource has no metadata (id, extent, geometry type). > His branch is here

Re: [Qgis-developer] [Server] performance questions

Hi all, reviving the thread - Oslandia had the opportunity to work on speed up improvements. So Paul introduced an option to avoid unecessary checks on startup called "Trust project when datasource has no metadata (id, extent, geometry type). His branch is here

Re: [Qgis-developer] [Server] performance questions

Hello Andreas, I did forward the question to our internal development, returned some answers for clarity: Am 22.04.2016 um 16:45 schrieb Neumann, Andreas: > Hi Jörg, > > Unfortunately I am not the suitable person to ask. In only occasionally > develop Python and don't know C/C++. However, I am

Re: [Qgis-developer] [Server] performance questions

Am 23.04.2016 um 11:47 schrieb Matthias Kuhn: > Hi Jörg, > > On 22/04/16 18:24, Jörg Habenicht wrote: >> Hi Matthias, >> [snip] >> It seems to me I have to extract the code inside the loop (in >> QgsMapRenderer::render(), "while ( li.hasPrevious() )") into a separate >> method and call

Re: [Qgis-developer] [Server] performance questions

Hi Jörg, On 22/04/16 18:24, Jörg Habenicht wrote: Hi Matthias, Am 22.04.2016 um 17:20 schrieb Matthias Kuhn: Hi, I don't know the server code very well, so I may be wrong, but I think that making the server multithreaded rendering (MTR) capable should be possible. And while it is certainly

Re: [Qgis-developer] [Server] performance questions

Hello Marco. Am 22.04.2016 um 17:44 schrieb Marco Hugentobler: > Hi > > Yes, rendering multithreaded in the server is possible (but needs some > work of course). > > What I said was that the effect is probably not that big, because the > fcgi module already distributes concurrent requests to

Re: [Qgis-developer] [Server] performance questions

Hi Matthias, Am 22.04.2016 um 17:20 schrieb Matthias Kuhn: > Hi, > > I don't know the server code very well, so I may be wrong, but I think > that making the server multithreaded rendering (MTR) capable should be > possible. And while it is certainly often possible to increase the > performance

Re: [Qgis-developer] [Server] performance questions

Hi Yes, rendering multithreaded in the server is possible (but needs some work of course). What I said was that the effect is probably not that big, because the fcgi module already distributes concurrent requests to different processes. In the special case of very rare requests to the

Re: [Qgis-developer] [Server] performance questions

Hi Jörg, Unfortunately I am not the suitable person to ask. In only occasionally develop Python and don't know C/C++. However, I am a long-time QGIS server user. I have big projects as well (with 80/90 layers). They usually render in 1-2 seconds, not 20 seconds like you cite. So maybe there are

Re: [Qgis-developer] [Server] performance questions

Hi Andreas, dear list, sorry for the warm up of this old topic. There is in deed a need to enable multi threading in Qgis-Server. In our company we use around 60 different layer to lay some topics on the map. This may be an extreme example to read, but quite common in our environment, i.e. we

Re: [Qgis-developer] [Server] performance questions

Hi Marco, 2016-02-29 8:40 GMT+01:00 Marco Hugentobler : > > Hi all > > This is not a server specific problem. It is that QGIS may need a long > time to get metadata for some layers. So the best solution is (as it has > been proposed already in this thread) to

Re: [Qgis-developer] [Server] performance questions

Hi all This is not a server specific problem. It is that QGIS may need a long time to get metadata for some layers. So the best solution is (as it has been proposed already in this thread) to enhance QGIS to store the metadata (in the project file) and not read it from the db the first time.

Re: [Qgis-developer] [Server] performance questions

Hi all, I have made some comparison on requests done when QGIS Server is called for a simple GetMap, on the first initialization and aftewards when the cache is found. Here are the logs When QGIS builds the maplayer object, ie when there is no cache for this layer yet (first call, for example

Re: [Qgis-developer] [Server] performance questions

Hi Alessandro, On 23.02.2016 17:22, Alessandro Pasotti wrote: Yes, but Andreas probably meant that plugin support is still compiled into the server. yes - if you compile yourself, you can disable it in the CMAKE settings. Still, we never measured any noticeable performance issue with

Re: [Qgis-developer] [Server] performance questions

On Tuesday, February 23, 2016 17:11:33 Alessandro Pasotti wrote: > Mapserver takes extent from mapfile, not from > data. that's not really true, it depends if extent exist in mapfile or not and data format in input. If it doesn't exist in mapfile, mapserver will look at the data but such things

Re: [Qgis-developer] [Server] performance questions

On Tuesday, February 23, 2016 19:18:37 Alessandro Pasotti wrote: > 2016-02-23 19:06 GMT+01:00 Yves Jacolin : > > On Tuesday, February 23, 2016 17:11:33 Alessandro Pasotti wrote: > > > Mapserver takes extent from mapfile, not from > > > data. > > > > that's not really true, it

Re: [Qgis-developer] [Server] performance questions

2016-02-23 19:06 GMT+01:00 Yves Jacolin : > On Tuesday, February 23, 2016 17:11:33 Alessandro Pasotti wrote: > > Mapserver takes extent from mapfile, not from > > data. > that's not really true, it depends if extent exist in mapfile or not and > data > format in input. If it

Re: [Qgis-developer] [Server] performance questions

2016-02-23 17:23 GMT+01:00 Régis Haubourg < regis.haubo...@eau-adour-garonne.fr>: > Alessandro Pasotti-2 wrote > > Yes, but Andreas probably meant that plugin support is still compiled > into > > the server. > > > > Still, we never measured any noticeable performance issue with plugins > >

Re: [Qgis-developer] [Server] performance questions

Alessandro Pasotti-2 wrote > Yes, but Andreas probably meant that plugin support is still compiled into > the server. > > Still, we never measured any noticeable performance issue with plugins > enabled (as long as thre aren't any of course, otherwise it will obviously > depend on what the

Re: [Qgis-developer] [Server] performance questions

Alessandro Pasotti-2 wrote > You should definitely add a feature request. Done here: http://hub.qgis.org/issues/14364 Cheers If someone interested in working on that, please contact me. Cheers Régis -- View this message in context:

Re: [Qgis-developer] [Server] performance questions

Neumann, Andreas wrote > did you switch of QGIS server python plugins? If you don't need them, I > recommend you switch them off - both for security reasons, but also > there was a huge performance problem with QGIS server Python plugins > just recently. See http://hub.qgis.org/issues/13919 -

Re: [Qgis-developer] [Server] performance questions

2016-02-23 16:55 GMT+01:00 Régis Haubourg < regis.haubo...@eau-adour-garonne.fr>: > Alessandro Pasotti-2 wrote > > The answer from strk makes sense to me, I might be wrong but calculating > > estimated metadata on a query doesn't make much sense to me. > > Oh, I read too fast Strk's comment.

Re: [Qgis-developer] [Server] performance questions

Andrea Peri wrote > To avoid also all these questions we use the spatialite db that is fast > like a shapefile toopen and have no the problem of connection and break > of connection like the postgres. Good to know, thanks. unfortunately, my current use case is not compatible with data

Re: [Qgis-developer] [Server] performance questions

Alessandro Pasotti-2 wrote > The answer from strk makes sense to me, I might be wrong but calculating > estimated metadata on a query doesn't make much sense to me. Oh, I read too fast Strk's comment. Sorry for that. I won't explore that dead end no more. Another idea, maybe autodiscovering

Re: [Qgis-developer] [Server] performance questions

Hi Regis, The shapefile is obviously more fast in opne than a postgres connection. Is due to the different need of resources. The postgres need to assign a lot of resources for every connection that it is opening. I do't know quite well the pgpool solution, but I guess it cannot helpyou

Re: [Qgis-developer] [Server] performance questions

2016-02-23 16:29 GMT+01:00 Régis Haubourg < regis.haubo...@eau-adour-garonne.fr>: > Alessandro Pasotti-2 wrote > > > > Hi, > > > > For your point 2, is this bug related to your issue > > http://hub.qgis.org/issues/13232 ? > > > > -- > > Alessandro Pasotti > > w3: www.itopen.it > > Hi

Re: [Qgis-developer] [Server] performance questions

Alessandro Pasotti-2 wrote > > Hi, > > For your point 2, is this bug related to your issue > http://hub.qgis.org/issues/13232 ? > > -- > Alessandro Pasotti > w3: www.itopen.it Hi Alessandro, probably not, we do not have inherited tables and we have autovacuum activated. St_estimated_extent

Re: [Qgis-developer] [Server] performance questions

Hi Régis, QGIS server is single-threaded. You can't simply turn on multi-threaded rendering in QGIS server. The other issue is that each Apache FCGI process has it's own set of cache. So if you have 5-10 parallel Apache threads or processes each thread/process has it's own cache. If your client

Re: [Qgis-developer] [Server] performance questions

Andrea Peri wrote > I Guess the time difference between the qgis desktop and qgis-server > when using a postgres, > > is due to the protocol. > Infact the http is a connection-less session-less protocoll, > so after every map the qgis-server disconnect from postgres. > > Instead when you work on

Re: [Qgis-developer] [Server] performance questions

2016-02-23 15:20 GMT+01:00 Régis Haubourg < regis.haubo...@eau-adour-garonne.fr>: > Hi all, > we are working on using qgis server here and we face some performance > issues > on big data sets. Cache is not an option for those layers that will be > edited by users. Currently performances are not

Re: [Qgis-developer] [Server] performance questions

I Guess the time difference between the qgis desktop and qgis-server when using a postgres, is due to the protocol. Infact the http is a connection-less session-less protocoll, so after every map the qgis-server disconnect from postgres. Instead when you work on a qgis desktop as a user on its

[Qgis-developer] [Server] performance questions

Hi all, we are working on using qgis server here and we face some performance issues on big data sets. Cache is not an option for those layers that will be edited by users. Currently performances are not acceptable for production uses. Here is a couple of questions that I could not answer by