Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Hi Sunil, We capture asset data for a local council. There are 27 tables in the database representing each asset category. We have times when the demand for the import is higher eg at the end of the calendar year and at the end of the financial year. When it is busy, we can be adding 2-3000 assets per week. Some of the tables already contain 45 000+ assets. We have no alternatives to software. IT won’t allow it. Johanna Botman Assets / GIS Officer – Melton City Council From: se_su...@rediffmail.com [mailto:se_su...@rediffmail.com] Sent: Wednesday, 6 May 2020 7:35 PM To: Johanna Botman Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ Hi! Can you please share the purpose and process for that you are using QGIS and SQL Server (Multi user). So that I can suggest you another alternate for the same purpose which is fast as well as easy to operate for multi users. Thanks Sunil On Tue, 05 May 2020 12:35:42 +0530 Johanna Botman wrote > Hi, I have a situation where there are three of us using QGIS v3.4 connecting to a Microsoft 2016 SQL Server to add and edit items to tables in the same database at the same time. And I’m growing old waiting for things to happen. When we were all in the office, we connected through the work network to the databases in the cloud and suffered some issues with delay that may be caused by internet speed. Now that we are all working from home, we have the added complexity of connecting to our home Wi-Fi then a VPN to the office before we then go out to the cloud. But now the bottom line is that no more than one user at a time can edit the tables. Responses are painfully slow and by mid-afternoon, QGIS is completely unresponsive. Users love to blame the software. That’s what they are interacting with, but I don’t believe that it is all QGIS’ problem. I’d prefer to blame a database that appears to not respond well to a multi user environment. Does anyone have any ideas, or strategies, to troubleshoot? Johanna Botman Assets / GIS Officer – Melton City Council *** > The information in this message is privileged and confidential, intended only for the use of the individual or entity named above. If you are not the intended recipient you are hereby notified to delete the message and that any dissemination, copying or use of its content is strictly prohibited. If you have received this message in error please notify the Melton City Council. > *** > ___ Qgis-user mailing list Qgis-user@lists.osgeo.org<mailto:Qgis-user@lists.osgeo.org> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user *** The information in this message is privileged and confidential, intended only for the use of the individual or entity named above. If you are not the intended recipient you are hereby notified to delete the message and that any dissemination, copying or use of its content is strictly prohibited. If you have received this message in error please notify the Melton City Council. *** ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Hey Johanna We have a similar setup and QGIS has been running okay to my knowledge though it is slower than being in the office. One option you could ask your IT dept to setup a virtual machine (Citrix etc) with QGIS installed. This would place your machine within your network and keep all your data transactions low latency. I have been running QGIS and FME from our enterprise application servers to achieve the same effect while working from home. Luke On Wed, May 6, 2020 at 4:37 PM Nyall Dawson wrote: > On Wed, 6 May 2020 at 16:33, Johanna Botman > wrote: > > > > Hi Nyall, > > > > Yes, I have restarted QGIS. I have even restarted the laptop. > > BTW I am using QGIS 3.4 as are my colleagues. We are trying to get our > IT folk to upgrade us to 3.10 but are not having any luck with that. > > In that case it's almost certainly NOT a QGIS issue. > > I would test direct modification of the database through another > utility (such as the SQL server management console) to confirm that > the slowness is a database issue. > > Nyall > > > > > > > > > > Johanna Botman > > > > Assets / GIS Officer – Melton City Council > > > > > > > > > > -Original Message- > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > Sent: Wednesday, 6 May 2020 4:31 PM > > To: Johanna Botman > > Cc: chris hermansen ; qgis-user@lists.osgeo.org > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > On Wed, 6 May 2020 at 16:05, Johanna Botman > wrote: > > > > > > Just to confirm that I have been working all afternoon with all my > plugins uninstalled. This has made no difference to the issue. > > > > Have you tried restarting QGIS when you hit this slowness issue? If so, > do you experience the slowness immediately after restarting? > > > > Nyall > > > > > > > > > > > > > > Johanna Botman > > > > > > Assets / GIS Officer – Melton City Council > > > > > > > > > > > > -Original Message- > > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > > Sent: Wednesday, 6 May 2020 2:34 PM > > > To: Johanna Botman > > > Cc: chris hermansen ; qgis-user@lists.osgeo.org > > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > > > On Wed, 6 May 2020 at 14:31, Johanna Botman < > johan...@melton.vic.gov.au> wrote: > > > > > > > > Hi Nyall, > > > > > > > > I've had good support ideas from you before so I knew that I untick > all plugins before I asked for more assistance. Sadly, it has not made any > difference. Did you mean to uninstall them all? I could try that. > > > > > > Yes, there is a chance that a plugin which is disabled but still > installed **could** cause an issue (although unlikely). A clean profile > would be the easiest way to test this, and QGIS makes it easy to flick > between profiles so you can quickly switch back to your regular profile > after testing. > > > > > > Nyall > > > > > > > > > > > And, to clarify, each user has their own machine, their own > installation of QGIS and their own version of the Project file all pointing > at the one database with all the tables. It does look like a network or > database issue as I thought. > > > > > > > > Thank you. > > > > > > > > > > > > > > > > Johanna Botman > > > > > > > > Assets / GIS Officer – Melton City Council > > > > > > > > > > > > > > > > -Original Message- > > > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > > > Sent: Wednesday, 6 May 2020 2:25 PM > > > > To: Johanna Botman > > > > Cc: chris hermansen ; > > > > qgis-user@lists.osgeo.org > > > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > > > > > On Wed, 6 May 2020 at 08:19, Johanna Botman < > johan...@melton.vic.gov.au> wrote: > > > > > > > > > What I do know is that the refresh – or my ability to edit and > save data - in the attribute table slows down when multiple users are > editing the same table. And I know that this behaviour has become worse now > that we are all working from home and have the added ‘hops’ in the network > created by our home Wi-Fi and VPN. > > > > > > > > Unless you do have multiple users sharing a single machine (e.g. via > remote de
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Hi Johanna, Unfortunately I can't help you explain the gradual slow down during a longer edit session. But I do have experience with databases (not SQL Server but PostgreSQL) in a network and my recommendation is to always have QGIS in the same network than the database. Having the database in the cloud and QGIS in the LAN of your organization with a slow network link in between will result in bad performance due to network latency. In the long run, I would try to either bring the database to the same LAN within your organization to avoid network latency, or alternatively run QGIS desktop in the same network/cloud where your database is located. There are still functions in QGIS where certain database operations are processed one feature at a time and network latency makes this much worse. The developers are though trying to eliminate such feature by feature processing in favour of processing whole batches at once, which improves the situation with slow network connections. If, for some reason you need the same database in two different locations, then I would introduce two database installations local to the respective networks and use replication in between to keep the data in sync. This reduces the network latency issues significantly. Andreas Am 05.05.20 um 08:51 schrieb Johanna Botman: Hi, I have a situation where there are three of us using QGIS v3.4 connecting to a Microsoft 2016 SQL Server to add and edit items to tables in the same database at the same time. And I’m growing old waiting for things to happen. When we were all in the office, we connected through the work network to the databases in the cloud and suffered some issues with delay that may be caused by internet speed. Now that we are all working from home, we have the added complexity of connecting to our home Wi-Fi then a VPN to the office before we then go out to the cloud. But now the bottom line is that no more than one user at a time can edit the tables. Responses are painfully slow and by mid-afternoon, QGIS is completely unresponsive. Users love to blame the software. That’s what they are interacting with, but I don’t believe that it is all QGIS’ problem. I’d prefer to blame a database that appears to not respond well to a multi user environment. Does anyone have any ideas, or strategies, to troubleshoot? ** ** *Johanna Botman* Assets / GIS Officer – Melton City Council *** The information in this message is privileged and confidential, intended only for the use of the individual or entity named above. If you are not the intended recipient you are hereby notified to delete the message and that any dissemination, copying or use of its content is strictly prohibited. If you have received this message in error please notify the Melton City Council. *** ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
On Wed, 6 May 2020 at 16:33, Johanna Botman wrote: > > Hi Nyall, > > Yes, I have restarted QGIS. I have even restarted the laptop. > BTW I am using QGIS 3.4 as are my colleagues. We are trying to get our IT > folk to upgrade us to 3.10 but are not having any luck with that. In that case it's almost certainly NOT a QGIS issue. I would test direct modification of the database through another utility (such as the SQL server management console) to confirm that the slowness is a database issue. Nyall > > > > Johanna Botman > > Assets / GIS Officer – Melton City Council > > > > > -Original Message- > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > Sent: Wednesday, 6 May 2020 4:31 PM > To: Johanna Botman > Cc: chris hermansen ; qgis-user@lists.osgeo.org > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > On Wed, 6 May 2020 at 16:05, Johanna Botman > wrote: > > > > Just to confirm that I have been working all afternoon with all my plugins > > uninstalled. This has made no difference to the issue. > > Have you tried restarting QGIS when you hit this slowness issue? If so, do > you experience the slowness immediately after restarting? > > Nyall > > > > > > > > > Johanna Botman > > > > Assets / GIS Officer – Melton City Council > > > > > > > > -Original Message- > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > Sent: Wednesday, 6 May 2020 2:34 PM > > To: Johanna Botman > > Cc: chris hermansen ; qgis-user@lists.osgeo.org > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > On Wed, 6 May 2020 at 14:31, Johanna Botman > > wrote: > > > > > > Hi Nyall, > > > > > > I've had good support ideas from you before so I knew that I untick all > > > plugins before I asked for more assistance. Sadly, it has not made any > > > difference. Did you mean to uninstall them all? I could try that. > > > > Yes, there is a chance that a plugin which is disabled but still installed > > **could** cause an issue (although unlikely). A clean profile would be the > > easiest way to test this, and QGIS makes it easy to flick between profiles > > so you can quickly switch back to your regular profile after testing. > > > > Nyall > > > > > > > > And, to clarify, each user has their own machine, their own installation > > > of QGIS and their own version of the Project file all pointing at the one > > > database with all the tables. It does look like a network or database > > > issue as I thought. > > > > > > Thank you. > > > > > > > > > > > > Johanna Botman > > > > > > Assets / GIS Officer – Melton City Council > > > > > > > > > > > > -Original Message- > > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > > Sent: Wednesday, 6 May 2020 2:25 PM > > > To: Johanna Botman > > > Cc: chris hermansen ; > > > qgis-user@lists.osgeo.org > > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > > > On Wed, 6 May 2020 at 08:19, Johanna Botman > > > wrote: > > > > > > > What I do know is that the refresh – or my ability to edit and save > > > > data - in the attribute table slows down when multiple users are > > > > editing the same table. And I know that this behaviour has become worse > > > > now that we are all working from home and have the added ‘hops’ in the > > > > network created by our home Wi-Fi and VPN. > > > > > > Unless you do have multiple users sharing a single machine (e.g. via > > > remote desktop or similar), then this is almost certainly a database or > > > network issue*. If everyone is running distinct QGIS sessions on > > > different machines then it's highly unlikely that you'd also see the same > > > issues arise at the same time of day. > > > > > > * Unless it's a plugin related issue. I'm aware of some plugins which are > > > badly written and cause gradual slow-downs over the course of a single > > > QGIS session. So possibly if you ALL had a bad plugin installed and ALL > > > started a fresh QGIS session at the start of the day then you may > > > experience simultaneous slow downs in the afternoon. The fix for this > > > would be starting a clean profile with no plugins installed and testing. > > > > > > Nyall > > > &
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Hi Nyall, Yes, I have restarted QGIS. I have even restarted the laptop. BTW I am using QGIS 3.4 as are my colleagues. We are trying to get our IT folk to upgrade us to 3.10 but are not having any luck with that. Johanna Botman Assets / GIS Officer – Melton City Council -Original Message- From: Nyall Dawson [mailto:nyall.daw...@gmail.com] Sent: Wednesday, 6 May 2020 4:31 PM To: Johanna Botman Cc: chris hermansen ; qgis-user@lists.osgeo.org Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ On Wed, 6 May 2020 at 16:05, Johanna Botman wrote: > > Just to confirm that I have been working all afternoon with all my plugins > uninstalled. This has made no difference to the issue. Have you tried restarting QGIS when you hit this slowness issue? If so, do you experience the slowness immediately after restarting? Nyall > > > > Johanna Botman > > Assets / GIS Officer – Melton City Council > > > > -Original Message- > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > Sent: Wednesday, 6 May 2020 2:34 PM > To: Johanna Botman > Cc: chris hermansen ; qgis-user@lists.osgeo.org > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > On Wed, 6 May 2020 at 14:31, Johanna Botman > wrote: > > > > Hi Nyall, > > > > I've had good support ideas from you before so I knew that I untick all > > plugins before I asked for more assistance. Sadly, it has not made any > > difference. Did you mean to uninstall them all? I could try that. > > Yes, there is a chance that a plugin which is disabled but still installed > **could** cause an issue (although unlikely). A clean profile would be the > easiest way to test this, and QGIS makes it easy to flick between profiles so > you can quickly switch back to your regular profile after testing. > > Nyall > > > > > And, to clarify, each user has their own machine, their own installation of > > QGIS and their own version of the Project file all pointing at the one > > database with all the tables. It does look like a network or database issue > > as I thought. > > > > Thank you. > > > > > > > > Johanna Botman > > > > Assets / GIS Officer – Melton City Council > > > > > > > > -Original Message- > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > Sent: Wednesday, 6 May 2020 2:25 PM > > To: Johanna Botman > > Cc: chris hermansen ; > > qgis-user@lists.osgeo.org > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > On Wed, 6 May 2020 at 08:19, Johanna Botman > > wrote: > > > > > What I do know is that the refresh – or my ability to edit and save data > > > - in the attribute table slows down when multiple users are editing the > > > same table. And I know that this behaviour has become worse now that we > > > are all working from home and have the added ‘hops’ in the network > > > created by our home Wi-Fi and VPN. > > > > Unless you do have multiple users sharing a single machine (e.g. via remote > > desktop or similar), then this is almost certainly a database or network > > issue*. If everyone is running distinct QGIS sessions on different machines > > then it's highly unlikely that you'd also see the same issues arise at the > > same time of day. > > > > * Unless it's a plugin related issue. I'm aware of some plugins which are > > badly written and cause gradual slow-downs over the course of a single QGIS > > session. So possibly if you ALL had a bad plugin installed and ALL started > > a fresh QGIS session at the start of the day then you may experience > > simultaneous slow downs in the afternoon. The fix for this would be > > starting a clean profile with no plugins installed and testing. > > > > Nyall > > > > > > > > > > > > > > > > > > Our workaround today will be to try to make sure that only one person is > > > in a particular table at a time. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Johanna, I'm struggling to understand your configuration here. > > > > > > > > > > > > Are you working via some kind of remote desktop software? It sounds like > > > it. > > > > > > > > > > > > What is your theory as to why response time is worse in the afternoon? Is > > > your connection to your office being overloaded? Is your office's > > > connection to the cloud database also being overloa
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
On Wed, 6 May 2020 at 16:05, Johanna Botman wrote: > > Just to confirm that I have been working all afternoon with all my plugins > uninstalled. This has made no difference to the issue. Have you tried restarting QGIS when you hit this slowness issue? If so, do you experience the slowness immediately after restarting? Nyall > > > > Johanna Botman > > Assets / GIS Officer – Melton City Council > > > > -Original Message- > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > Sent: Wednesday, 6 May 2020 2:34 PM > To: Johanna Botman > Cc: chris hermansen ; qgis-user@lists.osgeo.org > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > On Wed, 6 May 2020 at 14:31, Johanna Botman > wrote: > > > > Hi Nyall, > > > > I've had good support ideas from you before so I knew that I untick all > > plugins before I asked for more assistance. Sadly, it has not made any > > difference. Did you mean to uninstall them all? I could try that. > > Yes, there is a chance that a plugin which is disabled but still installed > **could** cause an issue (although unlikely). A clean profile would be the > easiest way to test this, and QGIS makes it easy to flick between profiles so > you can quickly switch back to your regular profile after testing. > > Nyall > > > > > And, to clarify, each user has their own machine, their own installation of > > QGIS and their own version of the Project file all pointing at the one > > database with all the tables. It does look like a network or database issue > > as I thought. > > > > Thank you. > > > > > > > > Johanna Botman > > > > Assets / GIS Officer – Melton City Council > > > > > > > > -----Original Message----- > > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > > Sent: Wednesday, 6 May 2020 2:25 PM > > To: Johanna Botman > > Cc: chris hermansen ; qgis-user@lists.osgeo.org > > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > > > On Wed, 6 May 2020 at 08:19, Johanna Botman > > wrote: > > > > > What I do know is that the refresh – or my ability to edit and save data > > > - in the attribute table slows down when multiple users are editing the > > > same table. And I know that this behaviour has become worse now that we > > > are all working from home and have the added ‘hops’ in the network > > > created by our home Wi-Fi and VPN. > > > > Unless you do have multiple users sharing a single machine (e.g. via remote > > desktop or similar), then this is almost certainly a database or network > > issue*. If everyone is running distinct QGIS sessions on different machines > > then it's highly unlikely that you'd also see the same issues arise at the > > same time of day. > > > > * Unless it's a plugin related issue. I'm aware of some plugins which are > > badly written and cause gradual slow-downs over the course of a single QGIS > > session. So possibly if you ALL had a bad plugin installed and ALL started > > a fresh QGIS session at the start of the day then you may experience > > simultaneous slow downs in the afternoon. The fix for this would be > > starting a clean profile with no plugins installed and testing. > > > > Nyall > > > > > > > > > > > > > > > > > > Our workaround today will be to try to make sure that only one person is > > > in a particular table at a time. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Johanna, I'm struggling to understand your configuration here. > > > > > > > > > > > > Are you working via some kind of remote desktop software? It sounds like > > > it. > > > > > > > > > > > > What is your theory as to why response time is worse in the afternoon? Is > > > your connection to your office being overloaded? Is your office's > > > connection to the cloud database also being overloaded? Do your IT > > > support people have any thoughts on why response is worse in the > > > afternoon? > > > > > > > > > > > > The reason I'm keying on this is that one possibility is that your > > > network infrastructure is slightly insufficient for the morning load and > > > completely insufficient for the afternoon load. > > > > > > > > > > > > On the contrary, if your database is starved of resources, why is it > > >
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Just to confirm that I have been working all afternoon with all my plugins uninstalled. This has made no difference to the issue. Johanna Botman Assets / GIS Officer – Melton City Council -Original Message- From: Nyall Dawson [mailto:nyall.daw...@gmail.com] Sent: Wednesday, 6 May 2020 2:34 PM To: Johanna Botman Cc: chris hermansen ; qgis-user@lists.osgeo.org Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ On Wed, 6 May 2020 at 14:31, Johanna Botman wrote: > > Hi Nyall, > > I've had good support ideas from you before so I knew that I untick all > plugins before I asked for more assistance. Sadly, it has not made any > difference. Did you mean to uninstall them all? I could try that. Yes, there is a chance that a plugin which is disabled but still installed **could** cause an issue (although unlikely). A clean profile would be the easiest way to test this, and QGIS makes it easy to flick between profiles so you can quickly switch back to your regular profile after testing. Nyall > > And, to clarify, each user has their own machine, their own installation of > QGIS and their own version of the Project file all pointing at the one > database with all the tables. It does look like a network or database issue > as I thought. > > Thank you. > > > > Johanna Botman > > Assets / GIS Officer – Melton City Council > > > > -Original Message- > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > Sent: Wednesday, 6 May 2020 2:25 PM > To: Johanna Botman > Cc: chris hermansen ; qgis-user@lists.osgeo.org > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > On Wed, 6 May 2020 at 08:19, Johanna Botman > wrote: > > > What I do know is that the refresh – or my ability to edit and save data - > > in the attribute table slows down when multiple users are editing the same > > table. And I know that this behaviour has become worse now that we are all > > working from home and have the added ‘hops’ in the network created by our > > home Wi-Fi and VPN. > > Unless you do have multiple users sharing a single machine (e.g. via remote > desktop or similar), then this is almost certainly a database or network > issue*. If everyone is running distinct QGIS sessions on different machines > then it's highly unlikely that you'd also see the same issues arise at the > same time of day. > > * Unless it's a plugin related issue. I'm aware of some plugins which are > badly written and cause gradual slow-downs over the course of a single QGIS > session. So possibly if you ALL had a bad plugin installed and ALL started a > fresh QGIS session at the start of the day then you may experience > simultaneous slow downs in the afternoon. The fix for this would be starting > a clean profile with no plugins installed and testing. > > Nyall > > > > > > > > > > > Our workaround today will be to try to make sure that only one person is in > > a particular table at a time. > > > > > > > > > > > > > > > > > > > > Johanna, I'm struggling to understand your configuration here. > > > > > > > > Are you working via some kind of remote desktop software? It sounds like it. > > > > > > > > What is your theory as to why response time is worse in the afternoon? Is > > your connection to your office being overloaded? Is your office's > > connection to the cloud database also being overloaded? Do your IT support > > people have any thoughts on why response is worse in the afternoon? > > > > > > > > The reason I'm keying on this is that one possibility is that your network > > infrastructure is slightly insufficient for the morning load and completely > > insufficient for the afternoon load. > > > > > > > > On the contrary, if your database is starved of resources, why is it worse > > now than when you were working from the office? Again your IT people should > > be able to look at log info or otherwise instrument your server to find out > > if it's the problem (having suggested this I admit I wouldn't use SQL > > Server and know nothing about tuning it). > > > > > > > > Can you run a different configuration, say with QGIS on your home computer > > and some kind of database proxy in your office, or even a direct connection > > to the cloud database (assuming I've guessed your configuration correctly)? > > > > > > > > Users love to blame the software. That’s what they are interacting with, > > but I don’t believe that it is all QGIS’ problem. I’d prefer to blame a > > database th
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Hi Nyall, I've had good support ideas from you before so I knew that I untick all plugins before I asked for more assistance. Sadly, it has not made any difference. Did you mean to uninstall them all? I could try that. And, to clarify, each user has their own machine, their own installation of QGIS and their own version of the Project file all pointing at the one database with all the tables. It does look like a network or database issue as I thought. Thank you. Johanna Botman Assets / GIS Officer – Melton City Council -Original Message- From: Nyall Dawson [mailto:nyall.daw...@gmail.com] Sent: Wednesday, 6 May 2020 2:25 PM To: Johanna Botman Cc: chris hermansen ; qgis-user@lists.osgeo.org Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ On Wed, 6 May 2020 at 08:19, Johanna Botman wrote: > What I do know is that the refresh – or my ability to edit and save data - in > the attribute table slows down when multiple users are editing the same > table. And I know that this behaviour has become worse now that we are all > working from home and have the added ‘hops’ in the network created by our > home Wi-Fi and VPN. Unless you do have multiple users sharing a single machine (e.g. via remote desktop or similar), then this is almost certainly a database or network issue*. If everyone is running distinct QGIS sessions on different machines then it's highly unlikely that you'd also see the same issues arise at the same time of day. * Unless it's a plugin related issue. I'm aware of some plugins which are badly written and cause gradual slow-downs over the course of a single QGIS session. So possibly if you ALL had a bad plugin installed and ALL started a fresh QGIS session at the start of the day then you may experience simultaneous slow downs in the afternoon. The fix for this would be starting a clean profile with no plugins installed and testing. Nyall > > > > Our workaround today will be to try to make sure that only one person is in a > particular table at a time. > > > > > > > > > > Johanna, I'm struggling to understand your configuration here. > > > > Are you working via some kind of remote desktop software? It sounds like it. > > > > What is your theory as to why response time is worse in the afternoon? Is > your connection to your office being overloaded? Is your office's connection > to the cloud database also being overloaded? Do your IT support people have > any thoughts on why response is worse in the afternoon? > > > > The reason I'm keying on this is that one possibility is that your network > infrastructure is slightly insufficient for the morning load and completely > insufficient for the afternoon load. > > > > On the contrary, if your database is starved of resources, why is it worse > now than when you were working from the office? Again your IT people should > be able to look at log info or otherwise instrument your server to find out > if it's the problem (having suggested this I admit I wouldn't use SQL Server > and know nothing about tuning it). > > > > Can you run a different configuration, say with QGIS on your home computer > and some kind of database proxy in your office, or even a direct connection > to the cloud database (assuming I've guessed your configuration correctly)? > > > > Users love to blame the software. That’s what they are interacting with, but > I don’t believe that it is all QGIS’ problem. I’d prefer to blame a database > that appears to not respond well to a multi user environment. > > > > I'd be inclined to blame the network first, since that's what it sounds like > has changed. > > > > Chris > > > ** > * The information in this message is privileged and > confidential, intended only for the use of the individual or entity named > above. If you are not the intended recipient you are hereby notified to > delete the message and that any dissemination, copying or use of its content > is strictly prohibited. If you have received this message in error please > notify the Melton City Council. > ** > * ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user *** The information in this message is privileged and confidential, intended only for the use of the individual or entity named above. If you
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
On Wed, 6 May 2020 at 14:31, Johanna Botman wrote: > > Hi Nyall, > > I've had good support ideas from you before so I knew that I untick all > plugins before I asked for more assistance. Sadly, it has not made any > difference. Did you mean to uninstall them all? I could try that. Yes, there is a chance that a plugin which is disabled but still installed **could** cause an issue (although unlikely). A clean profile would be the easiest way to test this, and QGIS makes it easy to flick between profiles so you can quickly switch back to your regular profile after testing. Nyall > > And, to clarify, each user has their own machine, their own installation of > QGIS and their own version of the Project file all pointing at the one > database with all the tables. It does look like a network or database issue > as I thought. > > Thank you. > > > > Johanna Botman > > Assets / GIS Officer – Melton City Council > > > > -Original Message- > From: Nyall Dawson [mailto:nyall.daw...@gmail.com] > Sent: Wednesday, 6 May 2020 2:25 PM > To: Johanna Botman > Cc: chris hermansen ; qgis-user@lists.osgeo.org > Subject: Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+ > > On Wed, 6 May 2020 at 08:19, Johanna Botman > wrote: > > > What I do know is that the refresh – or my ability to edit and save data - > > in the attribute table slows down when multiple users are editing the same > > table. And I know that this behaviour has become worse now that we are all > > working from home and have the added ‘hops’ in the network created by our > > home Wi-Fi and VPN. > > Unless you do have multiple users sharing a single machine (e.g. via remote > desktop or similar), then this is almost certainly a database or network > issue*. If everyone is running distinct QGIS sessions on different machines > then it's highly unlikely that you'd also see the same issues arise at the > same time of day. > > * Unless it's a plugin related issue. I'm aware of some plugins which are > badly written and cause gradual slow-downs over the course of a single QGIS > session. So possibly if you ALL had a bad plugin installed and ALL started a > fresh QGIS session at the start of the day then you may experience > simultaneous slow downs in the afternoon. The fix for this would be starting > a clean profile with no plugins installed and testing. > > Nyall > > > > > > > > > > > Our workaround today will be to try to make sure that only one person is in > > a particular table at a time. > > > > > > > > > > > > > > > > > > > > Johanna, I'm struggling to understand your configuration here. > > > > > > > > Are you working via some kind of remote desktop software? It sounds like it. > > > > > > > > What is your theory as to why response time is worse in the afternoon? Is > > your connection to your office being overloaded? Is your office's > > connection to the cloud database also being overloaded? Do your IT support > > people have any thoughts on why response is worse in the afternoon? > > > > > > > > The reason I'm keying on this is that one possibility is that your network > > infrastructure is slightly insufficient for the morning load and completely > > insufficient for the afternoon load. > > > > > > > > On the contrary, if your database is starved of resources, why is it worse > > now than when you were working from the office? Again your IT people should > > be able to look at log info or otherwise instrument your server to find out > > if it's the problem (having suggested this I admit I wouldn't use SQL > > Server and know nothing about tuning it). > > > > > > > > Can you run a different configuration, say with QGIS on your home computer > > and some kind of database proxy in your office, or even a direct connection > > to the cloud database (assuming I've guessed your configuration correctly)? > > > > > > > > Users love to blame the software. That’s what they are interacting with, > > but I don’t believe that it is all QGIS’ problem. I’d prefer to blame a > > database that appears to not respond well to a multi user environment. > > > > > > > > I'd be inclined to blame the network first, since that's what it sounds > > like has changed. > > > > > > > > Chris > > > > > > ** > > * The information in this message is privileged and > > confidential, int
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
On Wed, 6 May 2020 at 08:19, Johanna Botman wrote: > What I do know is that the refresh – or my ability to edit and save data - in > the attribute table slows down when multiple users are editing the same > table. And I know that this behaviour has become worse now that we are all > working from home and have the added ‘hops’ in the network created by our > home Wi-Fi and VPN. Unless you do have multiple users sharing a single machine (e.g. via remote desktop or similar), then this is almost certainly a database or network issue*. If everyone is running distinct QGIS sessions on different machines then it's highly unlikely that you'd also see the same issues arise at the same time of day. * Unless it's a plugin related issue. I'm aware of some plugins which are badly written and cause gradual slow-downs over the course of a single QGIS session. So possibly if you ALL had a bad plugin installed and ALL started a fresh QGIS session at the start of the day then you may experience simultaneous slow downs in the afternoon. The fix for this would be starting a clean profile with no plugins installed and testing. Nyall > > > > Our workaround today will be to try to make sure that only one person is in a > particular table at a time. > > > > > > > > > > Johanna, I'm struggling to understand your configuration here. > > > > Are you working via some kind of remote desktop software? It sounds like it. > > > > What is your theory as to why response time is worse in the afternoon? Is > your connection to your office being overloaded? Is your office's connection > to the cloud database also being overloaded? Do your IT support people have > any thoughts on why response is worse in the afternoon? > > > > The reason I'm keying on this is that one possibility is that your network > infrastructure is slightly insufficient for the morning load and completely > insufficient for the afternoon load. > > > > On the contrary, if your database is starved of resources, why is it worse > now than when you were working from the office? Again your IT people should > be able to look at log info or otherwise instrument your server to find out > if it's the problem (having suggested this I admit I wouldn't use SQL Server > and know nothing about tuning it). > > > > Can you run a different configuration, say with QGIS on your home computer > and some kind of database proxy in your office, or even a direct connection > to the cloud database (assuming I've guessed your configuration correctly)? > > > > Users love to blame the software. That’s what they are interacting with, but > I don’t believe that it is all QGIS’ problem. I’d prefer to blame a database > that appears to not respond well to a multi user environment. > > > > I'd be inclined to blame the network first, since that's what it sounds like > has changed. > > > > Chris > > > *** > The information in this message is privileged and confidential, intended only > for the use of the individual or entity named above. If you are not the > intended recipient you are hereby notified to delete the message and that any > dissemination, copying or use of its content is strictly prohibited. If you > have received this message in error please notify the Melton City Council. > *** > ___ > Qgis-user mailing list > Qgis-user@lists.osgeo.org > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user > Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
Hi Chris, Thanks for your reply. I don’t have any transparency on the config of our network so I can’t answer that. It is possible that my frustration peaks in the afternoon and it is possible that is a red herring. Each user has a similar project that contains tables in a SQL database. We need to add and edit items in these tables but struggle when more than one person is editing in the same table. What I do know is that the refresh – or my ability to edit and save data - in the attribute table slows down when multiple users are editing the same table. And I know that this behaviour has become worse now that we are all working from home and have the added ‘hops’ in the network created by our home Wi-Fi and VPN. Our workaround today will be to try to make sure that only one person is in a particular table at a time. Johanna, I'm struggling to understand your configuration here. Are you working via some kind of remote desktop software? It sounds like it. What is your theory as to why response time is worse in the afternoon? Is your connection to your office being overloaded? Is your office's connection to the cloud database also being overloaded? Do your IT support people have any thoughts on why response is worse in the afternoon? The reason I'm keying on this is that one possibility is that your network infrastructure is slightly insufficient for the morning load and completely insufficient for the afternoon load. On the contrary, if your database is starved of resources, why is it worse now than when you were working from the office? Again your IT people should be able to look at log info or otherwise instrument your server to find out if it's the problem (having suggested this I admit I wouldn't use SQL Server and know nothing about tuning it). Can you run a different configuration, say with QGIS on your home computer and some kind of database proxy in your office, or even a direct connection to the cloud database (assuming I've guessed your configuration correctly)? Users love to blame the software. That’s what they are interacting with, but I don’t believe that it is all QGIS’ problem. I’d prefer to blame a database that appears to not respond well to a multi user environment. I'd be inclined to blame the network first, since that's what it sounds like has changed. Chris *** The information in this message is privileged and confidential, intended only for the use of the individual or entity named above. If you are not the intended recipient you are hereby notified to delete the message and that any dissemination, copying or use of its content is strictly prohibited. If you have received this message in error please notify the Melton City Council. *** ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
Re: [Qgis-user] MS SQL Server, multi users and QGIS v3+
On Tue, May 5, 2020, 00:06 Johanna Botman wrote: > Hi, > > > > I have a situation where there are three of us using QGIS v3.4 connecting > to a Microsoft 2016 SQL Server to add and edit items to tables in the same > database at the same time. And I’m growing old waiting for things to happen. > > > > When we were all in the office, we connected through the work network to > the databases in the cloud and suffered some issues with delay that may be > caused by internet speed. Now that we are all working from home, we have > the added complexity of connecting to our home Wi-Fi then a VPN to the > office before we then go out to the cloud. > > > > But now the bottom line is that no more than one user at a time can edit > the tables. Responses are painfully slow and by mid-afternoon, QGIS is > completely unresponsive. > Johanna, I'm struggling to understand your configuration here. Are you working via some kind of remote desktop software? It sounds like it. What is your theory as to why response time is worse in the afternoon? Is your connection to your office being overloaded? Is your office's connection to the cloud database also being overloaded? Do your IT support people have any thoughts on why response is worse in the afternoon? The reason I'm keying on this is that one possibility is that your network infrastructure is slightly insufficient for the morning load and completely insufficient for the afternoon load. On the contrary, if your database is starved of resources, why is it worse now than when you were working from the office? Again your IT people should be able to look at log info or otherwise instrument your server to find out if it's the problem (having suggested this I admit I wouldn't use SQL Server and know nothing about tuning it). Can you run a different configuration, say with QGIS on your home computer and some kind of database proxy in your office, or even a direct connection to the cloud database (assuming I've guessed your configuration correctly)? > > > Users love to blame the software. That’s what they are interacting with, > but I don’t believe that it is all QGIS’ problem. I’d prefer to blame a > database that appears to not respond well to a multi user environment. > I'd be inclined to blame the network first, since that's what it sounds like has changed. > > Chris ___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
[Qgis-user] MS SQL Server, multi users and QGIS v3+
Hi, I have a situation where there are three of us using QGIS v3.4 connecting to a Microsoft 2016 SQL Server to add and edit items to tables in the same database at the same time. And I'm growing old waiting for things to happen. When we were all in the office, we connected through the work network to the databases in the cloud and suffered some issues with delay that may be caused by internet speed. Now that we are all working from home, we have the added complexity of connecting to our home Wi-Fi then a VPN to the office before we then go out to the cloud. But now the bottom line is that no more than one user at a time can edit the tables. Responses are painfully slow and by mid-afternoon, QGIS is completely unresponsive. Users love to blame the software. That's what they are interacting with, but I don't believe that it is all QGIS' problem. I'd prefer to blame a database that appears to not respond well to a multi user environment. Does anyone have any ideas, or strategies, to troubleshoot? Johanna Botman Assets / GIS Officer - Melton City Council *** The information in this message is privileged and confidential, intended only for the use of the individual or entity named above. If you are not the intended recipient you are hereby notified to delete the message and that any dissemination, copying or use of its content is strictly prohibited. If you have received this message in error please notify the Melton City Council. ***___ Qgis-user mailing list Qgis-user@lists.osgeo.org List info: https://lists.osgeo.org/mailman/listinfo/qgis-user Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
