RE: database connection lost

2022-12-20 Thread Gary Dixon

Thanks all

I just checked and mysql wait timeout is set to 28800
The strange thing is we take mysqldumps every 15 minutes - but we see the db 
connection only gets lost around every 7 and half hours apart not every 15 
minutes.
 I am going to set the mysql wait_timeout to 3600 as suggested in the last post 
in the article that Wei posted https://github.com/apache/cloudstack/issues/4657


Subject: Re: database connection lost

Hi Gary,

We had the same problem and increasing the wait timeout solved it.



Gary Dixon
Senior Technical Consultant
T:  +44 161 537 4990
E:  v...@quadris-support.com
W: www.quadris.co.uk
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.

From: Gary Dixon 
Sent: Tuesday, December 20, 2022, 9:31 AM
To: users@cloudstack.apache.org 
Subject: RE: database connection lost

Thanks Wei

Yes we are seeing the exact same errors in the cs mgmt. logs - we will set the 
MySQL global wait timeout to a higher value and see if it resolves our issue



What's the error message ?
There was a github issue may help you:
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fcloudstack%2Fissues%2F4657=05%7C01%7CGary.Dixon%40quadris.co.uk%7C605bb13402834b9e42bd08dae297f382%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C638071439517503224%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=XUINQ77haPeXi7%2BsRx%2BZvnT2OGxmqh0LIpLaB4y7wOM%3D=0

-Wei


On Tuesday, 20 December 2022, Gary Dixon 
wrote:

> Hi Vivek
>
> We are using the --single-transaction flag and --skip-lock-tables flag
> Could there be something other than mysqldumps causing the cs mgmt.
> server to be losing the connection to the database ?
>
>
> BR
>
> Gary
>
>
> Hello,
>
> You can use --single-transaction
> Option while taking the dump or you can schedule to take dump from a
> slave server if you have.
>
> Regards,
> Vivek Kumar
>
> Gary Dixon​
> Senior Technical Consultant
> T: +44 161 537 4990
> E: *v* <+44%207989717661>ms@quadris‑support.com
> W:
> https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.q
> %2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7C605bb13402834b9e42bd08
> dae297f382%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63807143951765
> 9442%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBT
> iI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=lxW6c1uPtRfxmKZxhu6Jmg
> PJOlnC0hhKOOuMhIM3zO8%3D=0
> uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e
> 4149de9c5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63
> 8071430711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=ClDbnphfgf
> WJtD37XnVSa2U1n6EQOtTVYBYbUBCsAJc%3D=0
> The information contained in this e-mail from Quadris may be
> confidential and privileged for the private use of the named
> recipient. The contents of this e-mail may not necessarily represent the 
> official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents. Please
> destroy any hard copies and delete this message.
>
Gary Dixon​
Senior Technical Consultant
T:  +44 161 537 4990
E:  vms@quadris‑support.com
W: 
https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.quadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7C605bb13402834b9e42bd08dae297f382%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C638071439517659442%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=trP%2BLqxu6N08d0Yu600pNE3y2y1Wuv0pb44t2n%2BTf6E%3D=0
[cid:image011498.png@FB84B645.38DDA861]
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.
On Tue, Dec 20, 2022, 7:25 PM Gary Dixon  invalid>
> wrote:
>
> > Hi all
> >
> >
> >
> > CS v4.15.2
> >
> > Hypervisor = KVM
> >
> >
> >
> > We have started to experience an issue on a frequent basis where the
> > CS mgmt. service is losing the connection to the databa

Re: database connection lost

2022-12-20 Thread Ricardo Pertuz
Hi Gary,

We had the same problem and increasing the wait timeout solved it.



From: Gary Dixon 
Sent: Tuesday, December 20, 2022, 9:31 AM
To: users@cloudstack.apache.org 
Subject: RE: database connection lost

Thanks Wei

Yes we are seeing the exact same errors in the cs mgmt. logs - we will set the 
MySQL global wait timeout to a higher value and see if it resolves our issue



What's the error message ?
There was a github issue may help you:
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fcloudstack%2Fissues%2F4657=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e4149de9c5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C638071430711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=u%2BEUWskmwM4y%2FA4%2FEwmJOBEOsdr0ZtYKcmz2Z5X9OGg%3D=0

-Wei


On Tuesday, 20 December 2022, Gary Dixon 
wrote:

> Hi Vivek
>
> We are using the --single-transaction flag and --skip-lock-tables flag
> Could there be something other than mysqldumps causing the cs mgmt.
> server to be losing the connection to the database ?
>
>
> BR
>
> Gary
>
>
> Hello,
>
> You can use --single-transaction
> Option while taking the dump or you can schedule to take dump from a
> slave server if you have.
>
> Regards,
> Vivek Kumar
>
> Gary Dixon​
> Senior Technical Consultant
> T: +44 161 537 4990
> E: *v* <+44%207989717661>ms@quadris‑support.com
> W:
> https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.q
> uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e
> 4149de9c5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63
> 8071430711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=ClDbnphfgf
> WJtD37XnVSa2U1n6EQOtTVYBYbUBCsAJc%3D=0
> The information contained in this e-mail from Quadris may be
> confidential and privileged for the private use of the named
> recipient. The contents of this e-mail may not necessarily represent the 
> official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents. Please
> destroy any hard copies and delete this message.
>
Gary Dixon​
Senior Technical Consultant
T:  +44 161 537 4990
E:  vms@quadris‑support.com
W: www.quadris.co.uk
[cid:image011498.png@FB84B645.38DDA861]
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.
On Tue, Dec 20, 2022, 7:25 PM Gary Dixon  invalid>
> wrote:
>
> > Hi all
> >
> >
> >
> > CS v4.15.2
> >
> > Hypervisor = KVM
> >
> >
> >
> > We have started to experience an issue on a frequent basis where the
> > CS mgmt. service is losing the connection to the database and
> > believe it is being caused by mysqldumps locking the tables.
> >
> > Looking at the db.properties file there are tuning parameters :
> >
> > # CloudStack database tuning parameters
> >
> > db.cloud.maxActive=250
> >
> > db.cloud.maxIdle=30
> >
> > db.cloud.maxWait=1
> >
> > db.cloud.validationQuery=SELECT 1
> >
> > db.cloud.testOnBorrow=true
> >
> > db.cloud.testWhileIdle=true
> >
> > db.cloud.timeBetweenEvictionRunsMillis=4
> >
> > db.cloud.minEvictableIdleTimeMillis=24
> >
> > db.cloud.poolPreparedStatements=false
> >
> >
> > db.cloud.url.params=prepStmtCacheSize=517=true
> > nV
> > ariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,
> > ER
> > ROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC
> >
> >
> >
> > would changing the ‘maxwait’ value to a higher value stop the mgmt.
> > service losing the db connection whilst dumps are taken ?
> >
> > BR
> >
> >
> >
> > Gary
> >
> >
> >
> >
> > Gary Dixon​
> > Senior Technical Consultant
> > T: +44 161 537 4990
> > E: *v* <+44%207989717661>ms@quadris‑support.com
> > W:
> > https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww
> > .q%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e4149de9c
> > 5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63807143
> > 0711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi

RE: database connection lost

2022-12-20 Thread Gary Dixon
Thanks Wei

Yes we are seeing the exact same errors in the cs mgmt. logs - we will set the 
MySQL global wait timeout to a higher value and see if it resolves our issue



What's the error message ?
There was a github issue may help you:
https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fcloudstack%2Fissues%2F4657=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e4149de9c5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C638071430711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=u%2BEUWskmwM4y%2FA4%2FEwmJOBEOsdr0ZtYKcmz2Z5X9OGg%3D=0

-Wei


On Tuesday, 20 December 2022, Gary Dixon 
wrote:

> Hi Vivek
>
> We are using the --single-transaction flag and --skip-lock-tables flag
> Could there be something other than mysqldumps causing the cs mgmt.
> server to be losing the connection to the database ?
>
>
> BR
>
> Gary
>
>
> Hello,
>
> You can use --single-transaction
> Option while taking the dump or you can schedule to take dump from a
> slave server if you have.
>
> Regards,
> Vivek Kumar
>
> Gary Dixon​
> Senior Technical Consultant
> T:  +44 161 537 4990
> E:  *v* <+44%207989717661>ms@quadris‑support.com
> W:
> https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.q
> uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e
> 4149de9c5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63
> 8071430711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=ClDbnphfgf
> WJtD37XnVSa2U1n6EQOtTVYBYbUBCsAJc%3D=0
> The information contained in this e-mail from Quadris may be
> confidential and privileged for the private use of the named
> recipient.  The contents of this e-mail may not necessarily represent the 
> official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please
> destroy any hard copies and delete this message.
> On Tue, Dec 20, 2022, 7:25 PM Gary Dixon  invalid>
> wrote:
>
> > Hi all
> >
> >
> >
> > CS v4.15.2
> >
> > Hypervisor = KVM
> >
> >
> >
> > We have started to experience an issue on a frequent basis where the
> > CS mgmt. service is losing the connection to the database and
> > believe it is being caused by mysqldumps locking the tables.
> >
> > Looking at the db.properties file there are tuning parameters :
> >
> > # CloudStack database tuning parameters
> >
> > db.cloud.maxActive=250
> >
> > db.cloud.maxIdle=30
> >
> > db.cloud.maxWait=1
> >
> > db.cloud.validationQuery=SELECT 1
> >
> > db.cloud.testOnBorrow=true
> >
> > db.cloud.testWhileIdle=true
> >
> > db.cloud.timeBetweenEvictionRunsMillis=4
> >
> > db.cloud.minEvictableIdleTimeMillis=24
> >
> > db.cloud.poolPreparedStatements=false
> >
> >
> > db.cloud.url.params=prepStmtCacheSize=517=true
> > nV
> > ariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,
> > ER
> > ROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC
> >
> >
> >
> > would changing the ‘maxwait’ value to a higher value stop the mgmt.
> > service losing the db connection whilst dumps are taken ?
> >
> > BR
> >
> >
> >
> > Gary
> >
> >
> >
> >
> > Gary Dixon​
> > Senior Technical Consultant
> > T: +44 161 537 4990
> > E: *v* <+44%207989717661>ms@quadris‑support.com
> > W:
> > https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww
> > .q%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc0e6e3c68e4149de9c
> > 5308dae295e6b3%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63807143
> > 0711725069%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luM
> > zIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=mt9MlK3EMSW1
> > shNbTq%2B4Z9JseyTJw1Ynah305yJeq4s%3D=0
> > uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc5084879
> > 20
> > c948fa441908dae2949e38%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C
> > 63
> > 8071425209591727%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjo
> > iV
> > 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=SAj0nkOY
> > 53
> > 6UUokgQPzXfdGH6Jp2pJ1hxlqA5hAJiwY%3D=0
> > The information contained in this e-mail from Quadris may be
> > confidential and privileged for the private use of the named
> > recipient. The contents of this e-mail may not necessarily represent
> > the
> official views of Quadris.
> > If you have received this information in error you must not copy,
> > distribute or take any action or reliance on its contents. Please
> > destroy any hard copies and delete this message.
> >
>
> --
> This message is intended only for the use of the individual or entity
> to which it is addressed and may contain confidential and/or
> privileged information. If you are not the intended recipient, please
> delete the original message and any copy of it from your computer
> system. You are hereby notified that any dissemination, distribution
> or copying of this communication is strictly prohibited 

Re: database connection lost

2022-12-20 Thread Wei ZHOU
What's the error message ?
There was a github issue may help you:
https://github.com/apache/cloudstack/issues/4657

-Wei


On Tuesday, 20 December 2022, Gary Dixon 
wrote:

> Hi Vivek
>
> We are using the --single-transaction flag and --skip-lock-tables flag
> Could there be something other than mysqldumps causing the cs mgmt. server
> to be losing the connection to the database ?
>
>
> BR
>
> Gary
>
>
> Hello,
>
> You can use --single-transaction
> Option while taking the dump or you can schedule to take dump from a slave
> server if you have.
>
> Regards,
> Vivek Kumar
>
> Gary Dixon​
> Senior Technical Consultant
> T:  +44 161 537 4990
> E:  *v* <+44%207989717661>ms@quadris‑support.com
> W: www.quadris.co.uk
> The information contained in this e-mail from Quadris may be confidential
> and privileged for the private use of the named recipient.  The contents of
> this e-mail may not necessarily represent the official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please destroy
> any hard copies and delete this message.
> On Tue, Dec 20, 2022, 7:25 PM Gary Dixon  invalid>
> wrote:
>
> > Hi all
> >
> >
> >
> > CS v4.15.2
> >
> > Hypervisor = KVM
> >
> >
> >
> > We have started to experience an issue on a frequent basis where the
> > CS mgmt. service is losing the connection to the database and believe
> > it is being caused by mysqldumps locking the tables.
> >
> > Looking at the db.properties file there are tuning parameters :
> >
> > # CloudStack database tuning parameters
> >
> > db.cloud.maxActive=250
> >
> > db.cloud.maxIdle=30
> >
> > db.cloud.maxWait=1
> >
> > db.cloud.validationQuery=SELECT 1
> >
> > db.cloud.testOnBorrow=true
> >
> > db.cloud.testWhileIdle=true
> >
> > db.cloud.timeBetweenEvictionRunsMillis=4
> >
> > db.cloud.minEvictableIdleTimeMillis=24
> >
> > db.cloud.poolPreparedStatements=false
> >
> >
> > db.cloud.url.params=prepStmtCacheSize=517=true
> > ariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ER
> > ROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC
> >
> >
> >
> > would changing the ‘maxwait’ value to a higher value stop the mgmt.
> > service losing the db connection whilst dumps are taken ?
> >
> > BR
> >
> >
> >
> > Gary
> >
> >
> >
> >
> > Gary Dixon​
> > Senior Technical Consultant
> > T: +44 161 537 4990
> > E: *v* <+44%207989717661>ms@quadris‑support.com
> > W:
> > https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.q
> > uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc508487920
> > c948fa441908dae2949e38%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63
> > 8071425209591727%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> > 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=SAj0nkOY53
> > 6UUokgQPzXfdGH6Jp2pJ1hxlqA5hAJiwY%3D=0
> > The information contained in this e-mail from Quadris may be
> > confidential and privileged for the private use of the named
> > recipient. The contents of this e-mail may not necessarily represent the
> official views of Quadris.
> > If you have received this information in error you must not copy,
> > distribute or take any action or reliance on its contents. Please
> > destroy any hard copies and delete this message.
> >
>
> --
> This message is intended only for the use of the individual or entity to
> which it is addressed and may contain confidential and/or privileged
> information. If you are not the intended recipient, please delete the
> original message and any copy of it from your computer system. You are
> hereby notified that any dissemination, distribution or copying of this
> communication is strictly prohibited unless proper authorization has been
> obtained for such action. If you have received this communication in error,
> please notify the sender immediately. Although IndiQus attempts to sweep
> e-mail and attachments for viruses, it does not guarantee that both are
> virus-free and accepts no liability for any damage sustained as a result of
> viruses.
>


RE: database connection lost

2022-12-20 Thread Gary Dixon
Hi Vivek

We are using the --single-transaction flag and --skip-lock-tables flag
Could there be something other than mysqldumps causing the cs mgmt. server to 
be losing the connection to the database ?


BR

Gary


Hello,

You can use --single-transaction
Option while taking the dump or you can schedule to take dump from a slave 
server if you have.

Regards,
Vivek Kumar

On Tue, Dec 20, 2022, 7:25 PM Gary Dixon 
wrote:

> Hi all
>
>
>
> CS v4.15.2
>
> Hypervisor = KVM
>
>
>
> We have started to experience an issue on a frequent basis where the
> CS mgmt. service is losing the connection to the database and believe
> it is being caused by mysqldumps locking the tables.
>
> Looking at the db.properties file there are tuning parameters :
>
> # CloudStack database tuning parameters
>
> db.cloud.maxActive=250
>
> db.cloud.maxIdle=30
>
> db.cloud.maxWait=1
>
> db.cloud.validationQuery=SELECT 1
>
> db.cloud.testOnBorrow=true
>
> db.cloud.testWhileIdle=true
>
> db.cloud.timeBetweenEvictionRunsMillis=4
>
> db.cloud.minEvictableIdleTimeMillis=24
>
> db.cloud.poolPreparedStatements=false
>
>
> db.cloud.url.params=prepStmtCacheSize=517=true
> ariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ER
> ROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC
>
>
>
> would changing the ‘maxwait’ value to a higher value stop the mgmt.
> service losing the db connection whilst dumps are taken ?
>
> BR
>
>
>
> Gary
>
>
>
>
> Gary Dixon​
> Senior Technical Consultant
> T:  +44 161 537 4990
> E:  *v* <+44%207989717661>ms@quadris‑support.com
> W:
> https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.q
> uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Cc508487920
> c948fa441908dae2949e38%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63
> 8071425209591727%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=SAj0nkOY53
> 6UUokgQPzXfdGH6Jp2pJ1hxlqA5hAJiwY%3D=0
> The information contained in this e-mail from Quadris may be
> confidential and privileged for the private use of the named
> recipient.  The contents of this e-mail may not necessarily represent the 
> official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please
> destroy any hard copies and delete this message.
>

--
This message is intended only for the use of the individual or entity to which 
it is addressed and may contain confidential and/or privileged information. If 
you are not the intended recipient, please delete the original message and any 
copy of it from your computer system. You are hereby notified that any 
dissemination, distribution or copying of this communication is strictly 
prohibited unless proper authorization has been obtained for such action. If 
you have received this communication in error, please notify the sender 
immediately. Although IndiQus attempts to sweep e-mail and attachments for 
viruses, it does not guarantee that both are virus-free and accepts no 
liability for any damage sustained as a result of viruses.

Gary Dixon
Senior Technical Consultant
T:  +44 161 537 4990
E:  v...@quadris-support.com
W: www.quadris.co.uk
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.


Re: database connection lost

2022-12-20 Thread Vivek Kumar
Hello,

You can use --single-transaction
Option while taking the dump or you can schedule to take dump from a slave
server if you have.

Regards,
Vivek Kumar

On Tue, Dec 20, 2022, 7:25 PM Gary Dixon 
wrote:

> Hi all
>
>
>
> CS v4.15.2
>
> Hypervisor = KVM
>
>
>
> We have started to experience an issue on a frequent basis where the CS
> mgmt. service is losing the connection to the database and believe it is
> being caused by mysqldumps locking the tables.
>
> Looking at the db.properties file there are tuning parameters :
>
> # CloudStack database tuning parameters
>
> db.cloud.maxActive=250
>
> db.cloud.maxIdle=30
>
> db.cloud.maxWait=1
>
> db.cloud.validationQuery=SELECT 1
>
> db.cloud.testOnBorrow=true
>
> db.cloud.testWhileIdle=true
>
> db.cloud.timeBetweenEvictionRunsMillis=4
>
> db.cloud.minEvictableIdleTimeMillis=24
>
> db.cloud.poolPreparedStatements=false
>
>
> db.cloud.url.params=prepStmtCacheSize=517=true=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC
>
>
>
> would changing the ‘maxwait’ value to a higher value stop the mgmt.
> service losing the db connection whilst dumps are taken ?
>
> BR
>
>
>
> Gary
>
>
>
>
> Gary Dixon​
> Senior Technical Consultant
> T:  +44 161 537 4990
> E:  *v* <+44%207989717661>ms@quadris‑support.com
> W: www.quadris.co.uk
> The information contained in this e-mail from Quadris may be confidential
> and privileged for the private use of the named recipient.  The contents of
> this e-mail may not necessarily represent the official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please destroy
> any hard copies and delete this message.
>

-- 
This message is intended only for the use of the individual or entity to 
which it is addressed and may contain confidential and/or privileged 
information. If you are not the intended recipient, please delete the 
original message and any copy of it from your computer system. You are 
hereby notified that any dissemination, distribution or copying of this 
communication is strictly prohibited unless proper authorization has been 
obtained for such action. If you have received this communication in error, 
please notify the sender immediately. Although IndiQus attempts to sweep 
e-mail and attachments for viruses, it does not guarantee that both are 
virus-free and accepts no liability for any damage sustained as a result of 
viruses.


RE: database connection lost

2022-12-20 Thread Gary Dixon

Hi Wei

We thought that without locking tables the mysql dumps may be inconsistent ?

Hi,

You can dump databases without locking tables.

-Wei

On Tuesday, 20 December 2022, Gary Dixon 
wrote:

> Hi all
>
>
>
> CS v4.15.2
>
> Hypervisor = KVM
>
>
>
> We have started to experience an issue on a frequent basis where the
> CS mgmt. service is losing the connection to the database and believe
> it is being caused by mysqldumps locking the tables.
>
> Looking at the db.properties file there are tuning parameters :
>
> # CloudStack database tuning parameters
>
> db.cloud.maxActive=250
>
> db.cloud.maxIdle=30
>
> db.cloud.maxWait=1
>
> db.cloud.validationQuery=SELECT 1
>
> db.cloud.testOnBorrow=true
>
> db.cloud.testWhileIdle=true
>
> db.cloud.timeBetweenEvictionRunsMillis=4
>
> db.cloud.minEvictableIdleTimeMillis=24
>
> db.cloud.poolPreparedStatements=false
>
> db.cloud.url.params=prepStmtCacheSize=517=true&
> sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_
> IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION
> '&
> serverTimezone=UTC
>
>
>
> would changing the ‘maxwait’ value to a higher value stop the mgmt.
> service losing the db connection whilst dumps are taken ?
>
> BR
>
>
>
> Gary
>
>
>
>
> Gary Dixon​
> Senior Technical Consultant
> T:  +44 161 537 4990
> E:  *v* <+44%207989717661>ms@quadris‑support.com
> W:
> https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.q
> uadris.co.uk%2F=05%7C01%7CGary.Dixon%40quadris.co.uk%7Ccea023f90a
> c8411f3f4108dae2930167%7Cf1d6abf3d3b44894ae16db0fb93a96a2%7C0%7C0%7C63
> 8071418262847712%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> 2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=4koYUIbCcb
> ARylkd5DOg1ZP7gY%2B6YkNyRRjOipuM%2Brw%3D=0
> The information contained in this e-mail from Quadris may be
> confidential and privileged for the private use of the named
> recipient.  The contents of this e-mail may not necessarily represent the 
> official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please
> destroy any hard copies and delete this message.
>

Gary Dixon
Senior Technical Consultant
T:  +44 161 537 4990
E:  v...@quadris-support.com
W: www.quadris.co.uk
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.


Re: database connection lost

2022-12-20 Thread Wei ZHOU
Hi,

You can dump databases without locking tables.

-Wei

On Tuesday, 20 December 2022, Gary Dixon 
wrote:

> Hi all
>
>
>
> CS v4.15.2
>
> Hypervisor = KVM
>
>
>
> We have started to experience an issue on a frequent basis where the CS
> mgmt. service is losing the connection to the database and believe it is
> being caused by mysqldumps locking the tables.
>
> Looking at the db.properties file there are tuning parameters :
>
> # CloudStack database tuning parameters
>
> db.cloud.maxActive=250
>
> db.cloud.maxIdle=30
>
> db.cloud.maxWait=1
>
> db.cloud.validationQuery=SELECT 1
>
> db.cloud.testOnBorrow=true
>
> db.cloud.testWhileIdle=true
>
> db.cloud.timeBetweenEvictionRunsMillis=4
>
> db.cloud.minEvictableIdleTimeMillis=24
>
> db.cloud.poolPreparedStatements=false
>
> db.cloud.url.params=prepStmtCacheSize=517=true&
> sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_
> IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&
> serverTimezone=UTC
>
>
>
> would changing the ‘maxwait’ value to a higher value stop the mgmt.
> service losing the db connection whilst dumps are taken ?
>
> BR
>
>
>
> Gary
>
>
>
>
> Gary Dixon​
> Senior Technical Consultant
> T:  +44 161 537 4990
> E:  *v* <+44%207989717661>ms@quadris‑support.com
> W: www.quadris.co.uk
> The information contained in this e-mail from Quadris may be confidential
> and privileged for the private use of the named recipient.  The contents of
> this e-mail may not necessarily represent the official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please destroy
> any hard copies and delete this message.
>


database connection lost

2022-12-20 Thread Gary Dixon
Hi all

CS v4.15.2
Hypervisor = KVM

We have started to experience an issue on a frequent basis where the CS mgmt. 
service is losing the connection to the database and believe it is being caused 
by mysqldumps locking the tables.
Looking at the db.properties file there are tuning parameters :
# CloudStack database tuning parameters
db.cloud.maxActive=250
db.cloud.maxIdle=30
db.cloud.maxWait=1
db.cloud.validationQuery=SELECT 1
db.cloud.testOnBorrow=true
db.cloud.testWhileIdle=true
db.cloud.timeBetweenEvictionRunsMillis=4
db.cloud.minEvictableIdleTimeMillis=24
db.cloud.poolPreparedStatements=false
db.cloud.url.params=prepStmtCacheSize=517=true=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'=UTC

would changing the 'maxwait' value to a higher value stop the mgmt. service 
losing the db connection whilst dumps are taken ?
BR

Gary



Gary Dixon
Senior Technical Consultant
T:  +44 161 537 4990
E:  v...@quadris-support.com
W: www.quadris.co.uk
The information contained in this e-mail from Quadris may be confidential and 
privileged for the private use of the named recipient.  The contents of this 
e-mail may not necessarily represent the official views of Quadris.  If you 
have received this information in error you must not copy, distribute or take 
any action or reliance on its contents.  Please destroy any hard copies and 
delete this message.