subject:"Re\: \[SOGo\] PostgreSQL Idle connections from"

Re: [SOGo] PostgreSQL Idle connections from

2022-02-03 Thread Fabio Ciuffani

Hi Francis,

It looks very good so far. No more problems on both servers I updated
since you fixed it.

Thank you very much !

Fabio
-- 
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2022-02-03 Thread sogo-us...@list-post.ddt-consult.de


02.02.22, 15:26 +0100, Francis Lachapelle (flachape...@inverse.ca):


I've pushed a fix yesterday regarding this issue. Can you try the latest 
nightly build?


I've installed the SOGo 5.5.0.20220203-1 packages from Inverse's nightly 
repository for Debian Buster.
With this version, the problem with the steadily increasing number of DB 
connections seems to be gone.


Many thanks for looking into this issue - I really appreciate it!

--
Regards
  mks
--
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2022-02-02 Thread Francis Lachapelle

Hi Fabio

> On Feb 2, 2022, at 06:54, Fabio Ciuffani  wrote:
> 
> I write to let you and the other posters in this thread know that we 
> experience the same issue with two SOGo servers. Some time ago, we upgraded 
> them from 5.2 to 5.4 and started seeing these error messages in the logs :
> 
> sogod[26069:26069] EXCEPTION:  0x560ffa0fb410> NAME:NoMoreConnections REASON:cannot open a additional 
> connection ! INFO:(null) 
> 
> These errors occur throughout the day when more clients open open/update 
> calendars (a few mobiles devices either with Android/Dav5x or iPhones and 
> mostly Thunderbird 91 with the latest SOGo connector).
> 
> We could reduce the number of occurrences by tweaking the max_connections and 
> wait_timeout parameters of MySQL but it doesn't solve the problem of idle 
> connections piling up. Upgrading to the latest SOGo 5.5 nightly neither. 
> 
> Our SOGo installations run on Debian 9 and use MySQL 5.5. If more info, tests 
> or logs are needed, I'll be glad to provide them. If you need me to file a 
> detailed bug report, please just ask.

I've pushed a fix yesterday regarding this issue. Can you try the latest 
nightly build?

Thanks,

Francis

-- 
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2022-02-02 Thread Fabio Ciuffani

Good afternoon Mr. Lachapelle,

I write to let you and the other posters in this thread know that we
experience the same issue with two SOGo servers. Some time ago, we
upgraded them from 5.2 to 5.4 and started seeing these error messages in
the logs :

/sogod[26069:26069] EXCEPTION:  NAME:NoMoreConnections REASON:cannot open a additional
connection ! //INFO:(null)/

These errors occur throughout the day when more clients open open/update
calendars (a few mobiles devices either with Android/Dav5x or iPhones
and mostly Thunderbird 91 with the latest SOGo connector).

We could reduce the number of occurrences by tweaking the
max_connections and wait_timeout parameters of MySQL but it doesn't
solve the problem of idle connections piling up. Upgrading to the latest
SOGo 5.5 nightly neither.

Our SOGo installations run on Debian 9 and use MySQL 5.5. If more info,
tests or logs are needed, I'll be glad to provide them. If you need me
to file a detailed bug report, please just ask.

Thank you for your help.

Best regards,

Fabio
-- 
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2022-01-20 Thread sogo-us...@list-post.ddt-consult.de


Hi,

this will probably not come as a surprise: I'm still seeing the problem 
with the exhaustion of DB connections on SOGo 5.5.0.


In the meantime I've migrated the DB to the combined 9-table-layout. 
Makes no difference either.


Do you need additional logs?
As Cédric already asked: Should we file a bug?
Could you please comment on this issue?

Regards
  mks


19.12.21, 15:21 +0100 Markus Schönhaber:


26.11.21, 17:48 +0100: Francis Lachapelle (flachape...@inverse.ca):

The same happens to me with SOGo 5.3.0 and 5.4.0. Going back to 5.2.0
makes the problem disappear.
I see this on a very small SOGo setup with 4 users and 2-3 devices each
syncing via CalDAV/CardDAV. It takes roughly a day till all DB
connections are in use (max_connections of PostgreSQL is set to 100).

If you still need debug logs, I can provide some.

Regards
mks


Cédric

I need the debugging entries during a busy period, until you reach the maximum 
number of connections of your PostgreSQL server. I'm looking at entries such as:

   - DBPOOL: create new DB channel
   - DBPOOL: keeping channel
   - DBPOOL: garbage collecting

Thanks,

Francis


On Nov 26, 2021, at 10:43, Cédric Archambeau  wrote:

Without postgre debug, tell me if you want it :

Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT 
/SOGo/dav/user.n...@domain.tld/Contacts/pg_addressbook_name/ HTTP/1.1" 207 1517/4915 
0.064 27386 94% 0 - 16
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
reused cached DB channel! (0x55bde58f5ad0)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: keeping 
channel (age 125s, #2, 0x55bde598c160) : <0x0x55bde58f5ad0[PostgreSQL72Channel]: 
connection=<0x0x55bde59b8090[PGConnection]:  connection=0x0x55bde59b8250>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
reused cached DB channel! (0x55bde60e3d80)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: keeping 
channel (age 41s, #2, 0x55bde5aa1eb0) : <0x0x55bde60e3d80[PostgreSQL72Channel]: 
connection=<0x0x55bde5f93910[PGConnection]:  connection=0x0x55bde5b7e560>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: cannot use 
handle (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
 
vspostgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a 
)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: cannot use 
handle (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
 
vspostgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder 
)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: create 
new DB channel for postgresql://localhost/dbname/table_pg_addressbook 


HTH

Cédric Archambeau
Le 26/11/2021 à 15:45, Francis Lachapelle (flachape...@inverse.ca 
) a écrit :

Hi Cédric


On Nov 26, 2021, at 06:29, Cédric Archambeau  
 wrote:

We have a problem with Postgresql connections from SOGo 5.3.0 since few days 
(last update monday 22 - community version).
Or we had it before but didn't see it ;-)

Connections stay idle, mainly with an adressbook (PostgreSQL view with right 
columns) query from Thunderbird dav (with sogo-connector).

We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up to 
date. We configured idle_in_transaction_session_timeout='5min' as workaround, 
the job is done for most of connections, but not on dav queries (maybe because 
of the client response?). These dav connections stay, and new ones are created 
every 30 min. With few clients we reached tuesday the default max amount of 
connections for Postgresql (100). Never happened in five years of happy use ;-)

With [PGDebugEnabled = YES;], no special observation, queries seem to be fine.

Restarting SOGo is the only way to clean up everything.

Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?

Thanks,

Francis



--
users@sogo.nu
https://inverse.ca/sogo/lists






--
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2022-01-18 Thread cedric.archamb...@solidairesfinancespubliques.org


Hi Francis,

Is there something new on your side about this? Should we fill a bug report?

Regards

Cédric Archambeau
Secrétariat National Solidaires Finances Publiques
Pôle Communication - Informatique

Le 26/11/2021 à 17:48, Francis Lachapelle (flachape...@inverse.ca) a écrit :

Cédric

I need the debugging entries during a busy period, until you reach the 
maximum number of connections of your PostgreSQL server. I'm looking 
at entries such as:


 - DBPOOL: create new DB channel
 - DBPOOL: keeping channel
 - DBPOOL: garbage collecting

Thanks,

Francis


On Nov 26, 2021, at 10:43, Cédric Archambeau  wrote:

Without postgre debug, tell me if you want it :

Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT 
/SOGo/dav/user.n...@domain.tld/Contacts/pg_addressbook_name/ 
HTTP/1.1" 207 1517/4915 0.064 27386 94% 0 - 16
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: reused cached DB channel! (0x55bde58f5ad0)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: keeping channel (age 125s, #2, 0x55bde598c160) : 
<0x0x55bde58f5ad0[PostgreSQL72Channel]: 
connection=<0x0x55bde59b8090[PGConnection]: connection=0x0x55bde59b8250>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: reused cached DB channel! (0x55bde60e3d80)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: keeping channel (age 41s, #2, 0x55bde5aa1eb0) : 
<0x0x55bde60e3d80[PostgreSQL72Channel]: 
connection=<0x0x55bde5f93910[PGConnection]: connection=0x0x55bde5b7e560>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: cannot use handle 
(postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
vs 
postgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: cannot use handle 
(postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
vs postgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: create new DB channel for 
postgresql://localhost/dbname/table_pg_addressbook


HTH

Cédric Archambeau
Le 26/11/2021 à 15:45, Francis Lachapelle (flachape...@inverse.ca) a 
écrit :

Hi Cédric


On Nov 26, 2021, at 06:29, Cédric Archambeau  wrote:

We have a problem with Postgresql connections from SOGo 5.3.0 since few days 
(last update monday 22 - community version).
Or we had it before but didn't see it ;-)

Connections stay idle, mainly with an adressbook (PostgreSQL view with right 
columns) query from Thunderbird dav (with sogo-connector).

We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up to 
date. We configured idle_in_transaction_session_timeout='5min' as workaround, 
the job is done for most of connections, but not on dav queries (maybe because 
of the client response?). These dav connections stay, and new ones are created 
every 30 min. With few clients we reached tuesday the default max amount of 
connections for Postgresql (100). Never happened in five years of happy use ;-)

With [PGDebugEnabled = YES;], no special observation, queries seem to be fine.

Restarting SOGo is the only way to clean up everything.

Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?

Thanks,

Francis



--
users@sogo.nu
https://inverse.ca/sogo/lists


--
users@sogo.nu
https://inverse.ca/sogo/lists

--
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2021-12-20 Thread sogo-us...@list-post.ddt-consult.de


26.11.21, 17:48 +0100: Francis Lachapelle (flachape...@inverse.ca):

The same happens to me with SOGo 5.3.0 and 5.4.0. Going back to 5.2.0 
makes the problem disappear.
I see this on a very small SOGo setup with 4 users and 2-3 devices each 
syncing via CalDAV/CardDAV. It takes roughly a day till all DB 
connections are in use (max_connections of PostgreSQL is set to 100).


If you still need debug logs, I can provide some.

Regards
  mks


Cédric

I need the debugging entries during a busy period, until you reach the maximum 
number of connections of your PostgreSQL server. I'm looking at entries such as:

  - DBPOOL: create new DB channel
  - DBPOOL: keeping channel
  - DBPOOL: garbage collecting

Thanks,

Francis


On Nov 26, 2021, at 10:43, Cédric Archambeau  wrote:

Without postgre debug, tell me if you want it :

Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT 
/SOGo/dav/user.n...@domain.tld/Contacts/pg_addressbook_name/ HTTP/1.1" 207 1517/4915 
0.064 27386 94% 0 - 16
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
reused cached DB channel! (0x55bde58f5ad0)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: keeping 
channel (age 125s, #2, 0x55bde598c160) : <0x0x55bde58f5ad0[PostgreSQL72Channel]: 
connection=<0x0x55bde59b8090[PGConnection]:  connection=0x0x55bde59b8250>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
reused cached DB channel! (0x55bde60e3d80)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: keeping 
channel (age 41s, #2, 0x55bde5aa1eb0) : <0x0x55bde60e3d80[PostgreSQL72Channel]: 
connection=<0x0x55bde5f93910[PGConnection]:  connection=0x0x55bde5b7e560>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: cannot use 
handle (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
 
vspostgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a 
)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: cannot use 
handle (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
 
vspostgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder 
)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: create 
new DB channel for postgresql://localhost/dbname/table_pg_addressbook 


HTH

Cédric Archambeau
Le 26/11/2021 à 15:45, Francis Lachapelle (flachape...@inverse.ca 
) a écrit :

Hi Cédric


On Nov 26, 2021, at 06:29, Cédric Archambeau  
 wrote:

We have a problem with Postgresql connections from SOGo 5.3.0 since few days 
(last update monday 22 - community version).
Or we had it before but didn't see it ;-)

Connections stay idle, mainly with an adressbook (PostgreSQL view with right 
columns) query from Thunderbird dav (with sogo-connector).

We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up to 
date. We configured idle_in_transaction_session_timeout='5min' as workaround, 
the job is done for most of connections, but not on dav queries (maybe because 
of the client response?). These dav connections stay, and new ones are created 
every 30 min. With few clients we reached tuesday the default max amount of 
connections for Postgresql (100). Never happened in five years of happy use ;-)

With [PGDebugEnabled = YES;], no special observation, queries seem to be fine.

Restarting SOGo is the only way to clean up everything.

Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?

Thanks,

Francis



--
users@sogo.nu
https://inverse.ca/sogo/lists




--
users@sogo.nu
https://inverse.ca/sogo/lists

RE: [SOGo] PostgreSQL Idle connections from

2021-12-07 Thread Bill Bushong

Hello,
  I too am running into this same problem. I have never had issues with MySQL 
connections, and usually operate with 550 connections MAX (in my.sql). I 
upgraded to 5.3, and I started getting a ton of "out of connection" messages. I 
bumped to 1,000 connections just to try and make it through the day, and we are 
exceeding that as well! This is a  heavily used mailserver (if that wasn't 
obvious from the numbers), but it has been rock solid for over 2 years. I'm not 
sure where to go - but hoping progress is being made on this issue.

Bill Bushong

From: users-requ...@sogo.nu  On Behalf Of Florian Unger
Sent: Wednesday, December 1, 2021 01:29
To: users@sogo.nu
Subject: Re: [SOGo] PostgreSQL Idle connections from

These are the log file entries when sogo runs out of SQL connections:

sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee9aa2e0)
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 43s, #1, 
0x5600edf629c0) : 
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee9aa2e0)
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 43s, #1, 
0x5600edf629c0) : 
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee9aa2e0)
sogo-mailcow_1   | Nov 30 20:54:17 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: garbage collecting 0 channels.
sogo-mailcow_1   | Nov 30 20:54:17 679d32496afb sogod [71]: 
<0x0x5600edf72180[GCSChannelManager]> DBPOOL: garbage collecting 0 channels.
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/_sogo_static_view
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 0s, #1, 
0x5600ee456510) : 
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee763d70)
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_user_profile
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb 2021-11-30 20:56:37.496 
sogod[67:67] EXCEPTION:  
NAME:NoMoreConnections REASON:cannot open a additional connection ! INFO:(null)
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 62.63.64.65 
"REPORT 
/SOGo/dav/test.test%40test.de/Calendar/sek_A_test_D_de_3B-60534C80-59-4A5D0F00/ 
HTTP/1.0" 501 0/188 0.004 - - 0 - 162
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_folder_info
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb 2021-11-30 20:56:37.578 
sogod[67:67] EXCEPTION:  
NAME:NoMoreConnections REASON:cannot open a additional connection ! INFO:(null)
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 62.63.64.65 
"REPORT /SOGo/dav/test.test%40test.de/Calendar/personal/ HTTP/1.0" 501 0/188 
0.002 - - 0 - 162
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_folder_info
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb 2021-11-30 20:56:39.394 
sogod[67:67] EXCEPTION:  
NAME:NoMoreConnections REASON:cannot open a additional connection ! INFO:(null)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [67]: 62.63.64.65 
"REPORT 
/SOGo/dav/test.test%40test.de/Calendar/sek_A_test_D_de_44-5E835E00-7-77A0F280/ 
HTTP/1.0" 501 0/188 0.002 - - 0 - 162Nov 30 20:56:39 sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee7b60a0)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600eedb2560)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: freeing old channel (age 244s, 
0x5600eedb2560)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_user_profile
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelMana

Re: [SOGo] PostgreSQL Idle connections from

2021-12-01 Thread Florian Unger


These are the log file entries when sogo runs out of SQL connections:

sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee9aa2e0)
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 43s, 
#1, 0x5600edf629c0) : connection=0x0x5600ef670610>
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee9aa2e0)
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 43s, 
#1, 0x5600edf629c0) : connection=0x0x5600ef670610>
sogo-mailcow_1   | Nov 30 20:53:18 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee9aa2e0)
sogo-mailcow_1   | Nov 30 20:54:17 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: garbage collecting 0 channels.
sogo-mailcow_1   | Nov 30 20:54:17 679d32496afb sogod [71]: 
<0x0x5600edf72180[GCSChannelManager]> DBPOOL: garbage collecting 0 channels.
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/_sogo_static_view
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 0s, 
#1, 0x5600ee456510) : connection=0x0x5600ef3a8f10>
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee763d70)
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_user_profile
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb 2021-11-30 
20:56:37.496 sogod[67:67] EXCEPTION: 
 
NAME:NoMoreConnections REASON:cannot open a additional connection ! 
INFO:(null)
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
62.63.64.65 "REPORT 
/SOGo/dav/test.test%40test.de/Calendar/sek_A_test_D_de_3B-60534C80-59-4A5D0F00/ 
HTTP/1.0" 501 0/188 0.004 - - 0 - 162
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_folder_info
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb 2021-11-30 
20:56:37.578 sogod[67:67] EXCEPTION: 
 
NAME:NoMoreConnections REASON:cannot open a additional connection ! 
INFO:(null)
sogo-mailcow_1   | Nov 30 20:56:37 679d32496afb sogod [67]: 
62.63.64.65 "REPORT /SOGo/dav/test.test%40test.de/Calendar/personal/ 
HTTP/1.0" 501 0/188 0.002 - - 0 - 162
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [67]: 
<0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_folder_info
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb 2021-11-30 
20:56:39.394 sogod[67:67] EXCEPTION: 
 
NAME:NoMoreConnections REASON:cannot open a additional connection ! 
INFO:(null)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [67]: 
62.63.64.65 "REPORT 
/SOGo/dav/test.test%40test.de/Calendar/sek_A_test_D_de_44-5E835E00-7-77A0F280/ 
HTTP/1.0" 501 0/188 0.002 - - 0 - 162Nov 30 20:56:39 sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ee7b60a0)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600eedb2560)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: freeing old channel (age 
244s, 0x5600eedb2560)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: create new DB channel for 
mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_user_profile
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: keeping channel (age 0s, 
#1, 0x5600ee083f80) : connection=0x0x5600f2516cf0>
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: freeing old channel (age 
244s, 0x5600ee7b60a0)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! 
(0x5600ef754960)
sogo-mailcow_1   | Nov 30 20:56:39 679d32496afb sogod [63]: 
<0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: keeping channel (age 0s, 
#1, 0x5600ee083f80) : connection=0x0x5600f2516cf0>



Greetings
Florian


On 29.11.2021 10:19, Florian Unger (florian.un...@intego.de) wrote:
I see a similar behaviour after upgrading to SOGO 5.2.0 with MySQL as 
database.
After a few hours of client

Re: [SOGo] PostgreSQL Idle connections from

2021-11-29 Thread Florian Unger

I see a similar behaviour after upgrading to SOGO 5.2.0 with MySQL as 
database.
After a few hours of client usage the Mysql database runs out of 
available connections.


Greetings
Florian

On 26.11.2021 17:48, Francis Lachapelle (flachape...@inverse.ca) wrote:

Cédric

I need the debugging entries during a busy period, until you reach the 
maximum number of connections of your PostgreSQL server. I'm looking 
at entries such as:


 - DBPOOL: create new DB channel
 - DBPOOL: keeping channel
 - DBPOOL: garbage collecting

Thanks,

Francis


On Nov 26, 2021, at 10:43, Cédric Archambeau  wrote:

Without postgre debug, tell me if you want it :

Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT 
/SOGo/dav/user.n...@domain.tld/Contacts/pg_addressbook_name/ 
HTTP/1.1" 207 1517/4915 0.064 27386 94% 0 - 16
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: reused cached DB channel! (0x55bde58f5ad0)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: keeping channel (age 125s, #2, 0x55bde598c160) : 
<0x0x55bde58f5ad0[PostgreSQL72Channel]: 
connection=<0x0x55bde59b8090[PGConnection]: connection=0x0x55bde59b8250>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: reused cached DB channel! (0x55bde60e3d80)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: keeping channel (age 41s, #2, 0x55bde5aa1eb0) : 
<0x0x55bde60e3d80[PostgreSQL72Channel]: 
connection=<0x0x55bde5f93910[PGConnection]: connection=0x0x55bde5b7e560>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: cannot use handle 
(postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
vs 
postgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: cannot use handle 
(postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
vs postgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: create new DB channel for 
postgresql://localhost/dbname/table_pg_addressbook


HTH

Cédric Archambeau
Le 26/11/2021 à 15:45, Francis Lachapelle (flachape...@inverse.ca) a 
écrit :

Hi Cédric


On Nov 26, 2021, at 06:29, Cédric Archambeau  wrote:

We have a problem with Postgresql connections from SOGo 5.3.0 since few days 
(last update monday 22 - community version).
Or we had it before but didn't see it ;-)

Connections stay idle, mainly with an adressbook (PostgreSQL view with right 
columns) query from Thunderbird dav (with sogo-connector).

We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up to 
date. We configured idle_in_transaction_session_timeout='5min' as workaround, 
the job is done for most of connections, but not on dav queries (maybe because 
of the client response?). These dav connections stay, and new ones are created 
every 30 min. With few clients we reached tuesday the default max amount of 
connections for Postgresql (100). Never happened in five years of happy use ;-)

With [PGDebugEnabled = YES;], no special observation, queries seem to be fine.

Restarting SOGo is the only way to clean up everything.

Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?

Thanks,

Francis



--
users@sogo.nu
https://inverse.ca/sogo/lists


--
users@sogo.nu
https://inverse.ca/sogo/lists


--
__

Florian UngerIntego GmbH
Tel.:  +49-9131-61082-121Henri-Dunant-Straße 8
Fax.:  +49-9131-61082-999D-91058 Erlangen
Email:florian.un...@intego.deGermany
_

Geschäftsführer: Registergericht:
Dr. Peter Plankensteiner Amtsgericht Fürth  
Dr. Thomas WagnerHRB 7576
--
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2021-11-26 Thread Francis Lachapelle

Cédric

I need the debugging entries during a busy period, until you reach the maximum 
number of connections of your PostgreSQL server. I'm looking at entries such as:

 - DBPOOL: create new DB channel
 - DBPOOL: keeping channel
 - DBPOOL: garbage collecting

Thanks,

Francis

> On Nov 26, 2021, at 10:43, Cédric Archambeau  wrote:
> 
> Without postgre debug, tell me if you want it :
> 
> Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT 
> /SOGo/dav/user.n...@domain.tld/Contacts/pg_addressbook_name/ HTTP/1.1" 207 
> 1517/4915 0.064 27386 94% 0 - 16
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> reused cached DB channel! (0x55bde58f5ad0)
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> keeping channel (age 125s, #2, 0x55bde598c160) : 
> <0x0x55bde58f5ad0[PostgreSQL72Channel]: 
> connection=<0x0x55bde59b8090[PGConnection]:  connection=0x0x55bde59b8250>>
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> reused cached DB channel! (0x55bde60e3d80)
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> keeping channel (age 41s, #2, 0x55bde5aa1eb0) : 
> <0x0x55bde60e3d80[PostgreSQL72Channel]: 
> connection=<0x0x55bde5f93910[PGConnection]:  connection=0x0x55bde5b7e560>>
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> cannot use handle 
> (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
>  
> vspostgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a 
> ) 
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> cannot use handle 
> (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
>  
> vspostgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder 
> ) 
> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: 
> create new DB channel for postgresql://localhost/dbname/table_pg_addressbook 
> 
> 
> HTH
> 
> Cédric Archambeau
> Le 26/11/2021 à 15:45, Francis Lachapelle (flachape...@inverse.ca 
> ) a écrit :
>> Hi Cédric
>> 
>>> On Nov 26, 2021, at 06:29, Cédric Archambeau  
>>>  wrote:
>>> 
>>> We have a problem with Postgresql connections from SOGo 5.3.0 since few 
>>> days (last update monday 22 - community version).
>>> Or we had it before but didn't see it ;-)
>>> 
>>> Connections stay idle, mainly with an adressbook (PostgreSQL view with 
>>> right columns) query from Thunderbird dav (with sogo-connector). 
>>> 
>>> We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything 
>>> up to date. We configured idle_in_transaction_session_timeout='5min' as 
>>> workaround, the job is done for most of connections, but not on dav queries 
>>> (maybe because of the client response?). These dav connections stay, and 
>>> new ones are created every 30 min. With few clients we reached tuesday the 
>>> default max amount of connections for Postgresql (100). Never happened in 
>>> five years of happy use ;-)
>>> 
>>> With [PGDebugEnabled = YES;], no special observation, queries seem to be 
>>> fine.
>>> 
>>> Restarting SOGo is the only way to clean up everything.
>> Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?
>> 
>> Thanks,
>> 
>> Francis
>> 
> 
> -- 
> users@sogo.nu
> https://inverse.ca/sogo/lists

-- 
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2021-11-26 Thread cedric.archamb...@solidairesfinancespubliques.org


Hi Francis,

Without postgre debug, tell me if you want it :

Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT 
/SOGo/dav/user.n...@domain.tld/Contacts/pg_addressbook_name/ HTTP/1.1" 
207 1517/4915 0.064 27386 94% 0 - 16
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: reused cached DB channel! (0x55bde58f5ad0)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: keeping channel (age 125s, #2, 0x55bde598c160) : 
<0x0x55bde58f5ad0[PostgreSQL72Channel]: 
connection=<0x0x55bde59b8090[PGConnection]: connection=0x0x55bde59b8250>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: reused cached DB channel! (0x55bde60e3d80)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: keeping channel (age 41s, #2, 0x55bde5aa1eb0) : 
<0x0x55bde60e3d80[PostgreSQL72Channel]: 
connection=<0x0x55bde5f93910[PGConnection]: connection=0x0x55bde5b7e560>>
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: cannot use handle 
(postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
vs postgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: cannot use handle 
(postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook 
vs postgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder)
Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> 
DBPOOL: create new DB channel for 
postgresql://localhost/dbname/table_pg_addressbook


HTH

Cédric Archambeau

Le 26/11/2021 à 15:45, Francis Lachapelle (flachape...@inverse.ca) a écrit :

Hi Cédric


On Nov 26, 2021, at 06:29, Cédric Archambeau  wrote:

We have a problem with Postgresql connections from SOGo 5.3.0 since few days 
(last update monday 22 - community version).
Or we had it before but didn't see it ;-)

Connections stay idle, mainly with an adressbook (PostgreSQL view with right 
columns) query from Thunderbird dav (with sogo-connector).

We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up to 
date. We configured idle_in_transaction_session_timeout='5min' as workaround, 
the job is done for most of connections, but not on dav queries (maybe because 
of the client response?). These dav connections stay, and new ones are created 
every 30 min. With few clients we reached tuesday the default max amount of 
connections for Postgresql (100). Never happened in five years of happy use ;-)

With [PGDebugEnabled = YES;], no special observation, queries seem to be fine.

Restarting SOGo is the only way to clean up everything.

Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?

Thanks,

Francis


--
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

2021-11-26 Thread Francis Lachapelle

Hi Cédric

> On Nov 26, 2021, at 06:29, Cédric Archambeau  wrote:
> 
> We have a problem with Postgresql connections from SOGo 5.3.0 since few days 
> (last update monday 22 - community version).
> Or we had it before but didn't see it ;-)
> 
> Connections stay idle, mainly with an adressbook (PostgreSQL view with right 
> columns) query from Thunderbird dav (with sogo-connector). 
> 
> We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up 
> to date. We configured idle_in_transaction_session_timeout='5min' as 
> workaround, the job is done for most of connections, but not on dav queries 
> (maybe because of the client response?). These dav connections stay, and new 
> ones are created every 30 min. With few clients we reached tuesday the 
> default max amount of connections for Postgresql (100). Never happened in 
> five years of happy use ;-)
> 
> With [PGDebugEnabled = YES;], no special observation, queries seem to be fine.
> 
> Restarting SOGo is the only way to clean up everything.

Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries?

Thanks,

Francis

-- 
users@sogo.nu
https://inverse.ca/sogo/lists

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

RE: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

Re: [SOGo] PostgreSQL Idle connections from

13 matches

Site Navigation

Mail list logo

Footer information