Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-17 Thread Gerben Wierda

> On 6 Jan 2023, at 08:53, Aki Tuomi  wrote:
> 
> 
> 
> On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda  
> wrote:
>> One step further in my quest to create a replacement mail server.
>> 
>> I now have my old mail server (2.3.19.1, macOS + MacPorts) and my new 
>> (2.3.20, Alpine Linux, Docker, apk package). When I turn on replication it 
>> works, but, after a while I see:
>> 
>> Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when allocating 
>> 268435496 bytes
>> Jan 06 00:50:32 replicator: Fatal: master: service(replicator): child 133 
>> killed with signal 6 (core dumped)
>> Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): Sync 
>> failure: 
>> Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): 
>> Remote sent invalid input: -
>> 
>> I've removed synchronous operation for now (found a message on the net 
>> suggesting that) but is this known and what does it mean?
>> 
>> Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>)
>> R IT Strategy <https://ea.rna.nl/> (main site)
>> Book: Chess and the Art of Enterprise Architecture 
>> <https://ea.rna.nl/the-book/>
>> Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>
>> 
> 
> Dovecot default memory limit is 256M. You should probably set
> 
> service replicator {
>  vsz_limit = 2G
> }
> 
> because replicator might have to use more memory, especially for larger 
> indexes. 
> 
> Aki

Coming back to this one. doveadm config says everything is vsz_limit = 
18446744073709551615 B

Isn't that more than 2G already (nd certainly more than 256M?)?

I also tried putting

default_vsz_limit = 2G

in dovecot.conf but that doesn't change anything either.

What am I missing?

Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-07 Thread Jörg Schulz
gt; {
 ssl_key =<http://mail.ekst.ca>
 ssl_cert =<http://mail.ekst.ca>
 ssl_ca =<http://mail.ekst.ca>

}

local_name mail.hamletdevelopments.ca 
<http://mail.hamletdevelopments.ca> {
 ssl_key =<http://mail.hamletdevelopments.ca>
 ssl_cert =<http://mail.hamletdevelopments.ca>
 ssl_ca =<http://mail.hamletdevelopments.ca>

}

pg sql support supporting replication

# cat dovecot-pgsql.conf
driver = pgsql
connect = host=localhost port=5433 dbname=scom_billing user=pgsql 
password=

default_pass_scheme = PLAIN

password_query = SELECT username as user, password FROM email_users 
WHERE username = '%u' and password <> 'alias' and status = True and 
destination = '%u'


user_query = SELECT home, uid, gid FROM email_users WHERE username = 
'%u' and password <> 'alias' and status = True and destination = '%u'


#iterate_query = SELECT user, password FROM email_users WHERE 
username = '%u' and password <> 'alias' and status = True and 
destination = '%u'


iterate_query = SELECT "username" as user, domain FROM email_users 
WHERE status = True and alias_flag = False






Happy Friday !!!
Thanks - paul

Paul Kudla


Scom.ca <http://Scom.ca> Internet Services <http://www.scom.ca 
<http://www.scom.ca>>

004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main 1.866.411.7266
Fax 1.888.892.7266
Email p...@scom.ca <mailto:p...@scom.ca>

On 1/6/2023 5:32 AM, Gerben Wierda wrote:
On 6 Jan 2023, at 08:53, Aki Tuomi <mailto:aki.tu...@open-xchange.com>> wrote:




On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda 
mailto:gerben.wie...@rna.nl>> wrote:

One step further in my quest to create a replacement mail server.

I now have my old mail server (2.3.19.1, macOS + MacPorts) and my 
new (2.3.20, Alpine Linux, Docker, apk package). When I turn on 
replication it works, but, after a while I see:


Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when 
allocating 268435496 bytes
Jan 06 00:50:32 replicator: Fatal: master: service(replicator): 
child 133 killed with signal 6 (core dumped)
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: 
replication(sysbh): Sync failure:
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: 
replication(sysbh): Remote sent invalid input: -


I've removed synchronous operation for now (found a message on 
the net suggesting that) but is this known and what does it mean?


Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda 
<https://www.linkedin.com/in/gerbenwierda>>)
R IT Strategy <https://ea.rna.nl/ <https://ea.rna.nl/>> (main 
site)
Book: Chess and the Art of Enterprise Architecture 
<https://ea.rna.nl/the-book/ <https://ea.rna.nl/the-book/>>
Book: Mastering ArchiMate 
<https://ea.rna.nl/the-book-edition-iii/ 
<https://ea.rna.nl/the-book-edition-iii/>>




Dovecot default memory limit is 256M. You should probably set

service replicator {
 vsz_limit = 2G
}

because replicator might have to use more memory, especially for 
larger indexes.


Aki

That is a good tip as well.
I had followed this bit of experience from someone else: 
https://marc.info/?l=dovecot=164438199727640 
<https://marc.info/?l=dovecot=164438199727640>, haven't seen any 
err message since. But that might be because they are in sync now 
and both sides are aware. Can I trigger full replication again so I 
can test?

Gerben
--
This message has been scanned for viruses and
dangerous content by *MailScanner* <http://www.mailscanner.info/>, 
and is

believed to be clean.



--
This message has been scanned for viruses and
dangerous content by *MailScanner* <http://www.mailscanner.info/>, 
and is

believed to be clean.


Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-07 Thread Paul Kudla
nts.ca>
 ssl_cert =<http://mail.hamletdevelopments.ca>
 ssl_ca =<http://mail.hamletdevelopments.ca>

}

pg sql support supporting replication

# cat dovecot-pgsql.conf
driver = pgsql
connect = host=localhost port=5433 dbname=scom_billing user=pgsql 
password=

default_pass_scheme = PLAIN

password_query = SELECT username as user, password FROM email_users 
WHERE username = '%u' and password <> 'alias' and status = True and 
destination = '%u'


user_query = SELECT home, uid, gid FROM email_users WHERE username = 
'%u' and password <> 'alias' and status = True and destination = '%u'


#iterate_query = SELECT user, password FROM email_users WHERE username 
= '%u' and password <> 'alias' and status = True and destination = '%u'


iterate_query = SELECT "username" as user, domain FROM email_users 
WHERE status = True and alias_flag = False






Happy Friday !!!
Thanks - paul

Paul Kudla


Scom.ca <http://Scom.ca> Internet Services <http://www.scom.ca 
<http://www.scom.ca>>

004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main 1.866.411.7266
Fax 1.888.892.7266
Email p...@scom.ca <mailto:p...@scom.ca>

On 1/6/2023 5:32 AM, Gerben Wierda wrote:
On 6 Jan 2023, at 08:53, Aki Tuomi <mailto:aki.tu...@open-xchange.com>> wrote:




On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda 
mailto:gerben.wie...@rna.nl>> wrote:

One step further in my quest to create a replacement mail server.

I now have my old mail server (2.3.19.1, macOS + MacPorts) and my 
new (2.3.20, Alpine Linux, Docker, apk package). When I turn on 
replication it works, but, after a while I see:


Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when 
allocating 268435496 bytes
Jan 06 00:50:32 replicator: Fatal: master: service(replicator): 
child 133 killed with signal 6 (core dumped)
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: 
replication(sysbh): Sync failure:
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: 
replication(sysbh): Remote sent invalid input: -


I've removed synchronous operation for now (found a message on the 
net suggesting that) but is this known and what does it mean?


Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda 
<https://www.linkedin.com/in/gerbenwierda>>)

R IT Strategy <https://ea.rna.nl/ <https://ea.rna.nl/>> (main site)
Book: Chess and the Art of Enterprise Architecture 
<https://ea.rna.nl/the-book/ <https://ea.rna.nl/the-book/>>
Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/ 
<https://ea.rna.nl/the-book-edition-iii/>>




Dovecot default memory limit is 256M. You should probably set

service replicator {
 vsz_limit = 2G
}

because replicator might have to use more memory, especially for 
larger indexes.


Aki

That is a good tip as well.
I had followed this bit of experience from someone else: 
https://marc.info/?l=dovecot=164438199727640 
<https://marc.info/?l=dovecot=164438199727640>, haven't seen any 
err message since. But that might be because they are in sync now and 
both sides are aware. Can I trigger full replication again so I can test?

Gerben
--
This message has been scanned for viruses and
dangerous content by *MailScanner* <http://www.mailscanner.info/>, and is
believed to be clean.



--
This message has been scanned for viruses and
dangerous content by *MailScanner* <http://www.mailscanner.info/>, and is
believed to be clean.


Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-06 Thread Gerben Wierda
dovecot-pgsql.conf
>  driver = sql
> 
> }
> 
> protocol imap {
>  mail_max_userip_connections = 50
>  mail_plugins = $mail_plugins notify replication
> }
> 
> protocol pop3 {
>  mail_max_userip_connections = 50
>  mail_plugins = $mail_plugins notify replication
> }
> 
> protocol imaps {
>  mail_max_userip_connections = 25
>  mail_plugins = $mail_plugins notify replication
> }
> 
> protocol pop3s {
>  mail_max_userip_connections = 25
>  mail_plugins = $mail_plugins notify replication
> }
> 
> 
> service managesieve-login {
>  process_limit = 1000
>  vsz_limit = 1g
>  inet_listener sieve {
>port = 4190
>  }
> }
> 
> verbose_proctitle = yes
> 
> replication_max_conns = 100
> 
> replication_full_sync_interval = 1d
> 
> service replicator {
>  client_limit = 0
>  drop_priv_before_exec = no
>  idle_kill = 4294967295s
>  process_limit = 1
>  process_min_avail = 0
>  service_count = 0
>  vsz_limit = 8g
>unix_listener replicator-doveadm {
>mode = 0600
>user = vmail
>  }
>  vsz_limit = 8192M
> }
> 
> 
> service aggregator {
>  process_limit = 1000
>  #vsz_limit = 1g
>  fifo_listener replication-notify-fifo {
>user = vmail
>group = vmail
>mode = 0666
>  }
> 
> }
> 
> service pop3-login {
>  process_limit = 1000
>  client_limit = 100
>  vsz_limit = 512m
> }
> 
> 
> service imap-urlauth-login {
>  process_limit = 1000
>  client_limit = 1000
>  vsz_limit = 1g
> }
> 
> 
> service imap-login {
>  process_limit=1000
>  client_limit = 1000
>  vsz_limit = 1g
> }
> 
> 
> protocol sieve {
>  managesieve_implementation_string = Dovecot Pigeonhole
>  managesieve_max_line_length = 65536
> }
> 
> 
> 
> 
> #Addition ssl config
> !include sni.conf
> 
> with sni cert support (examples)
> 
> # cat sni.conf
> #sni.conf
> ssl = yes
> verbose_ssl = yes
> ssl_dh = ssl_prefer_server_ciphers = yes
> #ssl_min_protocol = TLSv1.2
> 
> #Default *.scom.ca
> ssl_key = ssl_cert = ssl_ca = 
> local_name .scom.ca {
> ssl_key = ssl_cert = ssl_ca = 
> }
> 
> local_name mail.clancyca.com {
>  ssl_key =  ssl_cert =  ssl_ca = }
> 
> local_name mail.paulkudla.net {
>  ssl_key =  ssl_cert =  ssl_ca = }
> 
> local_name mail.ekst.ca {
>  ssl_key =  ssl_cert =  ssl_ca = }
> 
> local_name mail.hamletdevelopments.ca {
>  ssl_key =  ssl_cert =  ssl_ca = }
> 
> pg sql support supporting replication
> 
> # cat dovecot-pgsql.conf
> driver = pgsql
> connect = host=localhost port=5433 dbname=scom_billing user=pgsql password=
> default_pass_scheme = PLAIN
> 
> password_query = SELECT username as user, password FROM email_users WHERE 
> username = '%u' and password <> 'alias' and status = True and destination = 
> '%u'
> 
> user_query = SELECT home, uid, gid FROM email_users WHERE username = '%u' and 
> password <> 'alias' and status = True and destination = '%u'
> 
> #iterate_query = SELECT user, password FROM email_users WHERE username = '%u' 
> and password <> 'alias' and status = True and destination = '%u'
> 
> iterate_query = SELECT "username" as user, domain FROM email_users WHERE 
> status = True and alias_flag = False
> 
> 
> 
> 
> 
> Happy Friday !!!
> Thanks - paul
> 
> Paul Kudla
> 
> 
> Scom.ca Internet Services <http://www.scom.ca>
> 004-1009 Byron Street South
> Whitby, Ontario - Canada
> L1N 4S3
> 
> Toronto 416.642.7266
> Main 1.866.411.7266
> Fax 1.888.892.7266
> Email p...@scom.ca
> 
> On 1/6/2023 5:32 AM, Gerben Wierda wrote:
>>> On 6 Jan 2023, at 08:53, Aki Tuomi >> <mailto:aki.tu...@open-xchange.com>> wrote:
>>> 
>>> 
>>> 
>>> On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda 
>>> mailto:gerben.wie...@rna.nl>> wrote:
>>>> One step further in my quest to create a replacement mail server.
>>>> 
>>>> I now have my old mail server (2.3.19.1, macOS + MacPorts) and my new 
>>>> (2.3.20, Alpine Linux, Docker, apk package). When I turn on replication it 
>>>> works, but, after a while I see:
>>>> 
>>>> Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when 
>>>> allocating 268435496 bytes
>>>> Jan 06 00:50:32 replicator: Fatal: master: service(replicator): child 133 
>>>> killed with signal 6 (core dumped)
>>>> Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): 
>>>> Sync failure:
>>>> Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): 
>>>> Remote sent invalid input: -
>>>> 
>>>> I've removed synchronous operation for now (found a message on the net 
>>>> suggesting that) but is this known and what does it mean?
>>>> 
>>>> Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda 
>>>> <https://www.linkedin.com/in/gerbenwierda>>)
>>>> R IT Strategy <https://ea.rna.nl/ <https://ea.rna.nl/>> (main site)
>>>> Book: Chess and the Art of Enterprise Architecture 
>>>> <https://ea.rna.nl/the-book/ <https://ea.rna.nl/the-book/>>
>>>> Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/ 
>>>> <https://ea.rna.nl/the-book-edition-iii/>>
>>>> 
>>> 
>>> Dovecot default memory limit is 256M. You should probably set
>>> 
>>> service replicator {
>>>  vsz_limit = 2G
>>> }
>>> 
>>> because replicator might have to use more memory, especially for larger 
>>> indexes.
>>> 
>>> Aki
>> That is a good tip as well.
>> I had followed this bit of experience from someone else: 
>> https://marc.info/?l=dovecot=164438199727640 
>> <https://marc.info/?l=dovecot=164438199727640>, haven't seen any err 
>> message since. But that might be because they are in sync now and both sides 
>> are aware. Can I trigger full replication again so I can test?
>> Gerben
>> -- 
>> This message has been scanned for viruses and
>> dangerous content by *MailScanner* <http://www.mailscanner.info/>, and is
>> believed to be clean.



Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-06 Thread Paul Kudla
  process_limit = 1000
  client_limit = 100
  vsz_limit = 512m
 }


service imap-urlauth-login {
  process_limit = 1000
  client_limit = 1000
  vsz_limit = 1g
}


service imap-login {
  process_limit=1000
  client_limit = 1000
  vsz_limit = 1g
 }


protocol sieve {
  managesieve_implementation_string = Dovecot Pigeonhole
  managesieve_max_line_length = 65536
}




#Addition ssl config
!include sni.conf

with sni cert support (examples)

# cat sni.conf
#sni.conf
ssl = yes
verbose_ssl = yes
ssl_dh =password_query = SELECT username as user, password FROM email_users 
WHERE username = '%u' and password <> 'alias' and status = True and 
destination = '%u'


user_query = SELECT home, uid, gid FROM email_users WHERE username = 
'%u' and password <> 'alias' and status = True and destination = '%u'


#iterate_query = SELECT user, password FROM email_users WHERE username = 
'%u' and password <> 'alias' and status = True and destination = '%u'


iterate_query = SELECT "username" as user, domain FROM email_users WHERE 
status = True and alias_flag = False






Happy Friday !!!
Thanks - paul

Paul Kudla


Scom.ca Internet Services <http://www.scom.ca>
004-1009 Byron Street South
Whitby, Ontario - Canada
L1N 4S3

Toronto 416.642.7266
Main 1.866.411.7266
Fax 1.888.892.7266
Email p...@scom.ca

On 1/6/2023 5:32 AM, Gerben Wierda wrote:


On 6 Jan 2023, at 08:53, Aki Tuomi <mailto:aki.tu...@open-xchange.com>> wrote:




On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda 
mailto:gerben.wie...@rna.nl>> wrote:

One step further in my quest to create a replacement mail server.

I now have my old mail server (2.3.19.1, macOS + MacPorts) and my new 
(2.3.20, Alpine Linux, Docker, apk package). When I turn on 
replication it works, but, after a while I see:


Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when 
allocating 268435496 bytes
Jan 06 00:50:32 replicator: Fatal: master: service(replicator): child 
133 killed with signal 6 (core dumped)
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: 
replication(sysbh): Sync failure:
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: 
replication(sysbh): Remote sent invalid input: -


I've removed synchronous operation for now (found a message on the 
net suggesting that) but is this known and what does it mean?


Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda 
<https://www.linkedin.com/in/gerbenwierda>>)

R IT Strategy <https://ea.rna.nl/ <https://ea.rna.nl/>> (main site)
Book: Chess and the Art of Enterprise Architecture 
<https://ea.rna.nl/the-book/ <https://ea.rna.nl/the-book/>>
Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/ 
<https://ea.rna.nl/the-book-edition-iii/>>




Dovecot default memory limit is 256M. You should probably set

service replicator {
 vsz_limit = 2G
}

because replicator might have to use more memory, especially for 
larger indexes.


Aki


That is a good tip as well.

I had followed this bit of experience from someone else: 
https://marc.info/?l=dovecot=164438199727640 
<https://marc.info/?l=dovecot=164438199727640>, haven't seen any err 
message since. But that might be because they are in sync now and both 
sides are aware. Can I trigger full replication again so I can test?


Gerben

--
This message has been scanned for viruses and
dangerous content by *MailScanner* <http://www.mailscanner.info/>, and is
believed to be clean.


Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-06 Thread Gerben Wierda

> On 6 Jan 2023, at 08:53, Aki Tuomi  wrote:
> 
> 
> 
> On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda  
> wrote:
>> One step further in my quest to create a replacement mail server.
>> 
>> I now have my old mail server (2.3.19.1, macOS + MacPorts) and my new 
>> (2.3.20, Alpine Linux, Docker, apk package). When I turn on replication it 
>> works, but, after a while I see:
>> 
>> Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when allocating 
>> 268435496 bytes
>> Jan 06 00:50:32 replicator: Fatal: master: service(replicator): child 133 
>> killed with signal 6 (core dumped)
>> Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): Sync 
>> failure: 
>> Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): 
>> Remote sent invalid input: -
>> 
>> I've removed synchronous operation for now (found a message on the net 
>> suggesting that) but is this known and what does it mean?
>> 
>> Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>)
>> R IT Strategy <https://ea.rna.nl/> (main site)
>> Book: Chess and the Art of Enterprise Architecture 
>> <https://ea.rna.nl/the-book/>
>> Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>
>> 
> 
> Dovecot default memory limit is 256M. You should probably set
> 
> service replicator {
>  vsz_limit = 2G
> }
> 
> because replicator might have to use more memory, especially for larger 
> indexes. 
> 
> Aki

That is a good tip as well. 

I had followed this bit of experience from someone else: 
https://marc.info/?l=dovecot=164438199727640 
<https://marc.info/?l=dovecot=164438199727640>, haven't seen any err message 
since. But that might be because they are in sync now and both sides are aware. 
Can I trigger full replication again so I can test?

Gerben

Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-06 Thread Aki Tuomi



On January 6, 2023 12:21:45 PM GMT+02:00, justina colmena ~biz 
 wrote:
>On Thursday, January 5, 2023 10:53:13 PM AKST Aki Tuomi wrote:
>> On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda 
> wrote:
>> >Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when
>> >allocating 268435496 bytes Jan 06 00:50:32 replicator: Fatal: master:
>>  ...
>> service replicator {
>>   vsz_limit = 2G
>> }
>> 
>> because replicator might have to use more memory, especially for larger
>> indexes.
>> 
>> Aki
>That's probably as good a short-term fix as any, but a longer term fix will 
>probably require effectively "going on a diet," losing weight, cracking down 
>on 
>memory leaks, matching up every malloc() and free() and getting leaner and 
>meaner with the memory allocation and Big-O time & space complexity of 
>algorithms.

mmaps are counted against vsz_limit so if you got index+cache over 256M you 
will run against the limit. 

Aki


Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-06 Thread justina colmena ~biz
On Thursday, January 5, 2023 10:53:13 PM AKST Aki Tuomi wrote:
> On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda 
 wrote:
> >Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when
> >allocating 268435496 bytes Jan 06 00:50:32 replicator: Fatal: master:
>  ...
> service replicator {
>   vsz_limit = 2G
> }
> 
> because replicator might have to use more memory, especially for larger
> indexes.
> 
> Aki
That's probably as good a short-term fix as any, but a longer term fix will 
probably require effectively "going on a diet," losing weight, cracking down on 
memory leaks, matching up every malloc() and free() and getting leaner and 
meaner with the memory allocation and Big-O time & space complexity of 
algorithms.
-- 
https://justina.abeja.colmena.biz/

signature.asc
Description: This is a digitally signed message part.


Re: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-05 Thread Aki Tuomi



On January 6, 2023 3:56:39 AM GMT+02:00, Gerben Wierda  
wrote:
>One step further in my quest to create a replacement mail server.
>
>I now have my old mail server (2.3.19.1, macOS + MacPorts) and my new (2.3.20, 
>Alpine Linux, Docker, apk package). When I turn on replication it works, but, 
>after a while I see:
>
>Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when allocating 
>268435496 bytes
>Jan 06 00:50:32 replicator: Fatal: master: service(replicator): child 133 
>killed with signal 6 (core dumped)
>Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): Sync 
>failure: 
>Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): Remote 
>sent invalid input: -
>
>I've removed synchronous operation for now (found a message on the net 
>suggesting that) but is this known and what does it mean?
>
>Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>)
>R IT Strategy <https://ea.rna.nl/> (main site)
>Book: Chess and the Art of Enterprise Architecture 
><https://ea.rna.nl/the-book/>
>Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>
>

Dovecot default memory limit is 256M. You should probably set

service replicator {
  vsz_limit = 2G
}

because replicator might have to use more memory, especially for larger 
indexes. 

Aki


replicator: Panic: data stack: Out of memory when allocating 268435496 bytes

2023-01-05 Thread Gerben Wierda
One step further in my quest to create a replacement mail server.

I now have my old mail server (2.3.19.1, macOS + MacPorts) and my new (2.3.20, 
Alpine Linux, Docker, apk package). When I turn on replication it works, but, 
after a while I see:

Jan 06 00:50:31 replicator: Panic: data stack: Out of memory when allocating 
268435496 bytes
Jan 06 00:50:32 replicator: Fatal: master: service(replicator): child 133 
killed with signal 6 (core dumped)
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): Sync 
failure: 
Jan 06 00:50:32 lmtp(pid 195 user sysbh): Warning: replication(sysbh): Remote 
sent invalid input: -

I've removed synchronous operation for now (found a message on the net 
suggesting that) but is this known and what does it mean?

Gerben Wierda (LinkedIn <https://www.linkedin.com/in/gerbenwierda>)
R IT Strategy <https://ea.rna.nl/> (main site)
Book: Chess and the Art of Enterprise Architecture <https://ea.rna.nl/the-book/>
Book: Mastering ArchiMate <https://ea.rna.nl/the-book-edition-iii/>