Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 21:50, Luca Olivetti via Info ha escrit: El 26/9/24 a les 20:34, Luca Olivetti via Info ha escrit: El 26/9/24 a les 19:52, Luca Olivetti via Info ha escrit: El 26/9/24 a les 19:43, Nels Lindquist ha escrit: OK, I'll try twoskip an report back Mmh, with twoskip the conversat

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 20:34, Luca Olivetti via Info ha escrit: El 26/9/24 a les 19:52, Luca Olivetti via Info ha escrit: El 26/9/24 a les 19:43, Nels Lindquist ha escrit: OK, I'll try twoskip an report back Mmh, with twoskip the conversations db is already 8.3GB, I don't think this is going to e

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 19:52, Luca Olivetti via Info ha escrit: El 26/9/24 a les 19:43, Nels Lindquist ha escrit: OK, I'll try twoskip an report back Mmh, with twoskip the conversations db is already 8.3GB, I don't think this is going to end well Bye -- Luca Olivetti Wetron Automation Techno

xapian search

2024-09-26 Thread Albert Shih
Hi, Beside using strace/gdb etc... (something I never used) is they are any way to be almost sure the search on the server use xapian ? For example how much time should a recursive search on a empty server should take inside ~250 000 mails with and without xapian index ? Regards -- Albert SH

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 19:43, Nels Lindquist ha escrit: Possibly noteworthy is that your debian package is only 3.6.1; most of the 3.6.x point releases up to 3.6.4 include fixes for squatter related bugs. Possibly that's the problem, but that's the version in the debian repository On your test

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Nels Lindquist
On 2024-09-26 5:05 AM, Luca Olivetti via Info wrote: El 26/9/24 a les 12:16, Albert Shih ha escrit: 3) I see that the (incomplete?) conversation db for my 9.8GB mailbox is 4.1GB, is that normal? root@vmail:~# ls -lh /var/lib/cyrus/user/l/luca.conversations -rw--- 1 cyrus mail 4.1G Sep 26 0

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Nels Lindquist
On 2024-09-26 3:47 AM, Albert Shih wrote: Le 25/09/2024 à 17:39:36-0600, Nels Lindquist a écrit On 2024-09-25 1:23 PM, Albert Shih wrote: You could try rebuilding the conversations databases with "ctl_conversationsdb -v -b -r". Did you try increasing search_batchsize? That was the "one thing"

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 13:05, Luca Olivetti via Info ha escrit: I "only" have around 60 messages. Anyway, ctl_conversationsdb also segfaulted for another user with just a handful of messages (around 7k, 650MB) when the conversations db, again, reached the 4.1GB size. These are my search para

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 12:16, Albert Shih ha escrit: 3) I see that the (incomplete?) conversation db for my 9.8GB mailbox is 4.1GB, is that normal? root@vmail:~# ls -lh /var/lib/cyrus/user/l/luca.conversations -rw--- 1 cyrus mail 4.1G Sep 26 09:06 /var/lib/cyrus/user/l/luca.conversations root@vma

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Albert Shih
Le 26/09/2024 à 10:30:53+0200, Luca Olivetti via Info a écrit > El 26/9/24 a les 1:39, Nels Lindquist ha escrit: Hi, > > I presume you have conversations.db enabled? It's required for xapian to > > work. Use twoskip for the conversations db format. > > I found that the hard way (squatter compla

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Albert Shih
Le 26/09/2024 à 09:31:51+0200, Vladislav Kurz a écrit Hi, > Dne 25. 09. 24 v 21:23 Albert Shih napsal(a): > > Hi everyone. > > > > So I would like to know what would be the most efficient method to > > bootstrap squatter. > > > > On my new server after sync almost all the mail I got, I try to

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Albert Shih
Le 25/09/2024 à 17:39:36-0600, Nels Lindquist a écrit Hi, > On 2024-09-25 1:23 PM, Albert Shih wrote: > > Hi everyone. > > > > So I would like to know what would be the most efficient method to > > bootstrap squatter. > > > > On my new server after sync almost all the mail I got, I try to «boot

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Luca Olivetti via Info
El 26/9/24 a les 1:39, Nels Lindquist ha escrit: I presume you have conversations.db enabled? It's required for xapian to work. Use twoskip for the conversations db format. I found that the hard way (squatter complained about it), but shouldn't it be mentioned in https://www.cyrusimap.org/3.

Re: How to «bootstrap» xapian/squatter

2024-09-26 Thread Vladislav Kurz
Dne 25. 09. 24 v 21:23 Albert Shih napsal(a): Hi everyone. So I would like to know what would be the most efficient method to bootstrap squatter. On my new server after sync almost all the mail I got, I try to «bootstrap» squatter, meaning I launch the command squatter. But it's take lot of tim