Re: SOLR/Index?

2019-04-14 Thread Aki Tuomi via dovecot
On 15.4.2019 3.33, Larry Rosenman via dovecot wrote: > ⌂72% [l...@thebighonker.lerctr.org:~] $ doveadm search mailbox > lists/freebsd/ports-commiters  body 'sysutils' > [l...@thebighonker.lerctr.org:~] $ doveadm fts rescan > [l...@thebighonker.lerctr.org:~] $ doveadm index -q >

Re: SOLR/Index?

2019-04-14 Thread Larry Rosenman via dovecot
⌂72% [l...@thebighonker.lerctr.org:~] $ doveadm search mailbox lists/freebsd/ports-commiters body 'sysutils' [l...@thebighonker.lerctr.org:~] $ doveadm fts rescan [l...@thebighonker.lerctr.org:~] $ doveadm index -q lists/freebsd/ports-commiters ⌂64% [l...@thebighonker.lerctr.org:~] $ tail -f

Re: SOLR/Index?

2019-04-14 Thread John Fawcett via dovecot
On 15/04/2019 01:39, Larry Rosenman via dovecot wrote: > > full solr.log at: > https://www.lerctr.org/~ler/solr.log > > The search DOES make it to SOLR: > ⌂77% [l...@thebighonker.lerctr.org:~] 130 $ grep sysutils > /var/log/solr/solr.log > 2019-04-14 18:31:34.749 INFO  (qtp349420578-7538) [   

Re: SOLR/Index?

2019-04-14 Thread Larry Rosenman via dovecot
full solr.log at: https://www.lerctr.org/~ler/solr.log The search DOES make it to SOLR: ⌂77% [l...@thebighonker.lerctr.org:~] 130 $ grep sysutils /var/log/solr/solr.log 2019-04-14 18:31:34.749 INFO (qtp349420578-7538) [ x:dovecot] o.a.s.c.S.Request [dovecot] webapp=/solr path=/select

Re: SOLR/Index?

2019-04-14 Thread John Fawcett via dovecot
On 15/04/2019 01:15, Larry Rosenman via dovecot wrote: > Given all the discussion on FTS/Solr, etc, I have a question: > > I have autoindex set, and searching in roundcube most of the time does > NOT find things, > HOWEVER if I do: > doveadm fts rescan > doveadm index > > I can find things in the

SOLR/Index?

2019-04-14 Thread Larry Rosenman via dovecot
Given all the discussion on FTS/Solr, etc, I have a question: I have autoindex set, and searching in roundcube most of the time does NOT find things, HOWEVER if I do: doveadm fts rescan doveadm index I can find things in the mailboxes. WHY? (doveconf -n attached). -- Larry Rosenman

Re: dovecot Digest, Vol 192, Issue 52

2019-04-14 Thread Shawn Heisey via dovecot
On 4/14/2019 8:59 AM, Peter Mogensen via dovecot wrote: I run with SOLR_JAVA_MEM="-Xmx8g -Xms2g" Without other details, I cannot even offer a guess as to whether an 8GB heap is enough. How many documents are in all the indexes that Solr instance is handling? Can you share your

Re: [PATCH] Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread Shawn Heisey via dovecot
On 4/14/2019 7:59 AM, John Fawcett via dovecot wrote: From dovecot point of view I can see the following as potentially useful features: 1) a configurable batch size would enable to tune the number of emails per request and help stay under the 60 seconds hard coded http request timeout. A

Re: Fwd: Problem with solr working, but not indexing

2019-04-14 Thread TG Servers via dovecot
Thanks for providing help this quick! It's always the small things I just added now     mail_plugins = $mail_plugins fts fts_solr globally, right in front of the 2 protocol sections and it is indexing like hell now :) It seems it

Re: Fwd: Problem with solr working, but not indexing

2019-04-14 Thread Aki Tuomi via dovecot
You need to load it either globally or for doveadm protocol as well. Loading it globally should be safe. Aki On 14 April 2019 23:36 TG Servers via dovecot wrote: I have this in my

Fwd: Problem with solr working, but not indexing

2019-04-14 Thread TG Servers via dovecot
I have this in my dovecot.conf already, yes : protocol imap {     mail_plugins = $mail_plugins quota imap_quota imap_sieve fts fts_solr     mail_max_userip_connections = 20     imap_idle_notify_interval = 24 mins }

Re: Problem with solr working, but not indexing

2019-04-14 Thread Aki Tuomi via dovecot
On 14 April 2019 23:22 TG Servers via dovecot wrote: Hi,I have setup dovecot 2.3.5.1 with solr 7.7.1Everything seems to be working so far except that solr doesn't index a single message.Solr is running, the web api can be accessed, I see

Problem with solr working, but not indexing

2019-04-14 Thread TG Servers via dovecot
Hi, I have setup dovecot 2.3.5.1 with solr 7.7.1 Everything seems to be working so far except that solr doesn't index a single message. Solr is running, the web api can be accessed, I see the dovecot core there, but with zero docs. If I

Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread John Fawcett via dovecot
On 14/04/2019 17:55, John Fawcett via dovecot wrote: > The solr server is a small test virtual machine with 0.2 (shared) vCPU > and 0.6MB of memory and non SSD storage. It can index around 2000 emails > per minute when there is no other activity. Average email size is about > 45Kb. I'm not

Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread John Fawcett via dovecot
On 14/04/2019 17:16, Peter Mogensen via dovecot wrote: > sorry... I got distracted half way and forgot to put a meaningfull > subject so the archive could figure out the thread. - resending. > > On 4/14/19 4:04 PM, dovecot-requ...@dovecot.org wrote: > >>> Solr ships with autoCommit set to 15

Re: [PATCH] Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread John Fawcett via dovecot
On 14/04/2019 16:04, Aki Tuomi via dovecot wrote: > >> On 14 April 2019 16:59 John Fawcett via dovecot < dovecot@dovecot.org >> > wrote: >> >> >> On 13/04/2019 17:16, Shawn Heisey via dovecot wrote: >>> On 4/13/2019 4:29 AM, John Fawcett via dovecot wrote: If this

Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread Peter Mogensen via dovecot
sorry... I got distracted half way and forgot to put a meaningfull subject so the archive could figure out the thread. - resending. On 4/14/19 4:04 PM, dovecot-requ...@dovecot.org wrote: >> Solr ships with autoCommit set to 15 seconds and openSearcher set to >> false on the autoCommit.? The

Re: dovecot Digest, Vol 192, Issue 52

2019-04-14 Thread Peter Mogensen via dovecot
On 4/14/19 4:04 PM, dovecot-requ...@dovecot.org wrote: >> Solr ships with autoCommit set to 15 seconds and openSearcher set to >> false on the autoCommit.? The autoSoftCommit setting is not enabled by >> default, but depending on how the index was created, Solr might try to >> set

Re: Mail account brute force / harassment

2019-04-14 Thread mj via dovecot
Hi, On 4/12/19 11:05 PM, Joseph Tam via dovecot wrote: "www.blocklist.de" is a nifty source.  Could you suggest other publically available blacklists? The ones we are using are: "file:///etc/ipset-blacklist/ip-blacklist-custom.list" # optional, for your personal nemeses (no typo,

Re: [PATCH] Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread Aki Tuomi via dovecot
On 14 April 2019 16:59 John Fawcett via dovecot < dovecot@dovecot.org> wrote: On 13/04/2019 17:16, Shawn Heisey via dovecot wrote: On 4/13/2019 4:29 AM, John Fawcett via dovecot wrote: If

[PATCH] Re: Solr connection timeout hardwired to 60s

2019-04-14 Thread John Fawcett via dovecot
On 13/04/2019 17:16, Shawn Heisey via dovecot wrote: > On 4/13/2019 4:29 AM, John Fawcett via dovecot wrote: >> If this value was made configurable people could set it to what they >> want. However the underlying problem is likely on solr configuration. > > The Jetty that is included in Solr has

Re: permissions for quota-status

2019-04-14 Thread Aki Tuomi via dovecot
On 14 April 2019 16:17 Andreas Meyer via dovecot < dovecot@dovecot.org> wrote: Hello! doveconf --version 2.2.36 I want to move to a new server with dovecot but get an error

permissions for quota-status

2019-04-14 Thread Andreas Meyer via dovecot
Hello! doveconf --version 2.2.36 I want to move to a new server with dovecot but get an error Error: service(quota-status): listen(*, 12340) failed: Permission denied when I define service quota-status { executable = quota-status -p postfix inet_listener { port = 12340 }

Re: FTS delays

2019-04-14 Thread Joan Moreau via dovecot
I have tried to spend some time of understanding the logic (if any !) of the fts part Honestly, the one who created this mess shall be the one to fix it, or one shall refactor it totally. Basically, the fts "core" should be able to do - select the backend according to conf file - send

nginx configuration to pass x-originating-ip

2019-04-14 Thread André Rodier via dovecot
Hello, There is a bug in SOGo, as it sends the original IP after successful login, and not before the login process. I traced the bug to the source code. https://sogo.nu/bugs/view.php?id=2979. Then, in my research, I found this old thread:

Re: Extended logging / moved mails jumping back

2019-04-14 Thread Reto Brunner via dovecot
On Sun, Apr 14, 2019 at 12:04:36PM +0200, Martin Müller via dovecot wrote: > relay=dovecot, delay=0.13, delays=0.07/0/0/0.06, dsn=4.3.0, status=deferred > (temporary failure. Command output: Can't open log file > /var/log/mail.dovecot-error: Permission denied ) >[...] > Here the output of ls -la

Re: Extended logging / moved mails jumping back

2019-04-14 Thread Martin Müller via dovecot
Hi! Now I have to check, if this a Thunderbird-Issue or is this a dovecot-issue. For that reason, I will activate the extended logging of dovecot. I cant see such events in the logfiles. Which switch is to turn on to log all events? Or do anyone know the reason for the annoying

Re: Post login scripts environment

2019-04-14 Thread André Rodier via dovecot
On Sun, 2019-04-07 at 19:03 +0300, Aki Tuomi wrote: > > On 7 April 2019 18:55 Aki Tuomi via dovecot wrote: > > > > > > > On 7 April 2019 18:45 André Rodier via dovecot > > > wrote: > > > > > > > > > On Sun, 2019-04-07 at 17:49 +0300, Aki Tuomi via dovecot wrote: > > > > > On 7 April 2019