Re: dovecot fts hangs on search

2018-05-05 Thread André Rodier

Hello Teemu,

I am working on this today.

The errors I have might be an artefact of the virtual machine I am using 
(KVM), especially the multiple snapshots. I will send a confirmation 
when I am sure.


However, I had some difficulties understanding the principle of the 
original script, and how it runs. Perhaps the documentation can be 
improved a little bit.


Kind regards,
André

On 04/05/18 07:11, Teemu Huovila wrote:

Hello

Could you plese
1. send the full output of doveconf -n
2. Check the SOLR logs for any errors
3. Describe your dovecot architecture, ie. if  you are running a single backend 
or a more complex configuration.
4. Provide a backtrace of the core dump using the instructions on 
https://dovecot.org/bugreport.html

br,
Teemu

On 04.05.2018 01:13, André Rodier wrote:

On 02/05/18 22:17, André Rodier wrote:

On 02/05/18 11:45, André Rodier wrote:

On 2018-05-01 21:29, André Rodier wrote:

On 2018-05-01 07:22, André Rodier wrote:

Hello,

I am trying to use Doevecot fts, with solr the script provided.

To rebuild the index, I use the command:
doveadm -D index -u mirina 'inbox'

To rescan, I use: doveadm -D fts rescan -u mirina

But when I do a search, with doveadm, the program hangs:

doveadm -D search -u mirina text Madagascar


Debug: Loading modules from directory: /usr/lib/dovecot/modules
Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so
Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: 
acl_lookup_dict_iterate_visible_next (this is usually intentional, so just 
ignore this message)
Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined 
symbol: expire_set_deinit (this is usually intentional, so just ignore this 
message)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined 
symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore 
this m$
ssage)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined 
symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just 
ignore thi$ message)
doveadm(mirina): Debug: auth USER input: mirina home=/home/users/mirina 
uid=1002 gid=1001 mail=mirina@homebox.space
doveadm(mirina): Debug: Added userdb setting: mail=mirina@homebox.space 
doveadm(mirina): Debug: Effective uid=1002, gid=1001, home=/home/users/mirina
doveadm(mirina): Debug: Quota root: name=User quota backend=maildir args=
doveadm(mirina): Debug: Quota rule: root=User quota mailbox=* bytes=2147483648 
messages=0
doveadm(mirina): Debug: Quota grace: root=User quota bytes=214748364 (10%)
doveadm(mirina): Debug: Namespace inbox: type=private, prefix=, sep=/, 
inbox=yes, hidden=no, list=yes, subscriptions=yes 
location=maildir:~/mails/maildir:INDEX=~/mails/indexes/
doveadm(mirina): Debug: maildir++: root=/home/users/mirina/mails/maildir, 
index=/home/users/mirina/mails/indexes, indexpvt=, control=, 
inbox=/home/users/mirina/mails/maildir, alt=
doveadm(mirina): Debug: quota: quota_over_flag check: STORAGE ret=1 value=134 
limit=2097152
doveadm(mirina): Debug: quota: quota_over_flag check: MESSAGE ret=0 value=3 
limit=0
doveadm(mirina): Debug: quota: quota_over_flag=0((null)) vs currently 
overquota=0
doveadm(mirina): Debug: Namespace : Using permissions from 
/home/users/mirina/mails/maildir: mode=0700 gid=default
doveadm(mirina): Debug: http-client: host localhost: Host created
doveadm(mirina): Debug: http-client: host localhost: DNS lookup successful; got 
2 IPs
doveadm(mirina): Debug: http-client: peer [::1]:8080: Peer created
doveadm(mirina): Debug: http-client: queue http://localhost:8080: Setting up 
connection to [::1]:8080 (1 requests pending)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Linked queue 
http://localhost:8080 (1 queues linked)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: Started new 
connection to [::1]:8080
doveadm(mirina): Debug: http-client: request [Req1: GET 
http://localhost:8080/solr/select?fl=uid,score=1=uid+asc=%7b!lucene+q.op%3dAND%7d(hdr:Madagascar+OR+body:Madagascar)=%2Bbox:838a1701af1ae65a3e1232c62018+%2Buser:mi$
ina]: Submitted
doveadm(mirina): Debug: http-client: Waiting for 1 requests to finish
doveadm(mirina): Debug: 

Re: dovecot fts hangs on search

2018-05-04 Thread Teemu Huovila
Hello

Could you plese
1. send the full output of doveconf -n
2. Check the SOLR logs for any errors
3. Describe your dovecot architecture, ie. if  you are running a single backend 
or a more complex configuration.
4. Provide a backtrace of the core dump using the instructions on 
https://dovecot.org/bugreport.html

br,
Teemu

On 04.05.2018 01:13, André Rodier wrote:
> On 02/05/18 22:17, André Rodier wrote:
>> On 02/05/18 11:45, André Rodier wrote:
>>> On 2018-05-01 21:29, André Rodier wrote:
 On 2018-05-01 07:22, André Rodier wrote:
> Hello,
>
> I am trying to use Doevecot fts, with solr the script provided.
>
> To rebuild the index, I use the command:
> doveadm -D index -u mirina 'inbox'
>
> To rescan, I use: doveadm -D fts rescan -u mirina
>
> But when I do a search, with doveadm, the program hangs:
>
> doveadm -D search -u mirina text Madagascar
>
>> Debug: Loading modules from directory: /usr/lib/dovecot/modules
>> Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so
>> Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so
>> Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so
>> Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm
>> Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
>> /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined 
>> symbol: acl_lookup_dict_iterate_visible_next (this is usually 
>> intentional, so just ignore this message)
>> Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: 
>> /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: 
>> undefined symbol: expire_set_deinit (this is usually intentional, so 
>> just ignore this message)
>> Debug: Module loaded: 
>> /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so
>> Debug: Module loaded: 
>> /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so
>> Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() 
>> failed: 
>> /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: 
>> undefined symbol: lucene_index_iter_deinit (this is usually intentional, 
>> so just ignore this m$
>> ssage)
>> Debug: Module loaded: 
>> /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so
>> Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() 
>> failed: 
>> /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: 
>> undefined symbol: mail_crypt_box_get_pvt_digests (this is usually 
>> intentional, so just ignore thi$ message)
>> doveadm(mirina): Debug: auth USER input: mirina home=/home/users/mirina 
>> uid=1002 gid=1001 mail=mirina@homebox.space
>> doveadm(mirina): Debug: Added userdb setting: mail=mirina@homebox.space 
>> doveadm(mirina): Debug: Effective uid=1002, gid=1001, 
>> home=/home/users/mirina
>> doveadm(mirina): Debug: Quota root: name=User quota backend=maildir args=
>> doveadm(mirina): Debug: Quota rule: root=User quota mailbox=* 
>> bytes=2147483648 messages=0
>> doveadm(mirina): Debug: Quota grace: root=User quota bytes=214748364 
>> (10%)
>> doveadm(mirina): Debug: Namespace inbox: type=private, prefix=, sep=/, 
>> inbox=yes, hidden=no, list=yes, subscriptions=yes 
>> location=maildir:~/mails/maildir:INDEX=~/mails/indexes/
>> doveadm(mirina): Debug: maildir++: 
>> root=/home/users/mirina/mails/maildir, 
>> index=/home/users/mirina/mails/indexes, indexpvt=, control=, 
>> inbox=/home/users/mirina/mails/maildir, alt=
>> doveadm(mirina): Debug: quota: quota_over_flag check: STORAGE ret=1 
>> value=134 limit=2097152
>> doveadm(mirina): Debug: quota: quota_over_flag check: MESSAGE ret=0 
>> value=3 limit=0
>> doveadm(mirina): Debug: quota: quota_over_flag=0((null)) vs currently 
>> overquota=0
>> doveadm(mirina): Debug: Namespace : Using permissions from 
>> /home/users/mirina/mails/maildir: mode=0700 gid=default
>> doveadm(mirina): Debug: http-client: host localhost: Host created
>> doveadm(mirina): Debug: http-client: host localhost: DNS lookup 
>> successful; got 2 IPs
>> doveadm(mirina): Debug: http-client: peer [::1]:8080: Peer created
>> doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
>> Setting up connection to [::1]:8080 (1 requests pending)
>> doveadm(mirina): Debug: http-client: peer [::1]:8080: Linked queue 
>> http://localhost:8080 (1 queues linked)
>> doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
>> Started new connection to [::1]:8080
>> doveadm(mirina): Debug: http-client: request [Req1: GET 
>> 

Re: dovecot fts hangs on search

2018-05-03 Thread André Rodier

On 02/05/18 22:17, André Rodier wrote:

On 02/05/18 11:45, André Rodier wrote:

On 2018-05-01 21:29, André Rodier wrote:

On 2018-05-01 07:22, André Rodier wrote:

Hello,

I am trying to use Doevecot fts, with solr the script provided.

To rebuild the index, I use the command:
doveadm -D index -u mirina 'inbox'

To rescan, I use: doveadm -D fts rescan -u mirina

But when I do a search, with doveadm, the program hangs:

doveadm -D search -u mirina text Madagascar


Debug: Loading modules from directory: /usr/lib/dovecot/modules
Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/lib21_fts_solr_plugin.so
Debug: Loading modules from directory: 
/usr/lib/dovecot/modules/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: 
undefined symbol: acl_lookup_dict_iterate_visible_next (this is 
usually intentional, so just ignore this message)
Debug: Skipping module doveadm_expire_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: 
undefined symbol: expire_set_deinit (this is usually intentional, 
so just ignore this message)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined 
symbol: lucene_index_iter_deinit (this is usually intentional, so 
just ignore this m$

ssage)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: 
undefined symbol: mail_crypt_box_get_pvt_digests (this is usually 
intentional, so just ignore thi$ message)
doveadm(mirina): Debug: auth USER input: mirina 
home=/home/users/mirina uid=1002 gid=1001 mail=mirina@homebox.space
doveadm(mirina): Debug: Added userdb setting: 
mail=mirina@homebox.space doveadm(mirina): Debug: Effective 
uid=1002, gid=1001, home=/home/users/mirina
doveadm(mirina): Debug: Quota root: name=User quota backend=maildir 
args=
doveadm(mirina): Debug: Quota rule: root=User quota mailbox=* 
bytes=2147483648 messages=0
doveadm(mirina): Debug: Quota grace: root=User quota 
bytes=214748364 (10%)
doveadm(mirina): Debug: Namespace inbox: type=private, prefix=, 
sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes 
location=maildir:~/mails/maildir:INDEX=~/mails/indexes/
doveadm(mirina): Debug: maildir++: 
root=/home/users/mirina/mails/maildir, 
index=/home/users/mirina/mails/indexes, indexpvt=, control=, 
inbox=/home/users/mirina/mails/maildir, alt=
doveadm(mirina): Debug: quota: quota_over_flag check: STORAGE ret=1 
value=134 limit=2097152
doveadm(mirina): Debug: quota: quota_over_flag check: MESSAGE ret=0 
value=3 limit=0
doveadm(mirina): Debug: quota: quota_over_flag=0((null)) vs 
currently overquota=0
doveadm(mirina): Debug: Namespace : Using permissions from 
/home/users/mirina/mails/maildir: mode=0700 gid=default

doveadm(mirina): Debug: http-client: host localhost: Host created
doveadm(mirina): Debug: http-client: host localhost: DNS lookup 
successful; got 2 IPs

doveadm(mirina): Debug: http-client: peer [::1]:8080: Peer created
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Setting up connection to [::1]:8080 (1 requests pending)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Linked queue 
http://localhost:8080 (1 queues linked)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Started new connection to [::1]:8080
doveadm(mirina): Debug: http-client: request [Req1: GET 
http://localhost:8080/solr/select?fl=uid,score=1=uid+asc=%7b!lucene+q.op%3dAND%7d(hdr:Madagascar+OR+body:Madagascar)=%2Bbox:838a1701af1ae65a3e1232c62018+%2Buser:mi$ 


ina]: Submitted
doveadm(mirina): Debug: http-client: Waiting for 1 requests to finish
doveadm(mirina): Debug: http-client: peer [::1]:8080: Creating 1 
new connections to handle requests (already 0 usable, connecting to 
0, closing 0)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Making new 
connection 1 of 1
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: HTTP 
connection created (1 parallel connections exist)

doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Connected
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Ready for 
requests
doveadm(mirina): Debug: http-client: peer [::1]:8080: Successfully 
connected (connections=1)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Using 1 idle 
connections to handle 1 requests (1 total connections ready)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Connection to peer [::1]:8080 

Re: dovecot fts hangs on search

2018-05-02 Thread André Rodier

On 02/05/18 11:45, André Rodier wrote:

On 2018-05-01 21:29, André Rodier wrote:

On 2018-05-01 07:22, André Rodier wrote:

Hello,

I am trying to use Doevecot fts, with solr the script provided.

To rebuild the index, I use the command:
doveadm -D index -u mirina 'inbox'

To rescan, I use: doveadm -D fts rescan -u mirina

But when I do a search, with doveadm, the program hangs:

doveadm -D search -u mirina text Madagascar


Debug: Loading modules from directory: /usr/lib/dovecot/modules
Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so
Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: 
undefined symbol: acl_lookup_dict_iterate_visible_next (this is 
usually intentional, so just ignore this message)
Debug: Skipping module doveadm_expire_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: 
undefined symbol: expire_set_deinit (this is usually intentional, so 
just ignore this message)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: 
undefined symbol: lucene_index_iter_deinit (this is usually 
intentional, so just ignore this m$

ssage)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: 
undefined symbol: mail_crypt_box_get_pvt_digests (this is usually 
intentional, so just ignore thi$ message)
doveadm(mirina): Debug: auth USER input: mirina 
home=/home/users/mirina uid=1002 gid=1001 mail=mirina@homebox.space
doveadm(mirina): Debug: Added userdb setting: 
mail=mirina@homebox.space doveadm(mirina): Debug: Effective 
uid=1002, gid=1001, home=/home/users/mirina
doveadm(mirina): Debug: Quota root: name=User quota backend=maildir 
args=
doveadm(mirina): Debug: Quota rule: root=User quota mailbox=* 
bytes=2147483648 messages=0
doveadm(mirina): Debug: Quota grace: root=User quota bytes=214748364 
(10%)
doveadm(mirina): Debug: Namespace inbox: type=private, prefix=, 
sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes 
location=maildir:~/mails/maildir:INDEX=~/mails/indexes/
doveadm(mirina): Debug: maildir++: 
root=/home/users/mirina/mails/maildir, 
index=/home/users/mirina/mails/indexes, indexpvt=, control=, 
inbox=/home/users/mirina/mails/maildir, alt=
doveadm(mirina): Debug: quota: quota_over_flag check: STORAGE ret=1 
value=134 limit=2097152
doveadm(mirina): Debug: quota: quota_over_flag check: MESSAGE ret=0 
value=3 limit=0
doveadm(mirina): Debug: quota: quota_over_flag=0((null)) vs 
currently overquota=0
doveadm(mirina): Debug: Namespace : Using permissions from 
/home/users/mirina/mails/maildir: mode=0700 gid=default

doveadm(mirina): Debug: http-client: host localhost: Host created
doveadm(mirina): Debug: http-client: host localhost: DNS lookup 
successful; got 2 IPs

doveadm(mirina): Debug: http-client: peer [::1]:8080: Peer created
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Setting up connection to [::1]:8080 (1 requests pending)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Linked queue 
http://localhost:8080 (1 queues linked)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Started new connection to [::1]:8080
doveadm(mirina): Debug: http-client: request [Req1: GET 
http://localhost:8080/solr/select?fl=uid,score=1=uid+asc=%7b!lucene+q.op%3dAND%7d(hdr:Madagascar+OR+body:Madagascar)=%2Bbox:838a1701af1ae65a3e1232c62018+%2Buser:mi$ 


ina]: Submitted
doveadm(mirina): Debug: http-client: Waiting for 1 requests to finish
doveadm(mirina): Debug: http-client: peer [::1]:8080: Creating 1 new 
connections to handle requests (already 0 usable, connecting to 0, 
closing 0)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Making new 
connection 1 of 1
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: HTTP 
connection created (1 parallel connections exist)

doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Connected
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Ready for 
requests
doveadm(mirina): Debug: http-client: peer [::1]:8080: Successfully 
connected (connections=1)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Using 1 idle 
connections to handle 1 requests (1 total connections ready)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Connection to peer [::1]:8080 claimed request [Req1: GET 

Re: dovecot fts hangs on search

2018-05-02 Thread André Rodier

On 2018-05-01 21:29, André Rodier wrote:

On 2018-05-01 07:22, André Rodier wrote:

Hello,

I am trying to use Doevecot fts, with solr the script provided.

To rebuild the index, I use the command:
doveadm -D index -u mirina 'inbox'

To rescan, I use: doveadm -D fts rescan -u mirina

But when I do a search, with doveadm, the program hangs:

doveadm -D search -u mirina text Madagascar


Debug: Loading modules from directory: /usr/lib/dovecot/modules
Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/lib21_fts_solr_plugin.so
Debug: Loading modules from directory: 
/usr/lib/dovecot/modules/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: 
undefined symbol: acl_lookup_dict_iterate_visible_next (this is 
usually intentional, so just ignore this message)
Debug: Skipping module doveadm_expire_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: 
undefined symbol: expire_set_deinit (this is usually intentional, so 
just ignore this message)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: 
undefined symbol: lucene_index_iter_deinit (this is usually 
intentional, so just ignore this m$

ssage)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: 
undefined symbol: mail_crypt_box_get_pvt_digests (this is usually 
intentional, so just ignore thi$ message)
doveadm(mirina): Debug: auth USER input: mirina 
home=/home/users/mirina uid=1002 gid=1001 mail=mirina@homebox.space
doveadm(mirina): Debug: Added userdb setting: 
mail=mirina@homebox.space doveadm(mirina): Debug: Effective uid=1002, 
gid=1001, home=/home/users/mirina
doveadm(mirina): Debug: Quota root: name=User quota backend=maildir 
args=
doveadm(mirina): Debug: Quota rule: root=User quota mailbox=* 
bytes=2147483648 messages=0
doveadm(mirina): Debug: Quota grace: root=User quota bytes=214748364 
(10%)
doveadm(mirina): Debug: Namespace inbox: type=private, prefix=, 
sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes 
location=maildir:~/mails/maildir:INDEX=~/mails/indexes/
doveadm(mirina): Debug: maildir++: 
root=/home/users/mirina/mails/maildir, 
index=/home/users/mirina/mails/indexes, indexpvt=, control=, 
inbox=/home/users/mirina/mails/maildir, alt=
doveadm(mirina): Debug: quota: quota_over_flag check: STORAGE ret=1 
value=134 limit=2097152
doveadm(mirina): Debug: quota: quota_over_flag check: MESSAGE ret=0 
value=3 limit=0
doveadm(mirina): Debug: quota: quota_over_flag=0((null)) vs currently 
overquota=0
doveadm(mirina): Debug: Namespace : Using permissions from 
/home/users/mirina/mails/maildir: mode=0700 gid=default

doveadm(mirina): Debug: http-client: host localhost: Host created
doveadm(mirina): Debug: http-client: host localhost: DNS lookup 
successful; got 2 IPs

doveadm(mirina): Debug: http-client: peer [::1]:8080: Peer created
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Setting up connection to [::1]:8080 (1 requests pending)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Linked queue 
http://localhost:8080 (1 queues linked)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Started new connection to [::1]:8080
doveadm(mirina): Debug: http-client: request [Req1: GET 
http://localhost:8080/solr/select?fl=uid,score=1=uid+asc=%7b!lucene+q.op%3dAND%7d(hdr:Madagascar+OR+body:Madagascar)=%2Bbox:838a1701af1ae65a3e1232c62018+%2Buser:mi$

ina]: Submitted
doveadm(mirina): Debug: http-client: Waiting for 1 requests to finish
doveadm(mirina): Debug: http-client: peer [::1]:8080: Creating 1 new 
connections to handle requests (already 0 usable, connecting to 0, 
closing 0)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Making new 
connection 1 of 1
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: HTTP 
connection created (1 parallel connections exist)

doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Connected
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Ready for 
requests
doveadm(mirina): Debug: http-client: peer [::1]:8080: Successfully 
connected (connections=1)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Using 1 idle 
connections to handle 1 requests (1 total connections ready)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Connection to peer [::1]:8080 claimed request [Req1: GET 

Re: dovecot fts hangs on search

2018-05-01 Thread André Rodier

On 2018-05-01 07:22, André Rodier wrote:

Hello,

I am trying to use Doevecot fts, with solr the script provided.

To rebuild the index, I use the command:
doveadm -D index -u mirina 'inbox'

To rescan, I use: doveadm -D fts rescan -u mirina

But when I do a search, with doveadm, the program hangs:

doveadm -D search -u mirina text Madagascar


Debug: Loading modules from directory: /usr/lib/dovecot/modules
Debug: Module loaded: /usr/lib/dovecot/modules/lib10_quota_plugin.so
Debug: Module loaded: /usr/lib/dovecot/modules/lib20_fts_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/lib21_fts_solr_plugin.so
Debug: Loading modules from directory: 
/usr/lib/dovecot/modules/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: 
undefined symbol: acl_lookup_dict_iterate_visible_next (this is 
usually intentional, so just ignore this message)
Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: 
undefined symbol: expire_set_deinit (this is usually intentional, so 
just ignore this message)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: 
undefined symbol: lucene_index_iter_deinit (this is usually 
intentional, so just ignore this m$

ssage)
Debug: Module loaded: 
/usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() 
failed: 
/usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: 
undefined symbol: mail_crypt_box_get_pvt_digests (this is usually 
intentional, so just ignore thi$ message)
doveadm(mirina): Debug: auth USER input: mirina 
home=/home/users/mirina uid=1002 gid=1001 mail=mirina@homebox.space
doveadm(mirina): Debug: Added userdb setting: 
mail=mirina@homebox.space doveadm(mirina): Debug: Effective uid=1002, 
gid=1001, home=/home/users/mirina
doveadm(mirina): Debug: Quota root: name=User quota backend=maildir 
args=
doveadm(mirina): Debug: Quota rule: root=User quota mailbox=* 
bytes=2147483648 messages=0
doveadm(mirina): Debug: Quota grace: root=User quota bytes=214748364 
(10%)
doveadm(mirina): Debug: Namespace inbox: type=private, prefix=, sep=/, 
inbox=yes, hidden=no, list=yes, subscriptions=yes 
location=maildir:~/mails/maildir:INDEX=~/mails/indexes/
doveadm(mirina): Debug: maildir++: 
root=/home/users/mirina/mails/maildir, 
index=/home/users/mirina/mails/indexes, indexpvt=, control=, 
inbox=/home/users/mirina/mails/maildir, alt=
doveadm(mirina): Debug: quota: quota_over_flag check: STORAGE ret=1 
value=134 limit=2097152
doveadm(mirina): Debug: quota: quota_over_flag check: MESSAGE ret=0 
value=3 limit=0
doveadm(mirina): Debug: quota: quota_over_flag=0((null)) vs currently 
overquota=0
doveadm(mirina): Debug: Namespace : Using permissions from 
/home/users/mirina/mails/maildir: mode=0700 gid=default

doveadm(mirina): Debug: http-client: host localhost: Host created
doveadm(mirina): Debug: http-client: host localhost: DNS lookup 
successful; got 2 IPs

doveadm(mirina): Debug: http-client: peer [::1]:8080: Peer created
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Setting up connection to [::1]:8080 (1 requests pending)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Linked queue 
http://localhost:8080 (1 queues linked)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Started new connection to [::1]:8080
doveadm(mirina): Debug: http-client: request [Req1: GET 
http://localhost:8080/solr/select?fl=uid,score=1=uid+asc=%7b!lucene+q.op%3dAND%7d(hdr:Madagascar+OR+body:Madagascar)=%2Bbox:838a1701af1ae65a3e1232c62018+%2Buser:mi$

ina]: Submitted
doveadm(mirina): Debug: http-client: Waiting for 1 requests to finish
doveadm(mirina): Debug: http-client: peer [::1]:8080: Creating 1 new 
connections to handle requests (already 0 usable, connecting to 0, 
closing 0)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Making new 
connection 1 of 1
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: HTTP 
connection created (1 parallel connections exist)

doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Connected
doveadm(mirina): Debug: http-client: conn [::1]:8080 [0]: Ready for 
requests
doveadm(mirina): Debug: http-client: peer [::1]:8080: Successfully 
connected (connections=1)
doveadm(mirina): Debug: http-client: peer [::1]:8080: Using 1 idle 
connections to handle 1 requests (1 total connections ready)
doveadm(mirina): Debug: http-client: queue http://localhost:8080: 
Connection to peer [::1]:8080 claimed request [Req1: GET