[FTS Xapian] RC release

2019-01-24 Thread Joan Moreau via dovecot
Hi, FTS Xapian matches my targets for the plugins (replacing deprecated fts-squat in a production environment) https://github.com/grosjo/fts-xapian Please do not hesitate to add "issues" on github, if the case happen Hope it helps JM

Encoding input

2019-01-22 Thread Joan Moreau via dovecot
Hi Are data inputs of fts_backend_update_build_more(struct fts_backend_update_context *_ctx, const unsigned char *data, size_t size) already converted to UTF8 ? Thanks

Re: Solr -> Xapian ?

2019-01-22 Thread Joan Moreau via dovecot
dovecot[20984]: indexer-worker(j...@grosjo.net)<20998>: DATA2(date)=TUE, 22 JAN 2019 09:25:49 +0100DATE Jan 22 08:25:50 gjserver dovecot[20984]: indexer-worker(j...@grosjo.net)<20998>: DATA(from)="JOAN MOREAU" Jan 22 08:25:50 gjserver dovecot[20984]: indexer-worker(j.

Re: Solr - complete setup (update)

2019-01-18 Thread Joan Moreau via dovecot
Yes, the " -property update.autoCreateFields -value false " seems interesting However, we smash the created schema just after On 2019-01-14 23:25, Stephan Bosch wrote: Op 14/01/2019 om 07:44 schreef Joan Moreau via dovecot: Hi Stephan, What's up with that ? Thank you so much

Repetitive indexing nd LOCK WRITE error

2019-01-16 Thread Joan Moreau via dovecot
Hi, Monitoring the Xapian plugin, I notice that dovecot is re-indexing multiple times the same Inbox for no apparent reason (not the last email received but the whole mailbox, LAST UID being properly returned (with the confusion already discussed) ) : Why so ? Also, I get a LOCK on the

Re: [FTS Xapian] Beta release

2019-01-14 Thread Joan Moreau via dovecot
ated. Is that something you can look into as well? On Mon, 14 Jan 2019 at 11:43, Joan Moreau mailto:j...@grosjo.net>> wrote: THank you Odhiambo. I updated accordingly On 2019-01-14 08:07, Odhiambo Washington wrote: In your README.md, perhaps "This project intends to provide a straight

Re: [FTS Xapian] Beta release

2019-01-14 Thread Joan Moreau via dovecot
It is indeed better is you use the issue tracker of github: https://github.com/grosjo/fts-xapian/issues I updated the Readme accordingly On 2019-01-14 14:24, Stephan Bosch wrote: Op 14-1-2019 om 13:40 schreef Aki Tuomi: Just to remind that now that there is a github repo for fts-xapian,

Re: [FTS Xapian] Beta release

2019-01-14 Thread Joan Moreau via dovecot
that (usually some separate package). Regards, Stephan. On 14. Jan 2019, at 10:33, Joan Moreau via dovecot mailto:dovecot@dovecot.org>> wrote: Difficult to figure out without a coredump + gdb I have also battled quite a lot to make sure dovecot can core dump on my Archlinux servers

Re: [FTS Xapian] Beta release

2019-01-14 Thread Joan Moreau via dovecot
il/iwascoding/paul/mdbox/xapian-indexes/db_9ddfe10d8a8a8a568c12654d370e Jan 14 09:26:08 mail dovecot: indexer-worker(p...@iwascoding.com)<16777>: Debug: Mailbox sent: UID 2: Opened mail because: fts indexing Jan 14 09:26:08 mail dovecot: indexer-worker(p...@iwascoding.com)<16777>:

Re: [FTS Xapian] Beta release

2019-01-14 Thread Joan Moreau via dovecot
to no avail). Custom Dovecot 2.3.4 on Debian Stretch. Thanks, Paul On 14. Jan 2019, at 07:42, Joan Moreau via dovecot wrote: Thank you Stephan. The version here shall be up and running : https://github.com/grosjo/fts-xapian On 2019-01-14 00:07, Stephan Bosch wrote: Op 13/01/2019 om 21:25 schreef

Re: [FTS Xapian] Beta release

2019-01-14 Thread Joan Moreau via dovecot
er?? Also in the part after cloning from git: ./configure --prefix=/usr --with-dovecot=/path/to/dovecot [ This /path/to/dovecot is not obvious. Is it the dovecot binary or what??] On Mon, 14 Jan 2019 at 09:42, Joan Moreau via dovecot wrote: Thank you Stephan. The version here shall be up a

Re: Solr - complete setup (update)

2019-01-13 Thread Joan Moreau via dovecot
Hi Stephan, What's up with that ? Thank you so much On 2019-01-05 02:04, Stephan Bosch wrote: Hi, Op 04/01/2019 om 05:36 schreef Joan Moreau via dovecot: Hi This is the summary of my work with SOLR-Dovecot, in my *quest to reproduce the previoulsy excellent work of fts_squat* @Aki

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
Thank you Stephan. The version here shall be up and running : https://github.com/grosjo/fts-xapian On 2019-01-14 00:07, Stephan Bosch wrote: Op 13/01/2019 om 21:25 schreef Joan Moreau via dovecot: I tried to combined it, the "autoreconf" errors are solved Now, when I type &qu

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
(or wherever dovecot installed its libraries) On 2019-01-13 21:25, Joan Moreau via dovecot wrote: I tried to combined it, the "autoreconf" errors are solved Now, when I type "make install", the lib is not pushed into dovecot folder, but somewhere in /usr/local/

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
te: You copied your Makefile.am there. Stephan made you a working version, can you try that? (sorry for dup) Aki Original message From: Joan Moreau Date: 13/01/2019 21:39 (GMT+02:00) To: Stephan Bosch Cc: Aki Tuomi Subject: Re: [FTS Xapian] Beta release I used the skele

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
/MAKEFILE.AM:11: WARNING: VARIABLE 'NOPLUGIN_LDFLAGS' IS DEFINED BUT NO PROGRAM OR SRC/MAKEFILE.AM:11: LIBRARY HAS 'NOPLUGIN' AS CANONICAL NAME (POSSIBLE TYPO) AUTORECONF: AUTOMAKE FAILED WITH EXIT STATUS: 1 On 2019-01-13 20:32, Joan Moreau via dovecot wrote: Please kindly check https://github.com

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
./configure --with-dovecot=/path/to/dovecot make Aki On 13 January 2019 at 21:03 Joan Moreau wrote: THis is already what I send earlier (see : dovecot-xapian-1.0b2.tar.gz [1 [1]] ) What I would need is the files so one can download (git) it, and type some command (make ?) to compile it and place

Re: Solr -> Xapian ?

2019-01-13 Thread Joan Moreau via dovecot
writing a new FTS driver? If squat allegedly does everything you need it to do, why don't you just take that plugin and fix it up to do what you need? That seems way easier than trying to create a FTS driver from scratch. michael On January 7, 2019 at 7:05 AM Joan Moreau via dovecot wrote: Hi

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
experience problems with the skeleton, let us know. Aki On 13 January 2019 at 20:23 Joan Moreau wrote: Ok for having a link on the FTS page. PLease clarify what files are necessary to package it as a separate package On 2019-01-13 19:03, Aki Tuomi wrote: Yes, from compiling point of view

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
a link to your plugin on our FTS page so people can also find it. There are other plugins like this, e.g. https://github.com/st3fan/dovecot-xaps-plugin Aki On 13 January 2019 at 19:52 Joan Moreau wrote: The only point here of this fts-xapian is to get rid of solr (because it is just

Re: [FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
remaining point is to push it in hte git (yes, everything is already done) On 2019-01-13 18:45, Aki Tuomi wrote: On 13 January 2019 at 17:05 Joan Moreau via dovecot wrote: Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated

Indexing paralelism

2019-01-13 Thread Joan Moreau via dovecot
Hi Observing the processes of FTS, I observe the following: 1 - For one user, indexer-wroker does not start several threads for each request. On teh contrary, it waits for the first request to finish before starting the second. How to make sure all requests (or a limited number of it, for

[FTS Xapian] Beta release

2019-01-13 Thread Joan Moreau via dovecot
Hi Please find attached the beta release of FTS Xapian, with the objective to replace fts_squat that is being deprecated. Configuration is exactly the same as for fts_squat: plugin { plugin = fts fts_xapian (...) fts = xapian fts_autoindex = yes fts_enforced = yes fts_xapian = partial=2

Re: Solr -> Xapian ?

2019-01-13 Thread Joan Moreau via dovecot
I found the solution o this using SEQ_RANGE_ARRAY_ADD(>DEFINITE_UIDS, UID); Now, I can see in the logs that several times, the dovecot calls the fts_backend_xapian_update_set_mailbox with box == NULL. WHy so ? THank you On 2019-01-12 21:40, Joan Moreau via dovecot wrote: I somehow fi

Re: Solr -> Xapian ?

2019-01-12 Thread Joan Moreau via dovecot
te log that UID are properly found on Xapian database, but no results are transmitted to dovecot and to the imap client (roundcube in my case) Help please :) On 2019-01-12 18:15, Joan Moreau wrote: additionally, my logic is that the backend stores one databalse per mailox in /xapian-indexes (in

Re: Solr -> Xapian ?

2019-01-12 Thread Joan Moreau via dovecot
all emails For other folder, somehow, the process can not access that (root) folder. Am I missing something ? On 2019-01-12 17:37, Joan Moreau wrote: THank you Now, for the results I see the member of fts_result is : ARRAY_TYPE(seq_range) definite_uids; I have the UID as a aray of uint32

Re: Solr -> Xapian ?

2019-01-12 Thread Joan Moreau via dovecot
to result->definite_uids[1]=my_uid ? On 2019-01-12 10:25, Timo Sirainen wrote: On 11 Jan 2019, at 21.23, Joan Moreau via dovecot wrote: The below patch resolves the compilation error $ diff -p compat.h compat.h.joan *** compat.h 2019-01-11 20:21:00.726625427 +0100 --- compat.h.joan 2019-01-11 20:14

Re: [FTS Xapian] Status & Questions

2019-01-12 Thread Joan Moreau via dovecot
Sorted this out. sorry for noise On 2019-01-12 11:39, Joan Moreau wrote: The change of "Extern C" suggested by Timo actually solved the situation Now, further question : I put a "i_warning" at each of my functions, and I see in the log : Jan 12 10:33:27 indexer-wo

Re: [FTS Xapian] Status & Questions

2019-01-12 Thread Joan Moreau via dovecot
course no uid. How come ? On 2019-01-12 10:50, Aki Tuomi wrote: Did you remember to load fts first? mail_plugins =$mail_plugins fts fts_xapian Aki On 12 January 2019 at 10:37 Joan Moreau via dovecot < dovecot@dovecot.org> wrote: STATUS - Alpha code is written and compilin

[FTS Xapian] Status & Questions

2019-01-12 Thread Joan Moreau via dovecot
STATUS - Alpha code is written and compiling now. (attached) - I would like to start testing. However, there is an error when starting dovecot (git) : Error: Couldn't load required plugin /usr/lib/dovecot/lib21_fts_xapian_plugin.so: dlopen() failed:

Re: Solr -> Xapian ?

2019-01-11 Thread Joan Moreau via dovecot
; -> this mean at a certain point, indexer maybe rebuilding a previous email, so *last* uid is something different than max. And how indexer does know whther there is a gap wihtout callong the fts backend (whch it does not as there are no function for that) ? Thank you On 2019-01-11 18:27, Joa

Re: Solr -> Xapian ?

2019-01-11 Thread Joan Moreau via dovecot
Joan Moreau via dovecot < dovecot@dovecot.org> wrote: I managed to deal with the namespace issue (updated makefile.am) However, I reach : ../../../src/lib/compat.h:207:19: error: conflicting declaration of 'ssize_t i_my_pread(int, void*, size_t, __off_t)' with 'C' linkage # define

Re: Solr -> Xapian ?

2019-01-11 Thread Joan Moreau via dovecot
(whch it does not as there are no function for that) ? 4 - How to update configure.ac & additional files to add the "--with-xapian" wichi will test for libxapian presence and add it to the build ? Thank you On 2019-01-08 04:24, Timo Sirainen wrote: On 7 Jan 2019, at 16.05, Joan Moreau vi

Re: Solr -> Xapian ?

2019-01-11 Thread Joan Moreau via dovecot
'i_isspace'? namespace Xapian { Someone can bring me some light ? Thanks On 2019-01-09 09:58, Joan Moreau via dovecot wrote: Ok. Additional question : - for rescan : who is responsible for passing again the new email ? Is the Dovecot core sending again all the emails to index ? or the fts sh

Re: Solr -> Xapian ?

2019-01-09 Thread Joan Moreau via dovecot
e rebuilding a previous email, so *last* uid is something different than max. And how indexer does know whther there is a gap wihtout callong the fts backend (whch it does not as there are no function for that) ? On 2019-01-08 04:24, Timo Sirainen wrote: On 7 Jan 2019, at 16.05, Joan Moreau vi

Re: Solr -> Xapian ?

2019-01-07 Thread Joan Moreau via dovecot
ee below) ? THank you On 2019-01-06 16:50, Joan Moreau via dovecot wrote: and finally , for fts_backend__lookup_multi, why is that backend dependent ? Would- nt the below function below be the same for any backend ? Waiting fro your feedback on all those questions Thank

Re: Solr -> Xapian ?

2019-01-06 Thread Joan Moreau via dovecot
) { if(fts_backend_xapian_lookup(backend,box[i],args,flags,result->box_results[i])<0) return -1; i++; } return 0; } On 2019-01-06 16:31, Joan Moreau via dovecot wrote: for fts_backend_xxx_lookup, where is specidifed in which field (to, cc, subject, body, from, all) to lookup ? On 2019-01-06 16:03, Joan Moreau

Re: Solr -> Xapian ?

2019-01-06 Thread Joan Moreau via dovecot
for fts_backend_xxx_lookup, where is specidifed in which field (to, cc, subject, body, from, all) to lookup ? On 2019-01-06 16:03, Joan Moreau wrote: For "rescan " and "optimize", wouldn't it be the dovecot core who indicate which are to be dismissed (expunged), or

Re: Solr -> Xapian ?

2019-01-06 Thread Joan Moreau via dovecot
xxx_update_expunge", so I beleive the management of the expunged messages is *NOT* in the backend, right ? On 2019-01-06 15:41, Joan Moreau wrote: also, for fts_backend_solr_update_set_build_key -> where is the data (of the hdr_name or the body) ? On 2019-01-06 14:10, Joan

Re: Solr -> Xapian ?

2019-01-05 Thread Joan Moreau via dovecot
also, for fts_backend_solr_update_set_build_key -> where is the data (of the hdr_name or the body) ? On 2019-01-06 14:10, Joan Moreau wrote: for the "last uid"-> this is not the last added, but the maximum of the UID in the indexed emails, right ? On 2019-01-06 11:53,

Re: Solr -> Xapian ?

2019-01-05 Thread Joan Moreau via dovecot
for the "last uid"-> this is not the last added, but the maximum of the UID in the indexed emails, right ? On 2019-01-06 11:53, Joan Moreau via dovecot wrote: Thank you I still don't get the "build_key" function. The email (body, hearders, .. and the uid) is the

Re: Solr -> Xapian ?

2019-01-05 Thread Joan Moreau via dovecot
Thank you I still don't get the "build_key" function. The email (body, hearders, .. and the uid) is the one (and only) to index . What "key" is that function referring to ? Or is the "key" here the actual email ? On 2019-01-06 08:43, Stephan Bosch wrote: Op 06

Re: Solr -> Xapian ?

2019-01-05 Thread Joan Moreau via dovecot
Anyone willing to explain those functions ? Most notably " get_last_uid" "set_build_key" "build_more" , what is refresh versus rescan ? On January 5, 2019 14:23:10 Joan Moreau via dovecot wrote: Thank Stephan I basically need to know the role/descri

Re: Solr -> Xapian ?

2019-01-05 Thread Joan Moreau via dovecot
Anyone willing to explain those functions ? On January 5, 2019 14:23:10 Joan Moreau via dovecot wrote: Thank Stephan I basically need to know the role/description of each of the functions of the fts_backend: struct fts_backend fts_backend_xapian = { .name = "xapian&quo

Re: Solr -> Xapian ?

2019-01-04 Thread Joan Moreau via dovecot
Op 04/01/2019 om 11:17 schreef Joan Moreau via dovecot: Why not, but please guide me about the core structure (mandatory funcitons, etc..) of a typical Dovecot FTS plugin The Dovecot API documentation is not exhaustive everywhere, but the basics are documented. The remaining questions ca

Re: Solr -> Xapian ?

2019-01-04 Thread Joan Moreau via dovecot
_backend_xapian_refresh, fts_backend_xapian_rescan, fts_backend_xapian_optimize, fts_backend_default_can_lookup, fts_backend_xapian_lookup, fts_backend_xapian_lookup_multi, fts_backend_xapian_lookup_done } }; On 2019-01-04 20:33, Joan Moreau via dovecot wrote: Yes but: 1 - is there a documenta

Re: Solr -> Xapian ?

2019-01-04 Thread Joan Moreau via dovecot
19-01-04 18:49, admin wrote: A starting point would be to have a look at the current FTS plugins: https://github.com/dovecot/core/tree/master/src/plugins/fts-solr and https://github.com/dovecot/core/tree/master/src/plugins/fts-squat -M Am Freitag, den 04.01.2019, 18:17 +0800 schrieb Joan More

Re: Solr -> Xapian ?

2019-01-04 Thread Joan Moreau via dovecot
feels like writing fts_xapian, go for it. Aki On 04 January 2019 at 08:20 Joan Moreau via dovecot wrote: What about consedering linking Dovecot with Xapian librairies instead of going to nightmare Solr ? https://xapian.org/features On 2019-01-02 17:10, John Tulp wrote: On Wed, 2019-01-02 at 0

Solr -> Xapian ?

2019-01-03 Thread Joan Moreau via dovecot
What about consedering linking Dovecot with Xapian librairies instead of going to nightmare Solr ? https://xapian.org/features On 2019-01-02 17:10, John Tulp wrote: On Wed, 2019-01-02 at 00:59 -0800, M. Balridge wrote: The main problem is : After some time of indexing from Dovecot, Dovecot

Solr - complete setup (update)

2019-01-03 Thread Joan Moreau via dovecot
Hi This is the summary of my work with SOLR-Dovecot, in my QUEST TO REPRODUCE THE PREVIOULSY EXCELLENT WORK OF FTS_SQUAT @Aki : Based on the time I have spent on this, I would love to see you updating the Wiki with those improvements, and adding my name somewhere @All : Hope it helps -

Solr - complete setup

2019-01-03 Thread Joan Moreau via dovecot
Hi This is the summary of my work with SOLR-Dovecot, in my QUEST TO REPRODUCE THE PREVIOULSY EXCELLENT WORK OF FTS_SQUAT @Aki : Based on the time I have spent on this, I would love to see you updating the Wiki with those improvements, and adding my name somewhere @All : Hope it helps -

Solr - schema.xml

2019-01-02 Thread Joan Moreau via dovecot
Hi, This is the best I can do for having a SCHEMA.XML matching the needs of an email user. Use case on Solr 7.5.0 (note : this does not solve any of the bugs previously mentionned, but at least, the logic of Solr is back on track) --- id

Re: Solr

2019-01-02 Thread Joan Moreau via dovecot
use of the errors of fts_solr, but maybe this will help On 2019-01-02 18:00, Joan Moreau via dovecot wrote: Another bug appearing today: Jan 02 09:59:08 indexer-worker(j...@grosjo.net)<6777>: Warning: FTS-SOLR(j...@grosjo.net): Mailbox XX UID=121635 HEADER SIZE IS HUGE, TRUNCATING h

Re: Solr

2019-01-02 Thread Joan Moreau via dovecot
Another bug appearing today: Jan 02 09:59:08 indexer-worker(j...@grosjo.net)<6777>: Warning: FTS-SOLR(j...@grosjo.net): Mailbox XX UID=121635 HEADER SIZE IS HUGE, TRUNCATING header of the said email has nothing of "huge" On 2019-01-02 15:22, Joan Moreau via dovecot wr

Re: Solr

2019-01-01 Thread Joan Moreau via dovecot
cot, Dovecot returns errors (invalid SID, etc...) and Solr return "out of range indexes" errors On 2019-01-02 07:49, Joan Moreau wrote: Hi Solr is a standard package in ArchLinux. ("pacman -S solr") . the systemd installation script is included (and it is launching /opt/solr/b

Re: Solr

2019-01-01 Thread Joan Moreau via dovecot
Refinement of the schema.xml (below) THis however does not solve the "no results" and "Out of range" errors in Dovecot and Solr id

Re: Solr

2019-01-01 Thread Joan Moreau via dovecot
ome from Solr or Dovecot Below my adjusted (corrections from the one of Daniel who is definitely not working) schema.xml id On 2019-01-02 10:04, Joan Moreau wrote: The first result show "no results" in dovecot for any search by header (I typ

Re: Solr

2019-01-01 Thread Joan Moreau via dovecot
e problems On January 2, 2019 08:16:33 Joan Moreau via dovecot wrote: and the first line of the diff is : < this file, see http://wiki.apache.org/solr/SolrConfigXml. --- this file, see http://wiki.apache.org/solr/SolrConfigXml. 38c38 < 6.4.1 --- 7.5.0 So, are you running 6.4.1 or 7.5.0

Re: Solr

2019-01-01 Thread Joan Moreau via dovecot
and the first line of the diff is : < this file, see http://wiki.apache.org/solr/SolrConfigXml. --- this file, see http://wiki.apache.org/solr/SolrConfigXml. 38c38 < 6.4.1 --- 7.5.0 So, are you running 6.4.1 or 7.5.0 On 2019-01-02 08:12, Joan Moreau wrote: The real main diff

Re: Solr

2019-01-01 Thread Joan Moreau via dovecot
l, schema.xml, etc.. I made a symlink of the data folder to a second drive (ext4) much bigger On 2018-12-31 14:09, Daniel Miller wrote: On 12/29/2018 4:49 PM, Joan Moreau wrote: Also : - Java is 10.0.2 Same as me. - If i delete schema.xml but create only managed-schema, the solr ref

Re: Solr

2018-12-29 Thread Joan Moreau via dovecot
Also : - Java is 10.0.2 - If i delete schema.xml but create only managed-schema, the solr refuses to start with a java error "schema.xml missing" On 2018-12-30 08:46, Joan Moreau wrote: Hi Daniel, I am on Archlinux. Anyway, I adapted the scripts. 2 questions: 1 - It loo

Re: Solr

2018-12-29 Thread Joan Moreau via dovecot
On 2018-12-22 00:19, Daniel Miller wrote: Joan, The reason for dropping squat, I'm assuming, is that Lucene and Solr potentially provide superior features & performance and as they are 3rd-party libraries & apps it reduces the maintenance responsibilities and let's the Dovecot team focus

Re: Solr

2018-12-21 Thread Joan Moreau via dovecot
no tangible reason, what about maintaining fts_squat , which did the job nicely for years and no complains about. On 2018-12-16 08:51, Daniel Miller via dovecot wrote: Joan, I understand and sympathize with your frustration - trying to get multiple applications to work together, particularly g

Re: Solr

2018-12-15 Thread Joan Moreau via dovecot
here my latest schema.xml (remove the "long" type hich seems to be very deprecated in 7.x) id On 2018-12-15 20:54, Joan Moreau wrote: Daniel, I have done that so any times (deleteing the data folders, recreating the instance, rest

Re: Solr

2018-12-15 Thread Joan Moreau via dovecot
dovecot wrote: On 12/11/2018 4:46 AM, Joan Moreau via dovecot wrote: I shared the errors already so many times (check this mailinling for "solr" in teh title) Contrary to what you say, with SOlr 7.5 and Dovecot git, I had to remove the "managed-schema" to make solr re

Re: Solr

2018-12-11 Thread Joan Moreau via dovecot
in, the filename saved in the /conf folder needs to be "managed-schema" - no ".xml" suffix. If that doesn't work for you - please share the errors. Daniel On 12/10/2018 11:40 AM, Joan Moreau wrote: Hi Daniel, THere is no need of all this, just the command (on Solr 7.5) &

Re: Solr

2018-12-10 Thread Joan Moreau via dovecot
PerField.writeProx(FreqProxTermsWriterPerField.java:80) Dec 11 06:00:14 gjserver solr[16761]: at org.apache.lucene.index.FreqProxTermsWriterPerField.addTerm(FreqProxTermsWriterPerField.java:184) Dec 11 06:00:14 gjserver solr[16761]: at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:185) On 2018-12-10

Re: Solr

2018-12-10 Thread Joan Moreau via dovecot
.) id On 2018-12-10 21:17, Daniel Miller via dovecot wrote: On 12/4/2018 10:40 AM, Joan Moreau via dovecot wrote: In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would nice to stipulate to the reader to type the command : su

Re: Solr

2018-12-09 Thread Joan Moreau via dovecot
ny (keywords not presentin teh results) I am back to fs_squat On 2018-12-08 18:28, Joan Moreau via dovecot wrote: After some testsing, I managed to get proper functionning - The schema.xml is attached below (quite different from the one provided on teh wiki) (in bold the core

Re: Solr

2018-12-08 Thread Joan Moreau via dovecot
After some testsing, I managed to get proper functionning - The schema.xml is attached below (quite different from the one provided on teh wiki) (in bold the core differences) (NGramFilterFactory is the class that replace the fts_squat "partial=3 full=15", everything else is just a big hammer

Re: Solr

2018-12-08 Thread Joan Moreau via dovecot
After some testsing, I managed to get proper functionning - The schema.xml is attached below (quite different from the one provided on teh wiki) (in bold the core differences) (NGramFilterFactory is the class that replace the fts_squat "partial=3 full=15", everything else is just a big hammer

Re: Solr

2018-12-05 Thread Joan Moreau via dovecot
Additionally, I get "Invalid search response" on my Android , using dovecot-solr, whereas squat works fine Why making squat obsolete ? It is simple and straightforward On December 5, 2018 12:57:22 PM Joan Moreau via dovecot wrote: THen the Squat shall be maintained until the S

Re: Solr

2018-12-05 Thread Joan Moreau via dovecot
Solr does not support prefix/substring search unless you configure solr to support it. Aki On 5.12.2018 11.50, Joan Moreau wrote: Well, "break-imap-search" option prevent dovecot from starting. I used solr on one server since yesterday. First feedback is that * BODY search is

Re: Solr

2018-12-05 Thread Joan Moreau via dovecot
e sure it's used for all kinds of things automatically. break-imap-search is supported, but does nothing. Updated the wiki a bit. Aki On 4.12.2018 20.50, Joan Moreau via dovecot wrote: also, the value "break-imap-search" is not supported in fts_solr parameter, contrary to the wiki a

Re: Solr

2018-12-04 Thread Joan Moreau via dovecot
also, the value "break-imap-search" is not supported in fts_solr parameter, contrary to the wiki and not sure then how to enable full text search in BODY On 2018-12-04 19:40, Joan Moreau via dovecot wrote: In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would nice to

Re: Solr

2018-12-04 Thread Joan Moreau via dovecot
/dovecot/conf for archlinux users Additionaly, the url is http://(solr_ [1]server):8983/solr/dovecot/ (error in wiki) On 2018-12-04 19:01, Joan Moreau via dovecot wrote: Hi I am giving Solr another try. Using Solr 7.5 (from Archlinux AUR), I do not see anymore the"solr/conf/schem

Re: Solr

2018-12-04 Thread Joan Moreau via dovecot
Hi I am giving Solr another try. Using Solr 7.5 (from Archlinux AUR), I do not see anymore the"solr/conf/schema.xml" neither the "managed-schema" folder. (as per https://wiki.dovecot.org/Plugins/FTS/Solr) Maybe some things have moved ? Thank you so much

Re: Squat

2018-12-04 Thread Joan Moreau via dovecot
to set up though. FWIW, Squat has been deprecated since 2.0, so none of this should come as a surprise. https://wiki.dovecot.org/Plugins/FTS Aki On 04 December 2018 at 17:16 Joan Moreau wrote: Thanks for mySql For Squat vs Solr, Solr does not reach Squat by very far in terms of results : If I

Re: Compilation error

2018-12-04 Thread Joan Moreau via dovecot
Ooops, thanks Sorry for the noise On 2018-12-04 16:23, Aki Tuomi wrote: Did you run ./autogen.sh first? Aki On 04 December 2018 at 17:20 Joan Moreau via dovecot wrote: Hi USing git, I reach the following error (below). Here is my configure parameters : CPPFLAGS="-I/inclu

Re: [2.3.4] Segmentation faults

2018-12-04 Thread Joan Moreau via dovecot
So far, not getting any results with Solr. Squat however exactly meet the need. On 2018-12-04 16:18, Aki Tuomi wrote: We don't consider it as "very early beta". We consider it production ready. It is bit more work to set up though. Aki On 04 December 2018 at 17:16 Joan Mor

Compilation error

2018-12-04 Thread Joan Moreau via dovecot
Hi USing git, I reach the following error (below). Here is my configure parameters : CPPFLAGS="-I/include -I/usr/include/tirpc/" LDFLAGS="-L/lib -ltirpc" ./configure --prefix=/usr --sysconfdir=/etc --localstatedir=/var --libexec=/usr/libexec --with-sql=yes --without-sqlite --with-mysql

Re: [2.3.4] Segmentation faults

2018-12-04 Thread Joan Moreau via dovecot
body" and "search in fields" does not even work. Solr with Dovecot seems very early beta isnt'it ? On 2018-12-04 15:57, Aki Tuomi wrote: On 04 December 2018 at 16:46 Joan Moreau via dovecot wrote: Hi How to solve this ? So many similar segfaults Thank you On 2018-11-30 06:1

Re: [2.3.4] Segmentation faults

2018-12-04 Thread Joan Moreau via dovecot
Hi How to solve this ? So many similar segfaults Thank you On 2018-11-30 06:11, Joan Moreau wrote: ANother (very very long) example : # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.154353342400 GNU gdb (GDB) 8.2 Copyright (C

[no subject]

2018-12-02 Thread Joan Moreau via dovecot
--- Begin Message --- Hi How to solve this ? So many similar segfaults Thank you On 2018-11-30 06:11, Joan Moreau wrote: ANother (very very long) example : # gdb /usr/libexec/dovecot/indexer-worker core.indexer-worker.0.3a33f56105e043de802a7dfcee265a07.21017.154353342400 GNU gdb

Re: [2.3.4] Segmentation faults

2018-11-29 Thread Joan Moreau
aa in squat_uidlist_refresh (uidlist=) at squat-uidlist.c:569 No locals. #124 0x7f768a9787c2 in squat_trie_map (trie=0x564540376490, building=) at squat-trie.c:1526 file_lock = 0x56454210b9f0 dotlock = 0x0 changed = (continues for ages) On 2018-11-29 19:36, Joan Moreau wrote: finally managed to

Re: [2.3.4] Segmentation faults

2018-11-29 Thread Joan Moreau
in auth_deinit (auth=0x5636af7afd58) at auth.c:335 passdb = userdb = 0x5636af7aff18 passdb = userdb = #10 auths_deinit () at auth.c:433 auth__foreach_end = 0x5636af7ae2f8 auth = 0x5636af7ae2f0 #11 0x5636aeedcf65 in main_deinit () at main.c:270 l = l = l_end = #12 main (argc=, argv=) at ma

Re: [2.3.4] Segmentation faults

2018-11-29 Thread Joan Moreau
n wrote: See https://dovecot.org/bugreport.html#coredumps Without a backtrace it's not really possible to figure out where it's crashing. On 28 Nov 2018, at 13.20, Joan Moreau wrote: Where to get that ? On 2018-11-27 08:50, Aki Tuomi wrote: It's still missing core dump (or bt

Re: [2.3.4] Segmentation faults

2018-11-28 Thread Joan Moreau
Where to get that ? On 2018-11-27 08:50, Aki Tuomi wrote: It's still missing core dump (or bt full from it) Aki On 27.11.2018 8.39, Joan Moreau wrote: Thank you Aki here the requested data (below) Please not as well that we have numerous subfolders (>50) and pretty big mailbox si

Re: [2.3.4] Segmentation faults

2018-11-26 Thread Joan Moreau
notify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 24 M (...) passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } (the rest default values) On 2018-11-25 08:08, Aki Tuomi wrote: On 25 November 2018 at 06:29 Joan Moreau < j...@grosjo.n

[2.3.4] Segmentation faults

2018-11-24 Thread Joan Moreau
Hi THis is the lines I have in my dmesg (see below) In dovecot log , I see: Nov 25 04:26:47 auth-worker: Error: double free or corruption (fasttop) What do to about it ? Using lastest 2.3.4 version Thank you [132932.169265] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00

Re: Lucene

2017-06-12 Thread Joan Moreau
Hi, I compiled 2.2.30.2 and Clucene, looks like the message disappeared. Now, the search does not work when the number of input characters are below 6. How to change that limit (to 3 for instance) ? Thank you very much On 2017-06-09 06:21, Joan Moreau wrote: > Hi, > > I can no

Lucene

2017-06-09 Thread Joan Moreau
Hi, I can not get rid of the below message and my FTS seems not working properly. Is there a compile parameter to adjust to have Lucene working ? doveadm(root): Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed:

sieve script not applied

2015-03-16 Thread Joan Aymà
Hi everyone, I installed all-new server postfix+amavis+dovecot and pigeonhole. Clients, thunderbird and roundcube creates sieve scripts ok and changed ones are seen by eatch other, so server at 4190 accepts the scripts and ensure they are created. But filters onto new mail isn't applied.

[Dovecot] Issues when compiling dovecot antispam on debian wheezy

2013-06-28 Thread Joan
I've been trying to compile the latest version of dovecot-antispam, and it doesn't work, the latest patch fixes compilation for dovecot versions greater than 2.1.16 but the packaged version in debian is 2.1.7 and doesn't provide the DOVECOT_PREREQ macro. It seems there are some solutions: 1)

Re: [Dovecot] Autocreation the home folder

2013-06-14 Thread Joan
layout, so I might use a solution based on creating hardlinks, changing configuration, and then remove the original paths... Still I haven't tested this... Will post what I have in the future.. Regards, Joan 2013/5/17 Angel L. Mateo ama...@um.es El 16/05/13 12:48, Joan escribió: The issue

Re: [Dovecot] Autocreation the home folder

2013-05-16 Thread Joan
a script move the content to the new location 4.- Start dovecot with the new layout.. Am i right? Joan 2013/5/15 Timo Sirainen t...@iki.fi Dovecot autocreates the mail directory, but apparently it doesn't currently autocreate the home directory if it's located elsewhere. I'm not sure

Re: [Dovecot] Autocreation the home folder

2013-05-15 Thread Joan
Sorry for this bump, but isn't there a better solution to have those folders than to be watching the logs for warnings and recreate them? Regards, Joan 2013/5/14 Joan aseq...@gmail.com Yes, all folder tree has vmail:vmail as the owner, and dovecot can create the folders without issues. I

Re: [Dovecot] Autocreation the home folder

2013-05-14 Thread Joan
: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 13 May 2013, Joan wrote: Hi Steffen, that was an error I hadn't spotted (copypasting error). Still after changing mail_home to the proper value (/home/vmail/%d/%n/home) the errors in the logs are the same Am I supposed to create

[Dovecot] Autocreation the home folder

2013-05-13 Thread Joan
(75%) messages=0 reverse=no command=/etc/dovecot/quota-warning.sh 75 Am I supposed to create the folders via an external script? Or is there any option to make this automatic. Regards, Joan

Re: [Dovecot] Autocreation the home folder

2013-05-13 Thread Joan
-brs.de -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 13 May 2013, Joan wrote: The only issue I've had is with the change with the mail_location, mail_home, that in the 2.1 versions can't be on the same path. So I changed from: mail_location = maildir:/home/vmail/%d/%n mail_home

<    1   2   3   >