solr does not index files in the mailbox
Hello! I startet solr and configured dovecot to use it. Dovecot just indexes two files dovecot.index.log and dovecot.mailbox.log but nothing in the cur directory. ./post -c myfiles /home/a.meyer/Postfach java -classpath /home/andreas/solr-5.5.1/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach (2 files, depth=0) POSTing file dovecot.index.log (text/plain) to [base]/extract POSTing file dovecot.mailbox.log (text/plain) to [base]/extract Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/new (0 files, depth=1) Indexing directory /home/a.meyer/Postfach/tmp (0 files, depth=1) 2 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:00.751 If I give the cur folder as startingpoint ./post -c myfiles /home/a.meyer/Postfach/cur java -classpath /home/andreas/solr-5.5.1/dist/solr-core-5.5.1.jar -Dauto=yes -Dc=myfiles -Ddata=files -Drecursive=yes org.apache.solr.util.SimplePostTool /home/a.meyer/Postfach/cur SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/myfiles/update... Entering auto mode. File endings considered are xml,json,jsonl,csv,pdf,doc,docx,ppt,pptx,xls,xlsx,odt,odp,ods,ott,otp,ots,rtf,htm,html,txt,log Entering recursive mode, max depth=999, delay=0s Indexing directory /home/a.meyer/Postfach/cur (0 files, depth=0) 0 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/myfiles/update... Time spent: 0:00:00.102 nothing is indexed although the directory contains 4 mails. What am I doing wrong? Greetings Andreas
Re: Dovecot-FTS:
Hi Peer,
On 20.05.2016 14:19, Peer Heinlein wrote:
We're running Dovecot with SOLR Lucene 5.5 and we have several errors like
badMessage: 414 for
HttpChannelOverHttp@5216da8e{r=0,c=false,a=IDLE,uri=-}
20.5.2016, 14:10:16
and
URI is too large >8192
in our solr-logfile.
I don't know if this is a problem in SOLR or in Dovecot, so I just bring
it to your attention.
Peer
Maybe increasing maxHttpHeaderSize="65536" in your Tomcat Connector
definition in /etc/tomcat7/server.xml helps. But as far as I know the
default URI limit should be 32k, not 8k...
Do you have a HTTP proxy in front of your SOLR servers? Apache has a
request limit of 8k for example...
http://httpd.apache.org/docs/current/mod/core.html#limitrequestline
Problem seems to be that some clients (iOS?) are doing very strange
SEARCH commands, with many OR conditions, which results in very long
search requests to SOLR...
Michael
Dovecot-FTS:
We're running Dovecot with SOLR Lucene 5.5 and we have several errors like
badMessage: 414 for
HttpChannelOverHttp@5216da8e{r=0,c=false,a=IDLE,uri=-}
20.5.2016, 14:10:16
and
URI is too large >8192
in our solr-logfile.
I don't know if this is a problem in SOLR or in Dovecot, so I just bring
it to your attention.
Peer
--
Heinlein Support GmbH
Schwedter Str. 8/9b, 10119 Berlin
http://www.heinlein-support.de
Tel: 030 / 405051-42
Fax: 030 / 405051-19
Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht
Berlin-Charlottenburg,
Geschäftsführer: Peer Heinlein -- Sitz: Berlin
dovecot-sieve: require "mailbox" fails (Unbuntu 16.04)
Hello everyone,
I'm moving some old procmail recipes to sieve, but having problems with
it. The problem lies with the mailbox extension, which I'm trying to use
as proposed in an example in the Dovecot wiki:
> require ["variables","date","fileinto","mailbox"];
>
> # Extract date info
> if currentdate :matches "year" "*" { set "year" "${1}"; }
> if currentdate :matches "month" "*" { set "month" "${1}"; }
>
> # Archive Dovecot mailing list items by year and month.
> # Create folder when it does not exist.
> if header :is "list-id" "dovecot.dovecot.org" {
> fileinto :create "INBOX.Lists.${year}.${month}.dovecot";
> }
I'm trying a similar rule (different condition, different mail folder),
but cannot seen to get it to work. I always get the errors:
> .DOVECOT: LINE 16: ERROR: UNEXPECTED '}' FOUND AT (THE PRESUMED) END OF FILE.
> .DOVECOT: ERROR: PARSE FAILED.
I'm using the standard dovecot packages from Ubuntu 16.04:
> II DOVECOT-CORE 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - CORE FILES
> II DOVECOT-IMAPD 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - IMAP
> DAEMON
> II DOVECOT-MANAGESIEVED 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER -
> MANAGE SIEVE SERVER
> II DOVECOT-SIEVE 1:2.2.22-1UBUNTU2 AMD64 SECURE POP3/IMAP SERVER - SIEVE
> FILTERS SUPPORT
I was under the impression that these sieve extensions, including
"mailbox", are builtin into dovecot/pigeonhole, or at least packaged
into dovecot-sieve. Is that not the case? How can I get the example
working under Ubuntu linux 16.04? Do I need to add or reconfigure
something by hand?
Thanks in advance for any help on the subject.
Greetings
Kasi Mir
