Re: [Dovecot] virtual folder - crash while searching
Hello everyone, I had the same errors on my server, and I fixed it by increasing the header size buffer of my server to 65535, for instance. For jetty, the option is named headerBufferSize. See: 3 2 false 8443 65536 5000 5000 On 3 August 2012 15:14, Timo Sirainen wrote: > On 1.8.2012, at 23.23, Matthias Rieber wrote: > >> alright. Some resources say that "413 FULL head" means request too large. >> Maybe that's caused by the pretty big folder virtual.all which contains more >> than 36 mails. > Probably it means that the virtual folder consists of too many real folders. > Dovecot's Solr query adds each real folder's GUID to the query. I guess there > should be some limit and it would have to send more than one query and merge > the results. > No need to do this. -- André Rodier
Re: [Dovecot] virtual folder - crash while searching
On 1.8.2012, at 23.23, Matthias Rieber wrote: > alright. Some resources say that "413 FULL head" means request too large. > Maybe that's caused by the pretty big folder virtual.all which contains more > than 36 mails. Probably it means that the virtual folder consists of too many real folders. Dovecot's Solr query adds each real folder's GUID to the query. I guess there should be some limit and it would have to send more than one query and merge the results.
Re: [Dovecot] virtual folder - crash while searching
Am 01.08.2012 22:16, schrieb Timo Sirainen: On 1.8.2012, at 23.06, Matthias Rieber wrote: here are the crashes with fts_solr: .. Crash 1 Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 I thought non-fulltext searches were done by dovecot itself? They are, but header searches are part of full text search. alright. Some resources say that "413 FULL head" means request too large. Maybe that's caused by the pretty big folder virtual.all which contains more than 36 mails. Matthias
Re: [Dovecot] virtual folder - crash while searching
On 1.8.2012, at 23.06, Matthias Rieber wrote: >>> here are the crashes with fts_solr: >> .. >>> Crash 1 >>> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup >>> failed: 413 FULL head >> >> The crash happens because the Solr lookup failed. I don't know what this >> Solr error means. Anyway, the crash itself is fixed by: >> http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 > > I thought non-fulltext searches were done by dovecot itself? They are, but header searches are part of full text search.
Re: [Dovecot] virtual folder - crash while searching
Hi, Am 01.08.2012 21:45, schrieb Timo Sirainen: On 1.8.2012, at 22.21, Matthias Rieber wrote: here are the crashes with fts_solr: .. Crash 1 Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed: 413 FULL head The crash happens because the Solr lookup failed. I don't know what this Solr error means. Anyway, the crash itself is fixed by: http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68 I thought non-fulltext searches were done by dovecot itself? Matthias
Re: [Dovecot] virtual folder - crash while searching
On 1.8.2012, at 22.21, Matthias Rieber wrote:
> here are the crashes with fts_solr:
..
> Crash 1
> Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup failed:
> 413 FULL head
The crash happens because the Solr lookup failed. I don't know what this Solr
error means. Anyway, the crash itself is fixed by:
http://hg.dovecot.org/dovecot-2.1/rev/d499f6d0ca68
> Crash 2
> #0 fts_search_lookup_level (fctx=0x897cfc8, args=0x8995590, and_args=true)
> at fts-search.c:125
> 125 for (i = 0; result->box_results[i].box != NULL; i++) {
Fixed: http://hg.dovecot.org/dovecot-2.1/rev/323d6ce62567
Re: [Dovecot] virtual folder - crash while searching
Hi,
Am 01.08.2012 19:24, schrieb Timo Sirainen:
On 1.8.2012, at 9.09, Matthias Rieber wrote:
I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in
a virtual folder dovecot crashes.
Here's the stacktrace:
http://pastebin.com/urSDDzku
Looks like fts-squat isn't currently compatible with virtual folders. I'd
suggest moving to fts-lucene. But I guess this also fixes it:
http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad
here are the crashes with fts_solr:
Configuration
-
# 2.1.9: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.26-2-vserver-amd64 x86_64 Debian 5.0.10
auth_master_user_separator = *
disable_plaintext_auth = no
listen = *
mail_location = maildir:~/Maildir
mail_plugins = virtual fts fts_solr zlib acl
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave
namespace {
hidden = yes
inbox = no
list = no
location =
prefix = mail
separator =
type = private
}
namespace {
hidden = no
inbox = yes
location =
prefix =
separator = .
type = private
}
namespace {
hidden = yes
inbox = no
list = no
location =
prefix = INBOX.
separator = .
type = private
}
namespace {
location = maildir:/home/sharedbox/Maildir
prefix = shared.
separator = .
type = public
}
namespace {
list = yes
location = maildir:/home/%%n/Maildir
prefix = common.%%u.
separator = .
subscriptions = no
type = shared
}
namespace {
hidden = no
list = yes
location = virtual:~/Maildir/virtual
prefix = virtual.
separator = .
subscriptions = yes
type = private
}
passdb {
args = /etc/dovecot/dovecot-ldap.conf.ext
driver = ldap
}
passdb {
args = /etc/dovecot/passwd.masterusers
driver = passwd-file
master = yes
}
plugin {
acl = vfile:/etc/dovecot/acls:cache_secs=7200
acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes.db
fts = solr
fts_solr = url=http://localhost:8983/solr/
sieve_dir = ~/Maildir/sieve
}
protocols = imap pop3 sieve
service imap {
executable = imap
vsz_limit = 1 G
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
}
ssl_cert = a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE
IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND
UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE
QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS
SPECIAL-USE SEARCH=FUZZY COMPRESS=DEFLATE ACL RIGHTS=texk] Logged in
a SELECT virtual.all
* FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk
LearnedAsNonJunk $has_cal $MDNSent 2TDB 3TBD $Forwarded $label1 $DONE
$WEB $Label4 $MAILING $PBS $WAA $CHRISTOPH receipt-handled $PART foo
redirected Junk LearnedAsJunk 1done test)
* OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk
LearnedAsNonJunk $has_cal $MDNSent 2TDB 3TBD $Forwarded $label1 $DONE
$WEB $Label4 $MAILING $PBS $WAA $CHRISTOPH receipt-handled $PART foo
redirected Junk LearnedAsJunk 1done test \*)] Flags permitted.
* 365142 EXISTS
* 1 RECENT
* OK [UNSEEN 1270] First unseen.
* OK [UIDVALIDITY 1312063141] UIDs valid
* OK [UIDNEXT 799982] Predicted next UID
* OK [HIGHESTMODSEQ 249937] Highest
a OK [READ-WRITE] Select completed.
a SEARCH HEADER FROM foobar
(server disconects)
Log:
Aug 1 21:04:01 smtp dovecot: imap-login: Login: user=,
method=PLAIN, rip=10.0.1.3, lip=10.0.1.3, mpid=18561, TLS,
session=
Aug 1 21:05:37 smtp dovecot: imap(matthias): Disconnected: Logged out
in=689 out=239091
Aug 1 21:05:40 smtp dovecot: imap(matthias): Error: fts_solr: Lookup
failed: 413 FULL head
Aug 1 21:05:45 smtp dovecot: imap(matthias): Panic: Leaked t_pop() call
Aug 1 21:05:45 smtp dovecot: imap(matthias): Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636d71] ->
/usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] ->
/usr/local/lib/dov]
Aug 1 21:05:45 smtp dovecot: imap(matthias): Fatal: master:
service(imap): child 18507 killed with signal 6 (core dumped)
Backtrace:
Core was generated by `dovecot/imap'.
Program terminated with signal 6, Aborted.
[New process 18507]
#0 0xf74d6556 in raise () from /lib/libc.so.6
#0 0xf74d6556 in raise () from /lib/libc.so.6
No symbol table info available.
#1 0xf74d7d78 in abort () from /lib/libc.so.6
No symbol table info available.
#2 0xf7636d85 in default_fatal_finish (type=,
status=0) at failures.c:191
backtrace = 0x961f2b0 "/usr/local/lib/dovecot/libdovecot.so.0
[0xf7636d71] -> /usr/local/lib/dovecot/libdovecot.so.0 [0xf7636def] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0xf76370c4] ->
/usr/local/lib/dovecot/l"...
#3 0xf7636def in i_internal_fatal_handler (ctx=0xffb97268,
format=0xf76620b1 "Leaked t_pop() call", args=0xffb97284 "\024") at
failures.c:6
Re: [Dovecot] virtual folder - crash while searching
On 1.8.2012, at 21.13, Matthias Rieber wrote: > Is lucence the better choice? According to the wiki Solr seems to be the most > preferred solution. Solr and Lucene both work. Solr has a newer Lucene version, but it requires running a Solr server.
Re: [Dovecot] virtual folder - crash while searching
Hello, Am 01.08.2012 19:24, schrieb Timo Sirainen: On 1.8.2012, at 9.09, Matthias Rieber wrote: I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Here's the stacktrace: http://pastebin.com/urSDDzku Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad thanks, but in the meanwhile I moved to Solr, but I've still some, maybe different, crashes. I'll send a report later after upgrading to v2.1.9 (with config and log). Is lucence the better choice? According to the wiki Solr seems to be the most preferred solution. Regards, Matthias
Re: [Dovecot] virtual folder - crash while searching
On 1.8.2012, at 9.09, Matthias Rieber wrote: > I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in > a virtual folder dovecot crashes. > > Here's the stacktrace: > > http://pastebin.com/urSDDzku Looks like fts-squat isn't currently compatible with virtual folders. I'd suggest moving to fts-lucene. But I guess this also fixes it: http://hg.dovecot.org/dovecot-2.1/rev/8d59874e02ad
Re: [Dovecot] virtual folder - crash while searching
On 2012-08-01 2:09 AM, Matthias Rieber wrote: I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Sorry, our crystal ball is broken, although Timo can sometimes get his to work, how I don't know... ;) doveconf -n output? Logs (untrimmed) showing the events leading to the crash? Here's the stacktrace: http://pastebin.com/urSDDzku Stack trace *may* be useful to Timo, but first, please provide bare minimum details of your system/config/errors as requested above - as you should do *always* when asking for support for any software on any mail support list... -- Best regards, Charles
[Dovecot] virtual folder - crash while searching
Hi, I've upgraded from dovecot 2.0 to 2.1. When I perform a header search in a virtual folder dovecot crashes. Here's the stacktrace: http://pastebin.com/urSDDzku Regards, Matthias
