Re: [Dbmail-dev] Searching IMAP faster
Aaron Stone [EMAIL PROTECTED] schrieb: I've been thinking about this for a while, and especially with the query time escalation code, have found that the queries which do full header searches are incredibly slow (for the obvious reason that they cannot use the index). I did not have a look at the query times for a long time, but i like to provide you some feedback, which searches we are doing in eGroupWare very often and which don't seem to be as fast as i like to have. FeLaMiMail(the eGroupWare imap client) is working directly on the imap server. It has only a session cache to store latest search/sort results. This allows us to skip forward and back in the messagelist without the need to search/sort the folder again. By default we have no search filter active. Which means we just sort by date for example. After we have the sort result, we are fetching the needed headers for the messages to display. This is more less ok. But we also have a quicksearch field. If you enter something in this quicksearch filed, we are searching for this string in the from or to address(depending if we are in the sent folder or not) and in the subject field. Last time i had a look at the sql queries, i discovered that dbmail was asking to times for the from/to address field and then again for the subject field. Using this kind of quicksearch takes twice the time of search for only the from/to address or the subject. I'll try to do some timing, to be able to compare if the newer search is faster then the older. From the webbased app point of view it would be nice if dbmail could be optimized to handle this kind of queries as quick as possible. Just to let you know. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Support: http://www.egroupware-support.net OfficeSpot.Net Collaboration Server: http://cs.officespot.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-921 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
[Dbmail-dev] another feature i really, really miss from cyrus: duplicate delivery check
Hello! There is another feature that i really, really miss from cyrus. Cyrus checks if it has delivered a email(identified by it's message id) already to this mailbox. If cyrus had delivered a email already to a particular mailbox, then it silently discards the next messages with the same messageid. That way you don't get the same message twice, when a emails gets sent to your personal emailaddress and a email distribution list. Or get crossposted to multiple mailinglists. Cyrus simply keeps track for the message id's it got delivered to a particular mailbox for a given time. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] another feature i really, really miss from cyrus: duplicate delivery check
Paul J Stevens schrieb: Lars Kneschke wrote: Hello! There is another feature that i really, really miss from cyrus. Cyrus checks if it has delivered a email(identified by it's message id) already to this mailbox. It's not that hard to to check for message-ids against the last X messages in a mailbox during delivery. A single query should be sufficient. That's the power of SQL! :-) Of course. that should be easy. But is this really that much of a problem? Or rather, for you it is obviously. But crossposts to lists that get delivered to different mailboxes would still be inserted twice, right? Yes. Crossposts are not really a problem. Only emails which gets send to different emails, which both resolve to my personal mailbox are anoying. Because i see the message twice. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
[Dbmail-dev] implementation of imap idle extension
Hello! While working with mobile phones and email push, i discovered that most modern phones are supporting the imap idle extension to implement push email. That's really cool. Unfortunaly dbmail does not support imap idle. I would like to sponsor the implementation of the imap idle extension. Is it possible to get support for imap idle in the near future? -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] [DBMail 0000552]: IMAP COPY says BAD too many arguments to COPY since 2481
[EMAIL PROTECTED] schrieb: The following issue has been RESOLVED. == http://www.dbmail.org/mantis/view.php?id=552 I still have this problem. Also with latest SVN. It is not possible to reopen a bug for a normal user, isn't it? -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
[Dbmail-dev] current state of svn seem to be unstable
Hello! Today we tried to update to the latest svn revision. After the update we discovered following problems: - all folders are empty, because EXISTS was aways set to 0. This problem still existed after Paul's fix. We send a patch which solved the problem for us. - all dbmail-* processes started eating cpu cycles, after a connection. dbmail-lmtp was not able to deliver messages anymore. After downgrading to a 2 weeks older version everything was back to normal. - i can't select top folders(on the same level like INBOX) anymore. The imap error message is something like This folder is not selectable. I'll try to write some usefull bugreports and testcases. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] since svn revision 2483 all folders are empty
Paul J Stevens schrieb: Lars, that's not quite valid. Try replacing the %u with %llu instead of %d Ok. We will test that tomorrow. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 2-4, D-20457 Hamburg eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 Metaways Infosystems GmbH - Sitz: D-22967 Tremsbüttel Handelsregister: Amtsgericht Ahrensburg HRB 4508 Geschäftsführung: Hermann Thaele, Lüder-H.Thaele ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] Three things on my plate for 2.2.2
Aaron Stone [EMAIL PROTECTED] schrieb: Hasn't been changed yet. Did we conclude that this was the right thing to do? I got that impression from paul's response. http://www.mail-archive.com/dbmail-dev@dbmail.org/msg08100.html -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] Three things on my plate for 2.2.2
Paul J Stevens schrieb: Lars, don't hold your breath. That's a pretty invasive change that doesn't address any regressions or critical bugs. Stuff like that doesn't belong in a bug-fix release. Please file a wish-list bug/request on the tracker, and don't forget to add a brief use-case how/why this would be used/useful. As i discussed with Aaron yesterday already, it seems like it will be possible already, because this feature get's provided by the ldap api itself. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
[Dbmail-dev] support for uidplus (wanted by asterisk and egroupware)
Hello all! I just played around with Asterisk 1.4. The hottest feature from my point of view, is the imap integration. Asterisk can store voicemessages on a imap server. Which means you can also delete or move messages from your imap client. To get this done, it just requires a global account which needs to have write access to all user folders. This account get's used to store the messages in the users folder. When the voice message get's deleted, asterisk can use uid expunge (RFC 4315) to delete only specific messages or just call expunge(which would delete all messages marked for deletion). Would it be possible to implement this in dbmail too? -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] Three things on my plate for 2.2.2
Aaron Stone [EMAIL PROTECTED] schrieb: We don't do fallback SQL servers, either. I would accept a patch to do this for LDAP and SQL, too, if it were fairly concise. Me and C are not real friends! :-) Are the LDAP applications making their queries round-robin or first available in the order specified in the config file? It just contacts the first one available. And i'm pretty sure that it is feature of the ldap client. And requires not much coding inside dbmail. ldap_connect from php(which is basicly just a wrapper around the C ldap client library) can just get a space separated list of hostnames. The whole connection handling stuff should be done inside the ldap client library. Maybe it is working already out of the box. :-) I try to find the documentation for the C ldap client library. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] Three things on my plate for 2.2.2
Lars Kneschke [EMAIL PROTECTED] schrieb: I try to find the documentation for the C ldap client library. Just found it: http://www.openldap.org/software/man.cgi?query=ldap_openapropos=0sektion=3manpath=OpenLDAP+2.0-Releaseformat=html QUote from this page: LDAP *ldap_init(host, port) The host parameter may contain a blank-separated list of hosts to try to connect to, and each host may optionally by of the form host:port. Maybe it is working already. If the dbmail config parser has no problems with spaces in the config value. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324 ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
[Dbmail-dev] MySQL optimize vs analyze
Hello! When we call dbmail-util with the option -c or -a, all dbmail tables get optimized. Which means copying the tables physicaly from one location to another and updating the statistics. While copying the tables, they are locked for inserts. On a big database this can take some time. I'm not sure if we really need to optimize the tables. I think it is enough to analyze the tables only. When you analyze the tables, the counters(needed by the query analyzer/optimizer) get updated. While analyzing the tables, they don't get locked. I propose switching to analyze tables instead of optimize tables. Maybe we can also execute analyze tables with another option. But executing optimize tables every day to expensive. Calling analyze tables every day is cheap. ___ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://twister.fastxs.net/mailman/listinfo/dbmail-dev
Re: [Dbmail-dev] [DBMail 0000399]: Squirrelmail and FelamiMail (eGroupware) cannot always retrieve attachments.
[EMAIL PROTECTED] schrieb: -- aaron - 09-Nov-06 19:31 -- Paul, looks like you do indeed have this fixed. Resolving the bug. Yes. I have tested this yesterday too. Everything is working like expected now. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] very poor mysql performance when doing imap search
Hello!
I'm still searching for performance bottlenecks. And i discovered another
one.
I'm using mysql 4.1 and not the latest SVN snapshot of dbmail. Hopefully
this code did not change in the last 3-4 weeks. :-)
When searching for the subject, we are creating following query:
SELECT message_idnr FROM dbmail_messages m JOIN dbmail_physmessage p ON
m.physmessage_id=p.id JOIN dbmail_headervalue v ON v.physmessage_id=p.id
JOIN dbmail_headername n ON v.headername_id=n.id WHERE mailbox_idnr = '100'
AND status IN ('0','1') AND headername LIKE 'subject' AND headervalue LIKE
'%gentoo-%' ORDER BY message_idnr
This query tooks 15 seconds to finnish. :-(
The machine executing this query is really, really fast and has much ram.
I'm still trying to analyse this problem. Just want to let you know.
--
Lars Kneschke
Metaways Infosystems GmbH
Pickhuben 4
20457 Hamburg
Germany
eGroupWare Training Support == http://www.egroupware-support.net
E-Mail: mailto:[EMAIL PROTECTED]
Web: http://www.metaways.de
Tel: +49 (0)40 317031-21
Fax: +49 (0)40 317031-81
Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] very poor mysql performance when doing imap search
Aaron Stone [EMAIL PROTECTED] schrieb: Lars, this code has changed subtly, but significantly this month: there are no more quotes around numbers. I tried your query on my mailbox, and the time went from 40 seconds to 5 seconds. Then I tried it again and got a result in 0 seconds. Which means you can't trust my 40-5 results because my queries are cached. 'flush query cache' did not actually flush the query cache, so I have no clue what's up :-\ set session query_cache_type=0; is your friend. :-) Anyways, try the query with the quotes removed from around the numbers and see if you see anything different! I tried already without the quotes, but that did not change anything on my installation. The query took 14.29 seconds. I'm waiting for my brother to wake up. He will able to explain how this query can be optimized. At least i hope so! :-) -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] very poor mysql performance when doing imap search [SOLVED]
Lars Kneschke [EMAIL PROTECTED] schrieb: The machine executing this query is really, really fast and has much ram. I'm still trying to analyse this problem. Just want to let you know. Ok, i found the problem. I moved the database to another machine(yet faster, then the other :-)) . But the result was having a slower database. The problem has been, that the optimizer had not up-to-date information about the tables involved with the query. Which let MySQL do the the join in the wrong order. After running analyze table on all involved tables, the query finnished after 0,01 seconds. That's ok for me! :-) Something dbmail-util is doing every night anyway. It was all only my fault. Sorry! -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web: http://www.metaways.de Tel: +49 (0)40 317031-21 Fax: +49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] FeLaMiMail (off topic)
Blake Mitchell [EMAIL PROTECTED] schrieb: I would like to make a (hopefully) simple request to the FeLaMiMail folks, I think I even recall one of the developers posting to this list. Please, please, please, implement the References header for replies! Because FeLaMiMail doesn't insert that header, all the nice conversation threads in the DBMail lists get broken off every time someone replies with FeLaMiMail. I'll fix that. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] MySQL Optimization for DBMail
Aaron Stone [EMAIL PROTECTED] schrieb: And as for InnoDB, I cranked everything up like crazy, and basically get most of my database in memory. If you have 4GB of RAM, I think it's entirely reasonable to put a gig into MySQL buffering. But, again, no hard numbers to back these up :-\ As one MySQL instance is only 1 process with multiple threads, you are limited to 2 GByte per process on 32bit systems. Only 64bit systems can use more than 2 GByte per process.Just a reminder of the total amount a single process can use on 32bit systems. To much query cache can slow down the system.You can simply have a look at the examples delivered with MySQL itself. There is a file called my-huge.cnf. On Ubuntu you can find this file in /usr/share/doc/mysql-server-5.0/examples/ -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] Impact of ANYONE and PUBLIC changes
Aaron Stone [EMAIL PROTECTED] schrieb: Right, so there's two different sets of mailboxes appearing under the same #Public folder, based on ownership of the mailbox. Should all mailboxes under #Public simply be owned by '__public__'? Should we then create an ACL entry for the mailbox creator giving them Admin rights to the mailbox that they've created? Right now I think this is my plan. All that said, how did this work before? I'm not aware how this did work before, but at least it sounds logical for me, how you like to make it working in the future. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] Error unlinking pidfile [/var/run/dbmail-imapd.pid]: [Permission denied]
Aaron Stone [EMAIL PROTECTED] schrieb: Implemented this hack, works nicely. For me too! Thanks! -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] FATAL module server file pool.c func scoreboard_new line 87: shmget failed [No space left on device]
Hello! What could be the reason for this error message? I get this error message on a ubuntu edgy eft system with self compiled dbmail and libsieve packages.
Re: [Dbmail-dev] FATAL module server file pool.c func scoreboard_new line 87: shmget failed [No space left on device]
Paul J Stevens [EMAIL PROTECTED] schrieb: Is eft running /tmp on a tempfs? Hm, this is from the output of mount: devshm on /dev/shm type tmpfs (rw) /dev/mapper/system-tmp on /tmp type reiserfs (rw)
Re: [Dbmail-dev] FATAL module server file pool.c func scoreboard_new line 87: shmget failed [No space left on device]
Paul J Stevens [EMAIL PROTECTED] schrieb: Try # ipcs -m something is eating segments for lunch. -- Shared Memory Segments key shmid owner perms bytes nattch status 0x 19398656 root 600 655360 2 0x 1631453185 dbmail 644 10 0 0x 1631485954 dbmail 644 10 0 0x 1593933827 dbmail 644 10 0 0x 1593966596 dbmail 644 10 0 0x 71467013 dbmail 644 10 0 0x 71499782 dbmail 644 10 0 0x 71532551 dbmail 644 10 0 0x 71565320 dbmail 644 10 0 ~4000 lines following of the same type0x 1631326205 dbmail 644 10 0 0x 1631358974 dbmail 644 10 0 0x 1631391743 dbmail 644 10 0
Re: [Dbmail-dev] FATAL module server file pool.c func scoreboard_new line 87: shmget failed [No space left on device]
Paul J Stevens [EMAIL PROTECTED] schrieb: You shouldnt kill9 dbmail :-) I did not! I swear! :-)But, dbmail did kill itself. The parameter driver was set to pgsql in dbmail.conf. But is seems like not all needed libraries got installed. And i don't have pgsql installed. I'm a happy mysql user. Oct 4 12:54:14 laptoplk dbmail/imap4d[27903]: FATAL dbmodule.c,db_load_driver: cannot load libpgsql.so: cannot open shared object file: No such file or directoryWhich let restart dbmail over and over again. And after every restart, it created new shm segment.The same seem to happen, when you have not the correct database settings configure(username/password). That's the output from syslog Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func DoConfig line 198: reading config Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 228: server will create [2] children Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 241: children will make max. [1] connections Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 254: timeout [300] seconds Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 259: no value for SOCKET in config file Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 262: socket [] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 274: binding to PORT [110] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 286: binding to IP [*] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 292: no value for BACKLOG in config file. Using default value [16] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 306: resolving client IP Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 320: Disabling POP-before-SMTP Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 332: effective user shall be [dbmail] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 344: effective group shall be [dbmail] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 356: will maintain minimum of [2] spare children in reserve Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 368: will maintain maximum of [4] spare children in reserve Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module serverparent file serverparent.c func LoadServerConfig line 380: will allow maximum of [10] children Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module server file server.c func dm_socket line 322: done Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module server file server.c func create_inet_socket line 392: creating socket on [*:110] with backlog [16] Oct 4 13:41:35 laptoplk dbmail/pop3d[301]: Debug module server file server.c func dm_bind_and_listen line 342: done Oct 4 13:41:35 laptoplk dbmail/pop3d[341]: Error dbmysql.c,db_connect: mysql_real_connect failed: Access denied for user 'dbmail'@'localhost' (using password: YES) Oct 4 13:41:35 laptoplk dbmail/pop3d[341]: FATAL module server file server.c func StartServer line 118: Unable to connect to database. Oct 4 13:41:35 laptoplk dbmail/pop3d[341]: Error module server file pool.c func statefile_remove line 560: Error unlinking statefile [/var/run/dbmail/dbmail-pop3d.state]: [Permission denied]. Oct 4 13:41:35 laptoplk dbmail/pop3d[341]: Error module pidfile file pidfile.c func pidfile_remove line 91: Error unlinking pidfile [/var/run/dbmail/dbmail-pop3d.pid]: [Permission denied]. Oct 4 13:41:37 laptoplk dbmail/imap4d[32765]: Debug module server file server.c func server_run line 247: server has exited, exit status [75] After every restart i have one shm segment more. The processes get restarted until i execute /etc/init.d/dbmail stop.
[Dbmail-dev] Error unlinking pidfile [/var/run/dbmail-imapd.pid]: [Permission denied]
Hello! Whenever a logout occurs, i get following message in the syslog file. DBMail runs as nobody and the file is owned by root. Is that the expected behaviour?
[Dbmail-dev] Multipart Message Problem
Hello Paul and Aaron! I just would like to remind your about messages parsing problem, we have been discussing 2-3 weeks ago. The problem was that i was unable to fetch a specific part of a message. I will provide a testcase later this day.
Re: [Dbmail-dev] [DBMail 0000413]: Ubuntu/Debain package does not install
Paul J Stevens [EMAIL PROTECTED] schrieb: Lars, Doesn't ubuntu use debconf? It does. But the default level for the questions asked is cirtical by default on my installation. And then everything will fail. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] building ubuntu packages
Paul J Stevens [EMAIL PROTECTED] schrieb: Lars Kneschke wrote: Hello! I like to have dbmail and libsieve packages for ubuntu. Bulding dbmail packages itself is quite easy. It works out of the box. But building libsieve is a little bit tricky. So far there exists no working deb package. libsieve is now part of debian/unstable. It's called libsieve2-1 Thanks! I have downloaded the source files and rebuild the packages under ubuntu.
[Dbmail-dev] building ubuntu packages
Hello! I like to have dbmail and libsieve packages for ubuntu. Bulding dbmail packages itself is quite easy. It works out of the box. But building libsieve is a little bit tricky. So far there exists no working deb package. The library from Paul's debian repository has a strange numbering schema. ibsieve1_2.1.12-1_i386.deb Which breaks dependencies. I think the name should be libsieve_2.1.12-1_i386.deb Does some has the needed debian files to build this package from source? Someone created already a libsieve debian package.
Re: [Dbmail-dev] my current dbmail status
Paul J Stevens [EMAIL PROTECTED] schrieb: Lars Kneschke wrote: Hello! Today was debuging day. I tried to solve the random crashes. I found one problem in glib2. After moving around some ifdef's i solved one problem. Tell use more, please! After configure is run, i apply following patch: --- config.h.orig Fr Sep 15 15:08:55 2006 +++ config.h Fr Sep 15 15:10:20 2006 @@ -148,7 +148,7 @@ #define HAVE_GETTEXT 1 /* define to use system printf */ -/* #undef HAVE_GOOD_PRINTF */ +#define HAVE_GOOD_PRINTF 1 /* define to support printing 64-bit integers with format I64 */ /* #undef HAVE_INT64_AND_I64 */ @@ -337,7 +337,7 @@ #define HAVE_VALUES_H 1 /* Define to 1 if you have the `vasprintf' function. */ -#define HAVE_VASPRINTF 1 +/* #define HAVE_VASPRINTF 1 */ /* Define to 1 if you have the `vprintf' function. */ #define HAVE_VPRINTF 1 I just shuffle around some defines.The code which requires this defines is in glib/gprintf.c about line ~300(function gint g_vasprintf). With the standard config.h the first if clause get's used. With my modified config.h the last if clause get's used. And now i don't get any stack corruptions any more.I have no idea why. I was just poking around with the help of my brother. :-)
Re: [Dbmail-dev] [DBMail 0000408]: can not fetch by UID anymore
[EMAIL PROTECTED] schrieb: -- paul - 15-Sep-06 15:41 -- found it after I noticed horde3/imp4 broke on svn-trunk. from the rfc: The number after the * in an untagged FETCH response is always a message sequence number, not a unique identifier, even for a UID command response. whereas dbmail was returning unique identifiers. Ahhh! Very nice! I'm able to read emails again from the latest svn version.Thanks!
[Dbmail-dev] my current dbmail status
Hello! Today was debuging day. I tried to solve the random crashes. I found one problem in glib2. After moving around some ifdef's i solved one problem. I have dbmail now running on 4 Solaris based server. EMail gets delivered by any of the machines to the MySQL database by dbmail-lmtpd. So far i have no crashes anymore. I'm have tested dbmail-imapd using thunderbird, evolution, kmail and FeLaMiMail of course. So far everything looks good so far. Thanks to the devlopers for their work.
[Dbmail-dev] Uidvalidity not changing
Hello! I started caching sort results, until uidvalidity changes. But uidvalidity does not change when i receive a new mail or delete a old one. I have tested this with a 2 weeks old version. Tomorrow i'll test it with latest SVN.
Re: [Dbmail-dev] Uidvalidity not changing
Aaron Stone [EMAIL PROTECTED] schrieb: UIDVALIDITY is constant on a per-mailbox basis so long as the UIDs of each message still point to the same messages. To look for new messages, you need to check the current message sequence number. EXAMINE, SELECT and STATUS can get it for you. In fact, we should time them to see if they run at significantly different speeds. Ok. I changed my code. But should not change that value at least on delete?
Re: [Dbmail-dev] Uidvalidity not changing
Aaron Stone [EMAIL PROTECTED] schrieb: Ok. I changed my code. But should not change that value at least on delete? Nope, I don't think so. When UIDVALIDITY changes, it means all UID's that you have cached must be thrown away and you have to find out what the new UID's are for the messages in the mailbox. Unfortunaly it does not seem to be documented really good in the RFC. But it is also not important for me, as i now query the number of messages and nextuid. That solves the problem for me. There's an interesting extension, too: RFC 4315, UIDPLUS. I don't think it's implemented in DBMail (?). Not when having a look at the capabilities.
Re: [Dbmail-dev] Sort with search not yet implemented?
Paul J Stevens [EMAIL PROTECTED] schrieb: Lars, I did. It-works-for-me. Gimme some details please. I did expect that answer. :-)))I'll prepare a level 5 log.
[Dbmail-dev] Sort with search not yet implemented?
Hello! I pimped FeLaMiMail to work directly against the imap server. I developed against Cyrus IMAP server and now i tried to get it working with dbmail. So far it work good, but there is one major problem. Sorting the folder and filtering by subject for example is not working. ...[ID 748625 mail.notice] Info COMMAND: [0007 SORT (REVERSE DATE) utf-8 SUBJECT lars hase] and then some lines down is see this ... [ID 748625 mail.notice] Debug dbmail-mailbox.c,_handle_search_args: unknown search key [lars hase] The filter string get's not recognized. Is this a bug or not yet implemented?
[Dbmail-dev] Re: Sort with search not yet implemented? = it's a bug
Lars Kneschke [EMAIL PROTECTED] schrieb: Is this a bug or not yet implemented? It is a bug. This imap command works: COMMAND: [0007 SORT (REVERSE DATE) utf-8 SEEN SUBJECT trace_] This command does not work COMMAND: [0007 SORT (REVERSE DATE) utf-8 SUBJECT trace_]
Re: [Dbmail-dev] Sort with search not yet implemented?
Paul J Stevens [EMAIL PROTECTED] schrieb: Definitely a bug. search/sort should work and fully implement the rfc sort draft. Looks like a regression after I fixed somethings the popped up when using roundcube. But I can't reproduce on svn-trunk. Are you using 2.1.7, because that one *did* contain some regression in search/sort that have been fixed last week. Sorry! That was my fault. I build the fresh packages but did not install them. Witch latest SVN it is working again.Can you have look at bug 408 maybe? With current SVN i'm unable to fetch messages by UID.
Re: [Dbmail-dev] analysis of som performance bottlenecks
Am Montag, den 11.09.2006, 19:30 +0200 schrieb Paul J Stevens: Lars Kneschke wrote: Paul J Stevens [EMAIL PROTECTED] schrieb: Now how about running your test with the latest svn codebase? Just for the records.With the old codebase it took about 1 second to finnish the tests in best case. Now the tests are finnished after 0.6 seconds in best case. Still slower than cyrus then :-( Time to start profiling... Please be aware that the cyrus has all data on the local disk, while dbmail is talking to the mysql server over the network. So you can not really compare my results on a fair basis. But i still got the impression that that the time needed for fetching messages grows linear if you need to fetch more headers. I'll investigate this when i have a stable environment again.
Re: [Dbmail-dev] [DBMail 0000406]: random crashes with latest svn
Am Montag, den 11.09.2006, 12:09 -0700 schrieb Aaron Stone: On Mon, 2006-09-11 at 18:27 +0200, Lars Kneschke wrote: Am Montag, den 11.09.2006, 08:45 +0200 schrieb Paul J Stevens: Lars, The only changes over the last week were in the FETCH code (not touched in your examples), in the sqlite layer and in the pop3 code. But I've also been moving a lot of the trace calls in the imap code to Aaron's newtrace macros. Given that we've seen problems on solaris before in the trace code, I wonder if that's the case here as well. So, could you run some tests on a trace_level=0, and see if it still crashes then? Changing from trace to TRACE does not significantly change the behavior of the newtrace function; it just adds the module, file, func, line arguments into the format string. These are always non-null as far as I can tell. g_strdup_printf does require the Solaris workaround in case one of its arguments is null, so that's definitely something to look at. Can you explain that a little bit further? Do you mean /usr/lib/[EMAIL PROTECTED] I have a c developer in my company, who should have a look at this problem later this day. Now in SVN. Thanks! If you are on Solaris, are you using the Solaris null pointer workaround? You mean LD_PRELOAD_32=/usr/lib/[EMAIL PROTECTED] . Yes, i added that to our init scripts.
Re: [Dbmail-dev] [DBMail 0000406]: random crashes with latest svn
Am Montag, den 11.09.2006, 08:45 +0200 schrieb Paul J Stevens: Lars, The only changes over the last week were in the FETCH code (not touched in your examples), in the sqlite layer and in the pop3 code. But I've also been moving a lot of the trace calls in the imap code to Aaron's newtrace macros. Given that we've seen problems on solaris before in the trace code, I wonder if that's the case here as well. So, could you run some tests on a trace_level=0, and see if it still crashes then? While analyszing some more core dumps, i discovered also situations, where dbmail-imapd also crashes in situations, where no glib code seems to be involved. Should i post the backtraces too?
Re: [Dbmail-dev] [DBMail 0000406]: random crashes with latest svn
Paul J Stevens [EMAIL PROTECTED] schrieb: Lars, The only changes over the last week were in the FETCH code (not touched in your examples), in the sqlite layer and in the pop3 code. But I've also been moving a lot of the trace calls in the imap code to Aaron's newtrace macros. Given that we've seen problems on solaris before in the trace code, I wonder if that's the case here as well. So, could you run some tests on a trace_level=0, and see if it still crashes then? I'll try this over this day.
Re: [Dbmail-dev] analysis of som performance bottlenecks
Paul J Stevens [EMAIL PROTECTED] schrieb: Now how about running your test with the latest svn codebase? Just for the records.With the old codebase it took about 1 second to finnish the tests in best case. Now the tests are finnished after 0.6 seconds in best case.
[Dbmail-dev] Sieve: filtering by date
Hello Aaron! While having working vacation support in dbmail, people often asking if they can make a vacation notice not active before a given date. That is currenlty not possible with plain sieve scripts. While searching for a working solution i discovered http://tools.ietf.org/wg/sieve/ and http://tools.ietf.org/wg/sieve/draft-freed-sieve-date-index-01.txt . Do you think it would be hard to implement this in libsieve and dbmail?
[Dbmail-dev] analysis of som performance bottlenecks
Hello! I'm the process of switching from Cyrus to DBMail. While switching i suffered some performance problems. I don't want to say that DBMail is slow, i just want to point out some topics which can help improving the performance of DBMail in general. Both imap servers are running on the same machine. I know that i'm comparing apples with pears! :-) Something about our old cyrus based system. Everything is on one single server. That makes to solution really fast. I did some test with following results: Making a connection to the Cyrus IMAP server and login in: 0.07 seconds Sorting a folder with more than 1000 messages by subject: 0.07 seconds Fetching the headers of 10 messages from the result: 0.04 seconds Overall time spend in the php script: 0.2 seconds. Puh, that's really fast. :-) And now something about our DBMail setup. We have multiple IMAP fronservers and and a bigsized MySQL database. As the IMAP server needs to talk with the MySQL database over the network, we will have some delay added anyways. Here are the results: Making a connection to the DBMail IMAP server and login in: 0.2 seconds Sorting a folder with more than 1000 messages by subject: 0.09 seconds Fetching the headers of 10 messages from the result: 1 second Overall time spend in the php script: 1.3 seconds. Puh, that times slower. :-( I started using iampproxy to speed up the login process. But that changed nothing. I don't know why. But the login process still took the same time. Imapproxy stated that it was reusing a session. DBmail spends most time fetching the headers from the database. Then i took the sql queries generated by dbmail from the log file. Only executing the sql queries against the database over the network from the IMAP server and forwarding the results to /dev/null took 0.5 seconds. Doing the same queries on the database itself only took 0.05 seconds. As dbmail is doing very much single sql queries it should benefit much from doing more things in a single sql query, as every query adds another delay because of the round trip time from the imap server to the sql server. I already talked with Paul about this. I just wanted to write it down to share my findings with you. Lars
Re: [Dbmail-dev] [DBMail 0000401]: invalid byte sequence for dbmail_headervalue when database is utf-8 encoded
Matthew T. O'Connor matthew@zeut.net schrieb: Paul, I have a similar (perhaps the same problem), so I decided to try to update to 2250 and recompile, but I'm getting this error: dbmail-message.c: In function `_header_cache': dbmail-message.c:934: error: too few arguments to function `dm_strnesc' make[2]: *** [libdbmail_la-dbmail-message.lo] Error 1 make[2]: Leaving directory `/home/dbmail2/src/dbmail' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/home/dbmail2/src/dbmail' make: *** [all] Error 2 I just wanted to report the same.
Re: [Dbmail-dev] webmail direct from database.
Michael Tabolsky [EMAIL PROTECTED] schrieb: Do you mean the problem that php has access to the whole email server database regardless the mailbox authentication? Seems to be treat, but we can figure out how to put it in limits... Yes. That's my main concern. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] webmail direct from database.
Casper Langemeijer [EMAIL PROTECTED] schrieb: Yes I like my users to be able to change their own passwords, manage mailfilter rules, create aliases and stuff. The interface for that is not there (except for managesieve), but hey, the application for that is not there yet too :-) It is! :-) http://www.egroupware.org -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] webmail direct from database.
Michael Tabolsky [EMAIL PROTECTED] schrieb: If it is already mentioned, I am using dbmail with egroupware/felamimail too. I remember someone mentioning here development of egroupware/standalone application that will speak directly with database. If there is such an intension I would gladly join it. I also talked about it, but i'm not sure if i will do it. I'm a little bit concerned about security problems. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] fetch message part problem
Hello! I just discovered that dbmail seem to deliver the wrong part, when fetching the headers of message, which got forwarded as messages/rfc8222. How can we debug this?
Re: [Dbmail-dev] performance difference between cyrus and dbmail
Paul J Stevens [EMAIL PROTECTED] schrieb: That makes sense. Fetching is still very much sub-optimal in dbmail atm. I've redone sorting which should be very fast, but fetch is still refactored 2.0 style code. It doesn't take advantage of the header caches very much yet, and is not very smart about message ranges. Yes, that seems to be main problem. Do you have a time line when you want to have a look at this? -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] performance difference between cyrus and dbmail
Paul J Stevens [EMAIL PROTECTED] schrieb: I'm curious about your setup. Are you using imap's server-side sort here, or some kind of client side sorting? You can have a look at the numbers yourself at this page: https://officespot.net/imaptest/imaptest.php Sometime you need to reload sometimes, when the first connection fails. As you can see, the sorting is not the problem. It tooks only 0.06 seconds(dbmail) against 0.05 seconds(cyrus). On both servers we use server-side sorting. I had a look at the imap commands. DBMail just need much more time to fetch the headers, after the sorting was done. I'll try to investigate, where the time gets spend. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] Intel Solaris is working again
Hello! After updating to the latest SVN revision, dbmail seem to be working on Intel Solaris again. Just to let you know. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] performance difference between cyrus and dbmail
Hello! I just did some tests. I wrote a simple php script, which connects to the cyrus imap server and then to the dbmail imap server and measures the time spending for the varios taks. Both servers are more or less equal, regarding memory and cpu performance. The cyrus server is in a better situation, because he has all informations local avaiable. The dbmail server must authenticate to a external ldap server and the emails are stored in a external mysql server. I'm doing following actions: - authenticate as user - sort a folder with more than 1000 messages - fetch messages 10-30 The imapserver can do this in 0.1 seconds, the dbmail imap server needs 0.5 seconds. Which is 5 time slower. The dbmail server spends most time with fetching the headers. Just to let you know. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] Warning pool.c, manage_spare_children: error scaling up/down
Hello! After doing this: [EMAIL PROTECTED]:~ telnet host.domain.net 143 Trying 10.129.3.230... Connected to host.domain.net. Escape character is '^]'. * OK dbmail imap (protocol version 4r1) server 2.1 ready to run a001 login [EMAIL PROTECTED] password a001 OK LOGIN completed a002 bye a002 BAD command not recognized Connection closed by foreign host. i get following messages in the syslog file. dbmail/imap4d[23770]: [ID 748625 mail.alert] Error serverchild.c,PerformChildTask: stop requested dbmail/imap4d[23702]: [ID 748625 mail.alert] Warning pool.c,manage_spare_children: error scaling up/down dbmail/imap4d[23770]: [ID 748625 mail.alert] Error serverchild.c,PerformChildTask: stop requested dbmail/imap4d[23702]: [ID 748625 mail.alert] Warning pool.c,manage_spare_children: error scaling up/down I'm using SVN from yesterday. That's not ok, isn't it?
Re: [Dbmail-dev] Another strange bug
Am Freitag, 23. Juni 2006 23:31 schrieb Aaron Stone: Ok, let us know if you need any help! Aaron Stone [EMAIL PROTECTED] schrieb: Ok, let us know if you need any help! I'm lost... Jun 25 22:44:24 comp-isol01.metaways.net dbmail/imap4d[2283]: [ID 748625 mail.notice] Info COMMAND: [0001 AUTHENTICATE LOGIN] Jun 25 22:44:24 comp-isol01.metaways.net dbmail/imap4d[2283]: [ID 748625 mail.notice] Debug arg[0]: 'LOGIN' Jun 25 22:44:24 comp-isol01.metaways.net dbmail/imap4d[2283]: [ID 748625 mail.notice] Info imap4.c,IMAPClientHandler: Executing command authenticate... Jun 25 22:44:24 comp-isol01.metaways.net dbmail/imap4d[2283]: [ID 748625 mail.notice] Debug RESPONSE: [+ dXNlcm5hbWUNCg==^M Jun 25 22:44:24 comp-isol01.metaways.net ] Jun 25 22:44:24 comp-isol01.metaways.net dbmail/imap4d[2283]: [ID 748625 mail.notice] Debug RESPONSE: [!cGFzc3dvcmQNCg==^A^M Jun 25 22:44:24 comp-isol01.metaways.net ] I just compared config.h created by configure for glib2. They are mostly equal expect some endian variables. Somehow the output gets corupted, but i have no idea why. I have checked the code in glib/gprintf.c line 311(#elif defined (HAVE_VASPRINTF)). I commented this code out to use the code from the else clause, but that did not change anything. Any ideas?
Re: [Dbmail-dev] Another strange bug
Lars Kneschke [EMAIL PROTECTED] schrieb: Hello! Today i discovered another strange bug. I got i narrowed down to this piece of code: int dbmail_imap_session_printf(struct ImapSession * self, char * message, ...) trace(TRACE_MESSAGE, %s,%s: A string: %s, __FILE__, __func__, message); va_start(ap, message); ln = g_strdup_vprintf(message,ap); va_end(ap); trace(TRACE_MESSAGE, %s,%s: B string: %s, __FILE__, __func__, ln); When asking for the password, the string printed by the last trace contains strange characters. While asking for the password it works without any problems. I'm still debuging. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] Another strange bug
Aaron Stone [EMAIL PROTECTED] schrieb: In your glib builds, look to see if one or both are using the Solaris libc's vasnprintf, or if they're using the Gnulib vasnprintf. I also tracked it down to this point. But currently i'm missing some knowledge, but find out which implementation is used. But i will find a way. Somehow... :-)
Re: [Dbmail-dev] Foreign key constraints on the headers tables
Am Montag, 19. Juni 2006 09:52 schrieb Paul J Stevens: Aaron Stone wrote: Just for fun, try SELECT * FROM dbmail_headername. I don't think you should see more than 50-100 entries. I have 12729. The majority of them are like this: Do you also get this for newly inserted messages, or just for converted 'old' messages? I'm guessing the latter, which may make this a retrieval/decoding issue. I get 928 rows, but only valid headers. It's funny to see how many different emailheaders gets used.
Re: [Dbmail-dev] new strange error messages
Aaron Stone [EMAIL PROTECTED] schrieb: Go ahead and attach gdb or strace to your pids 12221 and 16305 to see where they are stuck. Unfortunaly i don't have this processes running anymore as dbmail-imap was simply unuseable at this moment. How do i need to call gdb to get some output which helps you debugging this problem? -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] [DBMail 0000367]: Sometimes LDAP Authentication fails
Paul J Stevens [EMAIL PROTECTED] schrieb: [EMAIL PROTECTED] wrote: The solution should be to bind as the user defined in dbmail.conf before searching for uids. Excellent. Another TODO for ldap is reconnection if the ldap server is restarted. Oh yes! That's worth another bug report. I just forgot it. :-) -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] customer id dbmail_users client_idnr
Lars Kneschke [EMAIL PROTECTED] schrieb: Would it be possible to use a string instead integer as database field type? That would make the integration very simple. If it's not possible i need to create the number from the string somehow. It's quite easy to generate a integer from string be using crc32(). On the other side we have also the ldap backend. It would be nice, if we could get the customer id from the ldap tree somehow. Currently we can do this only reading some entry the users entry. But if i use the group idnumber, i can not be sure that this group gets not changed, as this information get's also used by some other ldap services. If i have different tree's for different clients already, it would be very easy to extract that info from the dn. Then i would not need another field or schema extension. In the mean time i extended the dbmail ldap schema. I'll keep you updated. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] customer id dbmail_users client_idnr
Am Freitag, 16. Juni 2006 15:57 schrieb Paul J Stevens:
Difficult. The client_idnr has gone unused for most of dbmail's
existence. However, while finishing the Aaron's ldap code last year or
so, I decided to use it as a gidNumber. And as such the authldap and
authsql code now treat it, and dbmail-users allows management of it.
Ok. But it is correct that the gidNumber is used to separate user from each
other. To group them by customer for exmaple. Is that correct?
I already found a good way creating a integer inside eGroupWare which is
useable for this porpuse.
It would be nice, if we could get the customer id from the ldap tree
somehow. Currently we can do this only reading some entry the users
entry. But if i use the group idnumber, i can not be sure that this group
gets not changed, as this information get's also used by some other ldap
services. If i have different tree's for different clients already, it
would be very easy to extract that info from the dn. Then i would not
need another field or schema extension.
What do you think?
I don't get it. Are you using ldap or are you using the sql user tables?
We can use both in eGroupWare.
If you're using authldap, the dbmail_users table is used for creating
shadow entries. Only the user_idnr, userid and curmail_size values are
actively used. The rest is supposed to be in the ldap tree (come to
think of it, I don't know what's going on with maxsieve_size in case of
authldap). So if you're on authldap, you're free to change
dbmail_users.client_idnr to varchar if you prefer. But I guess you don't
want to impose ldap as a requirement for egroupware, right?
Right. eGroupWare can be used with both. And i want to support both.
The current code is writing the client_idnr too to the shadow table when using
ldap_auth. That would not allow me to simply change the type it. But this is
also not needed anymore.
About the dn thing i mentioned before.
When you have following ldap structure:
ou=accounts,ou=customer1,dc=de
uid=loginname,ou=accounts,ou=customer1,dc=de
...
ou=accounts,ou=customer2,dc=de
uid=loginname,ou=accounts,ou=customer2,dc=de
...
ou=accounts,ou=customer3,dc=de
uid=loginname,ou=accounts,ou=customer3,dc=de
...
This way you have your accounts already grouped. Grouped by customer.
Currently we use one field of the record to get it
groupid(FIELD_CID=gidNumber). But if you use the gidNumber already as real
group id(for a unix account), this is no good solution as you don't want to
separate the user groups of one customer in the imapserver.
Then you need to add another field to ldap entry(dbmailGroupID for example).
That would required a change on all ldap entrys to put them in the right
group. But we have organized the accounts already in the ldap tree by
customer. If we use customer{1,2,3} or something as group id, then we don't
need to modify a existing ldap directory but still get the same result like
reading the gidNumber from the entry.
I hope i found the right words to explain my ideas. :-)
If not feel free to ask again.
[Dbmail-dev] new strange error messages
Hello developers! I get this error messages on my test server. I have never seen them before. I'm using svn from yesterday. Any idea what could lead to this problem? There is only one user connecting to this website. Jun 15 18:32:02 mail-4.metaways.net last message repeated 1 time Jun 15 18:32:02 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Message pool.c,manage_spare_children: children [10/10], spares [3 (2 - 4)] Jun 15 18:32:03 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Debug serverchild.c,noop_child_sig_handler: ignoring signal [15] Jun 15 18:32:03 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Message pool.c,manage_spare_children: children [10/10], spares [3 (2 - 4)] Jun 15 18:32:03 mail-4.metaways.net dbmail/imap4d[12221]: [ID 748625 mail.notice] Message pool.c,manage_spare_children: children [10/10], spares [3 (2 - 4)] Jun 15 18:32:03 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Debug serverchild.c,noop_child_sig_handler: ignoring signal [15] Jun 15 18:32:03 mail-4.metaways.net last message repeated 1 time Jun 15 18:32:03 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Message pool.c,manage_spare_children: children [10/10], spares [3 (2 - 4)] Jun 15 18:32:04 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Debug serverchild.c,noop_child_sig_handler: ignoring signal [15] Jun 15 18:32:04 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Message pool.c,manage_spare_children: children [10/10], spares [3 (2 - 4)] Jun 15 18:32:04 mail-4.metaways.net dbmail/imap4d[12221]: [ID 748625 mail.notice] Message pool.c,manage_spare_children: children [10/10], spares [3 (2 - 4)] Jun 15 18:32:04 mail-4.metaways.net dbmail/imap4d[16305]: [ID 748625 mail.notice] Debug serverchild.c,noop_child_sig_handler: ignoring signal [15] Jun 15 18:32:04 mail-4.metaways.net last message repeated 1 time -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] strange error messages and login problems with ldap
Paul J Stevens [EMAIL PROTECTED] schrieb: But this can also be used from some bad guy, right? Yep. But inetd mode will also solve this, right? Does it? :-) I don't know. I just was thinking loud. I will have a look at the man page. Thanks for the hint. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
[Dbmail-dev] Sieve problem with current SVN
Hello! I just updated to latest svn revision. And now i get following errors, after i start dbmail-timsieved or when a message arives for dbmail-lmtp. Jun 13 18:19:47 mail-4.metaways.net dbmail/timsieved[7459]: [ID 702911 mail.alert] sortmodule.c,sort_load_driver: cannot load libsort_sieve.so: ld.so.1: dbmail-timsieved: fatal: relocation error: file /opt/local/lib/dbmail/libsort_sieve.so: symbol dbmail_message_get_header_repeated: referenced symbol not found Jun 13 18:19:47 mail-4.metaways.net dbmail/timsieved[7459]: [ID 702911 mail.alert] sortmodule.c, sort_listextensions: Error loading sort driver Any ideas?
[Dbmail-dev] strange error messages and login problems with ldap
Hello! In the past i have been running dbmail svn trunk without big problems. Now i started letting running egroupware(felamimail) against it. And now i come in trouble a little bit. First i get these error messages in the syslog file: Jun 13 18:49:35 mail-4.metaways.net dbmail/imap4d[7676]: [ID 702911 mail.alert] dbmail-imapsession.c,dbmail_imap_session_readln: error reading from client Jun 13 18:49:35 mail-4.metaways.net dbmail/imap4d[7676]: [ID 702911 mail.alert] imap4.c,IMAPClientHandler: error reading command -- bailing out Jun 13 18:49:36 mail-4.metaways.net dbmail/imap4d[7678]: [ID 702911 mail.alert] dbmail-imapsession.c,dbmail_imap_session_readln: error reading from client Jun 13 18:49:36 mail-4.metaways.net dbmail/imap4d[7678]: [ID 702911 mail.alert] imap4.c,IMAPClientHandler: error reading command -- bailing out Jun 13 18:49:36 mail-4.metaways.net dbmail/imap4d[7679]: [ID 702911 mail.alert] serverchild.c,PerformChildTask: stop requested Only when using eGroupWare. Not when using KMail for example. The main difference is that kmail for example only opens the connection one, while the webapplication(egroupware) needs to reopen the imap connection again and again. I'll try to debug this, but it would be nice if you can give me hint, waht source for this error messages could be. After some more of this error messages i get some other error messages: Jun 13 18:47:59 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] authldap.c,auth_validate: unable to determine DN for user Jun 13 18:47:59 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] dbmail-imapsession.c,dbmail_imap_session_handle_auth: db-validate error while validating user [EMAIL PROTECTED] (pass saftsack). Jun 13 18:47:59 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] imap4.c,IMAPClientHandler: command return with error [login] Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7654]: [ID 702911 mail.alert] serverchild.c,PerformChildTask: stop requested Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] authldap.c,auth_validate: unable to determine DN for user Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] dbmail-imapsession.c,dbmail_imap_session_handle_auth: db-validate error while validating user [EMAIL PROTECTED] (pass saftsack). Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] imap4.c,IMAPClientHandler: command return with error [authenticate] Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] authldap.c,auth_validate: unable to determine DN for user Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] dbmail-imapsession.c,dbmail_imap_session_handle_auth: db-validate error while validating user [EMAIL PROTECTED] (pass saftsack). Jun 13 18:48:31 mail-4.metaways.net dbmail/imap4d[7457]: [ID 702911 mail.alert] imap4.c,IMAPClientHandler: command return with error [login] As you can seen, i'm unable to authenticate against LDAP now. If i restart dbmail-imapd i'm able to authenticate just fine for a while. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] strange error messages and login problems with ldap
Lars Kneschke [EMAIL PROTECTED] schrieb: Hello! In the past i have been running dbmail svn trunk without big problems. Now i started letting running egroupware(felamimail) against it. And now i come in trouble a little bit. Ok. I located the problem. FeLaMiMail did login but did not logout. That way many new processes got created(with every page reload) until i was not able to login anymore. That was a bug in felamimail. But this can also be used from some bad guy, right? -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] Sieve problem with current SVN
Am Dienstag, 13. Juni 2006 19:02 schrieb Aaron Stone: On Tue, 2006-06-13 at 18:39 +0200, Lars Kneschke wrote: Jun 13 18:19:47 mail-4.metaways.net dbmail/timsieved[7459]: [ID 702911 mail.alert] sortmodule.c,sort_load_driver: cannot load libsort_sieve.so: ld.so.1: dbmail-timsieved: fatal: relocation error: file /opt/local/lib/dbmail/libsort_sieve.so: symbol dbmail_message_get_header_repeated: referenced symbol not found Jun 13 18:19:47 mail-4.metaways.net dbmail/timsieved[7459]: [ID 702911 mail.alert] sortmodule.c, sort_listextensions: Error loading sort driver The missing symbol will be in libdbmail.so once you've rebuilt it from current SVN. A simple make install should do the trick. Ok! I borked the Makefile while removing the asciidoc stuff. We don't have python on the buildserver available.
Re: [Dbmail-dev] strange error messages and login problems with ldap
Am Dienstag, 13. Juni 2006 19:55 schrieb Aaron Stone: On Tue, 2006-06-13 at 19:41 +0200, Lars Kneschke wrote: Ok. I located the problem. FeLaMiMail did login but did not logout. That way many new processes got created(with every page reload) until i was not able to login anymore. That was a bug in felamimail. Was PHP not closing the connections after the script finished? DBMail processes should not be sitting around with half open connections forever... I did not send the BYE(imap logout). I'm not sure what happens with the socket connection after the (php)page got delivered. Something to look for with ethereal.
[Dbmail-dev] sieve vacation and charset
Hello! I just started playing around with vacation messages. Basicly it is working fine so far. There only problem existing is a charset problem. The sieve script is encoded in utf-8. But the vacation email is generated without any header indicating the charset. Which leads to strange results when using characters like öäü and such. I think we only need to add the right charset to the email headers. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] sieve vacation and charset
Aaron Stone [EMAIL PROTECTED] schrieb: There only problem existing is a charset problem. The sieve script is encoded in utf-8. But the vacation email is generated without any header indicating the charset. Which leads to strange results when using characters like öäü and such. I think we only need to add the right charset to the email headers. Should go into pipe.c, in the send_mail function. What if we tagged everything coming from DBMail internally with a charset utf-8 header? That would include auto replies, auto notifications and vacations. I think that's the right way. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
Re: [Dbmail-dev] [DBMail 0000344]: Thunderbird runs in a loop, while logging in
Aaron Stone [EMAIL PROTECTED] schrieb: Now I wonder if we should have a README.solaris and just specify that we require lib/[EMAIL PROTECTED] or if we should be checking for null char *'s before every trace call? I'm going to see if I can get a fix into upstream Gnulib, since Owen Taylor didn't want to patch the Gnulib snapshot in Glib. I'm not sure either. So far i don't see any problems including this line in our init scripts. On the other side, dbmail is the only programm needing this library on our solaris systems so far. -- Lars Kneschke Metaways Infosystems GmbH Pickhuben 4 20457 Hamburg Germany eGroupWare Training Support == http://www.egroupware-support.net E-Mail: mailto:[EMAIL PROTECTED] Web:http://www.metaways.de Tel:+49 (0)40 317031-21 Fax:+49 (0)40 317031-81 Mobile: +49 (0)175 9304324
