A NOTE has been added to this issue. ====================================================================== http://www.dbmail.org/mantis/view.php?id=802 ====================================================================== Reported By: tabrisnet Assigned To: paul ====================================================================== Project: DBMail Issue ID: 802 Category: IMAP daemon Reproducibility: sometimes Severity: crash Priority: normal Status: acknowledged target: ====================================================================== Date Submitted: 29-Aug-09 20:39 CEST Last Modified: 23-May-10 22:19 CEST ====================================================================== Summary: Memory leak in IMAPd, DBmail v 2.3.6 Description: While importing mail from previous mail store to DBmail 2.3.6 on MySQL using imapsync, I have found that dbmail-imapd will leak memory. I have seen it up to 2GB. ======================================================================
---------------------------------------------------------------------- (0002912) paul (administrator) - 31-Aug-09 09:37 http://www.dbmail.org/mantis/view.php?id=802#c2912 ---------------------------------------------------------------------- Please run dbmail-imapd using valgrind. Without valgrind logs, there's not much we can do. ---------------------------------------------------------------------- (0002913) tabrisnet (reporter) - 01-Sep-09 03:07 http://www.dbmail.org/mantis/view.php?id=802#c2913 ---------------------------------------------------------------------- Find said file attached. Note that the crashes don't always happen, but they do sometimes happen outside valgrind. ---------------------------------------------------------------------- (0002914) tabrisnet (reporter) - 01-Sep-09 03:29 http://www.dbmail.org/mantis/view.php?id=802#c2914 ---------------------------------------------------------------------- Worth noting that it doesn't look that bad in the trace logs I'm reading. I'm trying a different set of folders to sync, should transfer a lot more data. I have a _lot_ of email to sync... albeit at this point it's looking less and less likely that I'm going to try to use dbmail 2.3 in production (for my personal use). Still, I have enough email that I can probably keep working on debugging for a while. ---------------------------------------------------------------------- (0002915) tabrisnet (reporter) - 01-Sep-09 17:13 http://www.dbmail.org/mantis/view.php?id=802#c2915 ---------------------------------------------------------------------- Second log has actual 'definitely lost' bytes, albeit it's still measured in megabytes not gigabytes. I had to compress it as this one was 4x larger than the previous one. ---------------------------------------------------------------------- (0002916) tabrisnet (reporter) - 02-Sep-09 19:15 http://www.dbmail.org/mantis/view.php?id=802#c2916 ---------------------------------------------------------------------- This 3rd one should be more interesting. 2MB definitely lost, 100MB possibly lost, and 760MB still reachable! Total size 876MB. Large proportion of the 760 is hash table entries (from gmime). Again had to compress, as the maximum file size is 50k and this one was 60k ---------------------------------------------------------------------- (0002917) paul (administrator) - 02-Sep-09 19:46 http://www.dbmail.org/mantis/view.php?id=802#c2917 ---------------------------------------------------------------------- Ok, this last logfile appears to offer sufficient clues to close a number of leaks. ---------------------------------------------------------------------- (0002921) tabrisnet (reporter) - 08-Sep-09 16:20 http://www.dbmail.org/mantis/view.php?id=802#c2921 ---------------------------------------------------------------------- It appears that 2.2 may have the same bug[s]. It normally hasn't happened to me due to the fact that I had set the per-process job limit to 2 and such large importations of email isn't the common use-case.' But I do right now have a 2.2.11 build with a virt-size of 770M and RSS of 760M. ---------------------------------------------------------------------- (0002947) pschmiel (reporter) - 02-Dec-09 18:05 http://www.dbmail.org/mantis/view.php?id=802#c2947 ---------------------------------------------------------------------- I lose about 800M VIRT per day with latest GIT head. valgrind log is attached. ---------------------------------------------------------------------- (0002949) pschmiel (reporter) - 02-Dec-09 18:05 http://www.dbmail.org/mantis/view.php?id=802#c2949 ---------------------------------------------------------------------- looks like the problem is - in my case - related to TLS. ---------------------------------------------------------------------- (0003059) paul (administrator) - 23-May-10 16:58 http://www.dbmail.org/mantis/view.php?id=802#c3059 ---------------------------------------------------------------------- Is this bug still happening? I'm seeing dbmail-imapd hover around 2MB after continuous operation for two weeks or more. ---------------------------------------------------------------------- (0003060) tabrisnet (reporter) - 23-May-10 22:15 http://www.dbmail.org/mantis/view.php?id=802#c3060 ---------------------------------------------------------------------- I'm no longer with the company that was running 2.2 in production, and 2.3 hasn't been on my list for experimentation for a while. I may be able to try it again however. ---------------------------------------------------------------------- (0003061) tabrisnet (reporter) - 23-May-10 22:19 http://www.dbmail.org/mantis/view.php?id=802#c3061 ---------------------------------------------------------------------- It's also worth noting that you haven't released a new dbmail-2.3.x since 2009/01, and I don't believe I ever was running the git. Issue History Date Modified Username Field Change ====================================================================== 29-Aug-09 20:39 tabrisnet New Issue 31-Aug-09 09:37 paul Note Added: 0002912 31-Aug-09 09:37 paul Status new => feedback 01-Sep-09 03:05 tabrisnet File Added: dbmail-imapd.valgrind.log 01-Sep-09 03:07 tabrisnet Note Added: 0002913 01-Sep-09 03:29 tabrisnet Note Added: 0002914 01-Sep-09 17:12 tabrisnet File Added: dbmail-imapd.valgrind-2.log.bz2 01-Sep-09 17:13 tabrisnet Note Added: 0002915 02-Sep-09 19:08 tabrisnet File Added: dbmail-imapd.valgrind-3.log.bz2 02-Sep-09 19:15 tabrisnet Note Added: 0002916 02-Sep-09 19:45 paul Status feedback => assigned 02-Sep-09 19:45 paul Assigned To => paul 02-Sep-09 19:46 paul Note Added: 0002917 02-Sep-09 19:46 paul Status assigned => acknowledged 07-Sep-09 17:36 jasb Issue Monitored: jasb 08-Sep-09 16:20 tabrisnet Note Added: 0002921 09-Sep-09 13:25 heisenberg Issue Monitored: heisenberg 02-Dec-09 16:48 pschmiel Note Added: 0002947 02-Dec-09 16:48 pschmiel File Added: valgrind_dbmail_02.12.09 02-Dec-09 17:14 pschmiel Issue Monitored: pschmiel 02-Dec-09 17:27 pschmiel Note Added: 0002948 02-Dec-09 17:44 pschmiel Note Edited: 0002948 02-Dec-09 17:49 pschmiel Note Deleted: 0002948 02-Dec-09 18:05 pschmiel Note Edited: 0002947 02-Dec-09 18:05 pschmiel Note Added: 0002949 23-May-10 16:58 paul Note Added: 0003059 23-May-10 22:15 tabrisnet Note Added: 0003060 23-May-10 22:19 tabrisnet Note Added: 0003061 ====================================================================== _______________________________________________ Dbmail-dev mailing list Dbmail-dev@dbmail.org http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail-dev
