Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Am Mittwoch, 17. April 2013 schrieb Kevin Krammer: On Wednesday, 2013-04-17, Martin Steigerwald wrote: Am Mittwoch, 17. April 2013 schrieb Kevin Krammer: On Wednesday, 2013-04-17, Diane Trout wrote: Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? All caching is handled by Akonadi server, all content in file based resources, e.g. maildir resource, is not involved in any cache handling. Thanks Kevin, thats what I thought, but it is good to head a confirmation. Andras mentioned that he is also using POP3 with Akonadi and he has no data losses. It is also the main setup used by current KMail maintainer Laurent Montel AFAIK. Thanks. So I know that it has quite some testing coverage. Makes it even more strange why it lost data on my setup. I still wonder whether others are using mutiple maildir resource or let all the mails downloaded from POP3 flow into one maildir resource. I asked András whether my setup was sane, but got no reply yet. -- Martin 'Helios' Steigerwald - http://www.Lichtvoll.de GPG: 03B0 0D6C 0040 0710 4AFA B82F 991B EAAC A599 84C7 -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/201304180949.33996.mar...@lichtvoll.de
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
On Thursday, 2013-04-18, Martin Steigerwald wrote: Am Mittwoch, 17. April 2013 schrieb Kevin Krammer: On Wednesday, 2013-04-17, Martin Steigerwald wrote: Am Mittwoch, 17. April 2013 schrieb Kevin Krammer: On Wednesday, 2013-04-17, Diane Trout wrote: Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? All caching is handled by Akonadi server, all content in file based resources, e.g. maildir resource, is not involved in any cache handling. Thanks Kevin, thats what I thought, but it is good to head a confirmation. Andras mentioned that he is also using POP3 with Akonadi and he has no data losses. It is also the main setup used by current KMail maintainer Laurent Montel AFAIK. Thanks. So I know that it has quite some testing coverage. Makes it even more strange why it lost data on my setup. I still wonder whether others are using mutiple maildir resource or let all the mails downloaded from POP3 flow into one maildir resource. My guess would be that the most common setup is a single resource, but I also don't think it would make a big difference. My bet would be on filtering, because this is usually where the setups begin to vary widely. E.g. some setups only have simple rules for matching on headers and moving to folders, some have more complex rules or more complex targets (e.g. move and change state), some have mails pass through external programs, etc. Those code paths then get only a fraction of the testing the main path gets and also makes bugs less easier to reproduce. Cheers, Kevin signature.asc Description: This is a digitally signed message part.
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Am Mittwoch, 17. April 2013 schrieb Diane Trout: On Wednesday, April 17, 2013 00:07:40 Martin Steigerwald wrote: Hi! I am back to KDEPIM 1 aka 4.4.11 and KDE SC 4.8.4 from Sid. Reason? Data losses. [Akonadi] [Bug 318227] New: Data loss on restarting Akonadi to get it responsive again https://bugs.kde.org/318227 [Akonadi] [Bug 318290] New: Empty mails: AkonadiAgentServer(4890)/libakonadi Akonadi::ResourceBase::itemRetrieved: Item does not provide part HEAD/RFC822 https://bugs.kde.org/318290 And finally the thing were I had enough of it: [Akonadi] [Bug 318444] New: data loss in maildir resource: Mails that were accessible disappeared and are not visible in maildir directory anymore https://bugs.kde.org/318444 KMail 2 / Akonadi lost mails from debian-kde mail folder while I was *reading* it. I never saw something like this with any mail application I ever used. Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? It was on the server, cause I told Akonadi POP3 resource to keep mails on server for 7 days. That was what made it possible to step back to a clean state with KMail 1. Unfortunately for the latest occurence I missed to save out ~/.xsession- errors. I wasn´t aware that its recreated on each KDE login and after I logged in it was gone. Anyway, if I let a POP3 resource download mails into a folder of a maildir resource I created, I´d expect to keep that mail once it has downloaded it. That would even hold true to disconnected IMAP, I think. Only process to be delete, add mails to it would be the IMAP resource. And in case of POP3 the only one deleting mails would be me *or* filter rules. Maybe it was something to do with mail filters. I am thinking about for to make a safe environment for trying to reproduce this. I think creating a second account, subscribe it to some mailing list and install a separate KDEPIM 4.10 install to use that would be a way to go. Since I didn´t read about data loss in kdepim or kdepim-users mailinglist I though such steps wouldn´t be necessary. Anyway, I got all mails back, and know a safe and quick way to switch back to KDEPIM-1 now. Thats good. I am a bit disappointment not to be able to use KDE SC 4.10 or only part of it, since some of it conflicts with KDEPIM 1, but well, my mails are safe and thats more important. -- Martin 'Helios' Steigerwald - http://www.Lichtvoll.de GPG: 03B0 0D6C 0040 0710 4AFA B82F 991B EAAC A599 84C7 -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/201304171030.38988.mar...@lichtvoll.de
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
On Wednesday, 2013-04-17, Diane Trout wrote: Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? All caching is handled by Akonadi server, all content in file based resources, e.g. maildir resource, is not involved in any cache handling. Cheers, Kevin signature.asc Description: This is a digitally signed message part.
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Hi, Alle mercoledì 17 aprile 2013, Martin Steigerwald ha scritto: I am back to KDEPIM 1 aka 4.4.11 and KDE SC 4.8.4 from Sid. Not that I'm asking you to try again, but at least reading the bug reports you opened I see things like: | kmail 4:4.10.2-0r4 newer than version in archive so the versions of kdepim packages were not the ones which we had in archive, meaning you either - recompiled it yourself from a random point of our git packaging - took those kdepim packages from another distro while in this case shouldn't change much (probably, although I cannot say anything for sure), please check to be using packages from Debian repositories only. -- Pino Toscano signature.asc Description: This is a digitally signed message part.
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
On 2013-04-17, Pino Toscano p...@debian.org wrote: | kmail 4:4.10.2-0r4 newer than version in archive In this case, it is packages provided by me for early testing. They don't differ except a bit of typos (and workarounds for a well known aptitude vs sbuild issue) from the packages I later pushed to experimental. /Sune -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/slrnkmtboc.fhs.nos...@sshway.ssh.pusling.com
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Am Mittwoch, 17. April 2013 schrieb Kevin Krammer: On Wednesday, 2013-04-17, Diane Trout wrote: Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? All caching is handled by Akonadi server, all content in file based resources, e.g. maildir resource, is not involved in any cache handling. Thanks Kevin, thats what I thought, but it is good to head a confirmation. Andras mentioned that he is also using POP3 with Akonadi and he has no data losses. Thus I think I will test again on Ext4, although I think that my BTRFS filesystem consistency is fine, BTRFS may implement some operation a bit differently. https://bugs.kde.org/show_bug.cgi?id=318444#c3 Thanks, -- Martin 'Helios' Steigerwald - http://www.Lichtvoll.de GPG: 03B0 0D6C 0040 0710 4AFA B82F 991B EAAC A599 84C7 -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/201304171727.05432.mar...@lichtvoll.de
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
On Wednesday, 2013-04-17, Martin Steigerwald wrote: Am Mittwoch, 17. April 2013 schrieb Kevin Krammer: On Wednesday, 2013-04-17, Diane Trout wrote: Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? All caching is handled by Akonadi server, all content in file based resources, e.g. maildir resource, is not involved in any cache handling. Thanks Kevin, thats what I thought, but it is good to head a confirmation. Andras mentioned that he is also using POP3 with Akonadi and he has no data losses. It is also the main setup used by current KMail maintainer Laurent Montel AFAIK. Cheers, Kevin signature.asc Description: This is a digitally signed message part.
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Am Mittwoch, 17. April 2013 schrieb Martin Steigerwald: I would have kept testing KDEPIM 2 despite the other about 10 bugs I reported which were are about performance issues - on an ThinkPad T520 with Intel Sandybridge i5 with 2,5GHz and 8 GB of RAM and 300 GB Intel SSD 320! - and some other oddities, but these repeated mail data loss were unacceptable for me. Well to be fair, make that about other 5 bugs :), but still. Some of these issues may be related as well. -- Martin 'Helios' Steigerwald - http://www.Lichtvoll.de GPG: 03B0 0D6C 0040 0710 4AFA B82F 991B EAAC A599 84C7 -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/201304170011.15930.mar...@lichtvoll.de
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Am Mittwoch, 17. April 2013 schrieb Martin Steigerwald: Only thing that doesn´t work right now is my CRM114 spam filter integration. Whyever. Folders were missing, cause I copied them elsewhere for KDEPIM 2 prior to migrating to it. CRM114 back to normal as well. All is well :) -- Martin 'Helios' Steigerwald - http://www.Lichtvoll.de GPG: 03B0 0D6C 0040 0710 4AFA B82F 991B EAAC A599 84C7 -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/201304170024.42530.mar...@lichtvoll.de
Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss
Did you check to see if the message was still on the server after it vanished locally? I wonder if they started assuming local is a cache? Diane On Wednesday, April 17, 2013 00:07:40 Martin Steigerwald wrote: Hi! I am back to KDEPIM 1 aka 4.4.11 and KDE SC 4.8.4 from Sid. Reason? Data losses. [Akonadi] [Bug 318227] New: Data loss on restarting Akonadi to get it responsive again https://bugs.kde.org/318227 [Akonadi] [Bug 318290] New: Empty mails: AkonadiAgentServer(4890)/libakonadi Akonadi::ResourceBase::itemRetrieved: Item does not provide part HEAD/RFC822 https://bugs.kde.org/318290 And finally the thing were I had enough of it: [Akonadi] [Bug 318444] New: data loss in maildir resource: Mails that were accessible disappeared and are not visible in maildir directory anymore https://bugs.kde.org/318444 KMail 2 / Akonadi lost mails from debian-kde mail folder while I was *reading* it. I never saw something like this with any mail application I ever used. I had this running on BTRFS, and due to a BTRFS problem with scrubbing I cannot fully prove that my BTRFS /home filesystem is correct. But I do think that it is no issue with BTRFS since the rsync based backup worked nicely. But the scrubbing does not complete right now and gives a kernel backtrace. Sorry, but I think my first head up were premature. Here is how I went back: 1) I had some discussion with Debian´s package management that I do not really remember in full. It basically went down to: dpkg --force-depends --purge $( dpkg -l | grep 4.10.2 | awk '{print $2;}' ) before trying to install old KDE SC and KDEPIM again. 2) Restore maildir from backup: merkaba:/mnt/home-zeit rsync -a -AHXS -P --del martin-Mail-2013-04-11/ /home/martin/Mail/ 3) Restore exact matching kmailrc from backup: martin@merkaba:~/Backup/KDEPIM-1/Konfigurationsdateien cp -p kmailrc ~/.kde/share/config/kmailrc I didn´t do this initially, since I thought KMail 2 uses a new config file kmail2rc and the old one would remain unaltered. Well was altered and KMail 1 tried to check all of its index files and it took ages. 4) Then I had KMail download about 60 MB and 6000 mails from last 5 days from my Dovecot POP3 server. This worked cause I configured KMail2 / Akonadi to keep mails on server for 7 days. Only thing that doesn´t work right now is my CRM114 spam filter integration. Whyever. I did not try what happens with IMAP accounts, but at least with POP3 I am quite sure that I had data losses. So be careful. I would have kept testing KDEPIM 2 despite the other about 10 bugs I reported which were are about performance issues - on an ThinkPad T520 with Intel Sandybridge i5 with 2,5GHz and 8 GB of RAM and 300 GB Intel SSD 320! - and some other oddities, but these repeated mail data loss were unacceptable for me. Ciao, -- To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/1759909.oHM04iabqz@myrada