Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-18 Thread Martin Steigerwald 
Am Mittwoch, 17. April 2013 schrieb Kevin Krammer:
 On Wednesday, 2013-04-17, Martin Steigerwald wrote:
  Am Mittwoch, 17. April 2013 schrieb Kevin Krammer:
   On Wednesday, 2013-04-17, Diane Trout wrote:
Did you check to see if the message was still on the server after
it vanished locally?

I wonder if they started assuming local is a cache?
   
   All caching is handled by Akonadi server, all content in file based
   resources, e.g. maildir resource, is not involved in any cache
   handling.
  
  Thanks Kevin, thats what I thought, but it is good to head a
  confirmation.
  
  Andras mentioned that he is also using POP3 with Akonadi and he has no
  data losses.
 
 It is also the main setup used by current KMail maintainer Laurent Montel
 AFAIK.

Thanks. So I know that it has quite some testing coverage. Makes it even 
more strange why it lost data on my setup.

I still wonder whether others are using mutiple maildir resource or let all 
the mails downloaded from POP3 flow into one maildir resource.

I asked András whether my setup was sane, but got no reply yet.

-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7


--
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201304180949.33996.mar...@lichtvoll.de

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-18 Thread Kevin Krammer 
On Thursday, 2013-04-18, Martin Steigerwald wrote:
 Am Mittwoch, 17. April 2013 schrieb Kevin Krammer:
  On Wednesday, 2013-04-17, Martin Steigerwald wrote:
   Am Mittwoch, 17. April 2013 schrieb Kevin Krammer:
On Wednesday, 2013-04-17, Diane Trout wrote:
 Did you check to see if the message was still on the server after
 it vanished locally?
 
 I wonder if they started assuming local is a cache?

All caching is handled by Akonadi server, all content in file based
resources, e.g. maildir resource, is not involved in any cache
handling.
   
   Thanks Kevin, thats what I thought, but it is good to head a
   confirmation.
   
   Andras mentioned that he is also using POP3 with Akonadi and he has no
   data losses.
  
  It is also the main setup used by current KMail maintainer Laurent Montel
  AFAIK.
 
 Thanks. So I know that it has quite some testing coverage. Makes it even
 more strange why it lost data on my setup.
 
 I still wonder whether others are using mutiple maildir resource or let all
 the mails downloaded from POP3 flow into one maildir resource.

My guess would be that the most common setup is a single resource, but I also 
don't think it would make a big difference.

My bet would be on filtering, because this is usually where the setups begin 
to vary widely.
E.g.  some setups only have simple rules for matching on headers and moving to 
folders, some have more complex rules or more complex targets (e.g. move and 
change state), some have mails pass through external programs, etc.

Those code paths then get only a fraction of the testing the main path gets 
and also makes bugs less easier to reproduce.

Cheers,
Kevin


signature.asc
Description: This is a digitally signed message part.

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-17 Thread Martin Steigerwald 
Am Mittwoch, 17. April 2013 schrieb Diane Trout:
 On Wednesday, April 17, 2013 00:07:40 Martin Steigerwald wrote:
  Hi!
  
  I am back to KDEPIM 1 aka 4.4.11 and KDE SC 4.8.4 from Sid.
  
  Reason? Data losses.
  
  [Akonadi] [Bug 318227] New: Data loss on restarting Akonadi to get it
  responsive again
  https://bugs.kde.org/318227
  
  
  [Akonadi] [Bug 318290] New: Empty mails:
  AkonadiAgentServer(4890)/libakonadi
  Akonadi::ResourceBase::itemRetrieved: Item does not provide part
  HEAD/RFC822
  https://bugs.kde.org/318290
  
  
  And finally the thing were I had enough of it:
  
  [Akonadi] [Bug 318444] New: data loss in maildir resource: Mails that
  were accessible disappeared and are not visible in maildir directory
  anymore https://bugs.kde.org/318444
  
  
  KMail 2 / Akonadi lost mails from debian-kde mail folder while I was
  *reading* it. I never saw something like this with any mail application
  I ever used.

 Did you check to see if the message was still on the server after it
 vanished locally?
 
 I wonder if they started assuming local is a cache?

It was on the server, cause I told Akonadi POP3 resource to keep mails on 
server for 7 days. That was what made it possible to step back to a clean 
state with KMail 1.

Unfortunately for the latest occurence I missed to save out ~/.xsession-
errors. I wasn´t aware that its recreated on each KDE login and after I 
logged in it was gone.

Anyway, if I let a POP3 resource download mails into a folder of a maildir 
resource I created, I´d expect to keep that mail once it has downloaded it.

That would even hold true to disconnected IMAP, I think. Only process to be 
delete, add mails to it would be the IMAP resource.

And in case of POP3 the only one deleting mails would be me *or* filter 
rules. Maybe it was something to do with mail filters.

I am thinking about for to make a safe environment for trying to reproduce 
this. I think creating a second account, subscribe it to some mailing list 
and install a separate KDEPIM 4.10 install to use that would be a way to go.

Since I didn´t read about data loss in kdepim or kdepim-users mailinglist I 
though such steps wouldn´t be necessary.

Anyway, I got all mails back, and know a safe and quick way to switch back 
to KDEPIM-1 now. Thats good.

I am a bit disappointment not to be able to use KDE SC 4.10 or only part of 
it, since some of it conflicts with KDEPIM 1, but well, my mails are safe and 
thats more important.

-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7


--
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201304171030.38988.mar...@lichtvoll.de

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-17 Thread Kevin Krammer 
On Wednesday, 2013-04-17, Diane Trout wrote:
 Did you check to see if the message was still on the server after it
 vanished locally?
 
 I wonder if they started assuming local is a cache?

All caching is handled by Akonadi server, all content in file based resources, 
e.g. maildir resource, is not involved in any cache handling.

Cheers,
Kevin


signature.asc
Description: This is a digitally signed message part.

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-17 Thread Pino Toscano 
Hi,

Alle mercoledì 17 aprile 2013, Martin Steigerwald ha scritto:
 I am back to KDEPIM 1 aka 4.4.11 and KDE SC 4.8.4 from Sid.

Not that I'm asking you to try again, but at least reading the bug 
reports you opened I see things like:
| kmail 4:4.10.2-0r4 newer than version in archive
so the versions of kdepim packages were not the ones which we had in 
archive, meaning you either
- recompiled it yourself from a random point of our git packaging
- took those kdepim packages from another distro

while in this case shouldn't change much (probably, although I cannot 
say anything for sure), please check to be using packages from Debian 
repositories only.

-- 
Pino Toscano


signature.asc
Description: This is a digitally signed message part.

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-17 Thread Sune Vuorela 
On 2013-04-17, Pino Toscano p...@debian.org wrote:
| kmail 4:4.10.2-0r4 newer than version in archive

In this case, it is packages provided by me for early testing. They
don't differ except a bit of typos (and workarounds for a well known
aptitude vs sbuild issue) from the packages I later pushed to
experimental.

/Sune


-- 
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/slrnkmtboc.fhs.nos...@sshway.ssh.pusling.com

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-17 Thread Martin Steigerwald 
Am Mittwoch, 17. April 2013 schrieb Kevin Krammer:
 On Wednesday, 2013-04-17, Diane Trout wrote:
  Did you check to see if the message was still on the server after it
  vanished locally?
  
  I wonder if they started assuming local is a cache?
 
 All caching is handled by Akonadi server, all content in file based
 resources, e.g. maildir resource, is not involved in any cache handling.

Thanks Kevin, thats what I thought, but it is good to head a confirmation.

Andras mentioned that he is also using POP3 with Akonadi and he has no data 
losses.

Thus I think I will test again on Ext4, although I think that my BTRFS 
filesystem consistency is fine, BTRFS may implement some operation a bit 
differently.

https://bugs.kde.org/show_bug.cgi?id=318444#c3

Thanks,
-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7


-- 
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201304171727.05432.mar...@lichtvoll.de

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-17 Thread Kevin Krammer 
On Wednesday, 2013-04-17, Martin Steigerwald wrote:
 Am Mittwoch, 17. April 2013 schrieb Kevin Krammer:
  On Wednesday, 2013-04-17, Diane Trout wrote:
   Did you check to see if the message was still on the server after it
   vanished locally?
   
   I wonder if they started assuming local is a cache?
  
  All caching is handled by Akonadi server, all content in file based
  resources, e.g. maildir resource, is not involved in any cache handling.
 
 Thanks Kevin, thats what I thought, but it is good to head a confirmation.
 
 Andras mentioned that he is also using POP3 with Akonadi and he has no data
 losses.

It is also the main setup used by current KMail maintainer Laurent Montel 
AFAIK.

Cheers,
Kevin


signature.asc
Description: This is a digitally signed message part.

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-16 Thread Martin Steigerwald 
Am Mittwoch, 17. April 2013 schrieb Martin Steigerwald:
 I would have kept testing KDEPIM 2 despite the other about 10 bugs I 
 reported which were are about performance issues - on an ThinkPad T520
 with  Intel Sandybridge i5 with 2,5GHz and 8 GB of RAM and 300 GB Intel
 SSD 320! - and some other oddities, but these repeated mail data loss
 were unacceptable for me.

Well to be fair, make that about other 5 bugs :), but still.

Some of these issues may be related as well.

-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7


-- 
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201304170011.15930.mar...@lichtvoll.de

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-16 Thread Martin Steigerwald 
Am Mittwoch, 17. April 2013 schrieb Martin Steigerwald:
 Only thing that doesn´t work right now is my CRM114 spam filter
 integration.  Whyever.

Folders were missing, cause I copied them elsewhere for KDEPIM 2 prior to 
migrating to it. CRM114 back to normal as well.

All is well :)
-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7


--
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/201304170024.42530.mar...@lichtvoll.de

Re: Back to KDEPIM 1 and KDE SC 4.8.4 due to repeated mail data loss

2013-04-16 Thread Diane Trout 
Did you check to see if the message was still on the server after it vanished 
locally?

I wonder if they started assuming local is a cache?

Diane

On Wednesday, April 17, 2013 00:07:40 Martin Steigerwald wrote:
 Hi!
 
 I am back to KDEPIM 1 aka 4.4.11 and KDE SC 4.8.4 from Sid.
 
 Reason? Data losses.
 
 [Akonadi] [Bug 318227] New: Data loss on restarting Akonadi to get it
 responsive again
 https://bugs.kde.org/318227
 
 
 [Akonadi] [Bug 318290] New: Empty mails: AkonadiAgentServer(4890)/libakonadi
 Akonadi::ResourceBase::itemRetrieved: Item does not provide part
 HEAD/RFC822
 https://bugs.kde.org/318290
 
 
 And finally the thing were I had enough of it:
 
 [Akonadi] [Bug 318444] New: data loss in maildir resource: Mails that were
 accessible disappeared and are not visible in maildir directory anymore
 https://bugs.kde.org/318444
 
 
 KMail 2 / Akonadi lost mails from debian-kde mail folder while I was
 *reading* it. I never saw something like this with any mail application I
 ever used.
 
 I had this running on BTRFS, and due to a BTRFS problem with scrubbing I
 cannot fully prove that my BTRFS /home filesystem is correct. But I do think
 that it is no issue with BTRFS since the rsync based backup worked nicely.
 But the scrubbing does not complete right now and gives a kernel backtrace.
 
 
 Sorry, but I think my first head up were premature.
 
 
 Here is how I went back:
 
 1) I had some discussion with Debian´s package management that I do not
 really remember in full. It basically went down to:
 
 dpkg --force-depends --purge $( dpkg -l | grep 4.10.2 | awk '{print $2;}' )
 
 before trying to install old KDE SC and KDEPIM again.
 
 
 2) Restore maildir from backup:
 
 merkaba:/mnt/home-zeit rsync -a -AHXS -P --del  martin-Mail-2013-04-11/
 /home/martin/Mail/
 
 
 3) Restore exact matching kmailrc from backup:
 
 martin@merkaba:~/Backup/KDEPIM-1/Konfigurationsdateien cp -p kmailrc
 ~/.kde/share/config/kmailrc
 
 I didn´t do this initially, since I thought KMail 2 uses a new config file
 kmail2rc and the old one would remain unaltered. Well was altered and KMail
 1 tried to check all of its index files and it took ages.
 
 
 4) Then I had KMail download about 60 MB and 6000 mails from last 5 days
 from my Dovecot POP3 server. This worked cause I configured KMail2 / Akonadi
 to keep mails on server for 7 days.
 
 
 Only thing that doesn´t work right now is my CRM114 spam filter integration.
 Whyever.
 
 
 I did not try what happens with IMAP accounts, but at least with POP3 I am
 quite sure that I had data losses. So be careful.
 
 I would have kept testing KDEPIM 2 despite the other about 10 bugs I
 reported which were are about performance issues - on an ThinkPad T520 with
 Intel Sandybridge i5 with 2,5GHz and 8 GB of RAM and 300 GB Intel SSD 320! -
 and some other oddities, but these repeated mail data loss were
 unacceptable for me.
 
 Ciao,


--
To UNSUBSCRIBE, email to debian-kde-requ...@lists.debian.org
with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org
Archive: http://lists.debian.org/1759909.oHM04iabqz@myrada