[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-03 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #9 from Martin Steigerwald mar...@lichtvoll.de --- Sergio, I tried: 107 QStringList listNew() const 108 { 109 static int count = 0; count++; 110 static int elapsed = 0; 111 112 QDir d( path +

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-03 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #10 from Martin Steigerwald mar...@lichtvoll.de --- Sergio, I tried: 107 QStringList listNew() const 108 { 109 static int count = 0; count++; 110 static int elapsed = 0; 111 112 QDir d( path +

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-03 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #11 from Martin Steigerwald mar...@lichtvoll.de --- I don´t know whether this is called and what that does, but setting nosort here as well for testing: diff --git a/resources/maildir/libmaildir/keycache.cpp

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-03 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #12 from Martin Steigerwald mar...@lichtvoll.de --- Created attachment 86428 -- https://bugs.kde.org/attachment.cgi?id=86428action=edit callgrind with nodirsorting also in libmaildir/keycache.cpp Well this is it. KMail is usable even with

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #1 from Martin Steigerwald mar...@lichtvoll.de --- I bet that stat()ing files isn´t the only issue here, as find -ls also uses a variant of the stat() call on each file and as demonstrated it way faster: Warm caches:

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #2 from Martin Steigerwald mar...@lichtvoll.de --- Compared to this strace of martin@merkaba:~#16 ps aux | head -1 ; ps aux | grep akonadi_maildir_resource | grep -v grep USER PID %CPU %MEMVSZ RSS TTY STAT START TIME

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #3 from Martin Steigerwald mar...@lichtvoll.de --- Created attachment 86406 -- https://bugs.kde.org/attachment.cgi?id=86406action=edit callgrind data of 5 minutes cpu busy maildir resource About 5 minute callgrind data with akonadi

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 Martin Steigerwald mar...@lichtvoll.de changed: What|Removed |Added Attachment #86406|0 |1 is obsolete|

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #5 from Martin Steigerwald mar...@lichtvoll.de --- Testing with: diff --git a/resources/maildir/libmaildir/maildir.cpp b/resources/maildir/libmaildir/maildir.cpp index 9bd3802..36166ed 100644 --- a/resources/maildir/libmaildir/maildir.cpp

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #6 from Martin Steigerwald mar...@lichtvoll.de --- Suggestion was from David Faure and Sergio. -- You are receiving this mail because: You are the assignee for the bug. ___ Kdepim-bugs mailing

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #7 from Martin Steigerwald mar...@lichtvoll.de --- Created attachment 86418 -- https://bugs.kde.org/attachment.cgi?id=86418action=edit second callgrind of about well at least half an hour, after nodirsorting patch applied This one looks a

[Akonadi] [Bug 334218] synchronizations of large folders with filesystem contents hogs a Sandybridge core for minutes stat()ing every file in it

2014-05-02 Thread Martin Steigerwald
https://bugs.kde.org/show_bug.cgi?id=334218 --- Comment #8 from Martin Steigerwald mar...@lichtvoll.de --- During this callgrind run KMail did respond in between, so I really think folder sync got faster by nodir sorting patch as during last callgrind of also about half an hour or so it didn´t