[Akonadi] [Bug 339393] Akonadi fail to fetch IMAP folder content with over 100MiB of messages (akonadi try to fetch too many UIDs at once)

2014-10-11 Thread boris.sh.1983+kde.bugzilla 
https://bugs.kde.org/show_bug.cgi?id=339393

--- Comment #1 from boris.sh.1983+kde.bugzi...@gmail.com ---
Created attachment 89092
  --> https://bugs.kde.org/attachment.cgi?id=89092&action=edit
Instead of fetching everything in every attempt try to work with 2K intervals

I don't understand why the it does not work with Batchfetcher, but this dirty
workaround allowed me to fetch (slowly) the data.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs

[Akonadi] [Bug 339393] Akonadi fail to fetch IMAP folder content with over 100MiB of messages (akonadi try to fetch too many UIDs at once)

2014-10-12 Thread boris.sh.1983+kde.bugzilla 
https://bugs.kde.org/show_bug.cgi?id=339393

--- Comment #2 from boris.sh.1983+kde.bugzi...@gmail.com ---
After additional review , Please ignore 
0001-use-2K-in-every-attempt-to-use-retrieve-items.patch and do not apply this

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs

[Akonadi] [Bug 339393] Akonadi fail to fetch IMAP folder content with over 100MiB of messages (akonadi try to fetch too many UIDs at once)

2014-10-13 Thread boris.sh.1983+kde.bugzilla 
https://bugs.kde.org/show_bug.cgi?id=339393

boris.sh.1983+kde.bugzi...@gmail.com changed:

   What|Removed |Added

  Attachment #89092|0   |1
is obsolete||

--- Comment #3 from boris.sh.1983+kde.bugzi...@gmail.com ---
Created attachment 89107
  --> https://bugs.kde.org/attachment.cgi?id=89107&action=edit
Split large UID Search commands to multiple smaller ones in batchfetcher

Split SearchJob inside batchfetcher if amount of messages is above a threshold
(2K).

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs

[Akonadi] [Bug 339393] Akonadi fail to fetch IMAP folder content with over 100MiB of messages (akonadi try to fetch too many UIDs at once)

2014-10-20 Thread boris.sh.1983+kde.bugzilla 
https://bugs.kde.org/show_bug.cgi?id=339393

--- Comment #6 from boris.sh.1983+kde.bugzi...@gmail.com ---
Hi Andre, 

thanks for your fix but it doesn't work for me, 
Only a small portion of the emails had been downloaded (<800), and then the
sync drops along with a parser exception. 

I suspect that I get a variant of 338967.

Traces : 

SearchManager::registerInstance( "akonadi_imap_resource_20" ) 
Registering search instance  "akonadi_imap_resource_20" 
 list is empty 
Database "akonadi" opened using driver "QMYSQL" 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_mailfilter_agent_11668_akKvoX" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_mailfilter_agent_11668_akKvoX" true false 
Database "akonadi" opened using driver "QMYSQL" 
Database "akonadi" opened using driver "QMYSQL" 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_archivemail_agent_11660_LnpgTG" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_archivemail_agent_11660_LnpgTG" true false 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_mailfilter_agent_11668_dq9if3" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_mailfilter_agent_11668_dq9if3" true false 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_archivemail_agent_11660_NGtPSO" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_archivemail_agent_11660_NGtPSO" true false 
.
.
.
akonadi_imap_resource_20(11666)/kdepimlibs (kimap) KIMAP::LoginJob::LoginJob:
KIMAP::LoginJob(0x1612d90)
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::SessionThread::reconnect: connectToHost "exchange2007.domain.tld" 143
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_mailfilter_agent_11668_sgrR5V" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadi_mailfilter_agent_11668_sgrR5V" true false 
akonadi_imap_resource_20(11666)/kdepimlibs (kimap) KIMAP::LoginJob::doStart:
KIMAP::LoginJob(0x1612d90)
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::LoginJob::handleResponse: "StartTls" "A01"
.
.
.
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::SessionThread::sslConnected: TLS negotiation done.
.
.
.
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::LoginJob::handleResponse: "Capability" "*"
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::LoginJob::handleResponse: Capabilities updated:  ("IMAP4", "IMAP4rev1",
"AUTH=NTLM", "AUTH=GSSAPI", "AUTH=PLAIN", "IDLE", "NAMESPACE", "LITERAL+")
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::LoginJob::handleResponse: "Capability" "A02"
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::LoginJob::handleResponse: "Login" "+"
akonadi_imap_resource_20(11666)/kdepimlibs (kimap)
KIMAP::LoginJob::handleResponse: "Login" "A03"
akonadi_imap_resource_20(11666)/kdepimlibs (kimap) KIMAP::LoginJob::~LoginJob:
KIMAP::LoginJob(0x1612d90)
Database "akonadi" opened using driver "QMYSQL" 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadiconsole_11752_B9OzyL" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadiconsole_11752_B9OzyL" true false 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadiconsole_11752_fjn7xb" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadiconsole_11752_fjn7xb" true false 
Database "akonadi" opened using driver "QMYSQL" 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV2(const
QString&, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadiconsole_11752_uxYeH2" true 
QDBusObjectPath Akonadi::Server::NotificationManager::subscribeV3(const
QString&, bool, bool) Akonadi::Server::NotificationManager(0x23c6410)
"akonadiconsole_11752_uxYeH2" true false 
QDBusObjectPath Akonadi::Server::Notifi

[Akonadi] [Bug 339393] Akonadi fail to fetch IMAP folder content with over 100MiB of messages (akonadi try to fetch too many UIDs at once)

2014-10-21 Thread boris.sh.1983+kde.bugzilla 
https://bugs.kde.org/show_bug.cgi?id=339393

--- Comment #8 from boris.sh.1983+kde.bugzi...@gmail.com ---
Hi Andre, 

Your patch does solve the problem of Exchange choking on large UID search,
however the inital bug of unable to sync over 100 Mib folder is not solved yet.

It does split the search job as expected, yet when exchange disconnects the
session we do not continue from the last fetched uid.

After the next akonadi restart, retrieveitemstask will trigger refetching of
the dir and and not from the last uid in the collection.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
___
Kdepim-bugs mailing list
Kdepim-bugs@kde.org
https://mail.kde.org/mailman/listinfo/kdepim-bugs