Your message dated Mon, 28 Mar 2005 14:27:43 -0600
with message-id <[EMAIL PROTECTED]>
and subject line Bug#296162: offlineimap: Speedup by using PIPELINING?
has caused the attached Bug report to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what I am
talking about this indicates a serious mail system misconfiguration
somewhere. Please contact me immediately.)
Debian bug tracking system administrator
(administrator, Debian Bugs database)
--------------------------------------
Received: (at submit) by bugs.debian.org; 20 Feb 2005 19:08:59 +0000
>From [EMAIL PROTECTED] Sun Feb 20 11:08:59 2005
Return-path: <[EMAIL PROTECTED]>
Received: from m26s25.vlinux.de [83.151.30.59]
([6Hju4/VUILeYyeXngh/8LKjxFAUvb0pO])
by spohr.debian.org with esmtp (Exim 3.35 1 (Debian))
id 1D2wRv-0005lN-00; Sun, 20 Feb 2005 11:08:59 -0800
Received: from 194-208-126-066.tele.net
([194.208.126.66] helo=argenau.downhill.at.eu.org
ident=[fANHBL/kGThPtFHCSnaghYNezUt6Skb4])
by m26s25.vlinux.de with asmtp (Exim 4.34)
id 1D2wRm-0008SN-9I; Sun, 20 Feb 2005 19:08:52 +0000
Received: from ametzler by argenau.downhill.at.eu.org with local (Exim 4.34)
id 1D2wRm-00019e-Nk; Sun, 20 Feb 2005 20:08:50 +0100
Date: Sun, 20 Feb 2005 20:08:50 +0100
From: Andreas Metzler <[EMAIL PROTECTED]>
To: Debian Bug Tracking System <[EMAIL PROTECTED]>
Subject: offlineimap: Speedup by using PIPELINING?
Message-ID: <[EMAIL PROTECTED]>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
X-Reportbug-Version: 3.2
X-GPG-Fingerprint: BCF7 1345 BE42 B5B8 1A57 EE09 1D33 9C65 8B8D 7663
User-Agent: Mutt/1.5.6+20040907i
X-Spam-Score: -2.5 (--)
Delivered-To: [EMAIL PROTECTED]
X-Spam-Checker-Version: SpamAssassin 2.60-bugs.debian.org_2005_01_02
(1.212-2003-09-23-exp) on spohr.debian.org
X-Spam-Status: No, hits=-6.0 required=4.0 tests=BAYES_00,HAS_PACKAGE,
RCVD_IN_DSBL autolearn=no version=2.60-bugs.debian.org_2005_01_02
X-Spam-Level:
Package: offlineimap
Version: 4.0.8
Severity: wishlist
Hello,
Over connections with low latency (modem) offlineimap is rather slow
and cannot use the full bandwith as IMAP is a classic ping-pong
protocol:
offlineimap: send command
# command travels to IMAP server, offlineimap waits.
IMAP server acknowledges command
# acknowledgment message travels to offlineimap, offlineimap waits.
<ad nauseam>
I've previously experienced this problem with NNTP and switching to
client using PIPELING helped a lot (I guess about 100% speedup.)
I do not know whether IMAP supports PIPELINING (googling seems to
/suggests/ it does, but I failed to find the correct RFC). - If it
does please consider implementing PIPELINING support in
offlineimap.[1]
thanks for providing this great software, cu andreas
[1] Off by default an configuarble per server, as probably only one in
three IMAP servers will implement PIPELINING correctly. ;-)
-- System Information:
Debian Release: 3.1
APT prefers testing
APT policy: (500, 'testing')
Architecture: i386 (i686)
Kernel: Linux 2.6.8-2-k7
Locale: LANG=de_AT.UTF-8, LC_CTYPE=de_AT.UTF-8 (charmap=UTF-8)
Versions of packages offlineimap depends on:
ii python2.3 2.3.4-19 An interactive high-level object-o
-- no debconf information
--
"See, I told you they'd listen to Reason," [SPOILER] Svfurlr fnlf,
fuhggvat qbja gur juveyvat tha.
Neal Stephenson in "Snow Crash"
http://downhill.aus.cc/
---------------------------------------
Received: (at 296162-done) by bugs.debian.org; 28 Mar 2005 20:28:19 +0000
>From [EMAIL PROTECTED] Mon Mar 28 12:28:19 2005
Return-path: <[EMAIL PROTECTED]>
Received: from gatekeeper.excelhustler.com
(gatekeeper.elmer.external.excelhustler.com) [68.99.114.105]
by spohr.debian.org with esmtp (Exim 3.35 1 (Debian))
id 1DG0qQ-0006Xx-00; Mon, 28 Mar 2005 12:28:18 -0800
Received: from chatterbox.elmer.internal.excelhustler.com (unknown
[192.168.0.12])
(using TLSv1 with cipher EDH-RSA-DES-CBC3-SHA (168/168 bits))
(Client CN "chatterbox.elmer.internal.excelhustler.com", Issuer
"excelhustler.com" (not verified))
by gatekeeper.elmer.external.excelhustler.com (Postfix) with ESMTP
id 4BE43117C7B; Mon, 28 Mar 2005 14:27:48 -0600 (CST)
Received: from localhost (localhost [127.0.0.1])
by chatterbox.elmer.internal.excelhustler.com (Postfix) with ESMTP
id 1677F117C77; Mon, 28 Mar 2005 14:27:48 -0600 (CST)
Received: from chatterbox.elmer.internal.excelhustler.com ([192.168.0.12])
by localhost (chatterbox [192.168.0.12]) (amavisd-new, port 10025)
with ESMTP id 27395-05; Mon, 28 Mar 2005 14:27:46 -0600 (CST)
Received: from wile.internal.excelhustler.com (wile.internal.excelhustler.com
[192.168.1.34])
by chatterbox.elmer.internal.excelhustler.com (Postfix) with ESMTP
id 3DDC6117C51; Mon, 28 Mar 2005 14:27:45 -0600 (CST)
Received: by wile.internal.excelhustler.com (Postfix, from userid 1000)
id E14721403E; Mon, 28 Mar 2005 14:27:43 -0600 (CST)
Date: Mon, 28 Mar 2005 14:27:43 -0600
From: John Goerzen <[EMAIL PROTECTED]>
To: Andreas Metzler <[EMAIL PROTECTED]>,
[EMAIL PROTECTED]
Subject: Re: Bug#296162: offlineimap: Speedup by using PIPELINING?
Message-ID: <[EMAIL PROTECTED]>
References: <[EMAIL PROTECTED]>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <[EMAIL PROTECTED]>
User-Agent: Mutt/1.5.6+20040907i
X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at excelhustler.com
Delivered-To: [EMAIL PROTECTED]
X-Spam-Checker-Version: SpamAssassin 2.60-bugs.debian.org_2005_01_02
(1.212-2003-09-23-exp) on spohr.debian.org
X-Spam-Status: No, hits=-6.0 required=4.0 tests=BAYES_00,HAS_BUG_NUMBER
autolearn=no version=2.60-bugs.debian.org_2005_01_02
X-Spam-Level:
Hello Andreas,
I made a fundamental design decision some time ago that instead of using
pipelining, OfflineIMAP will be multithreaded. It can thus open up
multiple connections to an IMAP server simultaneously, and by doing so,
achieve the better bandwidth utilization that you seek.
I did this for two reasons:
1) Poor server support for proper pipelining
2) Lack of Python client library support for proper pipelining
-- notably, Python's imaplib, used by OfflineIMAP, does not support
pipelining.
Some of the benchmarks that you can read about in the OfflineIMAP
manpage confirm that this multithreaded approach can indeed provide
tremendous performance gains.
On a slow dialup link, as few as 2 or 3 threads will be enough to do
what you want.
For more details, see "maxconnections" in the offlineimap.conf file.
I will be closing this bug now, since the fundamental problem
("offlineimap doesn't use 100% of available bandwidth due to latency")
is, IMHO, solved by the multithreaded options.
If you disagree, feel free to re-open it.
-- John
On Sun, Feb 20, 2005 at 08:08:50PM +0100, Andreas Metzler wrote:
> Hello,
> Over connections with low latency (modem) offlineimap is rather slow
> and cannot use the full bandwith as IMAP is a classic ping-pong
> protocol:
> offlineimap: send command
> # command travels to IMAP server, offlineimap waits.
> IMAP server acknowledges command
> # acknowledgment message travels to offlineimap, offlineimap waits.
> <ad nauseam>
>
> I've previously experienced this problem with NNTP and switching to
> client using PIPELING helped a lot (I guess about 100% speedup.)
>
> I do not know whether IMAP supports PIPELINING (googling seems to
> /suggests/ it does, but I failed to find the correct RFC). - If it
> does please consider implementing PIPELINING support in
> offlineimap.[1]
>
> thanks for providing this great software, cu andreas
>
> [1] Off by default an configuarble per server, as probably only one in
> three IMAP servers will implement PIPELINING correctly. ;-)
> -- System Information:
> Debian Release: 3.1
> APT prefers testing
> APT policy: (500, 'testing')
> Architecture: i386 (i686)
> Kernel: Linux 2.6.8-2-k7
> Locale: LANG=de_AT.UTF-8, LC_CTYPE=de_AT.UTF-8 (charmap=UTF-8)
>
> Versions of packages offlineimap depends on:
> ii python2.3 2.3.4-19 An interactive high-level
> object-o
>
> -- no debconf information
> --
> "See, I told you they'd listen to Reason," [SPOILER] Svfurlr fnlf,
> fuhggvat qbja gur juveyvat tha.
> Neal Stephenson in "Snow Crash"
> http://downhill.aus.cc/
>
>
--
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
