Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald


Am 10.07.2012 05:59, schrieb Stan Hoeppner:
>>> That's simply not true Reindl.
>>>
>>> SATA drives are being used very widely in production today, and
>>> outnumber SAS deployments by a very wide margin.  
>>
>> for SOHO with no public services, yes
> 
> Google has more public facing services, servers, than anyone, and Google
> uses only SATA drives, zero SAS.  They also host more mail spools and
> mailboxes than anyone.  Again, all on SATA drives.
> 
> Now I'm sure you'll tell us why Google doesn't count for some reason in
> this discussion, why their use of SATA isn't relevant somehow

DAMNED: why do you restart this thread again after
enough mails it shopuld be stopped?

finally it does not botehr me which hardware-crap who
is using as long mine critical one are only 14 SAS
disks for a lot of virtual servers, all with dual
channel, redundant and hotplug-able


however:

because google generally has the strategy to use cheap hardware
in huge masses with very high redundancy while SAS stands
for high ability (dual channel ports) with higher pricses
but less hardware at all




signature.asc
Description: OpenPGP digital signature


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Frank Bonnet



Le 10/07/2012 08:13, Robert Schetterer a écrit :

Am 09.07.2012 21:41, schrieb Reindl Harald:

in these environments you find near to zero SATA
only few people these does are doing bare metal installs in days
where hardware supported virtaliziation has nearly zero overhead

Hi Harald, that simply not true
i have thousends of mailbox users on sata stores
since years ,without any problem, you should learn that
things that might fit at your place, are not the ultimate
answer to everything


Would it be possible to close this thread from Dovecot mailing-list ?

Please setup  mailing-lists pros-cons-Reindl or pros-cons-sata instead

Thank you very much




Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Robert Schetterer
Am 09.07.2012 21:41, schrieb Reindl Harald:
> in these environments you find near to zero SATA
> only few people these does are doing bare metal installs in days
> where hardware supported virtaliziation has nearly zero overhead

Hi Harald, that simply not true
i have thousends of mailbox users on sata stores
since years ,without any problem, you should learn that
things that might fit at your place, are not the ultimate
answer to everything

-- 
Best Regards
MfG Robert Schetterer




Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Robert Schetterer
Am 09.07.2012 21:29, schrieb Stan Hoeppner:
> SAS is found today almost exclusively in high volume transactional
> servers such as mail spools, mail stores, databases, VM image storage,
> and applications that need higher reliability, such as medical imaging
> systems, etc.

and SAS may not be faster always, it deeply depends on motherboard
,bios versions, drivers, date of release, storage modell etc

SAS could be faster but it must not everytime and everywhere

IMAP and specially mailserver storages may have other needs
as other servertypes, so it depends on general parameters
which you like to goal, parameters i.e may your budget
number of mailboxes, size of mailboxes, number of parallel users,
mailbox type, cluster filesystem ,loadbalancing setup
soft/hardware raid/hardware, use drbd and/or san/nas specialized
hardware etc

so i found very interesting info in this thread , but at the end
it is not very helpfull to decide what to use in real world mailsetups
this is always a local decision by local circumstances

there are no general easy answers for this theme, that fit simply all
and as in real life , dont think what fits best to you , ist the best
for others

-- 
Best Regards
MfG Robert Schetterer




Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Noel Butler
On Mon, 2012-07-09 at 12:10 +0200, Reindl Harald wrote:

> what you do not understand is that a proper SAN is NOT
> an complex setup, it is in many cases a simpler one
> because you have TWO controllers, disks with DUAL channel
> and a proper RAID level in ONE device
> 
> to built all this redundancy at your own is a much
> complexer software-setup and you can be pretty sure
> taht as long you are not dealing night and day with
> storage/Failover-setups the people designing a
> SAN have much more expierience what the are doing
> 


Is not my experience with some pretty large  ISP's, SAN might have its
place for web, but not in any mail world I'm responsible for, stress
testing has shown me no SAN speed difference of NAS for mail (yes this
may differ is an office world, but not when dealing with the size of
emails) and I sure as hell wont pay the extra gazillion these vendors
want for the SAN gear.





signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Stan Hoeppner
On 7/9/2012 2:41 PM, Reindl Harald wrote:
> 
> 
> Am 09.07.2012 21:29, schrieb Stan Hoeppner:
>> On 7/9/2012 3:17 AM, Reindl Harald wrote:
>>>
>>>
>>> Am 09.07.2012 07:48, schrieb Wojciech Puchar:
> disagreed with my statement, then agreed with it.  Apparently you didn't
> realize you did so.  Would you please clarify what I stated that is
> "simply not true"?  You comment WRT SSD doesn't prove anything I said to
> be untrue.  Quite the contrary, you reinforced my statements.
>
 Actually the only storage i use are mainstream SATA drives
>>>
>>> ouch - that said and your offlist discussion why SAN storages
>>> are crap for you gives a picture - nobody, really nobody is
>>> using SATA for any production-storage
>>
>> That's simply not true Reindl.
>>
>> SATA drives are being used very widely in production today, and
>> outnumber SAS deployments by a very wide margin.  
> 
> for SOHO with no public services, yes

Google has more public facing services, servers, than anyone, and Google
uses only SATA drives, zero SAS.  They also host more mail spools and
mailboxes than anyone.  Again, all on SATA drives.

Now I'm sure you'll tell us why Google doesn't count for some reason in
this discussion, why their use of SATA isn't relevant somehow.

-- 
Stan



Re: [Dovecot] recover .sieve plaintext from .sievec binary file

2012-07-09 Thread Florin Andrei

On 07/09/2012 03:00 PM, Stephan Bosch wrote:


And then you still have a problem. The sieved tool does not reconstruct
the sieve script that was used to create it; it produces an
assembly-like output from the byte code. You'd have to manually
translate that back to Sieve. :/


Looks like I'll have to rebuild that file by hand. :(

--
Florin Andrei
http://florin.myip.org/




Re: [Dovecot] recover .sieve plaintext from .sievec binary file

2012-07-09 Thread Stephan Bosch

On 7/9/2012 10:53 PM, Florin Andrei wrote:

On 07/09/2012 01:46 PM, Pascal Volk wrote:

On 07/09/2012 10:28 PM Florin Andrei wrote:

…
By mistake, I deleted the .sieve plaintext file with all the Sieve
filters, but I still do have the .sievec compiled binary. Is there any
way to dump the binary file back into plaintext format? Keep in mind,
I'm running v2 now, and the binary was made on a v1 Dovecot server.


You could try to recover your scripts using sieve-dump(1):
http://pigeonhole.dovecot.org/doc/man1/sieve-dump.1.html


$ sieve-dump .dovecot.sievec
sieve-dump(florin): Error: sieve: binary_open: binary .dovecot.sievec 
has corrupted header (0x53727943) or it is not a Sieve binary

sieve-dump(florin): Error: failed to load binary: .dovecot.sievec


That is not going to work. That binary is produced by the old cmusieve 
plugin. You'll need the old sieved tool to dump the binary.


And then you still have a problem. The sieved tool does not reconstruct 
the sieve script that was used to create it; it produces an 
assembly-like output from the byte code. You'd have to manually 
translate that back to Sieve. :/


Regards,

Stephan.




Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Jakob Curdes

Am 09.07.2012 22:42, schrieb s...@privat.dk:

Moi.
Hi there.

Wouldn't it be possible to either stop this madness of silly people
trying to teach other maillist users this storage nonsense ? (Religion)
or to tell how to unsubscribe asap ?

My inbox is filling up with this to me, and maybe other on the dovecot
list, completely out of the list scope nonsense.

Agreed. Please continue the SAS-SATA fight and the SAN-NAS fight 
somewhere else.


Cheers JC


Re: [Dovecot] recover .sieve plaintext from .sievec binary file

2012-07-09 Thread Florin Andrei

On 07/09/2012 01:46 PM, Pascal Volk wrote:

On 07/09/2012 10:28 PM Florin Andrei wrote:

…
By mistake, I deleted the .sieve plaintext file with all the Sieve
filters, but I still do have the .sievec compiled binary. Is there any
way to dump the binary file back into plaintext format? Keep in mind,
I'm running v2 now, and the binary was made on a v1 Dovecot server.


You could try to recover your scripts using sieve-dump(1):
http://pigeonhole.dovecot.org/doc/man1/sieve-dump.1.html


$ sieve-dump .dovecot.sievec
sieve-dump(florin): Error: sieve: binary_open: binary .dovecot.sievec 
has corrupted header (0x53727943) or it is not a Sieve binary

sieve-dump(florin): Error: failed to load binary: .dovecot.sievec

--
Florin Andrei
http://florin.myip.org/




Re: [Dovecot] recover .sieve plaintext from .sievec binary file

2012-07-09 Thread Pascal Volk
On 07/09/2012 10:28 PM Florin Andrei wrote:
> …
> By mistake, I deleted the .sieve plaintext file with all the Sieve 
> filters, but I still do have the .sievec compiled binary. Is there any 
> way to dump the binary file back into plaintext format? Keep in mind, 
> I'm running v2 now, and the binary was made on a v1 Dovecot server.

You could try to recover your scripts using sieve-dump(1):
http://pigeonhole.dovecot.org/doc/man1/sieve-dump.1.html


Regards,
Pascal
-- 
The trapper recommends today: fabaceae.1219...@localdomain.org


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread solo
Moi.
Hi there.

Wouldn't it be possible to either stop this madness of silly people
trying to teach other maillist users this storage nonsense ? (Religion)
or to tell how to unsubscribe asap ?

My inbox is filling up with this to me, and maybe other on the dovecot
list, completely out of the list scope nonsense.

Regards
Solo


- Original meddelelse -

> Fra: Reindl Harald 
> Til: dovecot@dovecot.org
> Dato: Man, 09. jul 2012 21:41
> Emne: Re: [Dovecot] Howto add another disk storage
> 
> 
> 
> Am 09.07.2012 21:29, schrieb Stan Hoeppner:
> > On 7/9/2012 3:17 AM, Reindl Harald wrote:
> >>
> >>
> >> Am 09.07.2012 07:48, schrieb Wojciech Puchar:
>  disagreed with my statement, then agreed with it. Apparently you
> didn't
>  realize you did so. Would you please clarify what I stated that
> is
>  "simply not true"? You comment WRT SSD doesn't prove anything I
> said to
>  be untrue. Quite the contrary, you reinforced my statements.
> 
> >>> Actually the only storage i use are mainstream SATA drives
> >>
> >> ouch - that said and your offlist discussion why SAN storages
> >> are crap for you gives a picture - nobody, really nobody is
> >> using SATA for any production-storage
> >
> > That's simply not true Reindl.
> >
> > SATA drives are being used very widely in production today, and
> > outnumber SAS deployments by a very wide margin.
> 
> for SOHO with no public services, yes
> 
> > SAS is found today almost exclusively in high volume transactional
> > servers such as mail spools, mail stores, databases, VM image
> storage,
> > and applications that need higher reliability, such as medical
> imaging
> > systems, etc
> 
> well, we are speaking about mail spools and mail storages here i
> thought
> 
> additionally my mail storage lives on virtual machines as any other
> services
> started some years ago and finsihed 2010 moving the last bare-metal
> server to
> VM infrastructzre
> 
> in these environments you find near to zero SATA
> only few people these does are doing bare metal installs in days
> where hardware supported virtaliziation has nearly zero overhead



[Dovecot] recover .sieve plaintext from .sievec binary file

2012-07-09 Thread Florin Andrei

Hi,

I upgraded a server from an old Linux distribution to a much newer one. 
In the process, Dovecot got upgraded from v1 to v2.


By mistake, I deleted the .sieve plaintext file with all the Sieve 
filters, but I still do have the .sievec compiled binary. Is there any 
way to dump the binary file back into plaintext format? Keep in mind, 
I'm running v2 now, and the binary was made on a v1 Dovecot server.


Thanks.

--
Florin Andrei
http://florin.myip.org/



Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald


Am 09.07.2012 21:29, schrieb Stan Hoeppner:
> On 7/9/2012 3:17 AM, Reindl Harald wrote:
>>
>>
>> Am 09.07.2012 07:48, schrieb Wojciech Puchar:
 disagreed with my statement, then agreed with it.  Apparently you didn't
 realize you did so.  Would you please clarify what I stated that is
 "simply not true"?  You comment WRT SSD doesn't prove anything I said to
 be untrue.  Quite the contrary, you reinforced my statements.

>>> Actually the only storage i use are mainstream SATA drives
>>
>> ouch - that said and your offlist discussion why SAN storages
>> are crap for you gives a picture - nobody, really nobody is
>> using SATA for any production-storage
> 
> That's simply not true Reindl.
> 
> SATA drives are being used very widely in production today, and
> outnumber SAS deployments by a very wide margin.  

for SOHO with no public services, yes

> SAS is found today almost exclusively in high volume transactional
> servers such as mail spools, mail stores, databases, VM image storage,
> and applications that need higher reliability, such as medical imaging
> systems, etc

well, we are speaking about mail spools and mail storages here i thought

additionally my mail storage lives on virtual machines as any other services
started some years ago and finsihed 2010 moving the last bare-metal server to
VM infrastructzre

in these environments you find near to zero SATA
only few people these does are doing bare metal installs in days
where hardware supported virtaliziation has nearly zero overhead




signature.asc
Description: OpenPGP digital signature


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Stan Hoeppner
On 7/9/2012 3:17 AM, Reindl Harald wrote:
> 
> 
> Am 09.07.2012 07:48, schrieb Wojciech Puchar:
>>> disagreed with my statement, then agreed with it.  Apparently you didn't
>>> realize you did so.  Would you please clarify what I stated that is
>>> "simply not true"?  You comment WRT SSD doesn't prove anything I said to
>>> be untrue.  Quite the contrary, you reinforced my statements.
>>>
>> Actually the only storage i use are mainstream SATA drives
> 
> ouch - that said and your offlist discussion why SAN storages
> are crap for you gives a picture - nobody, really nobody is
> using SATA for any production-storage

That's simply not true Reindl.

SATA drives are being used very widely in production today, and
outnumber SAS deployments by a very wide margin.  For instance, web
servers, counting in the 10s of millions worldwide, use SATA drives
exclusively, where RAM is critical for performance, not disk.  You won't
find SAS drives in web farms simply due to cost.

Everyone doing D2D backup and nearline storage is using SATA today.  And
most everyone, from large enterprises, to K-12 schools, to SOHOs, use
SATA drives in front line file servers.

SAS is found today almost exclusively in high volume transactional
servers such as mail spools, mail stores, databases, VM image storage,
and applications that need higher reliability, such as medical imaging
systems, etc.

-- 
Stan


Re: [Dovecot] configuring imap_stats

2012-07-09 Thread Pascal Volk
On 07/09/2012 12:45 PM Reinhard Vicinus wrote:
> Hi,
> 
> i'm trying to configure imap_stats like it's documented in the wiki: 
> http://wiki2.dovecot.org/Statistics. But as soon as i activate the 
> imap_stats plugin i get the following error message trying to login via 
> imap:
> 
> dovecot: imap: Error: Can't load plugin imap_stats_plugin: Plugin stats 
> must be loaded also (you must set: mail_plugins=$mail_plugins stats)

The global mail_plugins setting should contain:

mail_plugins = quota stats

And "protocol imap"'s mail_plugins setting should contain:

mail_plugins = $mail_plugins imap_quota imap_stats

The $mail_plugins inside protocol imap {} will be expanded to the value
of your global mail_plugins setting.

,--[ doveconf -f protocol=imap mail_plugins ]--
| mail_plugins = quota stats imap_quota imap_stats
`--


Regards,
Pascal
-- 
The trapper recommends today: c01dcofe.1219...@localdomain.org


Re: [Dovecot] mailboxes missing after upgrade from 2.1.4 to 2.1.7

2012-07-09 Thread Micah Anderson
Micah Anderson  writes:

> I mentioned this on the #dovecot irc channel, but I thought I would post
> here so I can provide more details.
>
> The basic problem is that when I upgraded from 2.1.4 to 2.1.7, some
> users no longer are able to see their folders in pine/alpine. The
> folders are actually there, and are subscribed (according to doveadm)
> and its possible to do operations on those folders, if you know the
> name (for example, opening the folder works fine if you know the name).
>
> When I downgrade to 2.1.4 again, the folders appear again, so its
> clearly something that changed between the two versions. I looked
> through the changelog, and found a few possibile culprits, I think
> pine/alpine use imapc, so that could be related:

I was able to solve this by changing the alpine folder-collection
configuration to *not* have /INBOX.[] at the end and instead have just
[]!

micah



Re: [Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument

2012-07-09 Thread Robert Schetterer
Am 09.07.2012 13:51, schrieb Timo Sirainen:
> On Mon, 2012-07-09 at 13:39 +0200, Angel L. Mateo wrote:
>> Hello,
>>
>>  More problems (it seems that we won't be able to put our new servers in 
>> production). The problem now is that when we reach 1000 dovecot 
>> processes we have errors like:
>>
>> Jul  9 12:10:22 myotis31 dovecot: imap-login: Panic: epoll_ctl(add, 6) 
>> failed: Invalid argument
>> Jul  9 12:10:22 myotis31 dovecot: imap-login: Fatal: master: 
>> service(imap-login): child 32251 killed with signal 6 (core dumps disabled)
>>
>>  and server doesn't accept any new connection.
>>
>>  Our servers are running in ubuntu 12.04 with kernel 3.2.0-24-generic 
>> kernel. I have found a similar problem at 
>> https://bugzilla.redhat.com/show_bug.cgi?id=681578 but it is for redhat 
>> kernel of series 2.6.
>>
>>  Could be the same problem? 
> 
> It's definitely the same problem.
> 
>> Any pointer to this problem for ubuntu 
>> kernels? Or for generic 3.0 kernels?
> 
> Sorry, no idea.
> 
> 

in case its fixed in some more recent versions

http://kernel.ubuntu.com/~kernel-ppa/mainline/

guess this is latest for 12.04
http://kernel.ubuntu.com/~kernel-ppa/mainline/v3.4-precise/
-- 
Best Regards
MfG Robert Schetterer




Re: [Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument

2012-07-09 Thread Angel L. Mateo

El 09/07/12 13:51, Timo Sirainen escribió:

On Mon, 2012-07-09 at 13:39 +0200, Angel L. Mateo wrote:

Hello,

More problems (it seems that we won't be able to put our new servers in
production). The problem now is that when we reach 1000 dovecot
processes we have errors like:

Jul  9 12:10:22 myotis31 dovecot: imap-login: Panic: epoll_ctl(add, 6)
failed: Invalid argument
Jul  9 12:10:22 myotis31 dovecot: imap-login: Fatal: master:
service(imap-login): child 32251 killed with signal 6 (core dumps disabled)

and server doesn't accept any new connection.

Our servers are running in ubuntu 12.04 with kernel 3.2.0-24-generic
kernel. I have found a similar problem at
https://bugzilla.redhat.com/show_bug.cgi?id=681578 but it is for redhat
kernel of series 2.6.

Could be the same problem?


It's definitely the same problem.

	The patch mentioned in that thread to solve the problem 
(https://bugzilla.redhat.com/attachment.cgi?id=570690&action=diff#a/fs/eventpoll.c_sec1) 
consist on adding:


static int path_count_inc(int nests)
{
if (nests == 0)
return 0;

	to the begining of path_count_inc function at fs/eventpoll.c in kernel 
source.


I have checked that 3.2.0 kernel I have and this patch is already 
applied.

	Any other idea? Is there anybody running dovecot with a 
ubuntu/debian/vanilla (not redhat based) kernel? What kernel?



--
Angel L. Mateo Martínez
Sección de Telemática
Área de Tecnologías de la Información
y las Comunicaciones Aplicadas (ATICA)
http://www.um.es/atica
Tfo: 868887590
Fax: 86337




Re: [Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument

2012-07-09 Thread Timo Sirainen
On Mon, 2012-07-09 at 13:39 +0200, Angel L. Mateo wrote:
> Hello,
> 
>   More problems (it seems that we won't be able to put our new servers in 
> production). The problem now is that when we reach 1000 dovecot 
> processes we have errors like:
> 
> Jul  9 12:10:22 myotis31 dovecot: imap-login: Panic: epoll_ctl(add, 6) 
> failed: Invalid argument
> Jul  9 12:10:22 myotis31 dovecot: imap-login: Fatal: master: 
> service(imap-login): child 32251 killed with signal 6 (core dumps disabled)
> 
>   and server doesn't accept any new connection.
> 
>   Our servers are running in ubuntu 12.04 with kernel 3.2.0-24-generic 
> kernel. I have found a similar problem at 
> https://bugzilla.redhat.com/show_bug.cgi?id=681578 but it is for redhat 
> kernel of series 2.6.
> 
>   Could be the same problem? 

It's definitely the same problem.

> Any pointer to this problem for ubuntu 
> kernels? Or for generic 3.0 kernels?

Sorry, no idea.




[Dovecot] imap-login: Panic: epoll_ctl(add, 6) failed: Invalid argument

2012-07-09 Thread Angel L. Mateo

Hello,

	More problems (it seems that we won't be able to put our new servers in 
production). The problem now is that when we reach 1000 dovecot 
processes we have errors like:


Jul  9 12:10:22 myotis31 dovecot: imap-login: Panic: epoll_ctl(add, 6) 
failed: Invalid argument
Jul  9 12:10:22 myotis31 dovecot: imap-login: Fatal: master: 
service(imap-login): child 32251 killed with signal 6 (core dumps disabled)


and server doesn't accept any new connection.

	Our servers are running in ubuntu 12.04 with kernel 3.2.0-24-generic 
kernel. I have found a similar problem at 
https://bugzilla.redhat.com/show_bug.cgi?id=681578 but it is for redhat 
kernel of series 2.6.


	Could be the same problem? Any pointer to this problem for ubuntu 
kernels? Or for generic 3.0 kernels?


Any idea?

--
Angel L. Mateo Martínez
Sección de Telemática
Área de Tecnologías de la Información
y las Comunicaciones Aplicadas (ATICA)
http://www.um.es/atica
Tfo: 868887590
Fax: 86337



[Dovecot] Enough - Was: Re: Howto add another disk storage

2012-07-09 Thread Charles Marcus
Please, guys, lets put an end to this topic, I think everyone has had 
their say, and everyone is capable of making up their own mind about 
what type of storage to use - the noise is starting to get irritating.


On 2012-07-09 6:44 AM, Reindl Harald  wrote:

Am 09.07.2012 12:37, schrieb Wojciech Puchar:

look in the mirror after your off-list explanations why


i am talking both about your off-list and on-list conversation in which you prove all 
your "knowledge" is advert
based.


you have no idea about my knowledge
impossible becaus i have no time to explain you only a little part


Words like "mainstream", "enterprise", etc. are just marketing words, and 
should not be used in technical
discussion having no meaning. Using them prooves lack of real knowledge, and 
that's what you exactly did.


how foolish can anybody be for such poor argumentation


Saying to me - a regular massive user of cheap ATA/SATA drive in production since 14 
years - that "nobody" use them
in production is just funny!


luck is no base for a infrastructure your life depends


But OK - you at least plan disaster recovery. Rare event. Your clients after 
paying huge money to get high
complexity and low performance, AT LEAST will not loose data.


are you completly silly?

who let's you imagine that my clients pay "huge money" because SAN?

the level of complexity has not to interest any client
said that: "low performance" is bullshit
stop qulify things you do not know

as long our webservers are generating cms-contents in around 0.011 seconds
per request you are really not in the position to qualify anybodys
performance

as long as the following are your OFF-LIST answers you
better shut up here!

 Original-Nachricht 
Betreff: Re: [Dovecot] Howto add another disk storage
Datum: Mon, 9 Jul 2012 11:43:11 +0200 (CEST)
Von: Wojciech Puchar
An: Reindl Harald

repeat it twice. repeat in 10 times. just for sure as maybe some of your
clients will find out you are just another moron.




--

Best regards,

Charles Marcus
I.T. Director
Media Brokers International, Inc.
678.514.6200 x224 | 678.514.6299 fax


[Dovecot] configuring imap_stats

2012-07-09 Thread Reinhard Vicinus

Hi,

i'm trying to configure imap_stats like it's documented in the wiki: 
http://wiki2.dovecot.org/Statistics. But as soon as i activate the 
imap_stats plugin i get the following error message trying to login via 
imap:


dovecot: imap: Error: Can't load plugin imap_stats_plugin: Plugin stats 
must be loaded also (you must set: mail_plugins=$mail_plugins stats)


But the stats plugin is configured as you can see in the attached 
configurations. Also i can get statistics without the imap_stats 
enabled, but as far as i know only of the pop3 users.


Kind regards
Reinhard

# 2.1.7: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.32-40-server x86_64 Ubuntu 10.04.4 LTS 
auth_cache_negative_ttl = 0
auth_cache_size = 10 M
auth_cache_ttl = 1 mins
auth_verbose = yes
auth_verbose_passwords = sha1
deliver_log_format = mailbox: deliver: msgid=%m from=%f: %$
dict {
  quota = mysql:/etc/dovecot/conf.d/dovecot-dict-sql.conf.ext
}
disable_plaintext_auth = no
doveadm_password = xxx
imapc_features = rfc822.size
imapc_host = local-mailbox
imapc_port = 18143
instance_name = dovecot-mailbox
lda_mailbox_autocreate = yes
lda_mailbox_autosubscribe = yes
login_greeting = Mailbox
login_log_format = mailbox: login: %$: %s
login_trusted_networks = 10.129.3.0/24
mail_debug = yes
mail_fsync = always
mail_gid = vmail
mail_home = /mail/dovecot/%d/%n
mail_location = mdbox:~/mail
mail_log_prefix = "mailbox: mail: %s(%u): "
mail_plugins = quota stats
mail_privileged_group = vmail
mail_uid = vmail
managesieve_implementation_string = Sieve
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character 
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy 
include variables body enotify environment mailbox date ihave
mdbox_rotate_interval = 1 weeks
mdbox_rotate_size = 50 M
mmap_disable = yes
namespace {
  hidden = yes
  list = no
  location = pop3c:
  prefix = POP3-MIGRATION-NS/
}
namespace inbox {
  inbox = yes
  location = 
  prefix = 
}
passdb {
  args = /etc/dovecot/conf.d/dovecot-sql.conf.ext
  driver = sql
}
plugin {
  pop3_migration_mailbox = POP3-MIGRATION-NS/INBOX
  quota = dict:User quota::proxy::quota
  quota_rule = *:storage=10G
  quota_rule2 = Trash:storage=+100M
  quota_warning = storage=95%% quota-warning 95 %u
  quota_warning2 = storage=80%% quota-warning 80 %u
  sieve = ~/.dovecot.sieve
  sieve_dir = ~/sieve
  stats_refresh = 30 secs
  stats_track_cmds = yes
}
pop3c_host = local-mailbox
pop3c_port = 18110
protocols = imap pop3 lmtp sieve
service auth {
  unix_listener auth-userdb {
group = dovecot
mode = 0660
user = dovecot
  }
}
service dict {
  unix_listener dict {
group = vmail
mode = 0660
  }
}
service doveadm {
  inet_listener doveadm-server {
port = 19000
  }
}
service imap-login {
  inet_listener imap {
port = 19143
  }
}
service imap-postlogin {
  executable = script-login /usr/local/bin/dovecot-postlogin
  user = $default_internal_user
}
service imap {
  executable = imap imap-postlogin
}
service lmtp {
  inet_listener lmtp {
address = *
port = 19024
  }
}
service managesieve-login {
  inet_listener sieve {
port = 19200
  }
}
service pop3-login {
  inet_listener pop3 {
port = 19110
  }
}
service pop3-postlogin {
  executable = script-login /usr/local/bin/dovecot-postlogin
  user = $default_internal_user
}
service pop3 {
  executable = pop3 pop3-postlogin
}
service quota-warning {
  executable = script /usr/local/bin/quota-warning
  extra_groups = dovecot
  unix_listener quota-warning {
user = vmail
  }
  user = vmail
}
service stats {
  fifo_listener stats-mail {
mode = 0600
user = vmail
  }
}
ssl = no
userdb {
  driver = prefetch
}
userdb {
  args = /etc/dovecot/conf.d/dovecot-sql.conf.ext
  driver = sql
}
verbose_proctitle = yes
protocol imap {
  imap_client_workarounds = delay-newmail tb-extra-mailbox-sep
  mail_plugins = quota imap_quota imap_stats
}
protocol lmtp {
  mail_plugins = quota sieve
}
protocol doveadm {
  mail_plugins = quota pop3_migration
}


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald


Am 09.07.2012 12:37, schrieb Wojciech Puchar:
>> look in the mirror after your off-list explanations why
> 
> i am talking both about your off-list and on-list conversation in which you 
> prove all your "knowledge" is advert
> based.

you have no idea about my knowledge
impossible becaus i have no time to explain you only a little part

> Words like "mainstream", "enterprise", etc. are just marketing words, and 
> should not be used in technical
> discussion having no meaning. Using them prooves lack of real knowledge, and 
> that's what you exactly did.

how foolish can anybody be for such poor argumentation

> Saying to me - a regular massive user of cheap ATA/SATA drive in production 
> since 14 years - that "nobody" use them
> in production is just funny!

luck is no base for a infrastructure your life depends

> But OK - you at least plan disaster recovery. Rare event. Your clients after 
> paying huge money to get high
> complexity and low performance, AT LEAST will not loose data.

are you completly silly?

who let's you imagine that my clients pay "huge money" because SAN?

the level of complexity has not to interest any client
said that: "low performance" is bullshit
stop qulify things you do not know

as long our webservers are generating cms-contents in around 0.011 seconds
per request you are really not in the position to qualify anybodys
performance

as long as the following are your OFF-LIST answers you
better shut up here!

 Original-Nachricht 
Betreff: Re: [Dovecot] Howto add another disk storage
Datum: Mon, 9 Jul 2012 11:43:11 +0200 (CEST)
Von: Wojciech Puchar 
An: Reindl Harald 

repeat it twice. repeat in 10 times. just for sure as maybe some of your
clients will find out you are just another moron.



signature.asc
Description: OpenPGP digital signature


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Wojciech Puchar


please stop this bullshit, especially OFF-LIST


Fortunately you do not decide about it.


i do not sell them and i am not uneducated


The wording they use ("everyone do this", "because it is enterprise") just 
proves that most of them are people that
should not even touch a computer


look in the mirror after your off-list explanations why


i am talking both about your off-list and on-list conversation in which 
you prove all your "knowledge" is advert based.


Words like "mainstream", "enterprise", etc. are just marketing 
words, and should not be used in technical discussion having no meaning. Using them 
prooves lack of real knowledge, and that's what you exactly did.


Saying to me - a regular massive user of cheap ATA/SATA drive in 
production since 14 years - that "nobody" use them in production is just 
funny!


But OK - you at least plan disaster recovery. Rare event. 
Your clients after paying huge money to get high complexity and low 
performance, AT LEAST will not loose data.


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald


Am 09.07.2012 12:14, schrieb Wojciech Puchar:
> there are lots of skilled engineers here on that forum.
> 
> But certainly not the ones that babble about storage, SANs etc.. just because 
> they sell them, have profits from
> selling them or are just that uneducated.

please stop this bullshit, especially OFF-LIST
i do not sell them and i am not uneducated

> The wording they use ("everyone do this", "because it is enterprise") just 
> proves that most of them are people that
> should not even touch a computer

look in the mirror after your off-list explanations why
are you re-invent the wheel and that you are not need
ONLINE migration of running servers maybe you are the
one who sould even not touch a computer




signature.asc
Description: OpenPGP digital signature


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Wojciech Puchar



Many people just want to be proud, or want to make things expensive so their 
clients are proud. but not always it's like that.


You go on a bit about "pride in complexity" . . What you fail to understand is 
that many highly intelligent, experienced, very able engineers build systems that are as 
complex and as large as they _need to be_ and just because you don't deal with such large 
systems doesn't make everyone else wrong. (Okay, I know, some people are proud, and some 
people do make bad decisions about large complex systems -- but you make the mistake of 
assuming everyone does.)


there are lots of skilled engineers here on that forum.

But certainly not the ones that babble about storage, SANs etc.. just because they sell 
them, have profits from selling them or are just that uneducated.


The wording they use ("everyone do this", "because it is enterprise") just 
proves that most of them are people that should not even touch a computer.


Sadly that's majority of "specialists" nowadays.


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald
what you do not understand is that a proper SAN is NOT
an complex setup, it is in many cases a simpler one
because you have TWO controllers, disks with DUAL channel
and a proper RAID level in ONE device

to built all this redundancy at your own is a much
complexer software-setup and you can be pretty sure
taht as long you are not dealing night and day with
storage/Failover-setups the people designing a
SAN have much more expierience what the are doing

Am 09.07.2012 12:01, schrieb Noel Butler:
> Seem some people have never heard  of  "keep it simple, stupid"or
> "less  is more" ... sounds like a few  people here are falsely propping
> up their worth to their employers, making unnecessary BS to justify
> their own existence.
> 
> My experience of over 20 years of this industry easily shows that those
> who try to make complex networks _always_ have far higher fail rates
> than those that keep it simple, nearly never have any problems, and when
> they do its because the powers failed, the gennies didnt kick in and
> UPS's died before engineers got the gennies going. I've also seen most
> networks that use SAN's have a far more problems than those using NAS's
> - providing you use decent NAS gear like EMC or Netapp :)  Don't evne
> think about using a general server as a  NAS.
> 
> 
> On Mon, 2012-07-09 at 10:46 +0100, J E Lyon wrote:
> 
>> On 9 Jul 2012, at 10:41, Wojciech Puchar wrote:
>>
>>> Many people just want to be proud, or want to make things expensive so 
>>> their clients are proud. but not always it's like that.
>>
>> You go on a bit about "pride in complexity" . . What you fail to understand 
>> is that many highly intelligent, experienced, very able engineers build 
>> systems that are as complex and as large as they _need to be_ and just 
>> because you don't deal with such large systems doesn't make everyone else 
>> wrong. (Okay, I know, some people are proud, and some people do make bad 
>> decisions about large complex systems -- but you make the mistake of 
>> assuming everyone does.)
>>
>> Just my 0.02 -- hope it helps.
>>
> 
> 
> 

-- 

Reindl Harald
the lounge interactive design GmbH
A-1060 Vienna, Hofmühlgasse 17
CTO / CISO / Software-Development
p: +43 (1) 595 3999 33, m: +43 (676) 40 221 40
icq: 154546673, http://www.thelounge.net/

http://www.thelounge.net/signature.asc.what.htm





signature.asc
Description: OpenPGP digital signature


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Noel Butler
Seem some people have never heard  of  "keep it simple, stupid"or
"less  is more" ... sounds like a few  people here are falsely propping
up their worth to their employers, making unnecessary BS to justify
their own existence.

My experience of over 20 years of this industry easily shows that those
who try to make complex networks _always_ have far higher fail rates
than those that keep it simple, nearly never have any problems, and when
they do its because the powers failed, the gennies didnt kick in and
UPS's died before engineers got the gennies going. I've also seen most
networks that use SAN's have a far more problems than those using NAS's
- providing you use decent NAS gear like EMC or Netapp :)  Don't evne
think about using a general server as a  NAS.


On Mon, 2012-07-09 at 10:46 +0100, J E Lyon wrote:

> On 9 Jul 2012, at 10:41, Wojciech Puchar wrote:
> 
> > Many people just want to be proud, or want to make things expensive so 
> > their clients are proud. but not always it's like that.
> 
> You go on a bit about "pride in complexity" . . What you fail to understand 
> is that many highly intelligent, experienced, very able engineers build 
> systems that are as complex and as large as they _need to be_ and just 
> because you don't deal with such large systems doesn't make everyone else 
> wrong. (Okay, I know, some people are proud, and some people do make bad 
> decisions about large complex systems -- but you make the mistake of assuming 
> everyone does.)
> 
> Just my 0.02 -- hope it helps.
> 


<>

signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald


Am 09.07.2012 11:41, schrieb Wojciech Puchar:
>>> using SATA for any production-storage
>>>
>>
>> Hi, sorry SATA is running fine here,
> 
> as well here.
> 
> Many people just want to be proud, or want to make things expensive so their 
> clients are proud. but not always it's
> like that.

oh yeah show me the SATA drives with dual-channel

http://en.wikipedia.org/wiki/Serial_Attached_SCSI
Dual ports allowing redundant paths

in the case of a drive-failure all your cheapiness will strike back

what you do not realize that expensive hardware is NOTHING to be proud of
having a business means things have to run 365 days without downtimes
and as redundant as possible especially in failure cases




signature.asc
Description: OpenPGP digital signature


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread J E Lyon
On 9 Jul 2012, at 10:41, Wojciech Puchar wrote:

> Many people just want to be proud, or want to make things expensive so their 
> clients are proud. but not always it's like that.

You go on a bit about "pride in complexity" . . What you fail to understand is 
that many highly intelligent, experienced, very able engineers build systems 
that are as complex and as large as they _need to be_ and just because you 
don't deal with such large systems doesn't make everyone else wrong. (Okay, I 
know, some people are proud, and some people do make bad decisions about large 
complex systems -- but you make the mistake of assuming everyone does.)

Just my 0.02 -- hope it helps.



Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Wojciech Puchar

ouch - that said and your offlist discussion why SAN storages
are crap for you gives a picture - nobody, really nobody is
using SATA for any production-storage


In a view of moron you are "everyone".



Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Wojciech Puchar

using SATA for any production-storage



Hi, sorry SATA is running fine here,


as well here.

Many people just want to be proud, or want to make things expensive so 
their clients are proud. but not always it's like that.




[Dovecot] Timeout (180s) while waiting for lock for transaction log file

2012-07-09 Thread Angel L. Mateo

Hello,

	We still have problems with our updated dovecot servers... The problem 
now is that we are having errors like:


Jul  9 10:22:02 myotis31 dovecot: lmtp(15431, ): Error: Timeout 
(180s) while waiting for lock for transaction log file 
/var/indexes//.INBOX/dovecot.index.log
Jul  9 10:22:02 myotis31 dovecot: lmtp(15431, ): Error: 
+4YfCwKS+k9HPAAAmo+UlA: sieve: msgid=<4ffa8700.2080...@um.es>: failed to 
store into mailbox 'INBOX': Internal error occurred. Refer to server log 
for more information. [2012-07-09 10:19:02]
Jul  9 10:22:02 myotis31 dovecot: lmtp(15431, ): Error: 
+4YfCwKS+k9HPAAAmo+UlA: sieve: script /home/pdi/88/185188/.dovecot.sieve 
failed with unsuccessful implicit keep (user logfile 
/home/pdi/88/185188/.dovecot.sieve.log may reveal additional details)


in the .dovecot.sieve.log all we have is just:

sieve: info: started log at Jul 09 10:22:02.
error: msgid=<4ffa8700.2080...@um.es>: failed to store into mailbox 
'INBOX': Internal error occurred. Refer to server log for more 
information. [2012-07-09 10:19:02].


	maildir are in a nfs storage, but indexes are in local disk. I don't 
know if the problem could be related with a some "specific" messages or 
something specific to the user, because we are having this problem only 
with a few users and the problem repeatedly happens when our mta tries 
to deliver the queued message.


Any idea?

--
Angel L. Mateo Martínez
Sección de Telemática
Área de Tecnologías de la Información
y las Comunicaciones Aplicadas (ATICA)
http://www.um.es/atica
Tfo: 868887590
Fax: 86337

# 2.1.5: /etc/dovecot/dovecot.conf
# OS: Linux 3.2.0-24-generic x86_64 Ubuntu 12.04 LTS 
auth_cache_size = 20 M
auth_cache_ttl = 1 days
auth_debug = yes
auth_master_user_separator = *
auth_verbose = yes
default_process_limit = 1000
disable_plaintext_auth = no
log_timestamp = %Y-%m-%d %H:%M:%S
login_trusted_networks = 155.54.211.176/28
mail_debug = yes
mail_location = maildir:~/Maildir:INDEX=/var/indexes/%n
mail_privileged_group = mail
mdbox_rotate_size = 20 M
passdb {
  args = /etc/dovecot/master-users
  driver = passwd-file
  master = yes
  pass = yes
}
passdb {
  args = /etc/dovecot/dovecot-ldap.conf.ext
  driver = ldap
}
passdb {
  args = session=yes dovecot
  driver = pam
}
plugin {
  lazy_expunge = .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/
  sieve = ~/.dovecot.sieve
  sieve_dir = ~/sieve
  sieve_extensions = +imapflags
  sieve_max_redirects = 15
  zlib_save = gz
  zlib_save_level = 6
}
postmaster_address = postmas...@um.es
service anvil {
  client_limit = 2003
}
service auth {
  client_limit = 3000
  unix_listener auth-userdb {
mode = 0666
  }
}
service doveadm {
  inet_listener {
port = 24245
  }
}
service imap {
  process_limit = 5120
  process_min_avail = 6
  vsz_limit = 512 M
}
service lmtp {
  inet_listener lmtp {
port = 24
  }
  process_min_avail = 10
  vsz_limit = 512 M
}
service pop3 {
  process_min_avail = 6
}
ssl = no
ssl_cert = 
}


Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Robert Schetterer
Am 09.07.2012 10:17, schrieb Reindl Harald:
> 
> 
> Am 09.07.2012 07:48, schrieb Wojciech Puchar:
>>> disagreed with my statement, then agreed with it.  Apparently you didn't
>>> realize you did so.  Would you please clarify what I stated that is
>>> "simply not true"?  You comment WRT SSD doesn't prove anything I said to
>>> be untrue.  Quite the contrary, you reinforced my statements.
>>>
>> Actually the only storage i use are mainstream SATA drives
> 
> ouch - that said and your offlist discussion why SAN storages
> are crap for you gives a picture - nobody, really nobody is
> using SATA for any production-storage
> 

Hi, sorry SATA is running fine here,
by the way please show tec detail measures
about filesystems , different storages, hardware envolved
and tec evidence for your discusions related to dovecot.

I know this is a difficult theme, and test results
may controversial, but it shouldnt be a point for hot flames
so it may be better, doing it offlist.

Meanwhile why dont just post real working storage/filesystems examples
with big used dovecot setups, which may help everybody, perhaps in the wiki

After all we decide doing a big test setup to clear
all this questions.


-- 
Best Regards
MfG Robert Schetterer




Re: [Dovecot] Howto add another disk storage

2012-07-09 Thread Reindl Harald


Am 09.07.2012 07:48, schrieb Wojciech Puchar:
>> disagreed with my statement, then agreed with it.  Apparently you didn't
>> realize you did so.  Would you please clarify what I stated that is
>> "simply not true"?  You comment WRT SSD doesn't prove anything I said to
>> be untrue.  Quite the contrary, you reinforced my statements.
>>
> Actually the only storage i use are mainstream SATA drives

ouch - that said and your offlist discussion why SAN storages
are crap for you gives a picture - nobody, really nobody is
using SATA for any production-storage



signature.asc
Description: OpenPGP digital signature