[Dovecot] 76Gb to 146Gb [Resolved]

2012-10-23 Thread Spyros Tsiolis
Hello all,

I would like to thank you all for your kind replies and
feedback in regards to migrating from a smaller hdd to a
bigger one (namely from 72gb to 146gb).

I finally found a painless way of doing this.

Since I believe that this is still an off-topic post, if
anyone is interested in the solution i've adopted for this,
let me know by replying to me privately.

If, however, you don't mind me posting here, let me know.

Many many thanks go to Alexander Hoogerhuis, the mad Norwegian :-)
who helped me on this too much to describe here.
Alex, you are a true sport.

Thank you again people.


All the Best,

spyros





 

I merely function as a channel that filters 
music through the chaos of noise
- Vangelis


Re: [Dovecot] 76Gb to 146Gb

2012-09-26 Thread Stan Hoeppner
On 9/25/2012 12:29 AM, Spyros Tsiolis wrote:

 My clients don't invest in hardware. I live in Greece. Things are really
 bad right now. Not that if they were better they (the client) would invest
 in their infrastructure.
...
 Thank you very much Stan for you kind reply.
 
 I reply to you in private since I was told to stop the thread
 on the dovecot list because it's off-topic.

I'm going to bring it back on topic.  To recap the issue:

1.  73GB volume, ~82% full.  Volume contains OS, spool, and mailboxes
2.  Two 146GB drives on hand that are impossible to employ in either
a live or offline migration due to hardware limitations--drive slots

(0.82*73GB=60GB)-5GB(OS)= ~55GB/40= ~1.375GB/user mailbox

(This math assumes the box has already been scoured and things like
source files and other temporary stuff has already been removed, along
with anything and everything not necessary to the primary functions of
this box)

1.375GB/user suggests these users seem to horde old emails, or simply
don't keep their mailboxes tidy.  Normally I'd guess that a lot of space
in a situation like this is taken up by full text search indexes, but
you don't appear to have these enabled.

I notice in your 'dovecot -n' output that you are already employing
zlib, but to what degree is currently unknown to the list.  Are you
compressing maildirs with a nightly script?  If not, and you're
compressing on an ad hoc basis, realtime compression during write could
save you quite a bit of additional space, extending the operating life
of your current drives.  Of course a simple request to your users to
clean up their mailboxes would surely help as well, if that's a
possibility--some users would flog one for making such a suggestion.

If you're not fully taking advantage of compression currently, you may
want to consider upgrading to Dovecot 2.x which allows transparent
compression to dbox and maildir storage.  You may want to migrate to
mdbox message store format while still using zlib, and enable single
instance attachment storage (SIS).  As the name suggests, SIS saves an
attachment only once, regardless how many user emails in which it
exists.  See:

http://wiki2.dovecot.org/Plugins/Zlib

I'd point you to the docs for SIS but I'm unable to find them in the
Wiki.  Surely someone else can provide the settings and/or update the wiki.

-- 
Stan



Re: [Dovecot] 76Gb to 146Gb

2012-09-26 Thread Eliezer Croitoru

On 9/24/2012 7:42 PM, Spyros Tsiolis wrote:

Hello all,

I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
Xmail and OpenLDAP for a company and serving about 40 acouunts.

The machine is wonderful. I am very happy with it.
However, I am running out of disk space.
It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
has reached 82%.

I am starting of getting nervous.

Does anyone know of a painless way to migrate the entire contents directly
to another pair of 146Gb SCSI RAID1 disks ?

I thought of downtime and using clonezilla, but my last experience with it
was questionable. I remember having problems declaring disk re-sizing
from the smaller capacity drives to the larger ones.

CentOS 5.5
Manual install of :

Mysql
XMail (pop3/smtp)
ASSP (anti spam)
Apache / LAMP
and last but by no means list : Dovecot

SNIP

It really depends on the raid you have.
is it software or hardware raid?
if it's software raid it will be more then simple to do it while taking 
one drive out put a new one in and use let say FINNIX linux from 
cd\dvd\usb and manage the whole partitioning copying etc from another OS 
while not harming anything in the old HDDs.
you will might need to setup a new partitions manually on the new drive 
but just make a plan try it on some small VM to make sure the steps you 
are doing are fine for centos 5.5 and go for it.


rsync is your friend!! in this case.

someone mentioned here Gentoo which one installation of the system can 
give you very big backgorund on manual partitioning chrooting and other 
basic stuff that can help you in the process.


Regards,
Eliezer



Any help would be appreciated or any ideas you might have.

Regards,

spyros







I merely function as a channel that filters
music through the chaos of noise
- Vangelis


Re: [Dovecot] 76Gb to 146Gb

2012-09-25 Thread Johan Hendriks

Spyros Tsiolis schreef:

Hello all,

I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
Xmail and OpenLDAP for a company and serving about 40 acouunts.

The machine is wonderful. I am very happy with it.
However, I am running out of disk space.
It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
has reached 82%.

I am starting of getting nervous.

Does anyone know of a painless way to migrate the entire contents directly
to another pair of 146Gb SCSI RAID1 disks ?

I thought of downtime and using clonezilla, but my last experience with it
was questionable. I remember having problems declaring disk re-sizing
from the smaller capacity drives to the larger ones.

CentOS 5.5
Manual install of :

Mysql
XMail (pop3/smtp)
ASSP (anti spam)
Apache / LAMP
and last but by no means list : Dovecot

Dovecot -n :

# 1.2.16: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
base_dir: /var/run/dovecot/
log_path: /var/log/dovecot/dovecot.log
info_log_path: /var/log/dovecot/dovecot-info.log
ssl_parameters_regenerate: 48
verbose_ssl: yes
login_dir: /var/run/dovecot//login
login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
login_greeting: * Dovecot ready *
login_max_processes_count: 96
mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
mail_plugins: zlib
auth default:
   verbose: yes
   debug: yes
   debug_passwords: yes
   passdb:
 driver: passwd-file
 args: /etc/dovecot/passwd
   passdb:
 driver: pam
   userdb:
 driver: static
 args: uid=vmail gid=vmail home=/home/vmail/%u
   userdb:
 driver: passwd


Any help would be appreciated or any ideas you might have.

Regards,

spyros







I merely function as a channel that filters
music through the chaos of noise
- Vangelis

A solution you could try is add a new server to the mix.
Leave the OS on the DL360 and put the mail data on a second machine.
Then use NFS to mount the new data store.
If you use a ZFS solution, expanding your data store is a no brainer.
146 GB drives are expensive, for 40 users SATA drives can do the job 
without any problem.


gr
Johan Hendriks





Re: [Dovecot] 76Gb to 146Gb

2012-09-25 Thread Noel Butler
Spyros,

Sounds like you have bigger problems, as you appear to have no disaster
recovery processes, since your using a standalone server, as recommended
to you earlier by Robert,  rsync is your friend, and not just now, but
daily :) setup a rolling 7 day rsync archive (sata disks are big, cheap
and good enough for backups), and dont just rsync the same stuff to the
same place every night, thats no good if an error occurs and wipes out
your mail, coz rsync will only see it gone, and clean it out of your
backup.

So long as RedHat have patched dovecot for bugs and still does, 1.2.16
would still be fine, dovecot-1.2.17 is latest 1.2.x series   but IIRC no
longer supported, but thats fine, there are a lot, and I mean, a LOT of
companies and ISP's running that version, moving to 2.x was never going
to happen with new releases coming every week or so at one stage, and as
2.1.x doesn't now have nearly as regular updates, I recently myself
consider 2.1 finally to be mature enough to put on production servers,
which I will likely do around Christmas when its quiet.

Lastly, never ever ever rely on your users to have a copy of their mail
as a recovery method, it wont work, some will fsck it up, some wont
bother, and you will be blamed for not having redundancy inplace.


On Mon, 2012-09-24 at 20:24 +0100, Spyros Tsiolis wrote:

 
 
 
 - Original Message -
  From: Robert Schetterer rob...@schetterer.org
  To: dovecot@dovecot.org
  Cc: 
  Sent: Monday, 24 September 2012, 21:06
  Subject: Re: [Dovecot] 76Gb to 146Gb
  
  Am 24.09.2012 19:42, schrieb Spyros Tsiolis:
   Hello all,
  
  %%%%%%%%
  
  rsync
  should do the job
  
  depending on your whole machine setup it might only be only
  umount old /home and mount new(bigger) /home after sync
  ,perhaps with tmp store elsewhere
  ( for sure you have to have a plan before doing..)
  
  but your dovecot is very outdated, i would recommend
  get up to new hard and software/os install, and then migrate
  to new machine
  
 
attachment: face-smile.png

signature.asc
Description: This is a digitally signed message part


[Dovecot] 76Gb to 146Gb

2012-09-24 Thread Spyros Tsiolis
Hello all,

I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
Xmail and OpenLDAP for a company and serving about 40 acouunts.

The machine is wonderful. I am very happy with it.
However, I am running out of disk space.
It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
has reached 82%. 

I am starting of getting nervous.

Does anyone know of a painless way to migrate the entire contents directly
to another pair of 146Gb SCSI RAID1 disks ?

I thought of downtime and using clonezilla, but my last experience with it
was questionable. I remember having problems declaring disk re-sizing
from the smaller capacity drives to the larger ones.

CentOS 5.5
Manual install of :

Mysql
XMail (pop3/smtp)
ASSP (anti spam)
Apache / LAMP
and last but by no means list : Dovecot

Dovecot -n :

# 1.2.16: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
base_dir: /var/run/dovecot/
log_path: /var/log/dovecot/dovecot.log
info_log_path: /var/log/dovecot/dovecot-info.log
ssl_parameters_regenerate: 48
verbose_ssl: yes
login_dir: /var/run/dovecot//login
login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
login_greeting: * Dovecot ready *
login_max_processes_count: 96
mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
mail_plugins: zlib
auth default:
  verbose: yes
  debug: yes
  debug_passwords: yes
  passdb:
    driver: passwd-file
    args: /etc/dovecot/passwd
  passdb:
    driver: pam
  userdb:
    driver: static
    args: uid=vmail gid=vmail home=/home/vmail/%u
  userdb:
    driver: passwd


Any help would be appreciated or any ideas you might have.

Regards,

spyros







I merely function as a channel that filters 
music through the chaos of noise
- Vangelis 


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Michescu Andrei
Hello Spyros,

As best practice you never have the OS and the data/logs/user homes on
the same partition or set of disks.

If this is the case then your life is pretty easy:
 -simply create the new set of partitions
 -mount the new ones in a temporary location
 -rsync (or copy everything from old partitions)
 -Stop dovecot / all other daemons that might be using the data
 -mount the new ones in the place of old ones, mount the old ones in the
place of new ones
 - rsync again (should be quick as not many things changed)
 - start all your deamons again :P

If you do not have separate partitions maybe this is the perfect time to
look into that...

I would also look into btrfs... might be a good pick for your new partitions.

best regards,
Andrei

 Hello all,

 I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
 Xmail and OpenLDAP for a company and serving about 40 acouunts.

 The machine is wonderful. I am very happy with it.
 However, I am running out of disk space.
 It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
 has reached 82%. 

 I am starting of getting nervous.

 Does anyone know of a painless way to migrate the entire contents directly
 to another pair of 146Gb SCSI RAID1 disks ?

 I thought of downtime and using clonezilla, but my last experience with it
 was questionable. I remember having problems declaring disk re-sizing
 from the smaller capacity drives to the larger ones.

 CentOS 5.5
 Manual install of :

 Mysql
 XMail (pop3/smtp)
 ASSP (anti spam)
 Apache / LAMP
 and last but by no means list : Dovecot

 Dovecot -n :

 # 1.2.16: /etc/dovecot/dovecot.conf
 # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
 base_dir: /var/run/dovecot/
 log_path: /var/log/dovecot/dovecot.log
 info_log_path: /var/log/dovecot/dovecot-info.log
 ssl_parameters_regenerate: 48
 verbose_ssl: yes
 login_dir: /var/run/dovecot//login
 login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
 login_greeting: * Dovecot ready *
 login_max_processes_count: 96
 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
 mail_plugins: zlib
 auth default:
   verbose: yes
   debug: yes
   debug_passwords: yes
   passdb:
     driver: passwd-file
     args: /etc/dovecot/passwd
   passdb:
     driver: pam
   userdb:
     driver: static
     args: uid=vmail gid=vmail home=/home/vmail/%u
   userdb:
     driver: passwd


 Any help would be appreciated or any ideas you might have.

 Regards,

 spyros






 
 I merely function as a channel that filters
 music through the chaos of noise
 - Vangelis 

 !DSPAM:50609d2c301831828332458!






Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Robert Schetterer
Am 24.09.2012 19:42, schrieb Spyros Tsiolis:
 Hello all,
 
 I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
 Xmail and OpenLDAP for a company and serving about 40 acouunts.
 
 The machine is wonderful. I am very happy with it.
 However, I am running out of disk space.
 It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
 has reached 82%. 
 
 I am starting of getting nervous.
 
 Does anyone know of a painless way to migrate the entire contents directly
 to another pair of 146Gb SCSI RAID1 disks ?
 
 I thought of downtime and using clonezilla, but my last experience with it
 was questionable. I remember having problems declaring disk re-sizing
 from the smaller capacity drives to the larger ones.
 
 CentOS 5.5
 Manual install of :
 
 Mysql
 XMail (pop3/smtp)
 ASSP (anti spam)
 Apache / LAMP
 and last but by no means list : Dovecot
 
 Dovecot -n :
 
 # 1.2.16: /etc/dovecot/dovecot.conf
 # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
 base_dir: /var/run/dovecot/
 log_path: /var/log/dovecot/dovecot.log
 info_log_path: /var/log/dovecot/dovecot-info.log
 ssl_parameters_regenerate: 48
 verbose_ssl: yes
 login_dir: /var/run/dovecot//login
 login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
 login_greeting: * Dovecot ready *
 login_max_processes_count: 96
 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
 mail_plugins: zlib
 auth default:
   verbose: yes
   debug: yes
   debug_passwords: yes
   passdb:
 driver: passwd-file
 args: /etc/dovecot/passwd
   passdb:
 driver: pam
   userdb:
 driver: static
 args: uid=vmail gid=vmail home=/home/vmail/%u
   userdb:
 driver: passwd
 
 
 Any help would be appreciated or any ideas you might have.
 
 Regards,
 
 spyros
 


rsync
should do the job

depending on your whole machine setup it might only be only
umount old /home and mount new(bigger) /home after sync
,perhaps with tmp store elsewhere
( for sure you have to have a plan before doing..)

but your dovecot is very outdated, i would recommend
get up to new hard and software/os install, and then migrate
to new machine

 
 
 
 
 
 
 I merely function as a channel that filters 
 music through the chaos of noise
 - Vangelis 
 


-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Ed W
This is one of those questions which is almost too easy if you are 
familiar with Linux.  Trying not to sound like a d*ck, but is it an 
option to rent someone to help with admin jobs?  For example, were it me 
then I would probably have setup some partitioning scheme with separate 
partitions for data and operating system?  Possibly also using LVM?


You have several options, mainly the choice of filesystem will dictate 
here, but quite possibly you can:
1) Pull the drives one by one and rebuild the raid after each. Keep the 
old drives since you can technically roll back onto them. Expand the 
partitions (scary without LVM) and then expand the filesystem on the 
partitions
2) Boot from a DVD/Flash on your favourite rescue distro (I like 
sysrecuecd). Create the new raid, copy the old to the new, remove the 
old drives, reboot from new.  Possibly taking the time to repartition 
and move some data around while you do it (remember to update fstab)


Both are fairly simple if you have done it once, but it would be well 
worth finding someone either local or who will log in via remote control 
and support you?


Final thought:  For the size of drives you are looking at, SSD drives 
are relatively inexpensive and likely comparable with the high end 
drives you are probably looking to buy?  For 40 users I would hazard a 
guess you likely would be happy with inexpensive low end drives, but 
certainly a couple of small SSDs will blow away a spinning disk and give 
you a decent upgrade...


Good luck

Ed W



On 24/09/2012 18:42, Spyros Tsiolis wrote:

Hello all,

I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
Xmail and OpenLDAP for a company and serving about 40 acouunts.

The machine is wonderful. I am very happy with it.
However, I am running out of disk space.
It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
has reached 82%.

I am starting of getting nervous.

Does anyone know of a painless way to migrate the entire contents directly
to another pair of 146Gb SCSI RAID1 disks ?

I thought of downtime and using clonezilla, but my last experience with it
was questionable. I remember having problems declaring disk re-sizing
from the smaller capacity drives to the larger ones.

CentOS 5.5
Manual install of :

Mysql
XMail (pop3/smtp)
ASSP (anti spam)
Apache / LAMP
and last but by no means list : Dovecot

Dovecot -n :

# 1.2.16: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
base_dir: /var/run/dovecot/
log_path: /var/log/dovecot/dovecot.log
info_log_path: /var/log/dovecot/dovecot-info.log
ssl_parameters_regenerate: 48
verbose_ssl: yes
login_dir: /var/run/dovecot//login
login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
login_greeting: * Dovecot ready *
login_max_processes_count: 96
mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
mail_plugins: zlib
auth default:
   verbose: yes
   debug: yes
   debug_passwords: yes
   passdb:
 driver: passwd-file
 args: /etc/dovecot/passwd
   passdb:
 driver: pam
   userdb:
 driver: static
 args: uid=vmail gid=vmail home=/home/vmail/%u
   userdb:
 driver: passwd


Any help would be appreciated or any ideas you might have.

Regards,

spyros







I merely function as a channel that filters
music through the chaos of noise
- Vangelis




Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Michescu Andrei
Hello Spyros,

Oupss... the DL360 G4 has only 2 bays and no external SCSI/SATA
connector... so the solution below does not really apply to you :(

Andrei

 Hello Spyros,

 As best practice you never have the OS and the data/logs/user homes on
 the same partition or set of disks.

 If this is the case then your life is pretty easy:
  -simply create the new set of partitions
  -mount the new ones in a temporary location
  -rsync (or copy everything from old partitions)
  -Stop dovecot / all other daemons that might be using the data
  -mount the new ones in the place of old ones, mount the old ones in the
 place of new ones
  - rsync again (should be quick as not many things changed)
  - start all your deamons again :P

 If you do not have separate partitions maybe this is the perfect time to
 look into that...

 I would also look into btrfs... might be a good pick for your new
 partitions.

 best regards,
 Andrei

 Hello all,

 I have a DL360 G4 1U server that does a wonderfull job with dovecot
 horde,
 Xmail and OpenLDAP for a company and serving about 40 acouunts.

 The machine is wonderful. I am very happy with it.
 However, I am running out of disk space.
 It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
 has reached 82%. 

 I am starting of getting nervous.

 Does anyone know of a painless way to migrate the entire contents
 directly
 to another pair of 146Gb SCSI RAID1 disks ?

 I thought of downtime and using clonezilla, but my last experience with
 it
 was questionable. I remember having problems declaring disk re-sizing
 from the smaller capacity drives to the larger ones.

 CentOS 5.5
 Manual install of :

 Mysql
 XMail (pop3/smtp)
 ASSP (anti spam)
 Apache / LAMP
 and last but by no means list : Dovecot

 Dovecot -n :

 # 1.2.16: /etc/dovecot/dovecot.conf
 # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
 base_dir: /var/run/dovecot/
 log_path: /var/log/dovecot/dovecot.log
 info_log_path: /var/log/dovecot/dovecot-info.log
 ssl_parameters_regenerate: 48
 verbose_ssl: yes
 login_dir: /var/run/dovecot//login
 login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
 login_greeting: * Dovecot ready *
 login_max_processes_count: 96
 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
 mail_plugins: zlib
 auth default:
   verbose: yes
   debug: yes
   debug_passwords: yes
   passdb:
     driver: passwd-file
     args: /etc/dovecot/passwd
   passdb:
     driver: pam
   userdb:
     driver: static
     args: uid=vmail gid=vmail home=/home/vmail/%u
   userdb:
     driver: passwd


 Any help would be appreciated or any ideas you might have.

 Regards,

 spyros






 
 I merely function as a channel that filters
 music through the chaos of noise
 - Vangelis 







 !DSPAM:5060a006309197419291868!






Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Robert Schetterer
Am 24.09.2012 20:07, schrieb Michescu Andrei:
 Hello Spyros,
 
 Oupss... the DL360 G4 has only 2 bays and no external SCSI/SATA
 connector... so the solution below does not really apply to you :(
 
 Andrei

depends how long downtime is acceptable
i.e go rsync tmp over usb storage, or simple
tmp nfs mounts to other servers are thinkable to minimize downtime
should be no big problem its only one server with maildir and less
mailboxes and data

but thats all much off topic with dovecot

-- 
Best Regards
MfG Robert Schetterer


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Spyros Tsiolis
- Original Message -
 From: Michescu Andrei andrei.miche...@miau.ca
 To: Dovecot Mailing List dovecot@dovecot.org
 Cc: 
 Sent: Monday, 24 September 2012, 21:07
 Subject: Re: [Dovecot] 76Gb to 146Gb
 
 Hello Spyros,
 
 Oupss... the DL360 G4 has only 2 bays and no external SCSI/SATA
 connector... so the solution below does not really apply to you :(
 
 Andrei
 
 Hello Spyros,
 
 As best practice you never have the OS and the data/logs/user 
 homes on
 the same partition or set of disks.
 
 If this is the case then your life is pretty easy:
   -simply create the new set of partitions
   -mount the new ones in a temporary location
   -rsync (or copy everything from old partitions)
   -Stop dovecot / all other daemons that might be using the data
   -mount the new ones in the place of old ones, mount the old ones in the
 place of new ones
   - rsync again (should be quick as not many things changed)
   - start all your deamons again :P
 
 If you do not have separate partitions maybe this is the perfect time to
 look into that...
 
 I would also look into btrfs... might be a good pick for your new
 partitions.
 
 best regards,
 Andrei
 
 Hello all,
 
 I have a DL360 G4 1U server that does a wonderfull job with dovecot
 horde,
 Xmail and OpenLDAP for a company and serving about 40 acouunts.
 
 The machine is wonderful. I am very happy with it.
 However, I am running out of disk space.
 It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
 has reached 82%. 
 
 I am starting of getting nervous.
 
 Does anyone know of a painless way to migrate the entire contents
 directly
 to another pair of 146Gb SCSI RAID1 disks ?
 
 I thought of downtime and using clonezilla, but my last experience with
 it
 was questionable. I remember having problems declaring disk re-sizing
 from the smaller capacity drives to the larger ones.
 
 CentOS 5.5
 Manual install of :
 
 Mysql
 XMail (pop3/smtp)
 ASSP (anti spam)
 Apache / LAMP
 and last but by no means list : Dovecot
 
 Dovecot -n :
 
 # 1.2.16: /etc/dovecot/dovecot.conf
 # OS: Linux 2.6.18-194.17.4.el5 i686 CentOS release 5.5 (Final) ext3
 base_dir: /var/run/dovecot/
 log_path: /var/log/dovecot/dovecot.log
 info_log_path: /var/log/dovecot/dovecot-info.log
 ssl_parameters_regenerate: 48
 verbose_ssl: yes
 login_dir: /var/run/dovecot//login
 login_executable: /usr/local/dovecot/libexec/dovecot/imap-login
 login_greeting: * Dovecot ready *
 login_max_processes_count: 96
 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir
 mail_plugins: zlib
 auth default:
   verbose: yes
   debug: yes
   debug_passwords: yes
   passdb:
     driver: passwd-file
     args: /etc/dovecot/passwd
   passdb:
     driver: pam
   userdb:
     driver: static
     args: uid=vmail gid=vmail home=/home/vmail/%u
   userdb:
     driver: passwd
 
 
 Any help would be appreciated or any ideas you might have.
 
 Regards,
 
 spyros
 
 
 
 
 
 
 
 I merely function as a channel that filters
 music through the chaos of noise
 - Vangelis 
 
 
 
 
 
 
 
 !DSPAM:5060a006309197419291868!




Andrei,

Thank you very much for you kind reply and
both your messages.

Having said that, would it be possible to take
away on 72Gb drive (say Drive1 the second drive)
and shove in one of the two 146Gb ones ?

Shouldn't the array be rebuilt ?
Will it use the extra disk space though ?

Thanks,

spyros




 

I merely function as a channel that filters 
music through the chaos of noise
- Vangelis


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Ed W

On 24/09/2012 19:07, Ed W wrote:
This is one of those questions which is almost too easy if you are 
familiar with Linux.  Trying not to sound like a d*ck, but is it an 
option to rent someone to help with admin jobs?  For example, were it 
me then I would probably have setup some partitioning scheme with 
separate partitions for data and operating system? Possibly also using 
LVM?


That came out wrong...  What I meant to say was something more like if 
you were to employ someone locally they would probably give you a whole 
bunch of ideas on how you could adjust the setup of the server to be 
more future proof.  It would be worth working with someone just to get 
that right.  For example, here are some ideas that occur to me that you 
could use ...


Sorry, should re-read my words before hitting send

Ed


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Spyros Tsiolis
- Original Message -

 From: Ed W li...@wildgooses.com
 To: dovecot@dovecot.org
 Cc: 
 Sent: Monday, 24 September 2012, 21:55
 Subject: Re: [Dovecot] 76Gb to 146Gb
 
 On 24/09/2012 19:07, Ed W wrote:
  This is one of those questions which is almost too easy if you are familiar 
 with Linux.  Trying not to sound like a d*ck, but is it an option to rent 
 someone to help with admin jobs?  For example, were it me then I would 
 probably 
 have setup some partitioning scheme with separate partitions for data and 
 operating system? Possibly also using LVM?
 
 That came out wrong...  What I meant to say was something more like if you 
 were to employ someone locally they would probably give you a whole bunch of 
 ideas on how you could adjust the setup of the server to be more future 
 proof.  
 It would be worth working with someone just to get that right.  For example, 
 here are some ideas that occur to me that you could use ...
 
 Sorry, should re-read my words before hitting send
 
 Ed
 

Ed,

Don't worry about it. I wasn't offended.
I have a lot of experience with linux but not on heavy metal servers.
I used to have plenty of experience back in the G2/ G3 era (I was
also ACE in the Compaq years) but that was back in the time that
Compaq was only supporting Windows OSs and SCO.

Also the problem is that I don't have the time to play with a
spare HP/Compaq server ( I have a couple laying around btw).
I'll get round to it at some point.

I am just asking you chaps because I am sure people out there had
the chance to tinker with newer and better equipment.

Thank you for your reply,

Best Regards,

spyros



 

I merely function as a channel that filters 
music through the chaos of noise
- Vangelis



Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Spyros Tsiolis




- Original Message -
 From: Robert Schetterer rob...@schetterer.org
 To: dovecot@dovecot.org
 Cc: 
 Sent: Monday, 24 September 2012, 21:06
 Subject: Re: [Dovecot] 76Gb to 146Gb
 
 Am 24.09.2012 19:42, schrieb Spyros Tsiolis:
  Hello all,
 
 %%%%%%%%
 
 rsync
 should do the job
 
 depending on your whole machine setup it might only be only
 umount old /home and mount new(bigger) /home after sync
 ,perhaps with tmp store elsewhere
 ( for sure you have to have a plan before doing..)
 
 but your dovecot is very outdated, i would recommend
 get up to new hard and software/os install, and then migrate
 to new machine
 
 

 
 -- 
 Best Regards
 MfG Robert Schetterer
 


On client machines I have thunderbird.

What if :

1. I would make sure that thunderbird keeps a local
copy of all the message (I think there is a check box
somewhere on settings)

2. Make sure all client machines have synced their
mailboxes locally on thunderbird.


3. Install a new version of Dovecot/Horde/XMail etc.

4. When the new installation is done, try to sync
from the existing clients pc's to dovecot ?

Would that work ?
It's one scenario I am seriously contemplating.

Thank you very much again,

s.



 

I merely function as a channel that filters 
music through the chaos of noise
- Vangelis


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Benny Pedersen

Spyros Tsiolis skrev den 24-09-2012 19:42:


Any help would be appreciated or any ideas you might have.


try google centos cloud server

if you would like to do it local, use all 4 drives with 2 raid1 in the 
same controller if possible, then use sysrescue cd to tar it all over to 
the other raid1 while its down


no matter how, it will be downtime

i am not using centos here so i cant be more specifik

http://www.sysresccd.org





Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Benny Pedersen

Spyros Tsiolis skrev den 24-09-2012 20:42:


Having said that, would it be possible to take
away on 72Gb drive (say Drive1 the second drive)
and shove in one of the two 146Gb ones ?


this can be done yes, but you will have to do more steps :)

first step, remove one drive
add the 146 drive

wait it for rebuildin

when done, remove the last small drive
add the last 146 drive

wait for it to rebuild

now at this stage you have 72g more unused room for new partions

make this new partion /home

and after its being created, move the user data to it, but this leves 
72g system partion with just few gigs needed ?, then i would create the 
new partion as lwm2, and then possible shrink system, and mount the lwm2 
as /home, that way you have more options later if 146 will be to small 
again


warn i have not doing this myself, but if should work in teori atleast




Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Stan Hoeppner
On 9/24/2012 1:42 PM, Spyros Tsiolis wrote:

 Having said that, would it be possible to take
 away on 72Gb drive (say Drive1 the second drive)
 and shove in one of the two 146Gb ones ?

It's always best to manually take a drive off line before pulling it.

 Shouldn't the array be rebuilt ?

Depends on how your 6i is configured.  Best guess is that it will
automatically rebuild the mirror on the new 146GB drive, but...

 Will it use the extra disk space though ?

It will probably not.  You need to read the 6i manual.

I sense a hardware upgrade in your near future, either an HP server with
4 bays, or an SFF8088 JBOD chassis and an inexpensive RAID card.

You already have the 146GB drives correct?  They are HP pluggable
drives?  Which means they only work in HP gear.  If that's the case you
need a new server with at least 4 drive bays.  You you need to buy an
off brand JBOD box and two standard SATA drives.

Or maybe your organizations needs more storage on many servers, and it's
time to step up to an iSCSI SAN array.

-- 
Stan



Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Michael Orlitzky
On 09/24/2012 01:42 PM, Spyros Tsiolis wrote:
 Hello all,
 
 I have a DL360 G4 1U server that does a wonderfull job with dovecot horde,
 Xmail and OpenLDAP for a company and serving about 40 acouunts.
 
 The machine is wonderful. I am very happy with it.
 However, I am running out of disk space.
 It has two times 76Gb Drives in RAID1 (disk mirroring) and the capacity
 has reached 82%. 
 
 I am starting of getting nervous.
 
 Does anyone know of a painless way to migrate the entire contents directly
 to another pair of 146Gb SCSI RAID1 disks ?
 
 I thought of downtime and using clonezilla, but my last experience with it
 was questionable. I remember having problems declaring disk re-sizing
 from the smaller capacity drives to the larger ones.

We've done this on the same hardware. You can pick up these servers for
cheap; just buy an extra one. Take the new machine, throw two big disks
in it, and install Gentoo.

Rsync the important stuff. Make sure all of the services are working on
the new machine.

When you're ready to make the switch, disable external networking on the
current live server. Rsync everything again, and then turn the old
server off. Add its IP address to the new server. Maybe kick your
router's ARP cache to expedite the change. It should only cause a minute
or two of downtime.


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Michael Orlitzky
On 09/24/2012 10:59 PM, Michael Orlitzky wrote:
 
 We've done this on the same hardware. You can pick up these servers for
 cheap; just buy an extra one. Take the new machine, throw two big disks
 in it, and install Gentoo.

I seem to have gone insane, I thought this was on gentoo-user for some
reason. Anyway, it's a fine suggestion =)


Re: [Dovecot] 76Gb to 146Gb

2012-09-24 Thread Robert Schetterer
Am 24.09.2012 21:24, schrieb Spyros Tsiolis:
 
 
 
 
 - Original Message -
 From: Robert Schetterer rob...@schetterer.org
 To: dovecot@dovecot.org
 Cc: 
 Sent: Monday, 24 September 2012, 21:06
 Subject: Re: [Dovecot] 76Gb to 146Gb

 Am 24.09.2012 19:42, schrieb Spyros Tsiolis:
  Hello all,

 %%%%%%%%
  
 rsync
 should do the job

 depending on your whole machine setup it might only be only
 umount old /home and mount new(bigger) /home after sync
 ,perhaps with tmp store elsewhere
 ( for sure you have to have a plan before doing..)

 but your dovecot is very outdated, i would recommend
 get up to new hard and software/os install, and then migrate
 to new machine




 -- 
 Best Regards
 MfG Robert Schetterer

 
 
 On client machines I have thunderbird.
 
 What if :
 
 1. I would make sure that thunderbird keeps a local
 copy of all the message (I think there is a check box
 somewhere on settings)
 
 2. Make sure all client machines have synced their
 mailboxes locally on thunderbird.
 
 
 3. Install a new version of Dovecot/Horde/XMail etc.
 
 4. When the new installation is done, try to sync
 from the existing clients pc's to dovecot ?
 
 Would that work ?
 It's one scenario I am seriously contemplating.
 
 Thank you very much again,
 
 s.
 

in short words ,dont do it like this
setup your new server,
test it, then do i.e imapsync from old to new
switch your ips then ,done

only one way which you can go
look archives and www for migration tips

 
 
  
 
 I merely function as a channel that filters 
 music through the chaos of noise
 - Vangelis
 


-- 
Best Regards
MfG Robert Schetterer