Re: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Good suggestion, no it's not ESX, but it does do snapshots. -Ross - Original Message - From: [EMAIL PROTECTED] <[EMAIL PROTECTED]> To: 'CentOS mailing list' Sent: Wed Feb 13 17:30:39 2008 Subject: RE: [CentOS] pvmove speed >I am facing the same issue wi

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>I am facing the same issue with a migration of our VM machines >to a new iSCSI setup this year, around 1TB of VMs need to be >fork lifted over and I thought about exotic ways to move it >over, but I think in the end it will be by good ole backup exec >and tape. You're not running esx are you? Heh

RE: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Joseph L. Casale wrote: > > >Since your moving the data over to a new server/array combo have > >you thought about using LTO tapes to back it up and restore it > >on the new server? > > > >I know it isn't as sexy as LVM pv duplication and such, but it > >works... > > We have an HP Autoloader, I t

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>Since your moving the data over to a new server/array combo have >you thought about using LTO tapes to back it up and restore it >on the new server? > >I know it isn't as sexy as LVM pv duplication and such, but it >works... We have an HP Autoloader, I thought of doing that actually, and I think

RE: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Joseph L. Casale wrote: > > >Ah, well you are using SAS drives, so there is some cash there... > > My bad, SAS controller with SATA II drives :( > > >What industry do you work in? > > All sorts, odd company: We do everything from automotive > accessories to home building! > > >That's not true

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>Ah, well you are using SAS drives, so there is some cash there... My bad, SAS controller with SATA II drives :( >What industry do you work in? All sorts, odd company: We do everything from automotive accessories to home building! >That's not true! I'm unimpressed now ;-) > >-Ross Love your h

RE: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Joseph L. Casale > > >Don't know? Where are you pvmoving everything now? > > Where do I begin... Scenario is "No cash to do it right" so > the interim step involves migration to a non fault tolerant > setup temporarily. Server is a 1u HP and I don't have another > controller that matches the r

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>Don't know? Where are you pvmoving everything now? Where do I begin... Scenario is "No cash to do it right" so the interim step involves migration to a non fault tolerant setup temporarily. Server is a 1u HP and I don't have another controller that matches the remaining interface in that small

RE: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Joseph L. Casale wrote: > > >What are you pvmoving again? > > > >-Ross > > Ok, here is what happened: I have a box running iet exporting > an LV that started out as two 750 gig HD's mirrored off an 8 > channel LSI SAS controller. I needed more space, and added 3 > 400 gig HD's in a r5 vd to th

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>What are you pvmoving again? > >-Ross Ok, here is what happened: I have a box running iet exporting an LV that started out as two 750 gig HD's mirrored off an 8 channel LSI SAS controller. I needed more space, and added 3 400 gig HD's in a r5 vd to this VG. Yes, I now need even more space, but

RE: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Joseph L. Casale wrote: > > >I don't believe pvmove actually does any of the lifting. Pvmove > >merely creates a mirrored pv area in dev-mapper and then hangs > >around monitoring it's progress until the mirror is sync'd up > >then it throws a couple of barriers and removes the original > >pv from

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>I don't believe pvmove actually does any of the lifting. Pvmove >merely creates a mirrored pv area in dev-mapper and then hangs >around monitoring it's progress until the mirror is sync'd up >then it throws a couple of barriers and removes the original >pv from the mirror leaving the new pv as the

RE: [CentOS] pvmove speed

2008-02-13 Thread Ross S. W. Walker
Joseph L. Casale wrote: > > Are there any ways to improve/manage the speed of pvmove? Man > doesn't show any documented switches for priority scheduling. > Iostat shows the system way underutilized even though the lv > whose pe's are being migrated is continuously being written > (slowly) to.

RE: [CentOS] pvmove speed

2008-02-13 Thread Joseph L. Casale
>Running iostat like this will give you utilisation statistics since boot, >which will not be inidicative of what's happening now. If you give it a >reporting interval, say 10 seconds (iostat -m -x >10), I am guessing you will >see very different data (likely high r/s, w/s, await, and derived va

RE: [CentOS] pvmove speed

2008-02-13 Thread Bowie Bailey
Joseph L. Casale wrote: > > Not very impressive :) Two different SATA II based arrays on an LSI > controller, 5% complete in ~7 hours == a week to complete! I ran this > command from an ssh session from my workstation (That was clearly a > dumb move). Given the robustness of the pvmove command I h

Re: [CentOS] pvmove speed

2008-02-13 Thread Luke Dudney
On 13/02/2008 05:24, Joseph L. Casale wrote: But I really have a hunch that it is just a lot of I/O wait time due to either metadata maintenance and checkpointing and/or I/O failures, which have very long timeouts before failure is recognized and *then* alternate block assignment and mapping is d

RE: [CentOS] pvmove speed

2008-02-12 Thread William L. Maltby
On Tue, 2008-02-12 at 22:24 -0700, Joseph L. Casale wrote: > >But I really have a hunch that it is just a lot of I/O wait time due to > >either metadata maintenance and checkpointing and/or I/O failures, which > >have very long timeouts before failure is recognized and *then* > >alternate block ass

RE: [CentOS] pvmove speed

2008-02-12 Thread Joseph L. Casale
>But I really have a hunch that it is just a lot of I/O wait time due to >either metadata maintenance and checkpointing and/or I/O failures, which >have very long timeouts before failure is recognized and *then* >alternate block assignment and mapping is done. One of the original arrays just needs

RE: [CentOS] pvmove speed

2008-02-12 Thread William L. Maltby
On Tue, 2008-02-12 at 20:41 -0700, Joseph L. Casale wrote: > >You could "nice" it. "man nice". Since there is likely to be a lot of > >I/O happening, it may not help much. > > Ok, here's a noob question :) - What process would I nice? If you run pvmove from the command line, "nice -20 pvmove" for

RE: [CentOS] pvmove speed

2008-02-12 Thread Joseph L. Casale
>You could "nice" it. "man nice". Since there is likely to be a lot of >I/O happening, it may not help much. Ok, here's a noob question :) - What process would I nice? >If the drives are on the same channel, or other devices on the channel >are also flooding the channel, that would be expected. D

Re: [CentOS] pvmove speed

2008-02-12 Thread William L. Maltby
On Tue, 2008-02-12 at 19:57 -0700, Joseph L. Casale wrote: > > Iostat shows the system way underutilized even though the lv whose > pe's are being migrated is continuously being written (slowly) to. I finally thought about that last line. Makes since because meta-data tracking must be done as va

Re: [CentOS] pvmove speed

2008-02-12 Thread William L. Maltby
Sorry 'bout that previous one. Wrong key combo hit! On Tue, 2008-02-12 at 19:57 -0700, Joseph L. Casale wrote: > Are there any ways to improve/manage the speed of pvmove? Not that I am aware of. Keep in mind that a *lot* of work is being done. You could "nice" it. "man nice". Since there is like

Re: [CentOS] pvmove speed

2008-02-12 Thread William L. Maltby
On Tue, 2008-02-12 at 19:57 -0700, Joseph L. Casale wrote: > Are there any ways to improve/manage the speed of pvmove? Man doesn't show > any documented switches for priority scheduling. > Iostat shows the system way underutilized even though the lv whose pe's are > being migrated is continuously