Re: [gentoo-user] IDE RAID 0 and 1

2004-01-19 Thread Jimmy Rosen
I have some experience with
3ware
Promise
kernel SW raid

Promise:
I started with a promise 6000 card and after serious problems with that 
card I decided to abandon that path.
Primarily the card is largely incompatible with the AMD 760 chipset as far 
as I've been able to conclude. I use dual athlon MP for most customer 
cluster nodes.
Secondarily the serious tech support, while _very_ eager to help are 
situated in China and, believe it or not, are forbidden to access certain 
useful websites e.g. the openmosix site. So while we had some very 
interesting problems trying to smuggle kernel sources back and forth 
through their bizzaro imposed cencorship I finally got too tired of 
working with it.

3ware:
I've built a 4x120GB raid 5 to serve as main storage for a cluster I built 
for a customer. It works very nicely. I'm disappointed with the 
performance, only about 15MB/s. Anyone else got better results?
It is well supported in vanilla and openmosix sources.
The only problem I've had with this card is that it has dropped single 
disks twice in 12 months. After replacing and testing I have found nothing 
wrong with the disks, but I cannot really trust them after being dropped 
from the raid. Rebuilding is a breeze.

Kernel SW raid:
One customer wanted a very cheap storage solution for the cluster I built 
him. So I deployed a 2x120GB raid 1 on kernel SW raid.
Very simple setup, very simple management, good general cheap solution.


Harebraman
Jimmy

CSOL research


--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-16 Thread Terje Kvernes
Collins Richey [EMAIL PROTECTED] writes:

 On Tue, 13 Jan 2004 20:20:40 +0100
 Jimmy Rosen [EMAIL PROTECTED] wrote:
 
  Kernel SW raid: One customer wanted a very cheap storage solution
  for the cluster I built him. So I deployed a 2x120GB raid 1 on
  kernel SW raid.  Very simple setup, very simple management, good
  general cheap solution.
 
 How was performance in comparison to the Hardware alternatives?

  for RAID1, kernel software RAID is just as good as hardware.  modern
  CPUs are a _lot_ more powerful than what you find on the cheap
  RAID1-cards, and the overhead isn't noticeable.  another upside,
  with software RAID1 you can unplug any of the drives, install it on
  another system without having to think about RAID controllers and
  mount the drive. 

  that last part is the reason we chose software RAID1 for the servers
  that have it here.  RAID0 and RAID5 are different beasts though.

-- 
Terje

--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-14 Thread Mike Williams
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Monday 12 January 2004 20:37, Andrew Gaffney wrote:

 With the kernel software RAID, what would I need to do in order to move an
 existing system over to the RAID? I have 2 identical 120GB HD's. The second
 is just backup. I have a script that runs every night and rsync's from HD1
 to HD2. I want to move to RAID-1 with minimal system downtime as this is a
 production server.

http://www.tldp.org's software raid howto has instructions on how to do this, 
and they work!
It says it's for RedHat but worked nicely on my 2.6.1 gentoo desktop.
I skipped the bits about booting off a rescue cd as I was only doing this on 
my /home partition. No need to create /dev entries as devfs takes care of 
that, and haven't bothered changing the partition type, works ok so far, but 
I haven't yet rebooted.

- -- 
Mike Williams
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.2.3 (GNU/Linux)

iD8DBQFABTe6InuLMrk7bIwRAhIkAKCBKT51vW2c4jOURR2ZTWHMdkT+yACeNnYb
eGkRX74MyNhWFLIh6aeN/iI=
=7gBk
-END PGP SIGNATURE-

--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-14 Thread Andrew Gaffney
Mike Williams wrote:
On Monday 12 January 2004 20:37, Andrew Gaffney wrote:


With the kernel software RAID, what would I need to do in order to move an
existing system over to the RAID? I have 2 identical 120GB HD's. The second
is just backup. I have a script that runs every night and rsync's from HD1
to HD2. I want to move to RAID-1 with minimal system downtime as this is a
production server.


http://www.tldp.org's software raid howto has instructions on how to do this, 
and they work!
It says it's for RedHat but worked nicely on my 2.6.1 gentoo desktop.
I skipped the bits about booting off a rescue cd as I was only doing this on 
my /home partition. No need to create /dev entries as devfs takes care of 
that, and haven't bothered changing the partition type, works ok so far, but 
I haven't yet rebooted.
That's definately good to hear.

--
Andrew Gaffney
System Administrator
Skyline Aeronautics, LLC.
776 North Bell Avenue
Chesterfield, MO 63005
636-357-1548
--
[EMAIL PROTECTED] mailing list


Re: [gentoo-user] IDE RAID 0 and 1

2004-01-14 Thread Alec Shaner
On Wed, 14 Jan 2004 00:43:05 +0200
Sami Näätänen [EMAIL PROTECTED] wrote:

 PS. I has integrated ide raid which is half HW half SW from ITE. It 
 works well and is quite speedy too. Under normal system load (mp3 
 listening etc) two ibm 120GB HD's as RAID 1 gives these results. 
 Smaller result from the two consecutive runs.
 
 high-voltage /home/sami # hdparm -tT /dev/sda
 /dev/sda:
  Timing buffer-cache reads:   2712 MB in  2.00 seconds = 1356.00 MB/sec
  Timing buffered disk reads:  140 MB in  3.00 seconds =  43.56 MB/sec
 

On my P4P800 system with 3 drives, here are stats

3ware Escalade 7006 card connected to 32 bit PCI 2.2 with 133MB/s max transfer, 2 WD 
80GB Caviar drives RAID 1

# hdparm -tT /dev/sda
/dev/sda:
 Timing buffer-cache reads:   2956 MB in  2.00 seconds = 1478.00 MB/sec
 Timing buffered disk reads:  138 MB in  3.01 seconds =  45.85 MB/sec

80GB WD Caviar single drive connected to IDE on MB:

# hdparm -tT /dev/hda
/dev/hda:
 Timing buffer-cache reads:   2908 MB in  2.00 seconds = 1454.00 MB/sec
 Timing buffered disk reads:  140 MB in  3.02 seconds =  46.36 MB/sec

This is a dev machine where I'm not too concerned about performance, and I don't know 
if these numbers are good or bad (relative to other IDE RAID solutions)...just posting 
the stats. Not much load when I ran the tests.



--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-13 Thread Alec Shaner
On Mon, 12 Jan 2004 11:48:38 -0600
Andrew Gaffney [EMAIL PROTECTED] wrote:

 I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0 and/or 1 
 under 
 Linux. Can anyone recommend anything? Thanks.
 

I recently installed a 3ware Escalade 7006 card (cheap one $) running RAID 1 in my 
gentoo system and so far am very pleased with it. I didn't convert my existing HD, I 
added two new HDs and just moved certain partitions (not the root or boot) to RAID. I 
stayed away from Adaptec IDE cards because so many other gentooists on the forums had 
problems with them.

--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-13 Thread Al Smith
HP has a card called a netraid-1 for their netserver product line that does 
decent hardware raid controlling.

-Al

At 01:23 PM 1/13/2004 -0500, you wrote:
On Mon, 12 Jan 2004 11:48:38 -0600
Andrew Gaffney [EMAIL PROTECTED] wrote:
 I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0 
and/or 1 under
 Linux. Can anyone recommend anything? Thanks.


I recently installed a 3ware Escalade 7006 card (cheap one $) running RAID 
1 in my gentoo system and so far am very pleased with it. I didn't convert 
my existing HD, I added two new HDs and just moved certain partitions (not 
the root or boot) to RAID. I stayed away from Adaptec IDE cards because so 
many other gentooists on the forums had problems with them.

--
[EMAIL PROTECTED] mailing list


--
[EMAIL PROTECTED] mailing list


Re: [gentoo-user] IDE RAID 0 and 1

2004-01-13 Thread Jimmy Rosen
I have some experience with the following:
3ware
Promise
kernel SW raid

Promise:
I once started with a promise 6000 card and after serious problems with 
that card I decided to abandon that path.
Primarily the card is largely incompatible with the AMD 760 chipset as far 
as I've been able to conclude. I use dual athlon MP for most customer 
cluster nodes.
Secondarily the serious tech support, while _very_ eager to help are 
situated in China and, believe it or not, are forbidden to access certain 
useful websites e.g. the openmosix site. So while we had some very 
interesting problems trying to smuggle kernel sources back and forth 
through their bizzaro imposed cencorship I finally got too tired of 
working with it.

3ware:
I've built a 4x120GB raid 5 to serve as main storage for a cluster I built 
for a customer. It works very nicely. I'm disappointed with the 
performance, only about 15MB/s. Anyone else got better results?
It is well supported in vanilla and openmosix sources.
The only problem I've had with this card is that it has dropped single 
disks twice in 12 months. After replacing and testing I have found nothing 
wrong with the disks, but I cannot really trust them after being dropped 
from the raid. Rebuilding is a breeze.

Kernel SW raid:
One customer wanted a very cheap storage solution for the cluster I built 
him. So I deployed a 2x120GB raid 1 on kernel SW raid.
Very simple setup, very simple management, good general cheap solution.


Harebraman
Jimmy

CSOL research



--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-13 Thread Elton Algera
On Mon, 2004-01-12 at 22:57, Alan wrote:
 On Mon, Jan 12, 2004 at 02:37:53PM -0600, Andrew Gaffney wrote:
  Ciaran McCreesh wrote:
  On Mon, 12 Jan 2004 11:48:38 -0600 Andrew Gaffney
  [EMAIL PROTECTED] wrote:
  | I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0
  | and/or 1 under Linux. Can anyone recommend anything? Thanks.
  
  If you *really* want 'IDE RAID', you have to get a 3ware. The promise
  and highpoint drivers are just silly software hacks.
  
  On the other hand, in-kernel md raid is faster for IDE anyway, and
  doesn't lock you in to a specific vendor.
  
  With the kernel software RAID, what would I need to do in order to move an 
  existing system over to the RAID? I have 2 identical 120GB HD's. The second 
  is just backup. I have a script that runs every night and rsync's from HD1 
  to HD2. I want to move to RAID-1 with minimal system downtime as this is a 
  production server.
 
 If you want to move to raid 1 from a single disk there's a bit of a
 procedure to go through.  Hopefully others can add onto this for me, as
 I've never done it myself (completely anyway).  First of all, check the
 howto:
 http://www.tldp.org/HOWTO/Software-RAID-HOWTO-7.html#ss7.6
 It has one way to do it (redhat specific, but should give you some good
 pointers that are compatible with gentoo and a liveCD :)
 
 Basically what you'll do is set up *one* of the two disks for raid,
 setting the other as 'failed-disk' in the raidtab.  Start up the raid
 and it'll be running in degraded mode (1/2 disks available).  At this
 point you can copy data across from your real disk.  Setup grub or
 lilo so that your system will boot from /dev/md0 instead of /dev/hda1,
 then change your fstab to match up.  Then you can reboot (I think) and
 because raid1 is redundant you can leave your old hard drive alone
 without having to nuke it as you would if you were going to raid5 or
 raid0.  Once things are set up properly and working from the raid disk,
 you can set the old disk to be integrated into the raid array and then
 hot-add it in, let it resync (mirror the data) and you're golden.
 
 Disclaimer: I haven't done this, never tried it, and quite possibly
 missed some very important step, so don't hold me responsible for things
 totally screwing up and destroying everything :)  Backup first, etc etc.
 However, the gist of what is above *should* work :)


Hi,

I tried the above procedure with raid on loop devices and with User mode
linux and it worked...

However, the performance was not so good ;-)






--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-13 Thread Collins Richey
On Tue, 13 Jan 2004 20:20:40 +0100
Jimmy Rosen [EMAIL PROTECTED] wrote:


 Kernel SW raid:
 One customer wanted a very cheap storage solution for the cluster I built 
 him. So I deployed a 2x120GB raid 1 on kernel SW raid.
 Very simple setup, very simple management, good general cheap solution.
 

How was performance in comparison to the Hardware alternatives?

-- 
Collins - Denver Area
Gentoo stable plus kernel 2.6.1-mm2

--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-13 Thread Sami Näätänen
On Tuesday 13 January 2004 21:20, Jimmy Rosen wrote:
 I have some experience with the following:
 3ware
 Promise
 kernel SW raid

 Promise:
 I once started with a promise 6000 card and after serious problems
 with that card I decided to abandon that path.
 Primarily the card is largely incompatible with the AMD 760 chipset
 as far as I've been able to conclude. I use dual athlon MP for most
 customer cluster nodes.
 Secondarily the serious tech support, while _very_ eager to help are
 situated in China and, believe it or not, are forbidden to access
 certain useful websites e.g. the openmosix site. So while we had some
 very interesting problems trying to smuggle kernel sources back and
 forth through their bizzaro imposed cencorship I finally got too
 tired of working with it.

 3ware:
 I've built a 4x120GB raid 5 to serve as main storage for a cluster I
 built for a customer. It works very nicely. I'm disappointed with the
 performance, only about 15MB/s. Anyone else got better results? It is

The problem most likely is the fact that it used normal PCI bus, which 
really is not even closely enough for even single disk access.
Those 3ware cards are really fast and good when plugged to 64bit PCI-X 
bus working at 133 MHz speed, but to normal PCI there simply can't be a 
speedy PCI ide raid, because the PCI bus is too slow.


PS. I has integrated ide raid which is half HW half SW from ITE. It 
works well and is quite speedy too. Under normal system load (mp3 
listening etc) two ibm 120GB HD's as RAID 1 gives these results. 
Smaller result from the two consecutive runs.

high-voltage /home/sami # hdparm -tT /dev/sda
/dev/sda:
 Timing buffer-cache reads:   2712 MB in  2.00 seconds = 1356.00 MB/sec
 Timing buffered disk reads:  140 MB in  3.00 seconds =  43.56 MB/sec



--
[EMAIL PROTECTED] mailing list



[gentoo-user] IDE RAID 0 and 1

2004-01-12 Thread Andrew Gaffney
I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0 and/or 1 under 
Linux. Can anyone recommend anything? Thanks.

--
Andrew Gaffney
System Administrator
Skyline Aeronautics, LLC.
776 North Bell Avenue
Chesterfield, MO 63005
636-357-1548
--
[EMAIL PROTECTED] mailing list


Re: [gentoo-user] IDE RAID 0 and 1

2004-01-12 Thread Matthew Baxa
On Mon, 2004-01-12 at 11:48, Andrew Gaffney wrote:
 I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0 and/or 1 
 under 
 Linux. Can anyone recommend anything? Thanks.

3ware
http:://www.3ware.com

-- 
Matthew Baxa [EMAIL PROTECTED]
http://massachusetts.dce.ksu.edu/~mbaxa/
Applications Services Assistant
K-State University  Office of Mediated Education
http://www.dce.ksu.edu

Public key ID:  982330F8
Public key available at:  www.keyserver.net


signature.asc
Description: This is a digitally signed message part


Re: [gentoo-user] IDE RAID 0 and 1

2004-01-12 Thread Kim Ingemann
On Mon, 2004-01-12 at 18:48, Andrew Gaffney wrote:
 I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0 and/or 1 
 under 
 Linux. Can anyone recommend anything? Thanks.

Both the 3Ware and Promise controllers works fine for me under Linux.

-- 
Med venlig hilsen / Best regards,

Kim Ingemann
http://pingvinland.dk/


signature.asc
Description: This is a digitally signed message part


RE: [gentoo-user] IDE RAID 0 and 1

2004-01-12 Thread Tony Larco
From what I've read, the kernel software RAID for Linux was almost as fast
or faster than some IDE RAID Controllers.  Something to consider!

-Original Message-
From: Andrew Gaffney [mailto:[EMAIL PROTECTED] 
Sent: Monday, January 12, 2004 12:49 PM
To: Gentoo User
Subject: [gentoo-user] IDE RAID 0 and 1

I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0
and/or 1 under 
Linux. Can anyone recommend anything? Thanks.

-- 
Andrew Gaffney
System Administrator
Skyline Aeronautics, LLC.
776 North Bell Avenue
Chesterfield, MO 63005
636-357-1548


--
[EMAIL PROTECTED] mailing list

--
[EMAIL PROTECTED] mailing list



Re: [gentoo-user] IDE RAID 0 and 1

2004-01-12 Thread Andrew Gaffney
Ciaran McCreesh wrote:
On Mon, 12 Jan 2004 11:48:38 -0600 Andrew Gaffney
[EMAIL PROTECTED] wrote:
| I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0
| and/or 1 under Linux. Can anyone recommend anything? Thanks.
If you *really* want 'IDE RAID', you have to get a 3ware. The promise
and highpoint drivers are just silly software hacks.
On the other hand, in-kernel md raid is faster for IDE anyway, and
doesn't lock you in to a specific vendor.
With the kernel software RAID, what would I need to do in order to move an existing system 
over to the RAID? I have 2 identical 120GB HD's. The second is just backup. I have a 
script that runs every night and rsync's from HD1 to HD2. I want to move to RAID-1 with 
minimal system downtime as this is a production server.

--
Andrew Gaffney
System Administrator
Skyline Aeronautics, LLC.
776 North Bell Avenue
Chesterfield, MO 63005
636-357-1548
--
[EMAIL PROTECTED] mailing list


Re: [gentoo-user] IDE RAID 0 and 1

2004-01-12 Thread Alan
On Mon, Jan 12, 2004 at 02:37:53PM -0600, Andrew Gaffney wrote:
 Ciaran McCreesh wrote:
 On Mon, 12 Jan 2004 11:48:38 -0600 Andrew Gaffney
 [EMAIL PROTECTED] wrote:
 | I'm looking for a decent PCI IDE RAID card that can do hardware RAID 0
 | and/or 1 under Linux. Can anyone recommend anything? Thanks.
 
 If you *really* want 'IDE RAID', you have to get a 3ware. The promise
 and highpoint drivers are just silly software hacks.
 
 On the other hand, in-kernel md raid is faster for IDE anyway, and
 doesn't lock you in to a specific vendor.
 
 With the kernel software RAID, what would I need to do in order to move an 
 existing system over to the RAID? I have 2 identical 120GB HD's. The second 
 is just backup. I have a script that runs every night and rsync's from HD1 
 to HD2. I want to move to RAID-1 with minimal system downtime as this is a 
 production server.

If you want to move to raid 1 from a single disk there's a bit of a
procedure to go through.  Hopefully others can add onto this for me, as
I've never done it myself (completely anyway).  First of all, check the
howto:
http://www.tldp.org/HOWTO/Software-RAID-HOWTO-7.html#ss7.6
It has one way to do it (redhat specific, but should give you some good
pointers that are compatible with gentoo and a liveCD :)

Basically what you'll do is set up *one* of the two disks for raid,
setting the other as 'failed-disk' in the raidtab.  Start up the raid
and it'll be running in degraded mode (1/2 disks available).  At this
point you can copy data across from your real disk.  Setup grub or
lilo so that your system will boot from /dev/md0 instead of /dev/hda1,
then change your fstab to match up.  Then you can reboot (I think) and
because raid1 is redundant you can leave your old hard drive alone
without having to nuke it as you would if you were going to raid5 or
raid0.  Once things are set up properly and working from the raid disk,
you can set the old disk to be integrated into the raid array and then
hot-add it in, let it resync (mirror the data) and you're golden.

Disclaimer: I haven't done this, never tried it, and quite possibly
missed some very important step, so don't hold me responsible for things
totally screwing up and destroying everything :)  Backup first, etc etc.
However, the gist of what is above *should* work :)

-- 
Alan [EMAIL PROTECTED] - http://arcterex.net

There are only 3 real sports: bull-fighting, car racing and mountain 
climbing. All the others are mere games.-- Hemingway

--
[EMAIL PROTECTED] mailing list