Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
I tried to flac a wav file yesterday on my ReadyNAS Duo (base model). It was pitiful. Far quicker (i.e. 10 *) from my fairly ordinary (Celeron 2.6 GHz single core) NFS client connection to the data on the NAS. Definitely a processor set up for file serving only. I guess these units were built before the Atom. With either whatever the CPU is (cpuid won't apt-get) or the Atom, power (sorry, slaps wrist, I mean _energy_) consumption is largely the discs. Big difference on the meter (http://www.altronics.com.au/index.asp?area=itemid=K4600) when they spin down. Kevin. On Thu, 2009-11-12 at 07:38 +1100, James Polley wrote: The newer models (x39, where x is the number of disks) have atom processors; reportedly much faster and less power-hungry. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
Daniel Pittman wrote: Sridhar Dhanapalan srid...@dhanapalan.com writes: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: Save the environment - buy a NAS. (my mirrored 2-disc NAS averages about 20 W) That's a good suggestion. My reluctance to use a NAS myself stems from the perception of less configurability. Yup. If you want something capable of the flexibility of a real OS your options are very limited. OTOH, do you really *need* that level of flexibility from your storage system? Are they any good and affordable NAS solutions out there that allow a decent level of configurability and permissions-setting? The Linksys NSS[46]000 series are entirely Linux underneath, and fully source-available. I have not actually used the hardware, but we prototyped one ages ago and found it acceptable. Otherwise, the DLINK DNS-[24]32 devices can also run Linux, or... D Link do run linux, but hard to do anything on them, I wanted to do rsync, but it only accepts ftp. Ken OTOH, my preference would be to purchase external bulk storage in some sort of NAS that did NFS[1], or perhaps that offered eSATA, and run it through the central server *if* I needed a fancy set of permissions. Daniel Footnotes: [1] Limited options, sadly, though any of the named ones should, and I believe the Drobo stuff does too. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
On 11/11/2009, at 23:41, Ken Wilson kenwi...@ozemail.com.au wrote: Daniel Pittman wrote: Sridhar Dhanapalan srid...@dhanapalan.com writes: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: Save the environment - buy a NAS. (my mirrored 2-disc NAS averages about 20 W) That's a good suggestion. My reluctance to use a NAS myself stems from the perception of less configurability. Yup. If you want something capable of the flexibility of a real OS your options are very limited. OTOH, do you really *need* that level of flexibility from your storage system? Are they any good and affordable NAS solutions out there that allow a decent level of configurability and permissions-setting? I have a qnap ts-409 pro. It (and all qnap's other models) runs a cut- down openwrt-style Linux by default - but stock debian runs fine on it as well (http://www.cyrius.com/debian/orion/qnap/ts-409/) The newer models (x39, where x is the number of disks) have atom processors; reportedly much faster and less power-hungry. The Linksys NSS[46]000 series are entirely Linux underneath, and fully source-available. I have not actually used the hardware, but we prototyped one ages ago and found it acceptable. Otherwise, the DLINK DNS-[24]32 devices can also run Linux, or... D Link do run linux, but hard to do anything on them, I wanted to do rsync, but it only accepts ftp. Ken OTOH, my preference would be to purchase external bulk storage in some sort of NAS that did NFS[1], or perhaps that offered eSATA, and run it through the central server *if* I needed a fancy set of permissions. Daniel Footnotes: [1] Limited options, sadly, though any of the named ones should, and I believe the Drobo stuff does too. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
Ken Wilson kenwi...@ozemail.com.au writes: Daniel Pittman wrote: Sridhar Dhanapalan srid...@dhanapalan.com writes: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: [...] Otherwise, the DLINK DNS-[24]32 devices can also run Linux, or... D Link do run linux, but hard to do anything on them, I wanted to do rsync, but it only accepts ftp. http://lmgtfy.com/?q=dlink+dns-232+rsync Regards, Daniel -- ✣ Daniel Pittman✉ dan...@rimspace.net☎ +61 401 155 707 ♽ made with 100 percent post-consumer electrons -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
Daniel Pittman wrote: Ken Wilson kenwi...@ozemail.com.au writes: Daniel Pittman wrote: Sridhar Dhanapalan srid...@dhanapalan.com writes: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: [...] Otherwise, the DLINK DNS-[24]32 devices can also run Linux, or... D Link do run linux, but hard to do anything on them, I wanted to do rsync, but it only accepts ftp. http://lmgtfy.com/?q=dlink+dns-232+rsync Regards, Daniel thanks daniel There has been progress. Fun_plug was not reliably working on 343 at the time I bought dns-343. Required upgrading firmware to one that had been put up on web but withdrawn. So in the end I used it as was. Looks like I have a project to revisit. Ken -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
+1 QNAP. A lot of the QNAPS can be modified to run debian linux. 2009/11/12 Ken Wilson kenwi...@ozemail.com.au: Daniel Pittman wrote: Ken Wilson kenwi...@ozemail.com.au writes: Daniel Pittman wrote: Sridhar Dhanapalan srid...@dhanapalan.com writes: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: [...] Otherwise, the DLINK DNS-[24]32 devices can also run Linux, or... D Link do run linux, but hard to do anything on them, I wanted to do rsync, but it only accepts ftp. http://lmgtfy.com/?q=dlink+dns-232+rsync Regards, Daniel thanks daniel There has been progress. Fun_plug was not reliably working on 343 at the time I bought dns-343. Required upgrading firmware to one that had been put up on web but withdrawn. So in the end I used it as was. Looks like I have a project to revisit. Ken -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
f its myth, it performs better with your drives as simple partitions. mythvideo will support multiple video directories (check this) mythtv uses storage groups to record and playback with better performance. I set my myth up thusly. 3x 320gb drives (somewhat old, it has had a few 1tb drives added since) all 3 drives are partitioned the same \boot , 200mb raid 1 ext3 \, 10gb raid 5 xfs, you might think about reiser or ext4 for this on 9.10. swap, 1gb raid0 \var\lib\mythtv xfs (pick one drive to do this to) using linux software raid, as a result I have moved this install through a few systems. I leave the rest of the space empty during install then i partition the remaining space on each drive as xfs (good for large files) i mount those partitions as /var/lib/mythpool/1 /var/lib/mythpool/2 mkdir /var/lib/mythpool/1/recordings mkdir /var/lib/mythpool/1/video etc then go into myth and edit the storage groups to add /var/lib/mythpool/1/recordings to the general recordings pool and the same for video. if you want to add another drive you just stick it in, partition it and tell myth about it. stick videos on whichever drive has the most free space at the time. Mike Andy wrote: Ok so i'm trying to figure out what to do with all my data when I upgrade and i've got more options and ideas than i know what to do with. At the moment I'm on an everything machine I'm considering breaking it up into two different machines. All this might be aside from the overall point but basically my desktop is my MythTV backend, MythTV frontend, a samba server, virtual box/vmware player, and general desktop. If i go ahead with splitting it up i'll probably put centOS or debian on the server and have it running Samba and MythTV backend. I'll get a bunch of WOL and ping/sleep idle scripts like i've already got running to and from the server to save power. MythTV and Samba shares are going from my desktop to another frontend hooked up to a TV downstairs for good times. on my desktop I've got 2 hard drives totalling a possible 2TB in LVM folders on my desktop of ripped DVDs and CDs etc.. My /videos folder is larger than a single hard drive it's self, that and the fact that I was on a budget is why i chose LVM. The 3rd hard drive is 300Gig and is not in LVM and is my OS hard drive (Arch Linux, Ubuntu, XP) So I'm recently getting more and more nervous about my OS hard drive crashing, and to a lesser extent one of the media drives crashing. So what should I do? At present I use clonezilla to backup my Arch OS to a spare partition (along with standard photo/document backups done) Could i get my OS hard drive and put it into RAID5? if so, how? I'm confused because I heard I can do RAID5 in software, though i don't understand how that would work or how to get it running across 3 or more different operating systems. I heard RAID is also something a motherboard can control too, actually i know nothing about RAID! Also is it possible to get LVM working inside a RAID5? I could do that for my data maybe? Sorry i'm a bit of a noob but i'm keen on learning, unfortunately i'm self taught so go easy on me! -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
Save the environment - buy a NAS. (my mirrored 2-disc NAS averages about 20 W) Cheers, Kevin On Sat, 2009-11-07 at 15:01 +1100, Mike Andy wrote: Ok so i'm trying to figure out what to do with all my data when I upgrade and i've got more options and ideas than i know what to do with. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
2009/11/8 Kevin Shackleton kev...@reachnet.com.au: Save the environment - buy a NAS. (my mirrored 2-disc NAS averages about 20 W) That's a good suggestion. My reluctance to use a NAS myself stems from the perception of less configurability. Are they any good and affordable NAS solutions out there that allow a decent level of configurability and permissions-setting? Something based on FOSS would be preferable. -- Bring choice back to your computer. http://www.linux.org.au/linux -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
Sridhar Dhanapalan srid...@dhanapalan.com writes: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: Save the environment - buy a NAS. (my mirrored 2-disc NAS averages about 20 W) That's a good suggestion. My reluctance to use a NAS myself stems from the perception of less configurability. Yup. If you want something capable of the flexibility of a real OS your options are very limited. OTOH, do you really *need* that level of flexibility from your storage system? Are they any good and affordable NAS solutions out there that allow a decent level of configurability and permissions-setting? The Linksys NSS[46]000 series are entirely Linux underneath, and fully source-available. I have not actually used the hardware, but we prototyped one ages ago and found it acceptable. Otherwise, the DLINK DNS-[24]32 devices can also run Linux, or... OTOH, my preference would be to purchase external bulk storage in some sort of NAS that did NFS[1], or perhaps that offered eSATA, and run it through the central server *if* I needed a fancy set of permissions. Daniel Footnotes: [1] Limited options, sadly, though any of the named ones should, and I believe the Drobo stuff does too. -- ✣ Daniel Pittman✉ dan...@rimspace.net☎ +61 401 155 707 ♽ made with 100 percent post-consumer electrons Looking for work? Love Perl? In Melbourne, Australia? We are hiring. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
Re: [SLUG] Data Redundancy, RAID5/LVM backup decisions
My ReadyNAS Duo runs Linux: kev...@mypc:/$ ssh mynas kev...@mynas:/$ uname -a Linux mynas 2.6.17.8ReadyNAS #1 Tue Jun 9 13:59:28 PDT 2009 padre \ unknown kev...@mynas:/$ free total used free sharedbuffers cached Mem:487808 453392 34416 0 94944 205840 -/+ buffers/cache: 152608 335200 Swap: 255968320 255648 (you have to run a patch from Netgear to access the system, since then I've seldom used the web interface) The processor is a little slow but is ok for me. I upgraded the RAM from 256 GB using a 2nd-hand 512 GB (only 1 slot. You might prefer a unit that does RAID5 rather than RAID1 but there's only a 50% increase in capacity when filling a box that will hold 4 discs from the basic 3 discs. I doubled my box's capacity by stepping: single 500 GB - as supplied 500 GB + 1 TB - 2nd drive provided under a promotion some weeks later 1 TB + 1 TB - for the cost of one drive I removed some plastic from the front of the caddies that used a wedge system to jump the caddy catch. When the wedge got a little dusty it all jammed up. Now I can jump the catch with a biro. One feature you may want that the Duo doesn't have but some boxes do is a 2nd Ethernet adapter. I presume with 2 adapters you can use the box to do some firewalling / DMZ sort of stuff. Cheers, Kevin. On Sun, 2009-11-08 at 15:51 +1100, Sridhar Dhanapalan wrote: 2009/11/8 Kevin Shackleton kev...@reachnet.com.au: Save the environment - buy a NAS. (my mirrored 2-disc NAS averages about 20 W) That's a good suggestion. My reluctance to use a NAS myself stems from the perception of less configurability. Are they any good and affordable NAS solutions out there that allow a decent level of configurability and permissions-setting? Something based on FOSS would be preferable. -- SLUG - Sydney Linux User's Group Mailing List - http://slug.org.au/ Subscription info and FAQs: http://slug.org.au/faq/mailinglists.html
