Re: [BackupPC-users] FS and backuppc performance
With the amount of data I reported and number of files I just have 6% of inodes occupied so I don't think that is really a problem, do you use XFS for any special purpose besides dynamic inode creation? What do you think about recovery and maintenance tools for XFS. And least but not lest don't you have a bigger processor overhead with XFS? Usually people tend to say processor is not important while backing up but from what I've seen if you have like 8 or more hosts backing up data the processor and memory are stressed up. if you have to manage a FS with a large processor demand can't this be a bottleneck? Cheers, Pedro M. S. Oliveira On Wednesday 18 March 2009 19:30:33 Carl Wilhelm Soderstrom wrote: On 03/18 05:48 , Pedro M. S. Oliveira wrote: What FS do you guys use recommend/used and why? I typically use XFS for backuppc data pools, and ext3 for the root filesystem. I don't want to run out of inodes like ext3 can do. :) -- -- Pedro M. S. Oliveira IT Consultant Email: pmsolive...@gmail.com URL: http://pedro.linux-geex.com Cellular: +351 96 5867227 -- -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] FS and backuppc performance
On 03/19 11:56 , Pedro M. S. Oliveira wrote: With the amount of data I reported and number of files I just have 6% of inodes occupied so I don't think that is really a problem, do you use XFS for any special purpose besides dynamic inode creation? The ability to be resized while mounted is good as well; tho I don't use it much. There may be a performance improvement over ext3; tho it's very hard to say. (Backuppc is a fairly unusual load situation; and hard to benchmark well). I've not noticed a performance problem from it. I used to use reiserfs on backuppc installations; but after a couple of years, some corruption bugs turned up which made me abandon it. I didn't want to go back to the inode limitations of ext3 tho; so I went with XFS. Usually people tend to say processor is not important while backing up but Backuppc will use all the processor, ram, and disk speed you give it. I've not had a box where they weren't all pegged. I tend to limit concurrent backups to 2; maybe 3 or 4 on a really high-end box (multiple processors and a proven fast disk array); to control disk-head thrashing. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] FS and backuppc performance
Carl Wilhelm Soderstrom wrote: Backuppc will use all the processor, ram, and disk speed you give it. I've not had a box where they weren't all pegged. I tend to limit concurrent backups to 2; maybe 3 or 4 on a really high-end box (multiple processors and a proven fast disk array); to control disk-head thrashing. One thing I think is missing from backuppc that amanda has had for years is a concept of grouping (or excluding...) by network connectivity. I have a mix of local and remote targets and would like to be able to control concurrency to permit 1 or 2 local backups plus separate limits for each independent WAN path. -- Les Mikesell lesmikes...@gmail.com -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] FS and backuppc performance
2009/3/18 Pedro M. S. Oliveira pmsolive...@gmail.com: From what I've seen on the list there are some people using XFS, Ext3, and so on. What's your experience with the different file systems? What FS do you guys use recommend/used and why? We use XFS on a 3-disk raid 5 (3x500gb). Just because we're used to using XFS and it performs well with a lot of small files. cheers stoffell -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] FS and backuppc performance
Hi all! I'm running backuppc in several installations and sites and i'm very pleased with it, one of the sites has more than 3TB compressed data and about 6.000.000 files. Backupps run very well fast and reliable. My question is about FS performance. From what I've seen on the list there are some people using XFS, Ext3, and so on. What's your experience with the different file systems? For now I'm using ext3 and I don't have much of problems with one exception, some time ago backuppc server was rebooted for kernel and system security update (after being up for 8 months). And on boot a filecheck run on the backuppc data partition and it took almost 2 days to run, lots of inconsistency found and lots of corrections needed. Ext3 was running with noatime, nodiratime,and data mode is journaled. after that i tested some recoveries that went perfect and since then i don't have a prob, but to be sincere I didn't like to see the filecheck run like that and data getting corrupted like that too. BTW I'm using 8 sata drives in a hardware raid 5 (raid utilities say raid status is fine as well as the hard drives). I'm a SuSE fan and for years I used reiserfs that i loved and never game me problems the problem is that reiserfs is not maintained as it used to be... What FS do you guys use recommend/used and why? Cheers Pedro -- -- Pedro M. S. Oliveira IT Consultant Email: pmsolive...@gmail.com URL: http://pedro.linux-geex.com Cellular: +351 96 5867227 -- -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] FS and backuppc performance
On 03/18 05:48 , Pedro M. S. Oliveira wrote: What FS do you guys use recommend/used and why? I typically use XFS for backuppc data pools, and ext3 for the root filesystem. I don't want to run out of inodes like ext3 can do. :) -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
