Re: [BackupPC-users] Best NAS device to run BackupPC ?
Timothy J Massey wrote at about 14:00:43 -0400 on Tuesday, May 17, 2011: Jeffrey J. Kosowsky backu...@kosowsky.org wrote on 05/17/2011 01:11:16 PM: I haven't noticed any NFS problems due to hard links. I get approximately the same speed of transfer operations when I am reading/writing regular file or massively hard-linked ones. In my experience, the issue with hard links (e.g., rsync copying of the pool) has nothing to do with NFS (or any file system for that matter). Do you have any data supporting your claim that NFS suffers more than other filesystems with massive hard links? Again, the only issue I have with NFS is that it is relatively slow when accessing large numbers of small files due to the protocol overhead. But even so, it is quite workable even on a 100MHz ethernet. Woah! I take it all back! Feel free to use NFS: go nuts. Is NFS' honor now sufficiently defended?!? lots hyperbole and other stuff snipped Woah Woah Woah :) I never claimed NFS was particularly fast or better than other solutions -- I was just addressing your seemingly unsupported blanket statement that you didn't think anyone had gotten BackupPC to work with NFS and that NFS suffers particularly badly from hard links -- because the fact is that rightly or wrongly *many* people actually do run BackupPC over NFS and it works just fine as long as you have a non-buggy NFS driver. Furthermore, I am not aware of any corner cases (as you call them) that would cause BackupPC over NFS to fail in any unexpected way and I have not experienced any issue with hard links. So I merely asked whether you have data to support your blanket assertions -- I was not claiming that NFS is any better (or worse) than other similar situations -- in fact, I readily admit that there are other network based filesystems that are likely to be superior. I would be interested in any data or even anecdotes you have to back up your assertions about NFS being buggy or unworkable for BackupPC -- otherwise, let's end this thread... -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best NAS device to run BackupPC ?
Carl Wilhelm Soderstrom wrote at about 15:02:37 -0500 on Tuesday, May 17, 2011: On 05/17 02:30 , Les Mikesell wrote: On 5/17/2011 2:06 PM, Carl Wilhelm Soderstrom wrote: My advice is to get a 3ware RAID card and whatever disks you like for it. There's some sharp corners on the management interface; but at least it *has* a management interface that's consistent and sensible compared to the Dell crap I've had to suffer through (on the occasions I could get it to work). That's good advice for large arrays or more complex raid levels, but with the current price of disks it is pretty hard to justify compared to simple mirroring. And I've always liked the fact that in the case of software raid1 you can recover the data from any single disk connected to any physically compatible interface even if that's all that is left of the original setup. I found it to be a lot easier to deal with booting off a 3ware controller than to reliably get redundant boot records on software RAID. That's the main reason I prefer a hardware RAID controller. As always, YMMV, and it's good to have choices and options. True... But I was under the impression that for smaller systems one is better off with software RAID since with hardware RAID if your card dies then you may be stuck with a proprietary inaccessible RAID unless you can find another similar hardware RAID card... -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best NAS device to run BackupPC ?
In case of performance there could be other point of view. Everyone lay stress on fast backups but for me performance is not a goal. In my company there are many laptops (all windows) so I don't have time for backing up after hours. Furthermore great speed of BackupPC server comes with great client load. People are complaining and sometimes it is hard to explain that there is no need to reinstall windows because backup slows computer down. So I use combination of VSS (Shadow Copy) and slow backups in background. In such case and relatively small number of clients there is no need for very fast processor and maybe some NAS device will suits you just fine. Tom. lmirg...@microworld.org pisze: Thanks Tomasz, I am not too afraid by the installation issues - even though I would prefer something working out-of-the-box (or not far from that). I am more afraid by the performance problems - and I wonder how it would work on a more recent system. We have a lot of data, and it would be good to have a reasonably fast system. --- Laurent On Tue, May 17, 2011 at 5:07 PM, Tomasz Pawlik t...@mtl.one.pl mailto:t...@mtl.one.pl wrote: Hi Laurent, I have installed BackupPC on my very low-cost Synology DS110j. My device is running DSM 3.0 and optware perl. Installation was not easy at all and I think it will be the same on other Synology devices. Performance is also rather poor since my NAS has 128MB of RAM and very little processor ;) You can forget about pool compression and more then two simultaneous backups. Despite that I'm very satisfied with this setup because I have 24 hours for doing my backups and performance is not an issue. Device is small, quiet and low power consuming. Tom. lmirg...@microworld.org mailto:lmirg...@microworld.org pisze: Hello backuppc-users, I would like to backup all the machines of my company (12 laptops, Windows/Mac/Linux) in a centralized way on a NAS device. I like a lot BackupPC and if possible I would like to use it to run the backups. Now comes the choice of the NAS... What NAS device would you recommend with a good ratio performance / easy to install BackupPC on it ? The ideal situation would be a NAS with BackupPC pre-installed - or a NAS with some available BackupPC packages ready to deploy. I looked at Synology / QNap / WD Sharespace but in each case the install of BackupPC seems tedious, and I'm not sure of the performances I will get on such devices... Thanks for your advices and your help --- Laurent -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net mailto:BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net mailto:BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Achieve unprecedented app performance and reliability What every C/C++ and Fortran developer should know. Learn how Intel has extended the reach of its next-generation tools to help boost performance applications - inlcuding clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list
Re: [BackupPC-users] Best NAS device to run BackupPC ?
On Wed, 2011-05-18 at 02:45 -0400, Jeffrey J. Kosowsky wrote: Carl Wilhelm Soderstrom wrote at about 15:02:37 -0500 on Tuesday, May 17, 2011: I found it to be a lot easier to deal with booting off a 3ware controller than to reliably get redundant boot records on software RAID. That's the main reason I prefer a hardware RAID controller. But I was under the impression that for smaller systems one is better off with software RAID since with hardware RAID if your card dies then you may be stuck with a proprietary inaccessible RAID unless you can find another similar hardware RAID card... I run five BackupPC servers, each archiving from 7 to 70 hosts. Two of them run on 3ware RAID, two of them using Linux software raid (md raid), and one uses no RAID at all. I've had no trouble getting any of them to boot, moving disks between them, or recovering. Yes, you would need another 3ware card handy if you had to recover disks from another 3ware-based system. If you're serious about your backups you have a standby backup server anyway, with the same specs. mdadm is fine, stable, and fast enough for most needs. Even on your boot device. I've even written a guide for moving your boot device from no raid to software raid (not BackupPC specific): http://www.tolaris.com/2008/10/01/moving-your-linux-root-partition-to-raid/ Regards, Tyler -- It seems logical to me that he who supports total war in principle cannot complain of war against civilians. -- Fr. John A. Siemes -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] How to know backups stored or not
Dear all, I configured BackupPC in ubuntu 10.10 after i have some problem like how to see it is backup or not and i want see my backup files how to see my backup files Thanks Audi -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Backuppc Path session setup failed: NT_STATUS_LOGON_FAILURE
Dear all How to check witch location stored in backup files and directory's how to check the path and one more thing some system are creating backup structure and some system are not creating the structure error is Xfer PIDs are now 4045,4044 session setup failed: NT_STATUS_LOGON_FAILURE session setup failed: NT_STATUS_LOGON_FAILURE tarExtract: Done: 0 errors, 0 filesExist, 0 sizeExist, 0 sizeExistComp, 0 filesTotal, 0 sizeTotal Got fatal error during xfer (No files dumped for share pacews032) Backup aborted (No files dumped for share pacews032) Not saving this as a partial backup since it has fewer files than the prior one (got 0 and 0 files versus 0) Thanks Audi -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best NAS device to run BackupPC ?
On 05/18 02:45 , Jeffrey J. Kosowsky wrote: But I was under the impression that for smaller systems one is better off with software RAID since with hardware RAID if your card dies then you may be stuck with a proprietary inaccessible RAID unless you can find another similar hardware RAID card... There are always tradeoffs. :) 3ware cards aren't hard to come by. Administrator time is. (These of course are relative statements and YMMV). If you have the hardware within kicking range you have a different set of problems than I do (most of my backuppc instances are effectively 'lights out' operations). -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] How to know backups stored or not
On 5/18/11 6:27 AM, Audi Narayana Reddy wrote: Dear all, I configured BackupPC in ubuntu 10.10 after i have some problem like how to see it is backup or not and i want see my backup files how to see my backup files Log into the web interface as the backuppc user. The files land under /var/lib/backuppc/pc/host_name but they are compressed and the file names are mangled so it is harder to access them directly. You might want to practice using the BackupPC_tarCreate command line tool, though. -- Les Mikesell lesmikes...@gmail.com -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] How to know backups stored or not
Dear all Thanks for replay but I have some problem like while i am going to this path bash: cd: /var/lib/backuppc/: Permission denied and one more thing all client systems are xp systems and i have another problem also problem is while i create a new host i have problem session setup failed: NT_STATUS_LOGON_FAILURE Backup Summary Click on the backup number to browse and restore backup files. Backup# Type Filled Level Start Date Duration/mins Age/days Server Backup Path Xfer Error Summary Backup# Type View #Xfer errs #bad files #bad share #tar errs File Size/Count Reuse Summary Existing files are those already in the pool; new files are those added to the pool. Empty files and SMB errors aren't counted in the reuse and new counts. Totals Existing Files New Files Backup# Type #Files Size/MB MB/sec #Files Size/MB #Files Size/MB Compression Summary Compression performance for files already in the pool and newly compressed files. Existing Files New Files Backup# Type Comp Level Size/MB Comp/MB Comp Size/MB Comp/MB Comp User Actions Backup Summary Click on the backup number to browse and restore backup files. Backup# Type Filled Level Start Date Duration/mins Age/days Server Backup Path Xfer Error Summary Backup# Type View #Xfer errs #bad files #bad share #tar errs File Size/Count Reuse Summary Existing files are those already in the pool; new files are those added to the pool. Empty files and SMB errors aren't counted in the reuse and new counts. Totals Existing Files New Files Backup# Type #Files Size/MB MB/sec #Files Size/MB #Files Size/MB Compression Summary Compression performance for files already in the pool and newly compressed files. Existing Files New Files Backup# Type Comp Level Size/MB Comp/MB Comp Size/MB Comp/MB Comp Thanks Audi Date: Wed, 18 May 2011 07:36:29 -0500 From: lesmikes...@gmail.com To: backuppc-users@lists.sourceforge.net Subject: Re: [BackupPC-users] How to know backups stored or not On 5/18/11 6:27 AM, Audi Narayana Reddy wrote: Dear all, I configured BackupPC in ubuntu 10.10 after i have some problem like how to see it is backup or not and i want see my backup files how to see my backup files Log into the web interface as the backuppc user. The files land under /var/lib/backuppc/pc/host_name but they are compressed and the file names are mangled so it is harder to access them directly. You might want to practice using the BackupPC_tarCreate command line tool, though. -- Les Mikesell lesmikes...@gmail.com -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Best NAS device to run BackupPC ?
Hi, Jeffrey J. Kosowsky wrote on 2011-05-18 02:41:15 -0400 [Re: [BackupPC-users] Best NAS device to run BackupPC ?]: [...] let's end this thread... great idea, I second that! Timothy's point, as I understand it, was that if you *do* have buggy NFS implementations, you have the choice of either putting time into fixing that or putting time into implementing a different option (iSCSI, ATAoE), and that not everyone enjoys the challenge of hacking a proprietary NAS device. You do, and that's fine. I wouldn't, but I spend time on other topics where I *know* there's a simple solution or workaround readily available, but I prefer to go the complicated way - just for fun or for good reasons. Your experience seems to indicate that NAS devices occasionally *do* have buggy NFS implementations and other pitfalls, right? ;-) I believe many if not all options have been pointed out, so let's either find something we *really* disagree on or move on ... Regards, Holger -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] How to know backups stored or not
Hi, Audi Narayana Reddy wrote on 2011-05-18 18:49:54 +0530 [Re: [BackupPC-users] How to know backups stored or not]: Thanks for replay is this a replay attack? but I have some problem like while i am going to this path bash: cd: /var/lib/backuppc/: Permission denied Please note: not all questions are on-topic on this list, just because you happen to have BackupPC installed on your computer. You need a basic understanding of using a Linux computer. Teaching you that is beyond the scope (and aim) of this list. I'm sure there are lots of helpful resources to be found. If not, start by reading manual pages (try 'man man'). while i create a new host i have problem session setup failed: NT_STATUS_LOGON_FAILURE You also need a basic understanding of using a Windoze computer (if that's what you're backing up). Hint: you're not using a user name/password combination the computer knows. Backup Summary [...] Is that just a random quote, or was there a point to that? Hope that helps [us]. Regards, Holger -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC and MooseFS?
On 05/17 01:25 , Mike wrote: Has anyone tried using BackupPC and MooseFS (http://www.moosefs.org/)? Thanks for the link. That looks like a pretty cool project. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] BackupPC and MooseFS?
On 5/18/2011 3:21 PM, Carl Wilhelm Soderstrom wrote: On 05/17 01:25 , Mike wrote: Has anyone tried using BackupPC and MooseFS (http://www.moosefs.org/)? Thanks for the link. That looks like a pretty cool project. I've been hoping someone would write a fuse layer on top of riak (a distributed, clustered DB that doesn't need a master node). There is something called luwak that handles files as streams, but because the chunking step hashes the key from the chunk contents (and thus deduplicates with no reference counting) you can't ever delete anything. -- Les Mikesell lesmikes...@gmail.com -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Backuppc and FlexRaid?
Will backuppc work with FlexRaid? I am sure it will not from a windows (ntfs) host, but I think flexraid can be installed under linux, so it might work? -- What Every C/C++ and Fortran developer Should Know! Read this article and learn how Intel has extended the reach of its next-generation tools to help Windows* and Linux* C/C++ and Fortran developers boost performance applications - including clusters. http://p.sf.net/sfu/intel-dev2devmay___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
