Re: [Gluster-users] Backup Strategy
Thanks! ZFS brings up another question about encrypting data. Is there a feature in gluster that helps with encrypting data when it's written to the file system? On Wed, Mar 9, 2011 at 2:17 PM, Liam Slusser wrote: > Netbackup is great and can probably backup directly from a glusterFS > client mount, however, the license and software cost for a few clients > and one server/media server is nearly $50k. Not exactly cheap. Id > look into Amanda backup if I was on a budget and wanted to backup to > tape. > > Another option is to just do rsync your gluster cluster to a Sun > Solaris server with a ZFS partition. Then you can do nightly zfs > snapshots of your data (snapshots only save what changes so it uses > very little space). > > liam > > On Wed, Mar 9, 2011 at 11:40 AM, Mohit Anchlia wrote: >> Thanks! have you heard of netbackup? Our co. already has license for >> it. I think it can be used. >> >> On Wed, Mar 9, 2011 at 11:11 AM, Sabuj Pattanayek wrote: >>> I read the docs. But here you go : >>> >>> http://lmgtfy.com/?q=backuppc+howto >>> >>> On Wed, Mar 9, 2011 at 1:05 PM, Mohit Anchlia >>> wrote: Thanks! Is there a short blog or steps that I can look at. documentaion looks overwhelming at first look :) On Wed, Mar 9, 2011 at 10:53 AM, Sabuj Pattanayek wrote: > for the amount of features that you get with backuppc, it's worth the > fairly painless setup. Btw, we've found that it's better/faster to use > tar via backuppc (it supports rsync as well) to do the backups rather > than rsync in backuppc. Rsync can be really slow if you have > thousands/millions of files. > > On Wed, Mar 9, 2011 at 12:50 PM, Mohit Anchlia > wrote: >> Is there a problem with using just rsync vs backupcc? I need to read >> about backupcc and how easy it is to setup. > >>> ___ >>> Gluster-users mailing list >>> Gluster-users@gluster.org >>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>> >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
Netbackup is great and can probably backup directly from a glusterFS client mount, however, the license and software cost for a few clients and one server/media server is nearly $50k. Not exactly cheap. Id look into Amanda backup if I was on a budget and wanted to backup to tape. Another option is to just do rsync your gluster cluster to a Sun Solaris server with a ZFS partition. Then you can do nightly zfs snapshots of your data (snapshots only save what changes so it uses very little space). liam On Wed, Mar 9, 2011 at 11:40 AM, Mohit Anchlia wrote: > Thanks! have you heard of netbackup? Our co. already has license for > it. I think it can be used. > > On Wed, Mar 9, 2011 at 11:11 AM, Sabuj Pattanayek wrote: >> I read the docs. But here you go : >> >> http://lmgtfy.com/?q=backuppc+howto >> >> On Wed, Mar 9, 2011 at 1:05 PM, Mohit Anchlia wrote: >>> Thanks! Is there a short blog or steps that I can look at. >>> documentaion looks overwhelming at first look :) >>> >>> On Wed, Mar 9, 2011 at 10:53 AM, Sabuj Pattanayek wrote: for the amount of features that you get with backuppc, it's worth the fairly painless setup. Btw, we've found that it's better/faster to use tar via backuppc (it supports rsync as well) to do the backups rather than rsync in backuppc. Rsync can be really slow if you have thousands/millions of files. On Wed, Mar 9, 2011 at 12:50 PM, Mohit Anchlia wrote: > Is there a problem with using just rsync vs backupcc? I need to read > about backupcc and how easy it is to setup. >>> >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
Thanks! have you heard of netbackup? Our co. already has license for it. I think it can be used. On Wed, Mar 9, 2011 at 11:11 AM, Sabuj Pattanayek wrote: > I read the docs. But here you go : > > http://lmgtfy.com/?q=backuppc+howto > > On Wed, Mar 9, 2011 at 1:05 PM, Mohit Anchlia wrote: >> Thanks! Is there a short blog or steps that I can look at. >> documentaion looks overwhelming at first look :) >> >> On Wed, Mar 9, 2011 at 10:53 AM, Sabuj Pattanayek wrote: >>> for the amount of features that you get with backuppc, it's worth the >>> fairly painless setup. Btw, we've found that it's better/faster to use >>> tar via backuppc (it supports rsync as well) to do the backups rather >>> than rsync in backuppc. Rsync can be really slow if you have >>> thousands/millions of files. >>> >>> On Wed, Mar 9, 2011 at 12:50 PM, Mohit Anchlia >>> wrote: Is there a problem with using just rsync vs backupcc? I need to read about backupcc and how easy it is to setup. >>> >> > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
I read the docs. But here you go : http://lmgtfy.com/?q=backuppc+howto On Wed, Mar 9, 2011 at 1:05 PM, Mohit Anchlia wrote: > Thanks! Is there a short blog or steps that I can look at. > documentaion looks overwhelming at first look :) > > On Wed, Mar 9, 2011 at 10:53 AM, Sabuj Pattanayek wrote: >> for the amount of features that you get with backuppc, it's worth the >> fairly painless setup. Btw, we've found that it's better/faster to use >> tar via backuppc (it supports rsync as well) to do the backups rather >> than rsync in backuppc. Rsync can be really slow if you have >> thousands/millions of files. >> >> On Wed, Mar 9, 2011 at 12:50 PM, Mohit Anchlia >> wrote: >>> Is there a problem with using just rsync vs backupcc? I need to read >>> about backupcc and how easy it is to setup. >> > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
Thanks! Is there a short blog or steps that I can look at. documentaion looks overwhelming at first look :) On Wed, Mar 9, 2011 at 10:53 AM, Sabuj Pattanayek wrote: > for the amount of features that you get with backuppc, it's worth the > fairly painless setup. Btw, we've found that it's better/faster to use > tar via backuppc (it supports rsync as well) to do the backups rather > than rsync in backuppc. Rsync can be really slow if you have > thousands/millions of files. > > On Wed, Mar 9, 2011 at 12:50 PM, Mohit Anchlia wrote: >> Is there a problem with using just rsync vs backupcc? I need to read >> about backupcc and how easy it is to setup. > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
for the amount of features that you get with backuppc, it's worth the fairly painless setup. Btw, we've found that it's better/faster to use tar via backuppc (it supports rsync as well) to do the backups rather than rsync in backuppc. Rsync can be really slow if you have thousands/millions of files. On Wed, Mar 9, 2011 at 12:50 PM, Mohit Anchlia wrote: > Is there a problem with using just rsync vs backupcc? I need to read > about backupcc and how easy it is to setup. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
Is there a problem with using just rsync vs backupcc? I need to read about backupcc and how easy it is to setup. On Wed, Mar 9, 2011 at 10:45 AM, Burnash, James wrote: > I think the answer to that problem is to back up from a machine that has the > native Gluster client mount the data that needs to be backed up - that way > you don't have to worry about replicas and attributes. > > Of course this seems to indicate that you would need to restore the same way > ... but I'm not positive about that. > > James Burnash, Unix Engineering > > -Original Message- > From: gluster-users-boun...@gluster.org > [mailto:gluster-users-boun...@gluster.org] On Behalf Of Mohit Anchlia > Sent: Wednesday, March 09, 2011 1:39 PM > To: Sabuj Pattanayek; gluster-users@gluster.org > Subject: Re: [Gluster-users] Backup Strategy > > One confusion I have is when maintaining multiple bricks on multiple > physical volume and a replica also how do we do effective backups? > > So if I have 4 node glusterfs cluster and replica of 2 then how do I > effectively do the backups such that I don't backup multiple copies or > overwrite files when doing backups. > > On Wed, Mar 9, 2011 at 10:34 AM, Sabuj Pattanayek wrote: >> If you want to do backup to disk then I highly recommend backuppc . >> >> On Wed, Mar 9, 2011 at 12:16 PM, Mohit Anchlia >> wrote: >>> I would like to hear from experienced users of glusterFS about how >>> they are currently doing backups. I am looking at solutions but not >>> sure which one to use and how to effectively use them. First thing >>> comes to my mind is using rsync. >>> >>> Please advice. >>> ___ >>> Gluster-users mailing list >>> Gluster-users@gluster.org >>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >>> >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > > > DISCLAIMER: > This e-mail, and any attachments thereto, is intended only for use by the > addressee(s) named herein and may contain legally privileged and/or > confidential information. If you are not the intended recipient of this > e-mail, you are hereby notified that any dissemination, distribution or > copying of this e-mail, and any attachments thereto, is strictly prohibited. > If you have received this in error, please immediately notify me and > permanently delete the original and any copy of any e-mail and any printout > thereof. E-mail transmission cannot be guaranteed to be secure or error-free. > The sender therefore does not accept liability for any errors or omissions in > the contents of this message which arise as a result of e-mail transmission. > NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its > discretion, monitor and review the content of all e-mail communications. > http://www.knight.com > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
I think the answer to that problem is to back up from a machine that has the native Gluster client mount the data that needs to be backed up - that way you don't have to worry about replicas and attributes. Of course this seems to indicate that you would need to restore the same way ... but I'm not positive about that. James Burnash, Unix Engineering -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Mohit Anchlia Sent: Wednesday, March 09, 2011 1:39 PM To: Sabuj Pattanayek; gluster-users@gluster.org Subject: Re: [Gluster-users] Backup Strategy One confusion I have is when maintaining multiple bricks on multiple physical volume and a replica also how do we do effective backups? So if I have 4 node glusterfs cluster and replica of 2 then how do I effectively do the backups such that I don't backup multiple copies or overwrite files when doing backups. On Wed, Mar 9, 2011 at 10:34 AM, Sabuj Pattanayek wrote: > If you want to do backup to disk then I highly recommend backuppc . > > On Wed, Mar 9, 2011 at 12:16 PM, Mohit Anchlia wrote: >> I would like to hear from experienced users of glusterFS about how >> they are currently doing backups. I am looking at solutions but not >> sure which one to use and how to effectively use them. First thing >> comes to my mind is using rsync. >> >> Please advice. >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this in error, please immediately notify me and permanently delete the original and any copy of any e-mail and any printout thereof. E-mail transmission cannot be guaranteed to be secure or error-free. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its discretion, monitor and review the content of all e-mail communications. http://www.knight.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
This probably doesn't help, but I only use the GlusterFS to store copies of data already sourced and archived somewhere else - except for the read-write activity, which is really all considered scratch space - even though I'd have some pretty peeved users if they lost it all. James Burnash, Unix Engineering T. 201-239-2248 jburn...@knight.com | www.knight.com 545 Washington Ave. | Jersey City, NJ -Original Message- From: gluster-users-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] On Behalf Of Mohit Anchlia Sent: Wednesday, March 09, 2011 1:16 PM To: gluster-users@gluster.org Subject: [Gluster-users] Backup Strategy I would like to hear from experienced users of glusterFS about how they are currently doing backups. I am looking at solutions but not sure which one to use and how to effectively use them. First thing comes to my mind is using rsync. Please advice. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users DISCLAIMER: This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this in error, please immediately notify me and permanently delete the original and any copy of any e-mail and any printout thereof. E-mail transmission cannot be guaranteed to be secure or error-free. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its discretion, monitor and review the content of all e-mail communications. http://www.knight.com ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
One confusion I have is when maintaining multiple bricks on multiple physical volume and a replica also how do we do effective backups? So if I have 4 node glusterfs cluster and replica of 2 then how do I effectively do the backups such that I don't backup multiple copies or overwrite files when doing backups. On Wed, Mar 9, 2011 at 10:34 AM, Sabuj Pattanayek wrote: > If you want to do backup to disk then I highly recommend backuppc . > > On Wed, Mar 9, 2011 at 12:16 PM, Mohit Anchlia wrote: >> I would like to hear from experienced users of glusterFS about how >> they are currently doing backups. I am looking at solutions but not >> sure which one to use and how to effectively use them. First thing >> comes to my mind is using rsync. >> >> Please advice. >> ___ >> Gluster-users mailing list >> Gluster-users@gluster.org >> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users >> > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] Backup Strategy
If you want to do backup to disk then I highly recommend backuppc . On Wed, Mar 9, 2011 at 12:16 PM, Mohit Anchlia wrote: > I would like to hear from experienced users of glusterFS about how > they are currently doing backups. I am looking at solutions but not > sure which one to use and how to effectively use them. First thing > comes to my mind is using rsync. > > Please advice. > ___ > Gluster-users mailing list > Gluster-users@gluster.org > http://gluster.org/cgi-bin/mailman/listinfo/gluster-users > ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
[Gluster-users] Backup Strategy
I would like to hear from experienced users of glusterFS about how they are currently doing backups. I am looking at solutions but not sure which one to use and how to effectively use them. First thing comes to my mind is using rsync. Please advice. ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
