Re: ZFS info WAS: new backup server file system options
On 2012-12-21 11:28, Arthur Chance wrote: On 12/21/12 14:06, Paul Kraus wrote: On Dec 21, 2012, at 7:49 AM, yudi v wrote: I am building a new freebsd fileserver to use for backups, will be using 2 disk raid mirroring in a HP microserver n40l. I have gone through some of the documentation and would like to know what file systems to choose. According to the docs, ufs is suggested for the system partitions but someone on the freebsd irc channel suggested using zfs for the rootfs as well Are there any disadvantages of using zfs for the whole system rather than going with ufs for the system files and zfs for the user data? First a disclaimer, I have been working with Solaris since 1995 and managed lots of data under ZFS, I have only been working with FreeBSD for about the past 6 months. UFS is clearly very stable and solid, but to get redundancy you need to use a separate "volume manager". Slight correction here - you don't need a volume manager (as I understand the term), you'd use the GEOM subsystem, specifically gmirror in this case. See "man gmirror" for details ZFS is a completely different way of thinking about managing storage (not just a filesystem). I prefer ZFS for a number of reasons: 1) End to end data integrity through checksums. With the advent of 1 TB plus drives, the uncorrectable error rate (typically 10^-14 or 10^-15) means that over the life of any drive you *are* now likely to run into uncorrectable errors. This means that traditional volume managers (which rely on the drive reporting an bad reads and writes) cannot detect these errors and bad data will be returned to the application. 2) Simplicity of management. Since the volume management and filesystem layers have been combined, you don't have to manage each separately. 3) Flexibility of storage. Once you build a zpool, the filesystems that reside on it share the storage of the entire zpool. This means you don't have to decide how much space to commit to a given filesystem at creation. It also means that all the filesystems residing in that one zpool share the performance of all the drives in that zpool. 4) Specific to booting off of a ZFS, if you move drives around (as I tend to do in at least one of my lab systems) the bootloader can still find the root filesystem under ZFS as it refers to it by zfs device name, not physical drive device name. Yes, you can tell the bootloader where to find root if you move it, but zfs does that automatically. 5) Zero performance penalty snapshots. The only cost to snapshots is the space necessary to hold the data. I have managed systems with over 100,000 snapshots. I am running two production, one lab, and a bunch of VBox VMs all with ZFS. The only issue I have seen is one I have also seen under Solaris with ZFS. Certain kinds of hardware layer faults will cause the zfs management tools (the zpool and zfs commands) to hang waiting on a blocking I/O that will never return. The data continuos to be available, you just can't manage the zfs infrastructure until the device issues are cleared. For example, if you remove a USB drive that hosts a mounted ZFS, then any attempt to manage that ZFS device will hang (zpool export -f hangs until a reboot). Previously I had been running (at home) a fileserver under OpenSolaris using ZFS and it saved my data when I had multiple drive failures. At a certain client we had a 45 TB configuration built on top of 120 750GB drives. We had multiple redundancy and could survive a complete failure of 2 of the 5 disk enclosures (yes, we tested this in pre-production). There are a number of good writeups on how setup a FreeBSD system to boot off of ZFS, I like this one the best http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/9.0-RELEASE , but I do the zpool/zfs configuration slightly differently (based on some hard learned lessons on Solaris). I am writing up my configuration (and why I do it this way), but it is not ready yet. Make sure you look at all the information here: http://wiki.freebsd.org/ZFS , keeping in mind that lots of it was written before FreeBSD 9. I would NOT use ZFS, especially for booting, prior to release 9 of FreeBSD. Some of the reason for this is the bugs that were fixed in zpool version 28 (included in release 9). I would agree with all that. My current system uses UFS filesystems for the base install, and ZFS with a raidz zpool for everything else, but that's only because I started using ZFS in REL 8.0 when it was just out of experimental status, and I didn't want to risk having an unbootable system. (That last paragraph suggests I was wise in that decision.) My next machine I'm specing out now will be pure ZFS so I get the boot environment stuff. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd
Re: ZFS info WAS: new backup server file system options
On 12/21/12 14:06, Paul Kraus wrote: On Dec 21, 2012, at 7:49 AM, yudi v wrote: I am building a new freebsd fileserver to use for backups, will be using 2 disk raid mirroring in a HP microserver n40l. I have gone through some of the documentation and would like to know what file systems to choose. According to the docs, ufs is suggested for the system partitions but someone on the freebsd irc channel suggested using zfs for the rootfs as well Are there any disadvantages of using zfs for the whole system rather than going with ufs for the system files and zfs for the user data? First a disclaimer, I have been working with Solaris since 1995 and managed > lots of data under ZFS, I have only been working with FreeBSD for about the past > 6 months. UFS is clearly very stable and solid, but to get redundancy you need to use > a separate "volume manager". Slight correction here - you don't need a volume manager (as I understand the term), you'd use the GEOM subsystem, specifically gmirror in this case. See "man gmirror" for details ZFS is a completely different way of thinking about managing storage (not > just a filesystem). I prefer ZFS for a number of reasons: 1) End to end data integrity through checksums. With the advent of 1 TB plus > drives, the uncorrectable error rate (typically 10^-14 or 10^-15) means that > over the life of any drive you *are* now likely to run into uncorrectable errors. > This means that traditional volume managers (which rely on the drive reporting an > bad reads and writes) cannot detect these errors and bad data will be returned to > the application. 2) Simplicity of management. Since the volume management and filesystem layers > have been combined, you don't have to manage each separately. 3) Flexibility of storage. Once you build a zpool, the filesystems that reside > on it share the storage of the entire zpool. This means you don't have to decide > how much space to commit to a given filesystem at creation. It also means that all > the filesystems residing in that one zpool share the performance of all the drives > in that zpool. 4) Specific to booting off of a ZFS, if you move drives around (as I tend to do in > at least one of my lab systems) the bootloader can still find the root filesystem > under ZFS as it refers to it by zfs device name, not physical drive device name. > Yes, you can tell the bootloader where to find root if you move it, but zfs does > that automatically. 5) Zero performance penalty snapshots. The only cost to snapshots is the space > necessary to hold the data. I have managed systems with over 100,000 snapshots. I am running two production, one lab, and a bunch of VBox VMs all with ZFS. > The only issue I have seen is one I have also seen under Solaris with ZFS. Certain > kinds of hardware layer faults will cause the zfs management tools (the zpool and > zfs commands) to hang waiting on a blocking I/O that will never return. The data > continuos to be available, you just can't manage the zfs infrastructure until the > device issues are cleared. For example, if you remove a USB drive that hosts a > mounted ZFS, then any attempt to manage that ZFS device will hang (zpool export > -f hangs until a reboot). Previously I had been running (at home) a fileserver under OpenSolaris using > ZFS and it saved my data when I had multiple drive failures. At a certain client > we had a 45 TB configuration built on top of 120 750GB drives. We had multiple > redundancy and could survive a complete failure of 2 of the 5 disk enclosures (yes, > we tested this in pre-production). There are a number of good writeups on how setup a FreeBSD system to boot off > of ZFS, I like this one the best > http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/9.0-RELEASE , but I do the zpool/zfs > configuration slightly differently (based on some hard learned lessons on Solaris). > I am writing up my configuration (and why I do it this way), but it is not ready yet. Make sure you look at all the information here: http://wiki.freebsd.org/ZFS , > keeping in mind that lots of it was written before FreeBSD 9. I would NOT use ZFS, > especially for booting, prior to release 9 of FreeBSD. Some of the reason for this > is the bugs that were fixed in zpool version 28 (included in release 9). I would agree with all that. My current system uses UFS filesystems for the base install, and ZFS with a raidz zpool for everything else, but that's only because I started using ZFS in REL 8.0 when it was just out of experimental status, and I didn't want to risk having an unbootable system. (That last paragraph suggests I was wise in that decision.) My next machine I'm specing out now will be pure ZFS so I get the boot environment stuff. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freeb
ZFS info WAS: new backup server file system options
On Dec 21, 2012, at 7:49 AM, yudi v wrote: > I am building a new freebsd fileserver to use for backups, will be using 2 > disk raid mirroring in a HP microserver n40l. > I have gone through some of the documentation and would like to know what > file systems to choose. > > According to the docs, ufs is suggested for the system partitions but > someone on the freebsd irc channel suggested using zfs for the rootfs as > well > > Are there any disadvantages of using zfs for the whole system rather than > going with ufs for the system files and zfs for the user data? First a disclaimer, I have been working with Solaris since 1995 and managed lots of data under ZFS, I have only been working with FreeBSD for about the past 6 months. UFS is clearly very stable and solid, but to get redundancy you need to use a separate "volume manager". ZFS is a completely different way of thinking about managing storage (not just a filesystem). I prefer ZFS for a number of reasons: 1) End to end data integrity through checksums. With the advent of 1 TB plus drives, the uncorrectable error rate (typically 10^-14 or 10^-15) means that over the life of any drive you *are* now likely to run into uncorrectable errors. This means that traditional volume managers (which rely on the drive reporting an bad reads and writes) cannot detect these errors and bad data will be returned to the application. 2) Simplicity of management. Since the volume management and filesystem layers have been combined, you don't have to manage each separately. 3) Flexibility of storage. Once you build a zpool, the filesystems that reside on it share the storage of the entire zpool. This means you don't have to decide how much space to commit to a given filesystem at creation. It also means that all the filesystems residing in that one zpool share the performance of all the drives in that zpool. 4) Specific to booting off of a ZFS, if you move drives around (as I tend to do in at least one of my lab systems) the bootloader can still find the root filesystem under ZFS as it refers to it by zfs device name, not physical drive device name. Yes, you can tell the bootloader where to find root if you move it, but zfs does that automatically. 5) Zero performance penalty snapshots. The only cost to snapshots is the space necessary to hold the data. I have managed systems with over 100,000 snapshots. I am running two production, one lab, and a bunch of VBox VMs all with ZFS. The only issue I have seen is one I have also seen under Solaris with ZFS. Certain kinds of hardware layer faults will cause the zfs management tools (the zpool and zfs commands) to hang waiting on a blocking I/O that will never return. The data continuos to be available, you just can't manage the zfs infrastructure until the device issues are cleared. For example, if you remove a USB drive that hosts a mounted ZFS, then any attempt to manage that ZFS device will hang (zpool export -f hangs until a reboot). Previously I had been running (at home) a fileserver under OpenSolaris using ZFS and it saved my data when I had multiple drive failures. At a certain client we had a 45 TB configuration built on top of 120 750GB drives. We had multiple redundancy and could survive a complete failure of 2 of the 5 disk enclosures (yes, we tested this in pre-production). There are a number of good writeups on how setup a FreeBSD system to boot off of ZFS, I like this one the best http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/9.0-RELEASE , but I do the zpool/zfs configuration slightly differently (based on some hard learned lessons on Solaris). I am writing up my configuration (and why I do it this way), but it is not ready yet. Make sure you look at all the information here: http://wiki.freebsd.org/ZFS , keeping in mind that lots of it was written before FreeBSD 9. I would NOT use ZFS, especially for booting, prior to release 9 of FreeBSD. Some of the reason for this is the bugs that were fixed in zpool version 28 (included in release 9). -- Paul Kraus Deputy Technical Director, LoneStarCon 3 Sound Coordinator, Schenectady Light Opera Company ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
new backup server file system options
Hi all, I am building a new freebsd fileserver to use for backups, will be using 2 disk raid mirroring in a HP microserver n40l. I have gone through some of the documentation and would like to know what file systems to choose. According to the docs, ufs is suggested for the system partitions but someone on the freebsd irc channel suggested using zfs for the rootfs as well Are there any disadvantages of using zfs for the whole system rather than going with ufs for the system files and zfs for the user data? -- Kind regards, Yudi ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
Re: ZFS based machine to build a backup server ?
On 29 November 2010 10:54, Arthur Chance wrote: > On 11/29/10 09:56, Frank Bonnet wrote: > >> Would it be safe to use a FreeBSD + ZFS based machine to build >> a backups server to store sensitive data ? >> >> In a word is FreeBSD + ZFS stable and mature ? >> > > That's a regular theological debate round here, and some people will say > yes, and others an emphatic no. I'm personally happy with ZFS raidz, others > prefer UFS + mirroring + journalling. > > Speaking with far too many years of experience as a sysadmin, no single > backup solution is ever truly adequate. You want off site backups as well as > on site. For the off site backups, take a look at tarsnap: > > http://www.tarsnap.com/ > > -- > "Although the wombat is real and the dragon is not, few know what a > wombat looks like, but everyone knows what a dragon looks like." > >-- Avram Davidson, _Adventures in Unhistory_ > > ___ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to " > freebsd-questions-unsubscr...@freebsd.org" > It does all come down to risk analysis. In my experience company politics have far to much influence on this than I like. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
Re: ZFS based machine to build a backup server ?
On 11/29/10 09:56, Frank Bonnet wrote: Would it be safe to use a FreeBSD + ZFS based machine to build a backups server to store sensitive data ? In a word is FreeBSD + ZFS stable and mature ? That's a regular theological debate round here, and some people will say yes, and others an emphatic no. I'm personally happy with ZFS raidz, others prefer UFS + mirroring + journalling. Speaking with far too many years of experience as a sysadmin, no single backup solution is ever truly adequate. You want off site backups as well as on site. For the off site backups, take a look at tarsnap: http://www.tarsnap.com/ -- "Although the wombat is real and the dragon is not, few know what a wombat looks like, but everyone knows what a dragon looks like." -- Avram Davidson, _Adventures in Unhistory_ ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
Re: ZFS based machine to build a backup server ?
On Mon, Nov 29, 2010 at 10:56 AM, Frank Bonnet wrote: > In a word is FreeBSD + ZFS stable and mature ? > Yes. But do it with a machine with a lot of memory and run 64bit. -- chs, ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
ZFS based machine to build a backup server ?
Hello Would it be safe to use a FreeBSD + ZFS based machine to build a backups server to store sensitive data ? In a word is FreeBSD + ZFS stable and mature ? Thanks ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscr...@freebsd.org"
pure freebsd as backup server or freenas?
Hi folks, I'm expecting to receive two harddisks which I've bought to put in a old pc to act as backup server. Now I'm planning it all and got stuck because of the options and particularly I'm having the following two choices: a) install a pure freebsd 6.1 box with geom/geli capabilities b) install freenas (www.freenas.org) Can somebody share his/her feelings regarding this matter? What are the advantages/disadvantages of both solutions? I guess I would really like to have a stable environment and mirroring and encryption are important to mee. Hope somenody can help. Thanks Cheap talk? Check out Yahoo! Messenger's low PC-to-Phone call rates. http://voice.yahoo.com ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server with Freebsd 5.4. Help.
On 7/23/05, Hornet <[EMAIL PROTECTED]> wrote: > On 7/22/05, perikillo <[EMAIL PROTECTED]> wrote: > > On 7/22/05, lars <[EMAIL PROTECTED]> wrote: > > > perikillo wrote: > > > > Hi people. > > > > > > > > I like to hear some experienced about this situation and see if > > > > is possible: > > > > > > > >We have in the company i work, one backup system running Windows NT > > > > 4 with some Seagate Backup Exec 7.8 over one SCSI system HP SuRestore > > > > Ultrium 230, this system has working good for some years, but next > > > > week we are going to receive one new Dell server running win server > > > > 2k3, this will be our PDC, and we need to get rid of Windows NT system > > > > backup, and i want to install the backup system with Freebsd 5.3 or > > > > 5.4 and bacula or another backup system that you now is working with > > > > my HP device. > > > > > > > >Them, i can use Freebsd 5.3 or 5.4 with my HP device with bacula or > > > > other software to > > > > backup files on my windows domain? The PDC is going to run win 2k3 > > > > here is going to be the files we want to backup. > > > Did you check www.bacula.org whether your tape drive is supported by > > > Bacula? Or how to setup Bacula on MS Windows? > > > > > > > > > >Yes, is supported, but the OS dosent appear, this way i want to > > knows if someone has this tape drive working with freebsd 5.3 or 5.4. > > > >About setup bacula under Redmond software, i dont want pay more > > license only to use it like backup system, this why i want to use > > freeebsd, to use one simply hardware and backup my windows files for > > windows 2003. > > > >Some has this configuration? > > > > I have always like the bacula software. I have not used it in about a > year though. This was on a w2k AD domain. The problem only I had using > it, was the MS agent. It had issues backing up MS systems files. I > just cron'd MSbackup to backup the system state to a SMB mount, and > used the agent for everything else. Also you will have to run the > agent as administrator or an account with-in the administrators group. > > If your HP device will work the app "mt" it should work with bacula. > Sometimes it will require a bit of hacking. > Thanks for the tip Hornet, it seens that is possible to setup this, i will start next week this work and if i have problems i will can back here or if everething goes perfect i will inform you guys. Thanks all for your comments, grettings. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server with Freebsd 5.4. Help.
On 7/22/05, perikillo <[EMAIL PROTECTED]> wrote: > On 7/22/05, lars <[EMAIL PROTECTED]> wrote: > > perikillo wrote: > > > Hi people. > > > > > > I like to hear some experienced about this situation and see if > > > is possible: > > > > > >We have in the company i work, one backup system running Windows NT > > > 4 with some Seagate Backup Exec 7.8 over one SCSI system HP SuRestore > > > Ultrium 230, this system has working good for some years, but next > > > week we are going to receive one new Dell server running win server > > > 2k3, this will be our PDC, and we need to get rid of Windows NT system > > > backup, and i want to install the backup system with Freebsd 5.3 or > > > 5.4 and bacula or another backup system that you now is working with > > > my HP device. > > > > > >Them, i can use Freebsd 5.3 or 5.4 with my HP device with bacula or > > > other software to > > > backup files on my windows domain? The PDC is going to run win 2k3 > > > here is going to be the files we want to backup. > > Did you check www.bacula.org whether your tape drive is supported by > > Bacula? Or how to setup Bacula on MS Windows? > > > > > >Yes, is supported, but the OS dosent appear, this way i want to > knows if someone has this tape drive working with freebsd 5.3 or 5.4. > >About setup bacula under Redmond software, i dont want pay more > license only to use it like backup system, this why i want to use > freeebsd, to use one simply hardware and backup my windows files for > windows 2003. > >Some has this configuration? > I have always like the bacula software. I have not used it in about a year though. This was on a w2k AD domain. The problem only I had using it, was the MS agent. It had issues backing up MS systems files. I just cron'd MSbackup to backup the system state to a SMB mount, and used the agent for everything else. Also you will have to run the agent as administrator or an account with-in the administrators group. If your HP device will work the app "mt" it should work with bacula. Sometimes it will require a bit of hacking. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server with Freebsd 5.4. Help.
On 7/22/05, perikillo <[EMAIL PROTECTED]> wrote: > On 7/22/05, lars <[EMAIL PROTECTED]> wrote: > > perikillo wrote: > > > Hi people. > > > > > > I like to hear some experienced about this situation and see if > > > is possible: > > > > > >We have in the company i work, one backup system running Windows NT > > > 4 with some Seagate Backup Exec 7.8 over one SCSI system HP SuRestore > > > Ultrium 230, this system has working good for some years, but next > > > week we are going to receive one new Dell server running win server > > > 2k3, this will be our PDC, and we need to get rid of Windows NT system > > > backup, and i want to install the backup system with Freebsd 5.3 or > > > 5.4 and bacula or another backup system that you now is working with > > > my HP device. > > > > > >Them, i can use Freebsd 5.3 or 5.4 with my HP device with bacula or > > > other software to > > > backup files on my windows domain? The PDC is going to run win 2k3 > > > here is going to be the files we want to backup. > > Did you check www.bacula.org whether your tape drive is supported by > > Bacula? Or how to setup Bacula on MS Windows? > > > > > >Yes, is supported, but the OS dosent appear, this way i want to > knows if someone has this tape drive working with freebsd 5.3 or 5.4. > >About setup bacula under Redmond software, i dont want pay more > license only to use it like backup system, this why i want to use > freeebsd, to use one simply hardware and backup my windows files for > windows 2003. > >Some has this configuration? > I have always like the bacula software. I have not used it in about a year though. This was on a w2k AD domain. The problem only I had using it, was the MS agent. It had issues backing up MS systems files. I just cron'd MSbackup to backup the system state to a SMB mount, and used the agent for everything else. Also you will have to run the agent as administrator or an account with-in the administrators group. If your HP device will work the app "mt" it should work with bacula. Sometimes it will require a bit of hacking. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server with Freebsd 5.4. Help.
On 7/22/05, lars <[EMAIL PROTECTED]> wrote: > perikillo wrote: > > Hi people. > > > > I like to hear some experienced about this situation and see if > > is possible: > > > >We have in the company i work, one backup system running Windows NT > > 4 with some Seagate Backup Exec 7.8 over one SCSI system HP SuRestore > > Ultrium 230, this system has working good for some years, but next > > week we are going to receive one new Dell server running win server > > 2k3, this will be our PDC, and we need to get rid of Windows NT system > > backup, and i want to install the backup system with Freebsd 5.3 or > > 5.4 and bacula or another backup system that you now is working with > > my HP device. > > > >Them, i can use Freebsd 5.3 or 5.4 with my HP device with bacula or > > other software to > > backup files on my windows domain? The PDC is going to run win 2k3 > > here is going to be the files we want to backup. > Did you check www.bacula.org whether your tape drive is supported by > Bacula? Or how to setup Bacula on MS Windows? > > Yes, is supported, but the OS dosent appear, this way i want to knows if someone has this tape drive working with freebsd 5.3 or 5.4. About setup bacula under Redmond software, i dont want pay more license only to use it like backup system, this why i want to use freeebsd, to use one simply hardware and backup my windows files for windows 2003. Some has this configuration? Thanks. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server with Freebsd 5.4. Help.
perikillo wrote: Hi people. I like to hear some experienced about this situation and see if is possible: We have in the company i work, one backup system running Windows NT 4 with some Seagate Backup Exec 7.8 over one SCSI system HP SuRestore Ultrium 230, this system has working good for some years, but next week we are going to receive one new Dell server running win server 2k3, this will be our PDC, and we need to get rid of Windows NT system backup, and i want to install the backup system with Freebsd 5.3 or 5.4 and bacula or another backup system that you now is working with my HP device. Them, i can use Freebsd 5.3 or 5.4 with my HP device with bacula or other software to backup files on my windows domain? The PDC is going to run win 2k3 here is going to be the files we want to backup. Did you check www.bacula.org whether your tape drive is supported by Bacula? Or how to setup Bacula on MS Windows? ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Backup Server with Freebsd 5.4. Help.
Hi people. I like to hear some experienced about this situation and see if is possible: We have in the company i work, one backup system running Windows NT 4 with some Seagate Backup Exec 7.8 over one SCSI system HP SuRestore Ultrium 230, this system has working good for some years, but next week we are going to receive one new Dell server running win server 2k3, this will be our PDC, and we need to get rid of Windows NT system backup, and i want to install the backup system with Freebsd 5.3 or 5.4 and bacula or another backup system that you now is working with my HP device. Them, i can use Freebsd 5.3 or 5.4 with my HP device with bacula or other software to backup files on my windows domain? The PDC is going to run win 2k3 here is going to be the files we want to backup. Thanks in advanced. ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: BTX halted on backup server
On Sat, Nov 20, 2004 at 10:03:07PM -0800, Jeffrey S. Kaye wrote: > We have two servers, one mirrors the other. The backup server showed > the following a couple days ago. It's still down. Any ideas? The > primary is working just fine. > -jk > > FreeBSD/i386 bootstrap loader, Revision 0.8 > ([EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>, > Thu Apr 3 08:41:45 GMT 2003) > Loading /boot/defaults/loader.conf > /kernel text=0x171368 data=0x2342c+0x1bd08 > \ > Hit [Enter] to boot immediately, or any other key for command prompt. > Booting [kernel]... > - > int=000d err= efl=00010093 eip=002b200a > eax=0011e2e0 ebx= ecx=0003 edx=000274c0 > esi= edi=0003841c ebp=00094a7d esp=0009ea3f > cs=0008 ds=0010 es=0010 fs=0010 gs=0010 ss=0010 > cs:eip=6f 6e 73 6f 6c 65 3d 76-69 64 63 6f 6e 73 6f 6c > ss:esp=00 00 00 00 00 47 95 00-00 00 00 00 80 04 00 20 > BTX halted The boot loader cannot read the kernel from the disk drive into memory. That's pretty bad. Often it indicates that the disk has crashed. Or it could be a memory stick going AWOL. Or the CPU itself may have died. You need to investigate the machine to check if all of the hardware is in working order, and then depending on what you find, you probably need to reinstall and recover the system from backup. Try running memtest86 (http://www.memtest86.org/) from a floppy for several testing cycles: if memtest86 shows errors, then you've definitely got bad memory. If it doesn't show any errors, then you might still have bad memory, just beyond what memtest86 can detect; however that is quite rare. Next try booting from disk2 (from the installation media set) -- if that succeeds in booting and the memtest86 stuff ran OK then the CPU is probably OK. Then you can try running fsck(8) on all of the filesystems on your hard drive -- you may need to run it several times over the same partition. With luck you'll be able to get it to say 'filesystem clean'. Note that even if fsck(8) says the filesystem is clean, various files and directories may have disappeared, so recovering from backup once you've verified the hardware would be a good idea. Cheers, Matthew -- Dr Matthew J Seaman MA, D.Phil. 26 The Paddocks Savill Way PGP: http://www.infracaninophile.co.uk/pgpkey Marlow Tel: +44 1628 476614 Bucks., SL7 1TH UK pgpiKVMFjAyoA.pgp Description: PGP signature
BTX halted on backup server
We have two servers, one mirrors the other. The backup server showed the following a couple days ago. It's still down. Any ideas? The primary is working just fine. -jk FreeBSD/i386 bootstrap loader, Revision 0.8 ([EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>, Thu Apr 3 08:41:45 GMT 2003) Loading /boot/defaults/loader.conf /kernel text=0x171368 data=0x2342c+0x1bd08 \ Hit [Enter] to boot immediately, or any other key for command prompt. Booting [kernel]... - int=000d err= efl=00010093 eip=002b200a eax=0011e2e0 ebx= ecx=0003 edx=000274c0 esi= edi=0003841c ebp=00094a7d esp=0009ea3f cs=0008 ds=0010 es=0010 fs=0010 gs=0010 ss=0010 cs:eip=6f 6e 73 6f 6c 65 3d 76-69 64 63 6f 6e 73 6f 6c ss:esp=00 00 00 00 00 47 95 00-00 00 00 00 80 04 00 20 BTX halted ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
tape drive for backup server
Do any of you have experience with 200/400GB LTO scsi tape drives in general, and Dell's model in particular? I need opinions on reliability and speed. hal ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
man mysqldump and check out the man page for rsync at http://www.freebsd.org/cgi/man.cgi?query=rsync&apropos=0&sektion=0&manpath=FreeBSD+5.1-RELEASE+and+Ports&format=html you can dump the databases and use rsync on the single machine("client") to copy or pull the files/directories of your choosing from the "servers" to the "client". Please look at the man page and look at the scripts for rsync that were given in this thread. It is quite easy to setup. After looking back at one of your other replies, You don't need to have rsync running as a daemon on any of the machines. You just need to have rsync installed on all. Rsync will basically tunnel through ssh (or rsh if you want) to do the transfers(or synchronizations). --- Matthew Juszczak <[EMAIL PROTECTED]> wrote: > I'm not worried about down time. > > I'm strictly worrying about backing up: > > /home and /usr/local/mysql/var > > On server 1 and > > /home and /var/mail > > On Server 2. > > Thats it. > > Any ideas? Thanks! > > -Matt > On Mon, 2003-12-29 at 22:48, anubis wrote: > > On Sat, 27 Dec 2003 03:30 am, samy lancher wrote: > > > Hello all, > > > I have a 4.5 FreeBSD server. It is our Email, > web and database server. I > > > would like to setup a backup server so that when > the main server goes down > > > the backup server takes over its job. Could some > one please tell me the > > > best way to setup a backup server and also > suggest some good documentation. > > > > > > Thanks in advance, > > > Naveen. > > > > > > > > > - > > > Do you Yahoo!? > > > Protect your identity with Yahoo! Mail > AddressGuard > > > ___ > > > [EMAIL PROTECTED] mailing list > > > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > > To unsubscribe, send any mail to > > > "[EMAIL PROTECTED]" > > > > I have had a bit of a look into this myself and > this is my take on it. I > > would like to hear of other people experiences > too. > > > > There are a number of things that you have to > decide on first before you go > > any further. > > > > These are: > > budget > > how critical the system is to downtime > > how much data you are willing to lose > > how long are you willing to wait for the second > system to kick in. > > These will determine how you are going to build > your system. You will have to > > keep the answers in mind when you are looking at > any solution. > > > > What you seem to be looking for is a failover > system. There is a fair bit > > written about failover systems. Googling will > find you lots. Make sure that > > you look up linux high availability and failover > as well to get a broader > > view. I have added some links below. > > > > There is really 2 things that you are trying to do > here. Provide redundancy > > for the services and redundancy for the data. The > services are a bit easier > > and cheaper than the data. The big problem is the > data, especially > > databases. Due to their nature they cant easily > be copied while live. > > > > A solution to this is a SAN. With lots of money > it is easier as you can buy > > yourself a SAN and hook the two machines to it and > host the data on the SAN. > > With some clever scripts from those HA sites when > one machine goes down the > > other can take over and use the same data. There > are other solutions using a > > fancy Y shaped SCSI cable to a external drive > array. Others my be able to > > help here as I dont know about them. > > > > The other alternative is 2 identical machines. > > When you have 2 machines with the master storing > data on its local drives it > > gets tricker. This is where you have to decide on > how much data you are > > willing to lose. > > > > As an example we have a bsd box that rsyncs our > windows fileserver ever hour. > > Should windas go down we run a script on the > workstations remapping our > > drives to the bsd box. In this case we are > prepared to lose up to an hours > > work. We are also prepared to lose say 15-30 > minutes of time mucking around. > > > > In your situation perhaps what you could do is > upgrade to 5.1 and rsync > > snapshots of your data to the secondary machine. > You could use the failover > > setup as des
Re: Backup Server
I'm not worried about down time. I'm strictly worrying about backing up: /home and /usr/local/mysql/var On server 1 and /home and /var/mail On Server 2. Thats it. Any ideas? Thanks! -Matt On Mon, 2003-12-29 at 22:48, anubis wrote: > On Sat, 27 Dec 2003 03:30 am, samy lancher wrote: > > Hello all, > > I have a 4.5 FreeBSD server. It is our Email, web and database server. I > > would like to setup a backup server so that when the main server goes down > > the backup server takes over its job. Could some one please tell me the > > best way to setup a backup server and also suggest some good documentation. > > > > Thanks in advance, > > Naveen. > > > > > > - > > Do you Yahoo!? > > Protect your identity with Yahoo! Mail AddressGuard > > ___ > > [EMAIL PROTECTED] mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > > To unsubscribe, send any mail to > > "[EMAIL PROTECTED]" > > I have had a bit of a look into this myself and this is my take on it. I > would like to hear of other people experiences too. > > There are a number of things that you have to decide on first before you go > any further. > > These are: > budget > how critical the system is to downtime > how much data you are willing to lose > how long are you willing to wait for the second system to kick in. > These will determine how you are going to build your system. You will have to > keep the answers in mind when you are looking at any solution. > > What you seem to be looking for is a failover system. There is a fair bit > written about failover systems. Googling will find you lots. Make sure that > you look up linux high availability and failover as well to get a broader > view. I have added some links below. > > There is really 2 things that you are trying to do here. Provide redundancy > for the services and redundancy for the data. The services are a bit easier > and cheaper than the data. The big problem is the data, especially > databases. Due to their nature they cant easily be copied while live. > > A solution to this is a SAN. With lots of money it is easier as you can buy > yourself a SAN and hook the two machines to it and host the data on the SAN. > With some clever scripts from those HA sites when one machine goes down the > other can take over and use the same data. There are other solutions using a > fancy Y shaped SCSI cable to a external drive array. Others my be able to > help here as I dont know about them. > > The other alternative is 2 identical machines. > When you have 2 machines with the master storing data on its local drives it > gets tricker. This is where you have to decide on how much data you are > willing to lose. > > As an example we have a bsd box that rsyncs our windows fileserver ever hour. > Should windas go down we run a script on the workstations remapping our > drives to the bsd box. In this case we are prepared to lose up to an hours > work. We are also prepared to lose say 15-30 minutes of time mucking around. > > In your situation perhaps what you could do is upgrade to 5.1 and rsync > snapshots of your data to the secondary machine. You could use the failover > setup as described on HA sites to fire up the services on the secondary > machine and take over. This should work as snapshots are supposed to capture > an instant in time but I couldnt guarantee it until I tested it. You would > still be losing data as you could only snapshot data and transfer it in > discrete intervals. > > A handy thing that linux has that I dont think that freebsd has is drbd. This > is a block device that can mirror data across a network. If freebsd had this > it would be easy to make the second machine a true mirror of the first. > I wonder if they are looking at a thing similar to this in the future. > > Look here for some intersting reading > > http://linux-ha.org/ > http://www.drbd.org/ > http://sporner.dnsalias.org/ > http://failover.othello.ch/getting_started.html > > > > ___ > [EMAIL PROTECTED] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On Sat, 27 Dec 2003 03:30 am, samy lancher wrote: > Hello all, > I have a 4.5 FreeBSD server. It is our Email, web and database server. I > would like to setup a backup server so that when the main server goes down > the backup server takes over its job. Could some one please tell me the > best way to setup a backup server and also suggest some good documentation. > > Thanks in advance, > Naveen. > > > - > Do you Yahoo!? > Protect your identity with Yahoo! Mail AddressGuard > ___ > [EMAIL PROTECTED] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "[EMAIL PROTECTED]" I have had a bit of a look into this myself and this is my take on it. I would like to hear of other people experiences too. There are a number of things that you have to decide on first before you go any further. These are: budget how critical the system is to downtime how much data you are willing to lose how long are you willing to wait for the second system to kick in. These will determine how you are going to build your system. You will have to keep the answers in mind when you are looking at any solution. What you seem to be looking for is a failover system. There is a fair bit written about failover systems. Googling will find you lots. Make sure that you look up linux high availability and failover as well to get a broader view. I have added some links below. There is really 2 things that you are trying to do here. Provide redundancy for the services and redundancy for the data. The services are a bit easier and cheaper than the data. The big problem is the data, especially databases. Due to their nature they cant easily be copied while live. A solution to this is a SAN. With lots of money it is easier as you can buy yourself a SAN and hook the two machines to it and host the data on the SAN. With some clever scripts from those HA sites when one machine goes down the other can take over and use the same data. There are other solutions using a fancy Y shaped SCSI cable to a external drive array. Others my be able to help here as I dont know about them. The other alternative is 2 identical machines. When you have 2 machines with the master storing data on its local drives it gets tricker. This is where you have to decide on how much data you are willing to lose. As an example we have a bsd box that rsyncs our windows fileserver ever hour. Should windas go down we run a script on the workstations remapping our drives to the bsd box. In this case we are prepared to lose up to an hours work. We are also prepared to lose say 15-30 minutes of time mucking around. In your situation perhaps what you could do is upgrade to 5.1 and rsync snapshots of your data to the secondary machine. You could use the failover setup as described on HA sites to fire up the services on the secondary machine and take over. This should work as snapshots are supposed to capture an instant in time but I couldnt guarantee it until I tested it. You would still be losing data as you could only snapshot data and transfer it in discrete intervals. A handy thing that linux has that I dont think that freebsd has is drbd. This is a block device that can mirror data across a network. If freebsd had this it would be easy to make the second machine a true mirror of the first. I wonder if they are looking at a thing similar to this in the future. Look here for some intersting reading http://linux-ha.org/ http://www.drbd.org/ http://sporner.dnsalias.org/ http://failover.othello.ch/getting_started.html ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
Or even just create the tars on the machines nightly and have my box just go in and download them? -Matt On Mon, 2003-12-29 at 17:41, David Varieur wrote: > On Mon, 29 Dec 2003 17:28:44 -0500 > Matthew Juszczak <[EMAIL PROTECTED]> wrote: > > > But there would only be one client .. the machine behind my > > firewall...connecting to the two servers, which are publically > > available. > > > > -Matt > > > > Why not (from the client box)? > > ssh remotehost "cd /path/to/dir; tar -czf - dir_name" | cat >backup.tgz ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On Dec 29, 2003, at 5:28 PM, Matthew Juszczak wrote: But there would only be one client .. the machine behind my firewall...connecting to the two servers, which are publically available. No problem. Set up a cron job on your machine behind it's firewall, which does something like: 1 1 * * * /usr/local/bin/rsync -az --delete -e ssh server1:/stuff /PATH_TO_BACKUPS/server1/ 1 2 * * * /usr/local/bin/rsync -az --delete -e ssh server2:/more_stuff /PATH_TO_BACKUPS/server2/ 1 3 * * * # run backup script like Amanda, dump, etc here... -- -Chuck ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On Mon, 29 Dec 2003 17:28:44 -0500 Matthew Juszczak <[EMAIL PROTECTED]> wrote: > But there would only be one client .. the machine behind my > firewall...connecting to the two servers, which are publically > available. > > -Matt > Why not (from the client box)? ssh remotehost "cd /path/to/dir; tar -czf - dir_name" | cat >backup.tgz ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
But there would only be one client .. the machine behind my firewall...connecting to the two servers, which are publically available. -Matt On Mon, 2003-12-29 at 17:19, Dave McCammon wrote: > --- Charles Swiger <[EMAIL PROTECTED]> wrote: > > On Dec 29, 2003, at 3:21 PM, Matthew Juszczak wrote: > > > With rsync, it appears that my machine would need > > to run the server > > > software, and the two servers would run clients. > > That just wouldn't > > > work. > > > > While one can run rsync as a daemon (which might not > > be suitable for > > your purposes given what you've said), it's also > > possible to invoke > > rsync via SSH from either the "client" or the > > "server"... > > > > -- > > -Chuck > > > > > > install rsync from the ports on all machines > and on the "clients" do a > > /usr/local/bin/rsync -azRv --delete /etc > backup_server:/backup/ > > (modify command to your needs..see man rsync) > in a cron job or from command line. This command will > use rsync-over-ssh from the "client" to the > "backup_server". It will ask for a password unless you > set up keys for auto-login with ssh. > > __ > Do you Yahoo!? > New Yahoo! Photos - easier uploading and sharing. > http://photos.yahoo.com/ > ___ > [EMAIL PROTECTED] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
--- Charles Swiger <[EMAIL PROTECTED]> wrote: > On Dec 29, 2003, at 3:21 PM, Matthew Juszczak wrote: > > With rsync, it appears that my machine would need > to run the server > > software, and the two servers would run clients. > That just wouldn't > > work. > > While one can run rsync as a daemon (which might not > be suitable for > your purposes given what you've said), it's also > possible to invoke > rsync via SSH from either the "client" or the > "server"... > > -- > -Chuck > install rsync from the ports on all machines and on the "clients" do a /usr/local/bin/rsync -azRv --delete /etc backup_server:/backup/ (modify command to your needs..see man rsync) in a cron job or from command line. This command will use rsync-over-ssh from the "client" to the "backup_server". It will ask for a password unless you set up keys for auto-login with ssh. __ Do you Yahoo!? New Yahoo! Photos - easier uploading and sharing. http://photos.yahoo.com/ ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
--- Charles Swiger <[EMAIL PROTECTED]> wrote: > On Dec 29, 2003, at 3:21 PM, Matthew Juszczak wrote: > > With rsync, it appears that my machine would need > to run the server > > software, and the two servers would run clients. > That just wouldn't > > work. > > While one can run rsync as a daemon (which might not > be suitable for > your purposes given what you've said), it's also > possible to invoke > rsync via SSH from either the "client" or the > "server"... > > -- > -Chuck > > ___ > [EMAIL PROTECTED] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "[EMAIL PROTECTED]" __ Do you Yahoo!? New Yahoo! Photos - easier uploading and sharing. http://photos.yahoo.com/ ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On Dec 29, 2003, at 3:21 PM, Matthew Juszczak wrote: With rsync, it appears that my machine would need to run the server software, and the two servers would run clients. That just wouldn't work. While one can run rsync as a daemon (which might not be suitable for your purposes given what you've said), it's also possible to invoke rsync via SSH from either the "client" or the "server"... -- -Chuck ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
I'm actually looking for a decent way to backup data on two servers to my local machine (which isn't accessible from the public). So obviously, I would need some sort of client app on my local machine to "connect" to the two remote BSD machines and backup the files I need locally. With rsync, it appears that my machine would need to run the server software, and the two servers would run clients. That just wouldn't work. Anyone have any ideas? tar plus maybe wget? Thanks, Matt On Mon, 2003-12-29 at 00:01, Nicholas Basila wrote: > On Sunday 28 December 2003 03:26 pm, Matt Juszczak wrote: > > I read somewhere about the AMANDA project. Is that any good for a > > situation like this? > Well, Amanda is certainly good for the backup of the data. The main > site's here: > > http://www.amanda.org/ > > and Curtis Preston put part of his O'Reilly book online: > http://www.backupcentral.com/amanda.html > > But... Amanda would not be a great choice because it's really a > backup system and you'd end up having to write scripts to restore from > dump files created by Amanda to the backup server filesystem. If you're > going to that trouble, it would be easier to use rsync. > Again, I think shared scsi or fibre channel would be the way to > go. I'm not sure how well FreeBSD supports shared scsi/fibre channel > drive sharing ( I know it supports some fibre channel adapters), > however. If it does work well, you could have a central RAID array > running RAID 10 and have the master DB server run with the drive > mounted. If the master had problems, the backup/secondary could take > over. You would have one set of data to contend with, and consequently, > synchronization would not be an issue. My only concern would be > filesystem writes and soft depends in general. > > > ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On Sunday 28 December 2003 03:26 pm, Matt Juszczak wrote: > I read somewhere about the AMANDA project. Is that any good for a > situation like this? Well, Amanda is certainly good for the backup of the data. The main site's here: http://www.amanda.org/ and Curtis Preston put part of his O'Reilly book online: http://www.backupcentral.com/amanda.html But... Amanda would not be a great choice because it's really a backup system and you'd end up having to write scripts to restore from dump files created by Amanda to the backup server filesystem. If you're going to that trouble, it would be easier to use rsync. Again, I think shared scsi or fibre channel would be the way to go. I'm not sure how well FreeBSD supports shared scsi/fibre channel drive sharing ( I know it supports some fibre channel adapters), however. If it does work well, you could have a central RAID array running RAID 10 and have the master DB server run with the drive mounted. If the master had problems, the backup/secondary could take over. You would have one set of data to contend with, and consequently, synchronization would not be an issue. My only concern would be filesystem writes and soft depends in general. ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
I read somewhere about the AMANDA project. Is that any good for a situation like this? > On Friday 26 December 2003 12:30 pm, samy lancher wrote: >> Hello all, >> I have a 4.5 FreeBSD server. It is our Email, web and database >> server. I would like to setup a backup server so that when the main >> server goes down the backup server takes over its job. Could some one >> please tell me the best way to setup a backup server and also suggest >> some good documentation. > > In order to keep the data synchronized, you could possibly used some > sort of shared scsi or fibre channel drive/array. You'd have to write a > script that would run on the backup and tell it to mount the drive and > startup the databases when the server was down. > Shared scsi might be the easiest, but you'll have to buy some > Y-terminated scsi cables so that the main machine won't reset the scsi > bus on the backup machine when it (the main machine) goes down. > > Nicholas > >> >> Thanks in advance, >> Naveen. >> >> >> - >> Do you Yahoo!? >> Protect your identity with Yahoo! Mail AddressGuard >> ___ >> [EMAIL PROTECTED] mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >> To unsubscribe, send any mail to >> "[EMAIL PROTECTED]" > > ___ > [EMAIL PROTECTED] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "[EMAIL PROTECTED]" > ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On Friday 26 December 2003 12:30 pm, samy lancher wrote: > Hello all, > I have a 4.5 FreeBSD server. It is our Email, web and database > server. I would like to setup a backup server so that when the main > server goes down the backup server takes over its job. Could some one > please tell me the best way to setup a backup server and also suggest > some good documentation. In order to keep the data synchronized, you could possibly used some sort of shared scsi or fibre channel drive/array. You'd have to write a script that would run on the backup and tell it to mount the drive and startup the databases when the server was down. Shared scsi might be the easiest, but you'll have to buy some Y-terminated scsi cables so that the main machine won't reset the scsi bus on the backup machine when it (the main machine) goes down. Nicholas > > Thanks in advance, > Naveen. > > > - > Do you Yahoo!? > Protect your identity with Yahoo! Mail AddressGuard > ___ > [EMAIL PROTECTED] mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to > "[EMAIL PROTECTED]" ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
On 27 Dec 2003 10:15:06 -0500, Lowell Gilbert <[EMAIL PROTECTED]> wrote: samy lancher <[EMAIL PROTECTED]> writes: I have a 4.5 FreeBSD server. It is our Email, web and database server. I would like to setup a backup server so that when the main server goes down the backup server takes over its job. Could some one please tell me the best way to setup a backup server and also suggest some good documentation. You could try the Equalizer series of load balancing appliances from Coyote Point software (www.coyotepoint.com). They are designed for network load balancing but they have an automatic failover mode so that machine 'B' takes over immediately when machine 'A' is unavailable. Of course keeping your content synchronized between two machines is a different kettle of fish. In the application in which we used the Equalizers. IIRC we used rsync to keep a fairly live database up to date (we had to because we used the devices for load balancing primarily so they were actually both in used concurrently). This seems like it would be quite involved if you wanted to keep an e-mail server for several users ready to fail over. Oh, BTW, the equalizer is a software-based device that runs FreeBSD internally. Also worth noting is that the support we got from Coyote Point was exemplary. HTH, -nick -- _ Nick Tonkin {|8^)> information management systems and custom software development http://www.tonkinresolutions.com ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Backup Server
samy lancher <[EMAIL PROTECTED]> writes: > I have a 4.5 FreeBSD server. It is our Email, web and database server. I would like > to setup a backup server so that when the main server goes down the backup server > takes over its job. > Could some one please tell me the best way to setup a backup server and also suggest > some good documentation. This kind of thing can be quite tricky. If you want it to be invisible to the users, it will be a huge amount of work. In most situations, you're better off just having a spare machine ready to take over and letting the users know that the backup won't be fully up to date. Beyond that, you really have to identify the vulnerability scenarios you're trying to ameliorate. ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Backup Server
Hello all, I have a 4.5 FreeBSD server. It is our Email, web and database server. I would like to setup a backup server so that when the main server goes down the backup server takes over its job. Could some one please tell me the best way to setup a backup server and also suggest some good documentation. Thanks in advance, Naveen. - Do you Yahoo!? Protect your identity with Yahoo! Mail AddressGuard ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
RE: Backup Server
> Greetings, > I have an NT 4 server Sorry to hear that. I'm sure you realize MS no longer officially supports NT4 right? Well, no matter, on to the real questions... > that I wish to back its data up to a > FreeBSD box running Samba. The thought being that > since I cannot back all the NT 4 data up to one tape > (24GB compressed), that I could back it up every other night. > The nights it didn't go to tape, it would go to the Freebsd box. Why bother with tape at all? The speed is abysmal. If you need the ability to move the media, buy 5 USB 2.0 or Firewire external 100+GB drives. Oh, that's right, you're running NT 4. ;) > Should I use Freebsd 4.x or 5.x ? The disk drives in the to > be installed FreeBSD box are SCSI. Should I use Vinum ? I don't know about 4 vs 5. I only use 4.x. Your limiting factor here is going to be network speed. You could remove a possible disk bottleneck using vinum, but you'd want to stripe the disks and then you double (or x # of drives) your risk of a drive failure. If you have all night to run the backups, then staying at 100bt is probably fine, but you may want to consider gig-e. If you do that, you can run jumbo frames and get much better perf. Even if you stick to 100bt, you should probably tune things some. I can't remember if NT4 supports changing tcpwindow sizes, but its probably worth looking into, even if they're very close to each other (< 2ms). > Just curious about others thoughts before I start setting it up. You should look into this software: http://backuppc.sourceforge.net/info.html Do you already have the hardware for this box? If you don't, instead of spending money on scsi, you may want to consider using serial ATA and 3Ware's RAID cards. Put 4 or 5 SATA drives on a 3Ware in RAID5 and you have a cheap speedy fault-tolerant system. SATA drives are only like $10 more than their parallel ancestors. I've given up scsi in favor of this config. I just built a 6TB system using 24 SATA drives and 2 3Ware 12 port controllers and its *very* fast. I haven't speed tested it yet, but I also have a 2TB system using 12 ata133 drives and a single 3ware 12 port card and I can write at over 110mb/s over gig-E (reads are somewhere around 170mb/s). I expect the new sata one will be limited more by nic now. Good luck! If you decide you might want to go the 3ware route, let me know and I can put you in touch with the vendor I have build these for me. Great pricing and excellent service. Brent ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Backup Server
Greetings, I have an NT 4 server that I wish to back its data up to a FreeBSD box running Samba. The thought being that since I cannot back all the NT 4 data up to one tape (24GB compressed), that I could back it up every other night. The nights it didn't go to tape, it would go to the Freebsd box. Should I use Freebsd 4.x or 5.x ? The disk drives in the to be installed FreeBSD box are SCSI. Should I use Vinum ? Just curious about others thoughts before I start setting it up. thanks, -D ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Create a "hot backup" server machine?
On Sunday, Mar 30, 2003, at 14:18 US/Pacific, Ralph Dratman wrote: I'm trying to create an offsite "hot backup" of a FreeBSD server. If the primary server fails, I want to transport the spare machine to the existing site and bring it up as a replacement, with little or no reconfiguration necessary. Nightly mirroring would be adequate in this situation. The system is not running live transaction processing or anything comparable. Is there a straightforward, automated way to mirror a whole FreeBSD system, using open source software? I'm testing ftpcopy to remotely mirror the files and directories. Ftpcopy performs an incremental comparison using dates and file sizes, which should minimize the nightly backup time and traffic load. So far that part seems to be working well. But I haven't figured out how to get the users, groups and permissions mirrored. There are about 200 users. And there may be other gotchas I haven't thought of yet. The approach I am using is to tar the system to a file on the production machine and then rsync that file with my off-site backup machine. I leave it as a tar file on the backup as its almost impractical for me to move that machine to the production site. I would replace the machine on the production site and then copy the file back from the backup machine and un-tar it. In your case I would create the tar file, rsync it to the backup machine and then un-tar it there. Tar retains permissions and ownership properly. Leave the previous tar file on the backup machine as rsync will use it to reduce the download time. My backup file (4 servers) is just over 4 GB. The rsync transfer only sends 1/16th of it. Much of the archived data does not change very often. -- Doug ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Re: Create a "hot backup" server machine?
On Sun, Mar 30, 2003 at 05:18:54PM -0500, Ralph Dratman wrote: > I'm trying to create an offsite "hot backup" of a FreeBSD server. If > the primary server fails, I want to transport the spare machine to > the existing site and bring it up as a replacement, with little or no > reconfiguration necessary. > > Nightly mirroring would be adequate in this situation. The system is > not running live transaction processing or anything comparable. > > Is there a straightforward, automated way to mirror a whole FreeBSD > system, using open source software? > > I'm testing ftpcopy to remotely mirror the files and directories. > Ftpcopy performs an incremental comparison using dates and file > sizes, which should minimize the nightly backup time and traffic > load. So far that part seems to be working well. > > But I haven't figured out how to get the users, groups and > permissions mirrored. There are about 200 users. And there may be > other gotchas I haven't thought of yet. Sounds to me like this is a job for rsync(1) --- see http://rsync.samba.org/ or net/rsync in ports. You can use rsync to maintain a remote copy of a partition, as you describe. rsync(1) will transmit only the minimum necessary over the wire in order to bring the two filesystems into synch. Eg. to save or update a copy of the /var partition on your live server to a backup machine: # rsync -avx --delete /var/ backup.example.com:/backups/var/ By default on FreeBSD, rsync(1) will use ssh(1) for remote shell access. For unattended access you probably need to set up appropriate ssh keys without passwords, but definitely limiting access based on the 'from=' hostname and/or command used via options in the ~/.ssh/authorized_keys file, as described in the 'AUTHORIZED_KEYS FILE FORMAT' section of sshd(8) -- you should also turn off the three types of forwarding with an autologin key. See also http://www.snailbook.com/faq/no-passphrase.auto.html Cheers, Matthew -- Dr Matthew J Seaman MA, D.Phil. 26 The Paddocks Savill Way PGP: http://www.infracaninophile.co.uk/pgpkey Marlow Tel: +44 1628 476614 Bucks., SL7 1TH UK pgp0.pgp Description: PGP signature
Re: Create a "hot backup" server machine?
On Sun, 30 Mar 2003 17:18:54 -0500 Ralph Dratman <[EMAIL PROTECTED]> wrote: > I'm trying to create an offsite "hot backup" of a FreeBSD server. If > the primary server fails, I want to transport the spare machine to > the existing site and bring it up as a replacement, with little or no > reconfiguration necessary. > > Nightly mirroring would be adequate in this situation. The system is > not running live transaction processing or anything comparable. > > Is there a straightforward, automated way to mirror a whole FreeBSD > system, using open source software? rsync? ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"
Create a "hot backup" server machine?
I'm trying to create an offsite "hot backup" of a FreeBSD server. If the primary server fails, I want to transport the spare machine to the existing site and bring it up as a replacement, with little or no reconfiguration necessary. Nightly mirroring would be adequate in this situation. The system is not running live transaction processing or anything comparable. Is there a straightforward, automated way to mirror a whole FreeBSD system, using open source software? I'm testing ftpcopy to remotely mirror the files and directories. Ftpcopy performs an incremental comparison using dates and file sizes, which should minimize the nightly backup time and traffic load. So far that part seems to be working well. But I haven't figured out how to get the users, groups and permissions mirrored. There are about 200 users. And there may be other gotchas I haven't thought of yet. Thank you very much. Regards, Ralph ___ [EMAIL PROTECTED] mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "[EMAIL PROTECTED]"