Re: [U2] REPLICATING DATA [OT]
why aren't you upgrading? -Original Message- From: Ard956 ard...@optonline.net To: U2 Users List u2-users@listserver.u2ug.org Cc: U2 Users List u2-users@listserver.u2ug.org Sent: Wed, Sep 4, 2013 8:16 pm Subject: Re: [U2] REPLICATING DATA [OT] Without upgrading UV, we cannot upgrade Windows. Sent from my iPad On Sep 4, 2013, at 6:49 PM, John Hester jhes...@momtex.com wrote: Mainstream support for W2K3 ended 3 years ago, but extended support ends 7-14-2015. That means they'll continue to release security updates for it until then. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Phil Walker Sent: Wednesday, September 04, 2013 2:56 PM To: U2 Users List Subject: Re: [U2] REPLICATING DATA [OT] I did not think Windows Server 2003 was still supported by Microsoft -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Thursday, 5 September 2013 7:27 a.m. To: U2 Users List Cc: u2-users@listserver.u2ug.org Subject: Re: [U2] REPLICATING DATA We are on Windows Server 2003. Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
There's a similar product called Syncrify. Worth a look. Re dynamic files - remember that copying dynamic files is ONLY acceptable if the files have been closed and sync to disk. On your old version of UniVerse IIRC a DB Pause/resume does not sync the dynamic file headers as it does on current versions. I would check that with Rocket before you look at doing a dbpause/resume. Dynamic files rely on current modulus, split and load information held in shared memory. That information is only written back when the file is closed. So you can copy the file over, but if that information is out of date the file will not be usable and will eventually corrupt. Brian -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Peter Cheney Sent: 05 September 2013 02:59 To: U2 Users List Subject: Re: [U2] REPLICATING DATA Re rsync for windows. Try installing Cygwin and then rsync under that. I've had good success in the past with a basic (non-gui) cygwin install on a windows machine for other projects and rsync certainly works well in that environment. You can also set it up with pub/priv key auth for non-interactive operation too. I think the more recent releases of rsync will allow you to pull or push data in non daemon mode. At least that's how I use it to backup my daily work from my centos workstation (no rsync daemon running) to my crunch-bang (debian) laptop. The laptop runs the rsync out of cron. The script detects which wireless network it's on so doesn't run when at home. Setting some flags in the file system from UV and visa-versa would give you a reasonably good integration with dbpause etc etc. Cheers Peter Peter Cheney Universe Engineer t 07 3017 8837 | f 07 3002 8400 e peter.che...@firstmac.com.au | w www.firstmac.com.au From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] on behalf of Anthonys Lists [antli...@youngman.org.uk] Sent: Thursday, 5 September 2013 8:55 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] REPLICATING DATA On 04/09/2013 20:27, Ard956 wrote: We are on Windows Server 2003. I think you can get rsync for Windows, but also investigate robocopy. I don't know whether that can do the same. Basically, rsync will normally check file metadata and not try to copy stuff if it hasn't changed. If the metadata has changed, it will then compare MD5 sums or whatever of chunks of the file to identify which bits have changed. That way, if you have a 2Gb file and change one record, rsync will find the changed block and send just that, without having to copy the entire file. If you can find something like that, it'll give you far shorter network backup times. (Combined with DBPAUSE/DBRESUME, it might well give you zero backup downtime as seen by the users.) Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services
Re: [U2] REPLICATING DATA
Dynamic files increase the risk that using third-party technology (rather than U2 Replication) will result in corrupt files on fail-over. This is because dynamic files increase the probability that a single logical write will result in multiple disk writes - 3rd party technology will not know the correct write boundaries. Regards, Dan McGrath Managing Director, U2 Servers Lab Rocket Software 4600 South Ulster Street · Suite 1100 · Denver, CO 80237 · USA T: +1 720 475 8098 · E: dmcgr...@rocketsoftware.com · W: u2.rocketsoftware.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 7:55 PM To: U2 Users List Subject: Re: [U2] REPLICATING DATA Files are mostly dynamic and distributed files are used on the most active files, if that makes a difference. Sent from my iPad On Sep 3, 2013, at 6:48 PM, John Hester jhes...@momtex.com wrote: Daniel's post reminded me that I should probably qualify my original post by adding that you have to take special precautions when using 3rd party replication software with U2. Specifically, it's not safe to have overflow in hashed files because the overflow pointer and overflow data require two separate writes to disk. If a failover occurs when only one of the two writes has been completed, you'll likely end up with a corrupted file. I've eliminated this issue in our environment by keeping all hashed files sized to have no overflow and only using dynamic files for temporary report data. This probably isn't feasible in a lot of environments. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of John Hester Sent: Tuesday, September 03, 2013 11:40 AM To: U2 Users List Subject: Re: [U2] REPLICATING DATA We've been using LifeKeeper from SIOS to replicate UV for around 10 years. I think it's now been rebranded as Protection Suite: http://us.sios.com/linux-high-availability-replication-enterprise/ It can run on Linux or Windows. We're running UV 10.2.7 on RH EL 5.1. -John ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
We are on Windows Server 2003. Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA [OT]
I did not think Windows Server 2003 was still supported by Microsoft -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Thursday, 5 September 2013 7:27 a.m. To: U2 Users List Cc: u2-users@listserver.u2ug.org Subject: Re: [U2] REPLICATING DATA We are on Windows Server 2003. Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA [OT]
Mainstream support for W2K3 ended 3 years ago, but extended support ends 7-14-2015. That means they'll continue to release security updates for it until then. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Phil Walker Sent: Wednesday, September 04, 2013 2:56 PM To: U2 Users List Subject: Re: [U2] REPLICATING DATA [OT] I did not think Windows Server 2003 was still supported by Microsoft -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Thursday, 5 September 2013 7:27 a.m. To: U2 Users List Cc: u2-users@listserver.u2ug.org Subject: Re: [U2] REPLICATING DATA We are on Windows Server 2003. Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
On 04/09/2013 20:27, Ard956 wrote: We are on Windows Server 2003. I think you can get rsync for Windows, but also investigate robocopy. I don't know whether that can do the same. Basically, rsync will normally check file metadata and not try to copy stuff if it hasn't changed. If the metadata has changed, it will then compare MD5 sums or whatever of chunks of the file to identify which bits have changed. That way, if you have a 2Gb file and change one record, rsync will find the changed block and send just that, without having to copy the entire file. If you can find something like that, it'll give you far shorter network backup times. (Combined with DBPAUSE/DBRESUME, it might well give you zero backup downtime as seen by the users.) Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA [OT]
Without upgrading UV, we cannot upgrade Windows. Sent from my iPad On Sep 4, 2013, at 6:49 PM, John Hester jhes...@momtex.com wrote: Mainstream support for W2K3 ended 3 years ago, but extended support ends 7-14-2015. That means they'll continue to release security updates for it until then. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Phil Walker Sent: Wednesday, September 04, 2013 2:56 PM To: U2 Users List Subject: Re: [U2] REPLICATING DATA [OT] I did not think Windows Server 2003 was still supported by Microsoft -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Thursday, 5 September 2013 7:27 a.m. To: U2 Users List Cc: u2-users@listserver.u2ug.org Subject: Re: [U2] REPLICATING DATA We are on Windows Server 2003. Sent from my iPad On Sep 3, 2013, at 1:45 PM, Wols Lists antli...@youngman.org.uk wrote: On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
[U2] REPLICATING DATA
Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Hi Andrea: U2logic does replication via UniObjects for Java. It is built-in to our U2WebLink middle-ware engine. You just need to surround you writes and deletes with a few lines of code and our software takes care of the rest. This software works for version 10.1 of Universe and above. You can contact me off-line for more information. Regards, Doug www.u2logic.com On Tue, Sep 3, 2013 at 10:18 AM, Ard956 ard...@optonline.net wrote: Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
If you are on AIX, this is a possibility. http://www.pulsarsystems.com/uvback.html -- Carl Dula Voice: 973-227-8440 X111 Pulsar Systems, Inc.Fax: 973-227-8440 271 US Highway 46, STE H209 email:c...@pulsarsystems.com Fairfield, NJ 07004-2474http://www.pulsarsystems.com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
and we would keep replication in place as a DR solution. Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Under what scenario would the overflow record not get written? You mean a power outage? Or what exactly? -Original Message- From: John Hester jhes...@momtex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Tue, Sep 3, 2013 3:49 pm Subject: Re: [U2] REPLICATING DATA Daniel's post reminded me that I should probably qualify my original post by adding that you have to take special precautions when using 3rd party replication software with U2. Specifically, it's not safe to have overflow in hashed files because the overflow pointer and overflow data require two separate writes to disk. If a failover occurs when only one of the two writes has been completed, you'll likely end up with a corrupted file. I've eliminated this issue in our environment by keeping all hashed files sized to have no overflow and only using dynamic files for temporary report data. This probably isn't feasible in a lot of environments. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of John Hester Sent: Tuesday, September 03, 2013 11:40 AM To: U2 Users List Subject: Re: [U2] REPLICATING DATA We've been using LifeKeeper from SIOS to replicate UV for around 10 years. I think it's now been rebranded as Protection Suite: http://us.sios.com/linux-high-availability-replication-enterprise/ It can run on Linux or Windows. We're running UV 10.2.7 on RH EL 5.1. -John ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Back in 2000 at a previous employer my then boss and I implemented our DR plan on UV9.something using a nightly rsync. It wasn't a hot DR site but that didn't matter and we were also able to shut down UV for the duration of the backup which was from the live disks to backup disks using the Solaris dump/restore and once complete we'd dump the backup file systems off to tape and then rsync it to DR. The backup scripts were mostly perl but the rsync was ksh scripts. Only took a few months to hack together. The disks themselves were all under Veritas VM control. Regadrs, Peter Peter Cheney Universe Engineer t 07 3017 8837 | f 07 3002 8400 e peter.che...@firstmac.com.au | w www.firstmac.com.au From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] on behalf of Ard956 [ard...@optonline.net] Sent: Wednesday, 4 September 2013 2:18 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users --- Note: This email (inc all attachments) is for the use of the intended recipient(s) only. Privileged or confidential information may be contained in this communication. If you have received this email in error, please notify the sender immediately and then delete all copies of this message from your computer network. If you are not the intended recipient, you must not keep, use, disclose, copy or distribute this email without the author's prior permission. If you are the intended recipient and you do not wish to receive similar electronic messages from us in future, then please respond to the sender to this effect. We have taken precautions to minimise the risk of transmitting software viruses, but advise you to carry out your own virus checks on this email and its attachments. We do not accept liability for any loss or damage caused by software viruses and do not represent that this transmission is free from viruses or other defects. Firstmac Limited (ABN 59 094 145 963) (AFSL 290600) --- ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Hi Andrea, Rocket Professional Services can help you out with that, as well as give you the pros/cons of the different approaches - since other methods will increase the risk that your replicated copy will have corrupt files or be out-of-sync with production. I'm sure you know who to contact, otherwise I can point you their way. Cheers, Dan McGrath Managing Director, U2 Servers Lab Rocket Software 4600 South Ulster Street · Suite 1100 · Denver, CO 80237 · USA T: +1 720 475 8098 · E: dmcgr...@rocketsoftware.com · W: u2.rocketsoftware.com -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 10:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
On 03/09/13 18:33, Ard956 wrote: and we would keep replication in place as a DR solution. What OS are you on? Given that, I'd be inclined to use rsync - DBPAUSE the database to make sure it's quiescent, run an rsync, and then bring the database back. Dunno what the Windows equivalent of rsync is, but if you're backing up across machines, rsync tries to not copy stuff that hasn't changed. Cheers, Wol Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Daniel's post reminded me that I should probably qualify my original post by adding that you have to take special precautions when using 3rd party replication software with U2. Specifically, it's not safe to have overflow in hashed files because the overflow pointer and overflow data require two separate writes to disk. If a failover occurs when only one of the two writes has been completed, you'll likely end up with a corrupted file. I've eliminated this issue in our environment by keeping all hashed files sized to have no overflow and only using dynamic files for temporary report data. This probably isn't feasible in a lot of environments. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of John Hester Sent: Tuesday, September 03, 2013 11:40 AM To: U2 Users List Subject: Re: [U2] REPLICATING DATA We've been using LifeKeeper from SIOS to replicate UV for around 10 years. I think it's now been rebranded as Protection Suite: http://us.sios.com/linux-high-availability-replication-enterprise/ It can run on Linux or Windows. We're running UV 10.2.7 on RH EL 5.1. -John ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
We've been using LifeKeeper from SIOS to replicate UV for around 10 years. I think it's now been rebranded as Protection Suite: http://us.sios.com/linux-high-availability-replication-enterprise/ It can run on Linux or Windows. We're running UV 10.2.7 on RH EL 5.1. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 10:34 AM To: U2 Users List Cc: U2 Users List Subject: Re: [U2] REPLICATING DATA and we would keep replication in place as a DR solution. Sent from my iPad On Sep 3, 2013, at 1:30 PM, Ard956 ard...@optonline.net wrote: We are moving our servers to a new colo and wanted to replicate from the server in the old colo to the one in the new colo and then flip over to the new server one weekend. Looking to have minimal down time. Sent from my iPad On Sep 3, 2013, at 12:26 PM, Baker Hughes baker.hug...@mouser.com wrote: Andrea - are you wanting to replicate for the purposes of having a warm backup as DR solution, or for reporting from, or some (what) other purpose? This question will dictate the strategy and what tools to employ. We copied the entire db every night to a hot system for Business Analysis. That was put in place before EDA was available. You could spend a lot of resources and time cobbling a 'replication solution' into place, while trying to dodge an upgrade... and perhaps spend more and have less satisfactory results than proceeding with standard methodology (upgrade to get the new toolset). HTH. -Baker -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Ard956 Sent: Tuesday, September 03, 2013 11:19 AM To: u2-users@listserver.u2ug.org Subject: [U2] REPLICATING DATA Does anyone do replication with a tool outside of the U2 toolbox? We are on UV 10.2.10 which does not support UV replication. We have no plans to upgrade at this time but need a backup for our Universe server. Our database is about 180GB. Thank you, Andrea Dente Taylored Services Sent from my iPad ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Yes, a power outage would be one cause, but any hardware failure of the active cluster node that causes the other to assume the active role will suffice. Best practice is to literally force a power outage on the failed node when this happens via a STONITH device (acronym for shoot the other node in the head). Each of our servers has its power routed through one of these devices with a serial port connected to the other server. Without STONITH devices, you run the risk of a split brain situation if the two servers lose contact with each other for any reason. The backup node assumes the active role when it doesn't receive regular heartbeats from the active node, but if this is simply due to a network issue between the nodes, the original active node may still be serving clients. Now you have two active nodes serving different clients from their own individual copies of the data. I've experienced that situation once, and I hope to never go through it again. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Wjhonson Sent: Tuesday, September 03, 2013 4:32 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] REPLICATING DATA Under what scenario would the overflow record not get written? You mean a power outage? Or what exactly? -Original Message- From: John Hester jhes...@momtex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Tue, Sep 3, 2013 3:49 pm Subject: Re: [U2] REPLICATING DATA Daniel's post reminded me that I should probably qualify my original post by adding that you have to take special precautions when using 3rd party replication software with U2. Specifically, it's not safe to have overflow in hashed files because the overflow pointer and overflow data require two separate writes to disk. If a failover occurs when only one of the two writes has been completed, you'll likely end up with a corrupted file. I've eliminated this issue in our environment by keeping all hashed files sized to have no overflow and only using dynamic files for temporary report data. This probably isn't feasible in a lot of environments. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of John Hester Sent: Tuesday, September 03, 2013 11:40 AM To: U2 Users List Subject: Re: [U2] REPLICATING DATA We've been using LifeKeeper from SIOS to replicate UV for around 10 years. I think it's now been rebranded as Protection Suite: http://us.sios.com/linux-high-availability-replication-enterprise/ It can run on Linux or Windows. We're running UV 10.2.7 on RH EL 5.1. -John ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] REPLICATING DATA
Files are mostly dynamic and distributed files are used on the most active files, if that makes a difference. Sent from my iPad On Sep 3, 2013, at 6:48 PM, John Hester jhes...@momtex.com wrote: Daniel's post reminded me that I should probably qualify my original post by adding that you have to take special precautions when using 3rd party replication software with U2. Specifically, it's not safe to have overflow in hashed files because the overflow pointer and overflow data require two separate writes to disk. If a failover occurs when only one of the two writes has been completed, you'll likely end up with a corrupted file. I've eliminated this issue in our environment by keeping all hashed files sized to have no overflow and only using dynamic files for temporary report data. This probably isn't feasible in a lot of environments. -John -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of John Hester Sent: Tuesday, September 03, 2013 11:40 AM To: U2 Users List Subject: Re: [U2] REPLICATING DATA We've been using LifeKeeper from SIOS to replicate UV for around 10 years. I think it's now been rebranded as Protection Suite: http://us.sios.com/linux-high-availability-replication-enterprise/ It can run on Linux or Windows. We're running UV 10.2.7 on RH EL 5.1. -John ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users