RE: I need an even smarter robocopy

[Sam Cayze]

+1 

-Original Message-
From: James Kerr [mailto:cluster...@gmail.com] 
Sent: Thursday, October 15, 2009 8:27 AM
To: NT System Admin Issues
Subject: Re: I need an even smarter robocopy

I use DeltaCopy for this sort of thing, its a windows wrapper for rsync.

Miguel Gonzalez wrote:
> I would use rsync (there is a Windows version). It lets you to even remove 
> files that have dissapeared from the Master server.
>
> Miguel
>
> --- El jue, 15/10/09, G.Waleed Kavalec  escribió:
>
>   
>> De: G.Waleed Kavalec 
>> Asunto: Re: I need an even smarter robocopy
>> Para: "NT System Admin Issues" 
>> 
>> Fecha: jueves, 15 octubre, 2009 8:18
>> 
>>>   Why do you want to do this?
>>>   
>> Because we aren't quite up to the SAN/NAS level here and I am tasked 
>> with creating cloned archives across a WAN.
>> Daily SQL backups (only one example) are gathered to a dedicated 
>> drive.
>> I want to COPY them off to our local Buffalo unit, then MOVE them to 
>> a second drive, visible from the second site. That site will have the 
>> job that moves the files to its Buffalo.
>>
>> I have no doubt I am reinventing the wheel here, but keep in mind 
>> that I am also changing the wheel on a moving car ;-)
>>
>>
>> On Wed, Oct 14, 2009 at 3:03 PM,
>> Ben Scott 
>> wrote:
>>
>> On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec 
>> wrote:
>>
>>
>> 
>>> What tools are out there that will...
>>>   
>>> 1. copy all files from dir-tree A to dir-tree B and
>>>   
>> then,
>>
>> 
>>>(for ONLY those successfully copied)
>>>   
>>> 2. MOVE those same files from dir-tree A
>>>   
>> to dir-tree C
>>
>>
>>
>>   Why do you want to do this?
>>
>>
>>
>>   People will probabbly come up with various tools and
>> techniques, but
>>
>> if you tell us the goal, we might all have better ideas.
>>  :)
>>
>>
>>
>> -- Ben
>>
>>
>>
>> ~ Finally, powerful endpoint security that ISN'T a
>> resource hog! ~
>>
>> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>
>>  ~
>>
>>
>>
>>
>>
>>
>> -- 
>> -- 
>>
>>  Gregory Waleed Kavalec
>> -
>> What matters?...
>> Only the flicker of light within the darkness, 
>> the feeling of warmth within the cold, 
>>
>> the knowledge of love within the void.
>>   - Joan Walsh Anglund
>>  
>>  
>>
>>
>>
>>
>>  
>> 
>>  
>> 
>> 
>
>
>   
>
> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~
> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~
>
>
>   


~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~

Re: I need an even smarter robocopy

[Ben Scott]

On Thu, Oct 15, 2009 at 8:18 AM, G.Waleed Kavalec  wrote:
> creating cloned archives across a WAN.

  As others have suggested, I like to use rsync or other delta-copy
protocol for this sort of thing.  That way you can keep replicas of
everything, but with low bandwidth usage.

  There's rsnapshot if you want to keep multiple instances for
historical point-in-time snapshot functionality.  I haven't tried it
on Windows, but a quick Google suggests it works:

http://www.google.com/search?q=rsnapshot+windows

http://blog.gingerlime.com/rsnapshot-server-on-windows

> I want to COPY them off to our local Buffalo unit,
> then MOVE them to a second drive, visible from the second site.

  As a straight file copy without any "update" intelligence, you could
break this down into:

1. Start with empty target folders on the Buffalo unit and second drive
2. Copy to the local Buffalo unit
3. Copy to the second drive
4. For each file in original location:
  a. Check to see if it exists in both target locations (steps 2 and 3)
  b. If it does, delete from original location

  Step 1 can be done with "DEL *.*"; steps 2 and 3 with ROBOCOPY, and
step 4 with some simple scripting.

  If you want update functionality, you need to leave the source files
in place anyway.  So use a delta-copy mechanism, as above.  If you
need to move the files for space reasons, then I would:

1. Move from original to archive drive
2. sync from archive drive to replica

-- Ben

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~

Re: I need an even smarter robocopy

[James Kerr]

I use DeltaCopy for this sort of thing, its a windows wrapper for rsync.

Miguel Gonzalez wrote:

I would use rsync (there is a Windows version). It lets you to even remove 
files that have dissapeared from the Master server.

Miguel

--- El jue, 15/10/09, G.Waleed Kavalec  escribió:

  

De: G.Waleed Kavalec 
Asunto: Re: I need an even smarter robocopy
Para: "NT System Admin Issues" 
Fecha: jueves, 15 octubre, 2009 8:18


  Why do you want to do this?
  

Because we aren't quite up to the SAN/NAS
level here and I am tasked with creating cloned archives
across a WAN.
Daily SQL backups (only one example) are
gathered to a dedicated drive.  
I want to COPY them off to our local Buffalo

unit, then MOVE them to a second drive, visible
from the second site. That site will have the
job that moves the files to its Buffalo.

I have no doubt I am reinventing the wheel here,
but keep in mind that I am also changing the wheel on a
moving car ;-)


On Wed, Oct 14, 2009 at 3:03 PM,
Ben Scott 
wrote:

On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec

wrote:




What tools are out there that will...
  
1. copy all files from dir-tree A to dir-tree B and
  

then,



   (for ONLY those successfully copied)
  
2. MOVE those same files from dir-tree A
  

to dir-tree C



  Why do you want to do this?



  People will probabbly come up with various tools and
techniques, but

if you tell us the goal, we might all have better ideas.
 :)



-- Ben



~ Finally, powerful endpoint security that ISN'T a
resource hog! ~

~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>
 ~






--
--

 Gregory Waleed Kavalec
-
What matters?...
Only the flicker of light within the darkness, 
the feeling of warmth within the cold, 


the knowledge of love within the void.
  — Joan Walsh Anglund
 
 





 

 





  


~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~


  



~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~

Re: I need an even smarter robocopy

[Miguel Gonzalez]

I would use rsync (there is a Windows version). It lets you to even remove 
files that have dissapeared from the Master server.

Miguel

--- El jue, 15/10/09, G.Waleed Kavalec  escribió:

> De: G.Waleed Kavalec 
> Asunto: Re: I need an even smarter robocopy
> Para: "NT System Admin Issues" 
> Fecha: jueves, 15 octubre, 2009 8:18
> >  Why do you want to do this?
> Because we aren't quite up to the SAN/NAS
> level here and I am tasked with creating cloned archives
> across a WAN.
> Daily SQL backups (only one example) are
> gathered to a dedicated drive.  
> I want to COPY them off to our local Buffalo
> unit, then MOVE them to a second drive, visible
> from the second site. That site will have the
> job that moves the files to its Buffalo.
> 
> I have no doubt I am reinventing the wheel here,
> but keep in mind that I am also changing the wheel on a
> moving car ;-)
> 
> 
> On Wed, Oct 14, 2009 at 3:03 PM,
> Ben Scott 
> wrote:
> 
> On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec
> 
> wrote:
> 
> 
> > What tools are out there that will...
> 
> > 1. copy all files from dir-tree A to dir-tree B and
> then,
> 
> >    (for ONLY those successfully copied)
> 
> > 2. MOVE those same files from dir-tree A
> to dir-tree C
> 
> 
> 
>   Why do you want to do this?
> 
> 
> 
>   People will probabbly come up with various tools and
> techniques, but
> 
> if you tell us the goal, we might all have better ideas.
>  :)
> 
> 
> 
> -- Ben
> 
> 
> 
> ~ Finally, powerful endpoint security that ISN'T a
> resource hog! ~
> 
> ~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>
>  ~
> 
> 
> 
> 
> 
> 
> -- 
> -- 
> 
>  Gregory Waleed Kavalec
> -
> What matters?...
> Only the flicker of light within the darkness, 
> the feeling of warmth within the cold, 
> 
> the knowledge of love within the void.
>   — Joan Walsh Anglund
>  
>  
> 
> 
> 
> 
>  
> 
>  
> 


  

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~

Re: I need an even smarter robocopy

[G.Waleed Kavalec]

>  Why do you want to do this?
Because we aren't quite up to the SAN/NAS level here and I am tasked with
creating cloned archives across a WAN.

Daily SQL backups (only one example) are gathered to a dedicated drive.
I want to COPY them off to our local Buffalo unit,
then MOVE them to a second drive, visible from the second site.
That site will have the job that moves the files to its Buffalo.

I have no doubt I am reinventing the wheel here, but keep in mind that I am
also changing the wheel on a moving car ;-)



On Wed, Oct 14, 2009 at 3:03 PM, Ben Scott  wrote:

> On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec 
> wrote:
> > What tools are out there that will...
> > 1. copy all files from dir-tree A to dir-tree B and then,
> >(for ONLY those successfully copied)
> > 2. MOVE those same files from dir-tree A to dir-tree C
>
>   Why do you want to do this?
>
>  People will probabbly come up with various tools and techniques, but
> if you tell us the goal, we might all have better ideas.  :)
>
> -- Ben
>
> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~
> ~   ~
>
>


-- 
-- 

Gregory Waleed Kavalec
-
What matters?...
Only the flicker of light within the darkness,
the feeling of warmth within the cold,
the knowledge of love within the void.
 — Joan Walsh Anglund

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~

Re: I need an even smarter robocopy

[Andrew Levicki]

There is a newer version of Robocopy called Rich Copy:
http://technet.microsoft.com/en-us/magazine/2009.04.utilityspotlight.aspx?pr=blog

2009/10/14 Ben Scott 

> On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec 
> wrote:
> > What tools are out there that will...
> > 1. copy all files from dir-tree A to dir-tree B and then,
> >(for ONLY those successfully copied)
> > 2. MOVE those same files from dir-tree A to dir-tree C
>
>   Why do you want to do this?
>
>  People will probabbly come up with various tools and techniques, but
> if you tell us the goal, we might all have better ideas.  :)
>
> -- Ben
>
> ~ Finally, powerful endpoint security that ISN'T a resource hog! ~
> ~   ~
>
>

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~

Re: I need an even smarter robocopy

[Ben Scott]

On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec  wrote:
> What tools are out there that will...
> 1. copy all files from dir-tree A to dir-tree B and then,
>    (for ONLY those successfully copied)
> 2. MOVE those same files from dir-tree A to dir-tree C

  Why do you want to do this?

  People will probabbly come up with various tools and techniques, but
if you tell us the goal, we might all have better ideas.  :)

-- Ben

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~

RE: I need an even smarter robocopy

[Mike Hoffman]

How about Xcopy and use the archive-bit - or am I missing something?

Mike

From: Andrew S. Baker [mailto:asbz...@gmail.com]
Sent: 14 October 2009 21:54
To: NT System Admin Issues
Subject: Re: I need an even smarter robocopy

Your best bet is to script it...

Parse the output of the robocopy log and generate a new copy job.

ASB (My XeeSM Profile)<http://XeeSM.com/AndrewBaker>
Providing Competitive Advantage through Effective IT Leadership

On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec 
mailto:kava...@gmail.com>> wrote:
What tools are out there that will...

1. copy all files from dir-tree A to dir-tree B and then,
   (for ONLY those successfully copied)

2. MOVE those same files from dir-tree A to dir-tree C

--
--

Gregory Waleed Kavalec
-
What matters?...
Only the flicker of light within the darkness,
the feeling of warmth within the cold,
the knowledge of love within the void.
 - Joan Walsh Anglund












~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~

Re: I need an even smarter robocopy

[Andrew S. Baker]

Your best bet is to script it...

Parse the output of the robocopy log and generate a new copy job.

*ASB *(My XeeSM Profile) 
*Providing Competitive Advantage through Effective IT Leadership*



On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec  wrote:

> What tools are out there that will...
> 1. copy all files from dir-tree A to dir-tree B and then,(for ONLY
> those successfully copied)
>
> 2. MOVE those same files from dir-tree A to dir-tree C
>
> --
> --
>
> Gregory Waleed Kavalec
> -
> What matters?...
> Only the flicker of light within the darkness,
> the feeling of warmth within the cold,
> the knowledge of love within the void.
>  — Joan Walsh Anglund
>
>
>
>
>
>
>
>

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~

Re: I need an even smarter robocopy

[Micheal Espinola Jr]

you could do this with Robocopy and some batch scripting

--
ME2


On Wed, Oct 14, 2009 at 4:38 PM, G.Waleed Kavalec  wrote:

> What tools are out there that will...
> 1. copy all files from dir-tree A to dir-tree B and then,(for ONLY
> those successfully copied)
>
> 2. MOVE those same files from dir-tree A to dir-tree C
>
> --
> --
>
> Gregory Waleed Kavalec
> -
> What matters?...
> Only the flicker of light within the darkness,
> the feeling of warmth within the cold,
> the knowledge of love within the void.
>  — Joan Walsh Anglund
>
>
>
>
>
>
>
>

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~

RE: I need an even smarter robocopy

[Sam Cayze]

SyncBack.  Create a profile to Sync A>B.  On success, it can trigger
another profile to Move A>C.
 
Possible a few other too.  You could probably even get RoboCopy to do
this if it give an exit code.  
(IF RoboCopyScriptA Exit Code=Success THEN RoboCopyScriptB)



From: G.Waleed Kavalec [mailto:kava...@gmail.com] 
Sent: Wednesday, October 14, 2009 3:39 PM
To: NT System Admin Issues
Subject: I need an even smarter robocopy


What tools are out there that will...  

1. copy all files from dir-tree A to dir-tree B and then,  
   (for ONLY those successfully copied)

2. MOVE those same files from dir-tree A to dir-tree C

-- 
-- 

Gregory Waleed Kavalec
-
What matters?...
Only the flicker of light within the darkness, 
the feeling of warmth within the cold, 
the knowledge of love within the void.
 - Joan Walsh Anglund





 

 


~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~ <http://www.sunbeltsoftware.com/Business/VIPRE-Enterprise/>  ~

I need an even smarter robocopy

[G.Waleed Kavalec]

What tools are out there that will...
1. copy all files from dir-tree A to dir-tree B and then,(for ONLY those
successfully copied)

2. MOVE those same files from dir-tree A to dir-tree C

-- 
-- 

Gregory Waleed Kavalec
-
What matters?...
Only the flicker of light within the darkness,
the feeling of warmth within the cold,
the knowledge of love within the void.
 — Joan Walsh Anglund

~ Finally, powerful endpoint security that ISN'T a resource hog! ~
~   ~