Re: Copy data between clusters during the job execution.

2015-02-02 Thread Artem Ervits
take a look at oozie, once first job completes you can distcp to another server. Artem Ervits On Feb 2, 2015 5:46 AM, Daniel Haviv danielru...@gmail.com wrote: It should run after your job finishes. You can create the flow using a simple bash script Daniel On 2 בפבר׳ 2015, at 12:31,

Re: Copy data between clusters during the job execution.

2015-02-02 Thread Daniel Haviv
You can use distcp Daniel On 2 בפבר׳ 2015, at 11:12, xeon Mailinglist xeonmailingl...@gmail.com wrote: Hi I want to have a job that copies the map output, or the reduce output to another hdfs. Is is possible? E.g., the job runs in cluster 1 and takes the input from this cluster.

Re: Copy data between clusters during the job execution.

2015-02-02 Thread Daniel Haviv
It should run after your job finishes. You can create the flow using a simple bash script Daniel On 2 בפבר׳ 2015, at 12:31, xeonmailinglist xeonmailingl...@gmail.com wrote: But can I use discp inside my job, or I need to program something that executes distcp after executing my job?

Re: Copy data between clusters during the job execution.

2015-02-02 Thread xeonmailinglist
But can I use discp inside my job, or I need to program something that executes distcp after executing my job? On 02-02-2015 10:20, Daniel Haviv wrote: an use distcp Daniel On 2 בפבר׳ 2015, at 11:12,

RE: Copy data between clusters during the job execution.

2015-02-02 Thread hadoop.support
, S.RagavendraGanesh Hadoop Support Team ViSolve Inc.| http://www.visolve.com/ www.visolve.com From: dbis...@gmail.com [mailto:dbis...@gmail.com] On Behalf Of Artem Ervits Sent: Tuesday, February 03, 2015 6:49 AM To: user@hadoop.apache.org Subject: Re: Copy data between clusters during the job execution