Hi
I want to have a job that copies the map output, or the reduce output to
another hdfs. Is is possible?
E.g., the job runs in cluster 1 and takes the input from this cluster.
Then, before the job finishes, it copies the map output or the reduce
output to the hdfs in the cluster 2.
Thanks,
You can use distcp
Daniel
> On 2 בפבר׳ 2015, at 11:12, xeon Mailinglist wrote:
>
> Hi
>
> I want to have a job that copies the map output, or the reduce output to
> another hdfs. Is is possible?
>
> E.g., the job runs in cluster 1 and takes the input from this cluster. Then,
> before the j
But can I use discp inside my job, or I need to program something that
executes distcp after executing my job?
On 02-02-2015 10:20, Daniel Haviv wrote:
an use distcp
Daniel
On 2 בפבר׳ 2015, at 11:12,
It should run after your job finishes.
You can create the flow using a simple bash script
Daniel
> On 2 בפבר׳ 2015, at 12:31, xeonmailinglist wrote:
>
> But can I use discp inside my job, or I need to program something that
> executes distcp after executing my job?
>
>
>> On 02-02-2015 10:20
take a look at oozie, once first job completes you can distcp to another
server.
Artem Ervits
On Feb 2, 2015 5:46 AM, "Daniel Haviv" wrote:
> It should run after your job finishes.
> You can create the flow using a simple bash script
>
> Daniel
>
> On 2 בפבר׳ 2015, at 12:31, xeonmailinglist
> w
,
S.RagavendraGanesh
Hadoop Support Team
ViSolve Inc.| <http://www.visolve.com/> www.visolve.com
From: dbis...@gmail.com [mailto:dbis...@gmail.com] On Behalf Of Artem Ervits
Sent: Tuesday, February 03, 2015 6:49 AM
To: user@hadoop.apache.org
Subject: Re: Copy data between clusters during the job exe
