Re: can't copy files between HDFS to a specific dir

In my case it has nothing to do with directory permissions. I think |distcp| cannot copy a file into a directory. It just can copy directories, or copy a file into |/| dir. On 08/17/2015 11:30 PM, Vernon Funkhouser wrote: I would first check the directory permissions. If they are set to re

Remotely submit a job to Yarn on CDH5.4

Hi, I want to remotely submit a job to Yarn on CDH5.4. The following is the code about the WordCount and the error report. Any one knows how to solve it? Thanks in advance, Fei INFO: Job job_1439867352386_0025 failed with state FAILED due to: Application application_1439867352386_0025 failed

Remotely submit a job to Yarn on CDH5.4

Hi, I want to remotely submit a job to Yarn on CDH5.4. The following is the code about the WordCount and the error report. Any one knows how to solve it? Thanks in advance, Fei INFO: Job job_1439867352386_0025 failed with state FAILED due to: Application application_1439867352386_0025 failed

Re: can't copy files between HDFS to a specific dir

Have you created the destination directory "/input1"? I'm thinking you need to create the directory before distcp. Regards, Akira On 8/18/15 17:29, xeonmailinglist wrote: In my case it has nothing to do with directory permissions. I think |distcp| cannot copy a file into a directory. It just ca

Re: Sorting the inputSplits

Thank you.I have explained the problem better here below.Is this possible?. We have a use case where we have files in the below directory structure. The requirement is that we should not process files inside a Parent directory in parallel(1.txt and 2.txt cannot be processed in parallel sinc

Re: Sorting the inputSplits

Hi Nishanth Even if u ordered input split u can't order d output On Aug 19, 2015 1:55 AM, "Nishanth S" wrote: > Thank you.I have explained the problem better here below.Is this > possible?. > > > We have a use case where we have files in the below directory structure. > The requirement is tha

RE: Remotely submit a job to Yarn on CDH5.4

Are you trying submit job from Windows to Linux server? If yes, try to submit job using with mapreduce.app-submission.cross-platform=true. Thanks & Regards Rohith Sharma K S From: Fei Hu [mailto:hufe...@gmail.com] Sent: 18 August 2015 21:11 To: user@hadoop.apache.org Subject: Remotely submit a