Re: Job is reported as complete on history server while on console it shows as only half way thru

2014-08-31 Thread Zhijie Shen
Doe you mean multiple application attempts on YARN? One MR job shouldn't result in multiple YARN applications. Would you please share what is shown on the JHS and RM web UIs? On Thu, Aug 28, 2014 at 2:01 PM, S.L wrote: > Hi All, > > I am running a MRV1 job on Hadoop YARN 2.3.0 cluster , the pro

Re: Hadoop 2.5.0 unit tests failures

2014-08-31 Thread Zhijie Shen
Hi Rajat, It is the situation that some test cases will have kinds of race conditions, an fail intermittently. In most cases, contributors are working on a linux box, such that the test case may implicitly make some assumption that is not valid for other systems. It is appreciated to report these

Re: CPU utilization keeps increasing when using HDFS

2014-08-31 Thread Stanley Shi
Would you please give the output of the "top" command? at least to show that the HDFS process did use that much of CPU; On Mon, Sep 1, 2014 at 2:19 PM, Shiyuan Xiao wrote: > Hi > > > We have written a MapReduce application based on Hadoop 2.4 which keeps > reading data from HDFS(Pseudo-distrib

CPU utilization keeps increasing when using HDFS

2014-08-31 Thread Shiyuan Xiao
Hi We have written a MapReduce application based on Hadoop 2.4 which keeps reading data from HDFS(Pseudo-distributed mode in one node). And we found the CPU system time and user time of the application keeps increasing when it is running. If we changed the application to read data from local di

Re: Tez and MapReduce

2014-08-31 Thread Tsuyoshi OZAWA
Hi, Yes, they can on YARN. - Tsuyoshi On Mon, Sep 1, 2014 at 2:32 PM, Adaryl "Bob" Wakefield, MBA wrote: > Can Tez and MapReduce live together and get along in the same cluster? > B. -- - Tsuyoshi

Tez and MapReduce

2014-08-31 Thread Adaryl "Bob" Wakefield, MBA
Can Tez and MapReduce live together and get along in the same cluster? B.