RE: Wonky reduce progress

2011-08-19 Thread Vinayakumar B

Please check the defect in MAPREDUCE jira
https://issues.apache.org/jira/browse/MAPREDUCE-2264

This is because the compression is enabled for map outputs and statistics
are taken on compressed data instead of original data.

-Original Message-
From: Joey Echeverria [mailto:j...@cloudera.com] 
Sent: Friday, August 19, 2011 3:07 AM
To: d...@hive.apache.org
Subject: Wonky reduce progress

I'm seeing really weird numbers in the JobTracker when monitoring jobs
launched by hives. Some jobs who above 100% completion while running
and others show less than 100% after the job completed. I tried
searching for JIRAs but didn't see any matches.

Has anyone else run into this?

-Joey

-- 
Joseph Echeverria
Cloudera, Inc.
443.305.9434



Re: Wonky reduce progress

2011-08-19 Thread Joey Echeverria
Yup, that would do it. Thanks.

-Joey

On Fri, Aug 19, 2011 at 4:14 AM, Vinayakumar B vinayakuma...@huawei.com wrote:

 Please check the defect in MAPREDUCE jira
 https://issues.apache.org/jira/browse/MAPREDUCE-2264

 This is because the compression is enabled for map outputs and statistics
 are taken on compressed data instead of original data.

 -Original Message-
 From: Joey Echeverria [mailto:j...@cloudera.com]
 Sent: Friday, August 19, 2011 3:07 AM
 To: d...@hive.apache.org
 Subject: Wonky reduce progress

 I'm seeing really weird numbers in the JobTracker when monitoring jobs
 launched by hives. Some jobs who above 100% completion while running
 and others show less than 100% after the job completed. I tried
 searching for JIRAs but didn't see any matches.

 Has anyone else run into this?

 -Joey

 --
 Joseph Echeverria
 Cloudera, Inc.
 443.305.9434





-- 
Joseph Echeverria
Cloudera, Inc.
443.305.9434