[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-27 Thread Carl Steinbach (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach updated HIVE-1543:
-

Component/s: Query Processor

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>  Components: Query Processor
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1543.1.patch, HIVE-1543.2_branch0.6.patch, 
> HIVE-1543.patch, HIVE-1543_branch0.6.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-16 Thread Namit Jain (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-1543:
-

  Status: Resolved  (was: Patch Available)
Hadoop Flags: [Reviewed]
  Resolution: Fixed

Committed. Thanks Ning

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1543.1.patch, HIVE-1543.2_branch0.6.patch, 
> HIVE-1543.patch, HIVE-1543_branch0.6.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-16 Thread Ning Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang updated HIVE-1543:
-

Attachment: HIVE-1543.2_branch0.6.patch

Uploading a new patch for branch 0.6.

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1543.1.patch, HIVE-1543.2_branch0.6.patch, 
> HIVE-1543.patch, HIVE-1543_branch0.6.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-16 Thread Ning Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang updated HIVE-1543:
-

Attachment: HIVE-1543.1.patch
HIVE-1543_branch0.6.patch

Uploading 2 patches for trunk and 0.6 respectively. 

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1543.1.patch, HIVE-1543.patch, 
> HIVE-1543_branch0.6.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-16 Thread Ning Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang updated HIVE-1543:
-

Fix Version/s: 0.6.0
   (was: 0.7.0)

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1543.1.patch, HIVE-1543.patch, 
> HIVE-1543_branch0.6.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-16 Thread Ning Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang updated HIVE-1543:
-

   Status: Patch Available  (was: Open)
Fix Version/s: 0.7.0

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Fix For: 0.7.0
>
> Attachments: HIVE-1543.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.



[jira] Updated: (HIVE-1543) set abort in ExecMapper when Hive's record reader got an IOException

2010-08-16 Thread Ning Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang updated HIVE-1543:
-

Attachment: HIVE-1543.patch

passed all hadoop 0.20 tests.

> set abort in ExecMapper when Hive's record reader got an IOException
> 
>
> Key: HIVE-1543
> URL: https://issues.apache.org/jira/browse/HIVE-1543
> Project: Hadoop Hive
>  Issue Type: Improvement
>Reporter: Ning Zhang
>Assignee: Ning Zhang
> Attachments: HIVE-1543.patch
>
>
> When RecordReader got an IOException, ExecMapper does not know and will close 
> the operators as if there is not error. We should catch this exception and 
> avoid writing partial results to HDFS which will be removed later anyways.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.