[ 
https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13747756#comment-13747756
 ] 

Francis Liu commented on HIVE-4331:
-----------------------------------

{quote}
How about we make HiveOFImpl implement HiveOF and than add implementation for 
getHiveRR and getRR in it in similar fashion in whats in proposed HivePTOF is?
{quote}
I don't think that's possible since HiveOFImpl is not used the same way as 
HiveOF is. HiveOFImpl is the actual OF that's passed to the job and is 
essentially a wrapper for the different concrete FileSinkOperators that's part 
of a given stage. The FileSinkOperators in turn contain a concrete instance of 
HiveOF. Also it would be meaningless to have HiveOFImpl implement HiveOF given 
that the consumer of HiveOFImpl is the MR framework which has no notion of 
HiveOF.

Maybe I'm missing something here? I'd be happy to discuss this with you offline 
to help this patch get moving.
                
> Integrated StorageHandler for Hive and HCat using the HiveStorageHandler
> ------------------------------------------------------------------------
>
>                 Key: HIVE-4331
>                 URL: https://issues.apache.org/jira/browse/HIVE-4331
>             Project: Hive
>          Issue Type: Task
>          Components: HCatalog
>    Affects Versions: 0.11.0, 0.12.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Viraj Bhat
>         Attachments: HIVE4331_07-17.patch, StorageHandlerDesign_HIVE4331.pdf
>
>
> 1) Deprecate the HCatHBaseStorageHandler and "RevisionManager" from HCatalog. 
> These will now continue to function but internally they will use the 
> "DefaultStorageHandler" from Hive. They will be removed in future release of 
> Hive.
> 2) Design a HivePassThroughFormat so that any new StorageHandler in Hive will 
> bypass the HiveOutputFormat. We will use this class in Hive's 
> "HBaseStorageHandler" instead of the "HiveHBaseTableOutputFormat".
> 3) Write new unit tests in the HCat's "storagehandler" so that systems such 
> as Pig and Map Reduce can use the Hive's "HBaseStorageHandler" instead of the 
> "HCatHBaseStorageHandler".
> 4) Make sure all the old and new unit tests pass without backward 
> compatibility (except known issues as described in the Design Document).
> 5) Replace all instances of the HCat source code, which point to 
> "HCatStorageHandler" to use the"HiveStorageHandler" including the 
> "FosterStorageHandler".
> I have attached the design document for the same and will attach a patch to 
> this Jira.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to