[
https://issues.apache.org/jira/browse/HIVE-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750523#comment-13750523
]
Ashutosh Chauhan commented on HIVE-4331:
----------------------------------------
[~toffer] One more thing popped up in my discussion with Sushanth. Another
issue which is in this general area of Hive usage of OF is w.r.t
OutputCommitter. Hive currently explicitly disables OC and performs lot of
logic (which folks usually write in OC) from client side. Architecturally, its
cleaner for Hive to migrate these things from client to OC and make OC first
class citizen. For folks who has OF which has OC, it will be easier to
integrate that in Hive, instead of understanding Hive innards and handling of
OC. Wondering if you have given a thought on this? I just want to make sure if
and when we go that route these current changes won't get in the way.
> Integrated StorageHandler for Hive and HCat using the HiveStorageHandler
> ------------------------------------------------------------------------
>
> Key: HIVE-4331
> URL: https://issues.apache.org/jira/browse/HIVE-4331
> Project: Hive
> Issue Type: Task
> Components: HCatalog
> Affects Versions: 0.11.0, 0.12.0
> Reporter: Ashutosh Chauhan
> Assignee: Viraj Bhat
> Attachments: HIVE4331_07-17.patch, StorageHandlerDesign_HIVE4331.pdf
>
>
> 1) Deprecate the HCatHBaseStorageHandler and "RevisionManager" from HCatalog.
> These will now continue to function but internally they will use the
> "DefaultStorageHandler" from Hive. They will be removed in future release of
> Hive.
> 2) Design a HivePassThroughFormat so that any new StorageHandler in Hive will
> bypass the HiveOutputFormat. We will use this class in Hive's
> "HBaseStorageHandler" instead of the "HiveHBaseTableOutputFormat".
> 3) Write new unit tests in the HCat's "storagehandler" so that systems such
> as Pig and Map Reduce can use the Hive's "HBaseStorageHandler" instead of the
> "HCatHBaseStorageHandler".
> 4) Make sure all the old and new unit tests pass without backward
> compatibility (except known issues as described in the Design Document).
> 5) Replace all instances of the HCat source code, which point to
> "HCatStorageHandler" to use the"HiveStorageHandler" including the
> "FosterStorageHandler".
> I have attached the design document for the same and will attach a patch to
> this Jira.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
