[
https://issues.apache.org/jira/browse/ATLAS-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631283#comment-16631283
]
aflyary commented on ATLAS-2893:
--------------------------------
I refer to the hive source code, when we set the altas hook class at the
hive-site.xml with the name 'org.apache.atlas.hive.hook.HiveHook', hive
optimizer would not set the linegae info into the hookContext, after the patch
HIVE-13112 already fix this. But early hive version still could not work, so i
go ahead and dive into the hive lineageState of SessionState, maybe we could
get the private info of the LineageCtx to work out the lineage dependency,
then get the column lineage.
> Atlas Column Lineage of Hive Hook to support the hive old version (before
> hive version 1.2.1 after the patch for HIVE-13112)
> ----------------------------------------------------------------------------------------------------------------------------
>
> Key: ATLAS-2893
> URL: https://issues.apache.org/jira/browse/ATLAS-2893
> Project: Atlas
> Issue Type: Improvement
> Components: atlas-intg
> Affects Versions: 1.0.0
> Reporter: aflyary
> Priority: Major
> Fix For: 1.1.0
>
>
> Right now atlas hook for apache hive of column lineage is limited,
> only "Column level lineage works with Hive version 1.2.1 after the patch for
> HIVE-13112 is applied to Hive source" could support the hive column lineage.
> In some product env, hive version still very old, but we should also
> support the hive column lineage.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)