[
https://issues.apache.org/jira/browse/ATLAS-1291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15678921#comment-15678921
]
Vimal Sharma commented on ATLAS-1291:
-------------------------------------
[~madhan.neethiraj] Before the commit for ATLAS-1272, the below code in
HiveDataModelGenerator was responsible for creating hive_column_lineage type. I
have created JSON for hive_column_lineage type in the patch looking at the
corresponding code in HiveDataModelGenerator. Please checkout to commit before
ATLAS-1272 to get details
{code}
private void createColumnLineageClass() throws AtlasException {
AttributeDefinition[] attributeDefinitions = new AttributeDefinition[]{
new AttributeDefinition("query",
HiveDataTypes.HIVE_PROCESS.getName(),
Multiplicity.REQUIRED, false, null),
new
AttributeDefinition("depenendencyType",DataTypes.STRING_TYPE.getName(),
Multiplicity.REQUIRED, false, null),
new
AttributeDefinition("expression",DataTypes.STRING_TYPE.getName(),
Multiplicity.OPTIONAL, false, null)
};
HierarchicalTypeDefinition<ClassType> definition =
new HierarchicalTypeDefinition<>(ClassType.class,
HiveDataTypes.HIVE_COLUMN_LINEAGE.getName(), null,
ImmutableSet.of(AtlasClient.PROCESS_SUPER_TYPE),
attributeDefinitions);
classTypeDefinitions.put(HiveDataTypes.HIVE_COLUMN_LINEAGE.getName(),
definition);
LOG.debug("Created definition for " +
HiveDataTypes.HIVE_COLUMN_LINEAGE.getName());
}
{code}
> Type "hive_column_lineage" not present in hive_model.json
> ---------------------------------------------------------
>
> Key: ATLAS-1291
> URL: https://issues.apache.org/jira/browse/ATLAS-1291
> Project: Atlas
> Issue Type: Bug
> Reporter: Vimal Sharma
> Assignee: Vimal Sharma
> Attachments: ATLAS-1291.patch
>
>
> Type "hive_column_lineage" was generated in HiveDataModelGenerator.java.
> The above file has been deprecated and the types are now registered from
> hive_model.json inside models directory.
> This file does not contain the type definition JSON for type
> "hive_column_lineage". Due to this, column level lineage hook messages are
> failing to be registered with Atlas.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
