MK created ATLAS-4724: ------------------------- Summary: column lineage in where clause and join condition are not collected Key: ATLAS-4724 URL: https://issues.apache.org/jira/browse/ATLAS-4724 Project: Atlas Issue Type: Improvement Components: hive-integration Affects Versions: 2.2.0 Environment: hive 3.1.2 / atlas 2.2.0 Reporter: MK
we are using atlas to collect hivesql column lineage. when there's data issue in a column, we will rerun etl script follow this lineage . now we found columns in where clause and join condition are not collected in lineage. sample : insert into tableA( a, b, c ) select x, y , z from tableB where d = '123'; if there is data issue in tableB.d , tableA will be impacted and we will rerun tableA , but the lineage didn't show relation between column d and tableA . the same as columns in join condition . -- This message was sent by Atlassian Jira (v8.20.10#820010)