Tim Armstrong has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/14515 )
Change subject: IMPALA-9070: Include table location in lineage for 'CREATE EXTERNAL TABLE' DDL. ...................................................................... IMPALA-9070: Include table location in lineage for 'CREATE EXTERNAL TABLE' DDL. Atlas needs table location to establish lineage between a newly created external table and its table location. The table location information is not available until the createTable catalog op succeeds. After this change, location information is sent to the backend in the TDDLExecResponse message which adds it to the lineage graph. This information is sent only for create external table queries. Testing: Added a test to verify the tableLocation field is populated for a create external table query lineage. Also, modified the lineage.test file to include location information for all lineages. Change-Id: If02b0cc16d52c1956298171628f5737cab62ce9f Reviewed-on: http://gerrit.cloudera.org:8080/14515 Reviewed-by: Tim Armstrong <tarmstr...@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> --- M be/src/service/client-request-state.cc M be/src/util/lineage-util.h M common/thrift/CatalogService.thrift M common/thrift/LineageGraph.thrift M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java M testdata/workloads/functional-query/queries/QueryTest/lineage.test M tests/custom_cluster/test_lineage.py 7 files changed, 882 insertions(+), 449 deletions(-) Approvals: Tim Armstrong: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/14515 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: If02b0cc16d52c1956298171628f5737cab62ce9f Gerrit-Change-Number: 14515 Gerrit-PatchSet: 3 Gerrit-Owner: Anurag Mantripragada <anu...@cloudera.com> Gerrit-Reviewer: Anurag Mantripragada <anu...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Tim Armstrong <tarmstr...@cloudera.com> Gerrit-Reviewer: radford nguyen <radford.ngu...@gmail.com>
