okumin commented on PR #6641: URL: https://github.com/apache/hive/pull/6641#issuecomment-5250155727
@saihemanth-cloudera Thank you! Your insight is helpful. > The overall patch looks good to me. But I have one question around data lineage/audit: Should we add dedicated lineage/audit emission for stage-create itself? Or should the lineage is finalized only on commit/create? It's worth thinking... My understanding is as follows. Since a stage-created table is not visible from any other transactions yet, I would say it is not the time to generate a lineage yet. Regarding the audit w/ Ranger, the storage access is already audited. I expect the catalog operation to also be audited as CREATE TABLE if this PR is merged. Considering a stage-create is part of CTAS, it does not break the audit semantics in my current understanding. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
