Saisai Shao created SPARK-22405: ----------------------------------- Summary: Enrich the event information of ExternalCatalogEvent Key: SPARK-22405 URL: https://issues.apache.org/jira/browse/SPARK-22405 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.2.0 Reporter: Saisai Shao Priority: Minor
We're building a data lineage tool in which we need to monitor the metadata changes in {{ExternalCatalog}}, current {{ExternalCatalog}} already provides several useful events like "CreateDatabaseEvent" for custom SparkListener to use. But the information provided by such event is not rich enough, for example {{CreateTablePreEvent}} only provides "database" name and "table" name, not all the table metadata, which is hard for user to get all the table related useful information. So here propose to and new {{ExternalCatalogEvent}} and enrich the current existing events for all the catalog related updates. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org