HeartSaVioR commented on PR #47490: URL: https://github.com/apache/spark/pull/47490#issuecomment-2333377882
We talked offline. @ericm-db will do the following: 1. File a new JIRA ticket to handle the schema write for acceptable schema change. (This is only applicable for version 3) 2. Move the logic to MicroBatchExecution and let the metadata purge uses the same executor service with offset/commit purge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org