shashwatsai commented on issue #8037: URL: https://github.com/apache/seatunnel/issues/8037#issuecomment-2480939067
We also have a scenario, where we have an hdfs path as source (an external hive table sits on top of it), we have sink as hdfs path (another external hive table sits on top of it), post the sink task is complete, we need a way to add partition to the hive table through a DDL query (Alter Table Add Partition). CC: @Hisoka-X, @arshadmohammad Please suggest an existing way as a workaround for the same. Suggestive Event Based Approach: - Centralized Notification Engine (or extending the existing notification system). - On events, such as JobCompletion, JobError, JobFailure. - Notification listeners have connectors defined in their respective configurations. - Notification connectors implement methods like connect(), process(), and acknowledge(). <img width="1312" alt="image" src="https://github.com/user-attachments/assets/fa767e83-6e29-485c-964e-29bcb336fdec";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
