hudi-bot opened a new issue, #14789: URL: https://github.com/apache/hudi/issues/14789
## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-1881 - Type: Bug --- ## Comments 16/May/21 03:08;nishith29;Looking into the HoodieMultiTableDeltaStreamer is not designed to run in continuous mode as can be seen, the execution is done serially and in continuous mode, it's stuck at the first one. {code:java} for (TableExecutionContext context : tableExecutionContexts) { try { new HoodieDeltaStreamer(context.getConfig(), jssc, Option.ofNullable(context.getProperties())).sync(); successTables.add(Helpers.getTableWithDatabase(context)); } catch (Exception e) { logger.error("error while running MultiTableDeltaStreamer for table: " + context.getTableName(), e); failedTables.add(Helpers.getTableWithDatabase(context)); } } {code} ;;; --- 16/May/21 23:15;nishith29;To enable this feature, we might have to implement a threadpool and then let the sync() for each table happen in asynchronously without blocking. ;;; --- 18/May/21 00:09;shivnarayan;[~nishith29]: I guess we can downgrade the severity to sev:high IMO. ;;; --- 13/Dec/21 14:15;shivnarayan;CC [~harsh1231] ;;; -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
