JoonPark1 commented on PR #7227: URL: https://github.com/apache/kyuubi/pull/7227#issuecomment-3512233108
@turboFei That does sound like a good alternative to impose a limit on max # of batches to recover per each recovery attempt. Is this already an available configuration for kyuubi or does it needs to be added? If it's not available, I think we can add as extra kyuubi server-side config and have it be part of updated KyuubiSessionManager::getBatchSessionsToRecover method as extra argument as an offset int parameter to the method. Additionally, in the KyuubiRestFrontendService::recoverBatchSessions(), we can have it call KyuubiSessionManager::getBatchSessionsToRecover repeatedly to obtain sequence of instantiated KyuubiBatchSessions that correspond to batch records obtained from relational store until there are no more metadata records pertaining to batches to process. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
