GitHub user yrenat added a comment to the discussion: What should Texera do when a computing unit dies?
Hi @eugenegujing, I agree with @kunwp1 on the possible directions to address your questions, and I would like to add some of my thoughts to your observation. I think you are right that there is no liveness check for a CU, but there does exist such checks for workflows. This [PR](https://github.com/apache/texera/pull/2123) aims to clean garbage workflow execution results after a configured TTL. It does not directly solve your problem, but I think it shows the possibility to monitor CU status from a workflow perspective. That may be easier to work with because you are technically utilizing something pre-built. Anyway, this PR introduces the `last_active` variable which records the last active time of each workflow inside the CUs. This variable might be helpful for your question because 1. a CU can be considered avtive if there are more than one workflow being active 2. a CU can be considered dead if all the workflows have been idle for a long time 3. ... Thanks @chenlica for letting me join this discussion. Hope that helps. GitHub link: https://github.com/apache/texera/discussions/7670#discussioncomment-18039917 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
