taiyang-li commented on issue #5788: URL: https://github.com/apache/incubator-gluten/issues/5788#issuecomment-2116595445
猜想：当driver发送shutdown command到executor时，executor执行ShutdownHookManager中注册过的hook函数，其中包括释放native engine中的全局资源。但是从上面的log看，此时native engine中，source算子还在执行，它会依赖已经被释放的全局资源(global thread pool), 从而造成crash. TODO - LocalExecutor支持cancel功能，底层调用PullingPipelineExecutor::cancel。 - 实现gluten自定义processor的onCancel接口，在其中释放processor自身的资源。 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@gluten.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@gluten.apache.org For additional commands, e-mail: commits-h...@gluten.apache.org
