Re: [I] [CH] Make sure that all processors are cancelled before releasing global resources in native engine and after yarn kill or driver shutdown command comes [incubator-gluten]

2024-05-16 Thread via GitHub
taiyang-li commented on issue #5788: URL: https://github.com/apache/incubator-gluten/issues/5788#issuecomment-2116595445 猜想:当driver发送shutdown command到executor时,executor执行ShutdownHookManager中注册过的hook函数,其中包括释放native engine中的全局资源。但是从上面的log看,此时native engine中,source算子还在执行,它会依赖已经被释放的全局资源(global

[I] [CH] Make sure that all processors are cancelled before releasing global resources in native engine and after yarn kill or driver shutdown command comes [incubator-gluten]

2024-05-16 Thread via GitHub
taiyang-li opened a new issue, #5788: URL: https://github.com/apache/incubator-gluten/issues/5788 ### Backend CH (ClickHouse) ### Bug description