Weixin-Xu opened a new pull request, #13367:
URL: https://github.com/apache/gluten/pull/13367
## What changes are proposed in this pull request?
This PR fixes native runtime issues encountered while running Gluten tests
with the Bolt backend.
- Fix memory holder cleanup for driver contexts using task ID `-1`. Retain
task memory accounting until all holder destructions finish, including
concurrent destruction and registration of new holders.
- Pass the configured minimum-memory wait timeout to the execution memory
pool.
- Finalize the S3 filesystem after stopping the backend IO executor.
- Derive the default partial-aggregation spill threshold from the
abandonment thresholds, while preserving validation of explicitly configured
values.
- Link example UDF/UDAF libraries and the UDF test against the shared
backend engine to avoid duplicate engine registries. Export the required memory
flags and relink the backend when its symbol map changes.
Add memory lifecycle regression tests covering driver cleanup,
preservation of other managers, registration during destruction, and concurrent
destruction.
Changes are confined to Bolt native implementation, build configuration,
and tests.
## How was this patch tested?
These changes were tested as part of the integrated Bolt CI candidate
using Bolt revision `071e54764f887dfb4337260e440f2f12f6ab82f5`:
- Native CTest: 143 tests passed, with 7 existing skips.
- JVM UDF tests: 61 tests passed, plus 2 GenerateExample tests.
- The complete reference TPC-H/TPC-DS/HDFS/S3 integration case passed,
including process shutdown.
The integrated candidate was subsequently split into topic commits without
changing its final file tree. Patch composition and dependency checks passed.
The standalone branch has not been rebuilt or runtime-tested
independently. Native reproduction requires the recorded Bolt revision and
applicable engine compatibility patches.
## Was this patch authored or co-authored using generative AI tooling?
Generated-by: Codex (GPT-6)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
