zhengruifeng opened a new pull request, #57461: URL: https://github.com/apache/spark/pull/57461
### What changes were proposed in this pull request? This draft adds an AI-assisted, target-level post-merge test selector. In trusted Apache Spark push builds, Copilot CLI examines the changed code and tests with read-only access, then returns up to four Scala suite classes and four PySpark test modules. The workflow validates every selected target against the checked-out repository before execution. Scala targets are resolved to their SBT test project, including Connect, YARN, and Kafka subprojects, and run with `testOnly`. PySpark targets run with `python/run-tests --testnames`. Invalid, broad, or invented targets are ignored, and a Copilot setup or request failure leaves the existing CI unaffected. ### Why are the changes needed? The existing CI operates at module granularity, which can run substantially more tests than are directly relevant to a post-merge change. A validated, exact-target selection provides a focused signal while preserving the current deterministic CI jobs as the fallback coverage. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? - Parsed the modified GitHub Actions YAML files with PyYAML. - Ran `git diff --check`. - Validated known Scala, Connect, and PySpark test targets with `dev/ai_test_selection.py validate`. - No full Spark test suite was run; this workflow-only change will be exercised by post-merge CI. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Codex (GPT-5) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
