shrirangmhalgi opened a new pull request, #57866: URL: https://github.com/apache/spark/pull/57866
### What changes were proposed in this pull request? Add `OidcCredentialIntegrationSuite` with 13 integration tests that verify the coexistence of the new OIDC credential propagation framework (`UserCredentialManager`) with the existing Kerberos delegation token system (`HadoopDelegationTokenManager`). The tests cover: - OIDC credential delivery via the `UserCredentialManager` callback using the existing `FakeCredentialProvider` - Credential refresh on token expiry with version monotonicity guarantees - Per-user identity tokens produce credentials identically to workload-level tokens - Both `UserCredentialManager` and `HadoopDelegationTokenManager` active simultaneously without interference - Failure isolation: OIDC failure does not affect delegation tokens, and vice versa - `UserCredentials` serialization roundtrip (executor receive path) - Clean shutdown lifecycle - Feature-disabled state does not interfere with the other credential system ### Why are the changes needed? SPARK-57896 is a sub-task of the OIDC Credential Propagation SPIP (SPARK-57703). The SPIP's Q8 mid-term success criteria require integration tests proving that: - A Fake `CredentialProvider` delivers `ServiceCredential` to executors and refreshes on expiry - The same test passes with per-user identity tokens - Both credential systems coexist without interference - Existing Kerberos delegation token tests pass without modification - These tests did not previously exist. All core SPI components are now merged on master, making these tests implementable. ### Does this PR introduce _any_ user-facing change? No. This PR adds only test code. ### How was this patch tested? All 13 new tests pass in `OidcCredentialIntegrationSuite`. The existing credential suites pass without modification: - `UserCredentialManagerSuite` - `NonKerberosCredentialsSuite` - `HadoopDelegationTokenManagerSuite` - `HadoopFSDelegationTokenProviderSuite` ### Was this patch authored or co-authored using generative AI tooling? Yes. Co-Authored using Claude Opus 4.6 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
