amaechler opened a new pull request, #20471: URL: https://github.com/apache/druid/pull/20471
### Description Kafka supervisors and Kafka lookups cannot authenticate to an Amazon MSK cluster that uses IAM access control, because neither extension ships the [aws-msk-iam-auth](https://github.com/aws/aws-msk-iam-auth) plugin that provides the `AWS_MSK_IAM` SASL mechanism. This PR bundles the plugin in both extensions, so IAM authentication works with configuration alone. This PR replaces #17355 from @zachjsh, which took the same approach (but Druid move to AWS SDK v2 since) but updates the plugin to 2.3.9 and adds tests, docs and licence entries. Imply already runs the plugin internally, and the jar is 60 KB. #### Release note Kafka supervisors and Kafka lookups can now connect to Amazon MSK clusters that use IAM access control. The `druid-kafka-indexing-service` and `druid-kafka-extraction-namespace` extensions bundle the Amazon MSK IAM authentication library, so set `sasl.mechanism` to `AWS_MSK_IAM` and the related consumer properties, without installing extra jars. Druid picks up credentials from the default AWS provider chain and can assume a role. Closes #17355. <hr> This PR has: - [x] been self-reviewed. - [x] added documentation for new or modified features or behaviors. - [x] a release note entry in the PR description. - [x] added or updated version, license, or notice information in [licenses.yaml](https://github.com/apache/druid/blob/master/dev/license.md) - [x] added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader. - [x] added unit tests or modified existing tests to cover new code paths, ensuring the threshold for [code coverage](https://github.com/apache/druid/blob/master/dev/code-review/code-coverage.md) is met. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
