piby180 opened a new issue, #11761: URL: https://github.com/apache/pinot/issues/11761
We are currently facing the following exception in the controller pod ok EKS. The minion job SegmentGenerationAndPush works for one hour after controller pod restart and after that it doesn't work anymore and throws the error below. Restarting the job fixes the error again for an hour after which the error appears again. We use IRSA roles on service account to provide S3 access to pinot pods. The problem started happening after we upgraded the helm chart from release-0.12.1 to release-1.0.0. It seems that it is happening after upgrading awssdk to 2.20.162 in pinot release-1.0.0. It was not happening with awssdk 2.14.28 in pinot release-0.12.1. It looks like it is unable to referesh the aws session token after it is expired in one hour. Similar issue has been raised in awssdk project https://github.com/aws/aws-sdk-java-v2/issues/4386 https://github.com/aws/aws-sdk-java-v2/issues/4221 This issue is currently blocking all our batch ingestion minion jobs in our offline tables forcing us to downgrade back to release-0.12.1 ``` Unable to list files under URI: s3://bucket/path java.io.IOException: java.lang.IllegalStateException: Connection pool shut down at org.apache.pinot.plugin.filesystem.S3PinotFS.visitFiles(S3PinotFS.java:556) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.plugin.filesystem.S3PinotFS.listFiles(S3PinotFS.java:490) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.plugin.minion.tasks.segmentgenerationandpush.SegmentGenerationAndPushTaskGenerator.getInputFilesFromDirectory(SegmentGenerationAndPushTaskGenerator.java:343) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.plugin.minion.tasks.segmentgenerationandpush.SegmentGenerationAndPushTaskGenerator.generateTasks(SegmentGenerationAndPushTaskGenerator.java:161) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.controller.helix.core.minion.PinotTaskManager.scheduleTask(PinotTaskManager.java:547) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.controller.helix.core.minion.PinotTaskManager.scheduleTask(PinotTaskManager.java:642) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.controller.helix.core.minion.CronJobScheduleJob.execute(CronJobScheduleJob.java:68) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.quartz.core.JobRunShell.run(JobRunShell.java:202) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:573) [pinot-all-1.1.0-SNAPSHOT-jar-with-dependencies.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] Caused by: java.lang.IllegalStateException: Connection pool shut down at org.apache.http.util.Asserts.check(Asserts.java:34) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.requestConnection(PoolingHttpClientConnectionManager.java:269) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.internal.conn.ClientConnectionManagerFactory$DelegatingHttpClientConnectionManager.requestConnection(ClientConnectionManagerFactory.java:75) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.internal.conn.ClientConnectionManagerFactory$InstrumentedHttpClientConnectionManager.requestConnection(ClientConnectionManagerFactory.java:57) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:176) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.internal.impl.ApacheSdkHttpClient.execute(ApacheSdkHttpClient.java:72) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.ApacheHttpClient.execute(ApacheHttpClient.java:254) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.ApacheHttpClient.access$500(ApacheHttpClient.java:104) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.ApacheHttpClient$1.call(ApacheHttpClient.java:231) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.http.apache.ApacheHttpClient$1.call(ApacheHttpClient.java:228) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.util.MetricUtils.measureDurationUnsafe(MetricUtils.java:63) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeHttpRequestStage.executeHttpRequest(MakeHttpRequestStage.java:77) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeHttpRequestStage.execute(MakeHttpRequestStage.java:56) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.MakeHttpRequestStage.execute(MakeHttpRequestStage.java:39) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:72) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptTimeoutTrackingStage.execute(ApiCallAttemptTimeoutTrackingStage.java:42) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:78) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.TimeoutExceptionHandlingStage.execute(TimeoutExceptionHandlingStage.java:40) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:52) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallAttemptMetricCollectionStage.execute(ApiCallAttemptMetricCollectionStage.java:37) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:81) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.RetryableStage.execute(RetryableStage.java:36) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:56) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.StreamManagingStage.execute(StreamManagingStage.java:36) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.executeWithTimer(ApiCallTimeoutTrackingStage.java:80) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:60) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallTimeoutTrackingStage.execute(ApiCallTimeoutTrackingStage.java:42) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:48) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ApiCallMetricCollectionStage.execute(ApiCallMetricCollectionStage.java:31) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.RequestPipelineBuilder$ComposingRequestPipelineStage.execute(RequestPipelineBuilder.java:206) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:37) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.pipeline.stages.ExecutionFailureExceptionReportingStage.execute(ExecutionFailureExceptionReportingStage.java:26) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.http.AmazonSyncHttpClient$RequestExecutionBuilderImpl.execute(AmazonSyncHttpClient.java:193) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.invoke(BaseSyncClientHandler.java:103) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.doExecute(BaseSyncClientHandler.java:171) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:82) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:179) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:76) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:56) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.services.sts.DefaultStsClient.assumeRoleWithWebIdentity(DefaultStsClient.java:757) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.services.sts.auth.StsAssumeRoleWithWebIdentityCredentialsProvider.getUpdatedCredentials(StsAssumeRoleWithWebIdentityCredentialsProvider.java:74) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.services.sts.auth.StsCredentialsProvider.updateSessionCredentials(StsCredentialsProvider.java:88) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.utils.cache.CachedSupplier.lambda$jitteredPrefetchValueSupplier$3(CachedSupplier.java:284) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.utils.cache.CachedSupplier$PrefetchStrategy.fetch(CachedSupplier.java:420) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.utils.cache.CachedSupplier.refreshCache(CachedSupplier.java:199) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.utils.cache.CachedSupplier.get(CachedSupplier.java:128) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.services.sts.auth.StsCredentialsProvider.resolveCredentials(StsCredentialsProvider.java:101) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.services.sts.internal.StsWebIdentityCredentialsProviderFactory$StsWebIdentityCredentialsProvider.resolveCredentials(StsWebIdentityCredentialsProviderFactory.java:96) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.auth.credentials.WebIdentityTokenFileCredentialsProvider.resolveCredentials(WebIdentityTokenFileCredentialsProvider.java:121) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.auth.credentials.AwsCredentialsProviderChain.resolveCredentials(AwsCredentialsProviderChain.java:90) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.auth.credentials.internal.LazyAwsCredentialsProvider.resolveCredentials(LazyAwsCredentialsProvider.java:45) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.auth.credentials.DefaultCredentialsProvider.resolveCredentials(DefaultCredentialsProvider.java:128) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.util.MetricUtils.measureDuration(MetricUtils.java:50) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.awscore.internal.authcontext.AwsCredentialsAuthorizationStrategy.resolveCredentials(AwsCredentialsAuthorizationStrategy.java:100) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.awscore.internal.authcontext.AwsCredentialsAuthorizationStrategy.addCredentialsToExecutionAttributes(AwsCredentialsAuthorizationStrategy.java:77) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.awscore.internal.AwsExecutionContextBuilder.invokeInterceptorsAndCreateExecutionContext(AwsExecutionContextBuilder.java:123) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.invokeInterceptorsAndCreateExecutionContext(AwsSyncClientHandler.java:69) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.lambda$execute$1(BaseSyncClientHandler.java:78) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.measureApiCallSuccess(BaseSyncClientHandler.java:179) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.internal.handler.BaseSyncClientHandler.execute(BaseSyncClientHandler.java:76) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.core.client.handler.SdkSyncClientHandler.execute(SdkSyncClientHandler.java:45) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.awscore.client.handler.AwsSyncClientHandler.execute(AwsSyncClientHandler.java:56) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at software.amazon.awssdk.services.s3.DefaultS3Client.listObjectsV2(DefaultS3Client.java:6447) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] at org.apache.pinot.plugin.filesystem.S3PinotFS.visitFiles(S3PinotFS.java:548) ~[pinot-s3-1.1.0-SNAPSHOT-shaded.jar:1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2] ... 8 more ``` Our plugin versions are ``` { "pinot-protobuf": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-kafka-2.0": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-avro": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-distribution": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-csv": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-s3": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-yammer": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-segment-uploader-default": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-batch-ingestion-standalone": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-confluent-avro": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-thrift": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-orc": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-clp-log": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-pulsar": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-azure": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-gcs": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-dropwizard": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-hdfs": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-adls": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-kinesis": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-json": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-minion-builtin-tasks": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-parquet": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2", "pinot-segment-writer-file-based": "1.1.0-SNAPSHOT-13c2901978c7a6a7bab46afbce2b09c13a0b05e2" } ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
