[
https://issues.apache.org/jira/browse/HADOOP-18508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848385#comment-17848385
]
ASF GitHub Bot commented on HADOOP-18508:
-----------------------------------------
mukund-thakur commented on PR #5081:
URL: https://github.com/apache/hadoop/pull/5081#issuecomment-2123413022
These two tests are failing on trunk as well.
`[ERROR]
testEverything(org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory) Time
elapsed: 6.661 s <<< FAILURE!
java.lang.AssertionError: Expected a
org.apache.hadoop.fs.s3a.commit.PathCommitException to be thrown, but got the
result: :
FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl{jobId=job_202405210976_0008};
taskId=attempt_202405210976_0008_m_000000_0, status=''};
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter@41f68cab};
outputPath=s3a://mthakur-us-west-1/job-002-fork-0008/test/testEverything,
workPath=s3a://mthakur-us-west-1/job-002-fork-0008/test/testEverything/_temporary/1/_temporary/attempt_202405210976_0008_m_000000_0,
algorithmVersion=1, skipCleanup=false, ignoreCleanupFailures=false}
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:499)
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:384)
at
org.apache.hadoop.test.LambdaTestUtils.intercept(LambdaTestUtils.java:453)
at
org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory.testInvalidFileBinding(ITestS3ACommitterFactory.java:165)
at
org.apache.hadoop.fs.s3a.commit.ITestS3ACommitterFactory.testEverything(ITestS3ACommitterFactory.java:115)
`
`[ERROR]
testS3SpecificSignerOverride(org.apache.hadoop.fs.s3a.ITestS3AConfiguration)
Time elapsed: 1.692 s <<< ERROR!
software.amazon.awssdk.core.exception.SdkClientException: Unable to load
region from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@21daa1bb:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@74d904d3:
Unable to load region from system settings. Region must be specified either
via environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@47d37b27: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@297a12fd:
Unable to contact EC2 metadata service.]
at
software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111)
at
software.amazon.awssdk.regions.providers.AwsRegionProviderChain.getRegion(AwsRegionProviderChain.java:70)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveRegion(AwsDefaultClientBuilder.java:293)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.primeCache(AttributeMap.java:600)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.get(AttributeMap.java:589)
at
software.amazon.awssdk.utils.AttributeMap$Builder.resolveValue(AttributeMap.java:396)
at
software.amazon.awssdk.utils.AttributeMap$Builder.internalGet(AttributeMap.java:389)
at
software.amazon.awssdk.utils.AttributeMap$Builder.access$1300(AttributeMap.java:201)
at
software.amazon.awssdk.utils.AttributeMap$Builder$1.get(AttributeMap.java:399)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveEndpoint(AwsDefaultClientBuilder.java:268)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.primeCache(AttributeMap.java:600)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.get(AttributeMap.java:589)
at
software.amazon.awssdk.utils.AttributeMap$Builder.resolveValue(AttributeMap.java:396)
at java.util.ArrayList.forEach(ArrayList.java:1259)
at
software.amazon.awssdk.utils.AttributeMap$Builder.build(AttributeMap.java:362)
at
software.amazon.awssdk.core.client.config.SdkClientConfiguration$Builder.build(SdkClientConfiguration.java:232)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeAwsConfiguration(AwsDefaultClientBuilder.java:184)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeChildConfiguration(AwsDefaultClientBuilder.java:161)
at
software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.syncClientConfiguration(SdkDefaultClientBuilder.java:188)
at
software.amazon.awssdk.services.sts.DefaultStsClientBuilder.buildClient(DefaultStsClientBuilder.java:36)
at
software.amazon.awssdk.services.sts.DefaultStsClientBuilder.buildClient(DefaultStsClientBuilder.java:25)
at
software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.build(SdkDefaultClientBuilder.java:155)
at
org.apache.hadoop.fs.s3a.ITestS3AConfiguration.testS3SpecificSignerOverride(ITestS3AConfiguration.java:579)`
> support multiple s3a integration test runs on same bucket in parallel
> ---------------------------------------------------------------------
>
> Key: HADOOP-18508
> URL: https://issues.apache.org/jira/browse/HADOOP-18508
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.3.9
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Labels: pull-request-available
>
> to have (internal, sorry) jenkins test runs work in parallel, they need to
> share the same bucket so
> # must have a prefix for job id which is passed in to the path used for forks
> # support disabling root tests so they don't stamp on each other
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
