Steve Loughran created HADOOP-19189:
---------------------------------------
Summary: ITestS3ACommitterFactory failing
Key: HADOOP-19189
URL: https://issues.apache.org/jira/browse/HADOOP-19189
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3, test
Affects Versions: 3.4.0
Reporter: Steve Loughran
we've had ITestS3ACommitterFactory failing for a while, where it looks like
changed committer settings aren't being picked up.
{code}
ERROR] ITestS3ACommitterFactory.testEverything:115->testInvalidFileBinding:165
Expected a org.apache.hadoop.fs.s3a.commit.PathCommitException to be thrown,
but got the result: :
FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl
{code}
I've spent some time looking at it and it is happening because the test sets
the fileystem ref for the local test fs, and not that of the filesystem created
by the committer, which is where the option is picked up.
i've tried to parameterize it but things are still playing up and I'm not sure
how hard to try to fix.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]