bgaborg commented on issue #992: HADOOP-16537 TeraSort Job failing on S3 DirectoryStagingCommitter: destination path exists URL: https://github.com/apache/hadoop/pull/992#issuecomment-505090015 Thanks for working on this @steveloughran; this will stabilize the integration tests. When running the tests I get the following error: ``` [ERROR] Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 14.781 s <<< FAILURE! - in org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedTaskCommit [ERROR] testDefault(org.apache.hadoop.fs.s3a.commit.staging.TestStagingPartitionedTaskCommit) Time elapsed: 0.22 s <<< FAILURE! java.lang.AssertionError: Conflict resolution mode in PartitionedStagingCommitter{StagingCommitter{AbstractS3ACommitter{role=Task committer attempt_job_0001_r_000002_3, name=partitioned, outputPath=s3a://bucket-name/output/path, workPath=file:/var/folders/n_/cnl5_2s56511p7f5842_p8yc0000gp/T/buffer/736a1d32-6626-45bf-ab48-ad50650e9459/_temporary/0/_temporary/attempt_job_0001_r_000002_3}, conflictResolution=APPEND, wrappedCommitter=FileOutputCommitter{PathOutputCommitter{context=TaskAttemptContextImpl{JobContextImpl{jobId=job_job_0001}; taskId=attempt_job_0001_r_000002_3, status=''}; org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter@31d48fe3}; outputPath=file:/var/folders/n_/cnl5_2s56511p7f5842_p8yc0000gp/T/cluster/gaborbota/736a1d32-6626-45bf-ab48-ad50650e9459/staging-uploads, workPath=null, algorithmVersion=1, skipCleanup=false, ignoreCleanupFailures=false}}} expected:<FAIL> but was:<APPEND> ``` Maybe I do something wrong, forgot to set something?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org