steveloughran commented on pull request #3133:
URL: https://github.com/apache/hadoop/pull/3133#issuecomment-866183472
tested with `-Dparallel-tests -DtestsThreadCount=7 -Dmarkers=keep -Dscale
-Ds3guard -Ddynamo`
transient read buffer underflow failure; one extra S3Guard write than
expected. Both of those surface when there are too many records
```
[ERROR] Failures:
[ERROR]
ITestS3AContractUnbuffer>AbstractContractUnbufferTest.testUnbufferOnClosedFile:83->AbstractContractUnbufferTest.validateFullFileContents:132->AbstractContractUnbufferTest.validateFileContents:139->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
failed to read expected number of bytes from stream. This may be transient
expected:<1024> but was:<515>
[ERROR]
ITestCommitOperations.testBulkCommitFiles:723->Assert.assertEquals:647->Assert.failNotEquals:835->Assert.fail:89
Number of records written after commit #2; first commit had 4; first commit
ancestors CommitContext{operationState=AncestorState{operation=Commitid=44;
dest=s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out;
size=6;
paths={s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out/file1
s3a://stevel-london/fork-0007 s3a://stevel-london/fork-0007/test
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME}}}; second commit
ancestors: CommitContext{operationState=AncestorState{operation=Commitid=44;
dest=s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out;
size=8;
paths={s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out
s3a://st
evel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out/file1
s3a://stevel-london/fork-0007
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out/subdir
s3a://stevel-london/fork-0007/test
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME/testBulkCommitFiles/out/subdir/file2
s3a://stevel-london/fork-0007/test/DELAY_LISTING_ME}}}:
s3guard_metadatastore_record_writes expected:<2> but was:<3>
[INFO]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
