[
https://issues.apache.org/jira/browse/HADOOP-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16699715#comment-16699715
]
Sean Mackrory commented on HADOOP-15370:
----------------------------------------
+1 on this patch. But I am also seeing a pretty scary number of (presumably
unrelated) failures that we really need to get under control. I ran all tests
in parallel with 8 threads, but with and without this patch, HADOOP-15947, and
HADOOP-15798. I tried with S3Guard disabled, with -Ds3guard, -Ds3guard
-Ddynamo, and finally -Ds3guard -Ddynamo -Dauth. The bouncycastle issue always
shows up regardless, so I'm fine to ignore that until Steve's fix goes in. I
hit HADOOP-14927 with -Ds3guard against the local metadata store. And I hit
this issue once with S3Guard disabled, but I haven't been able to reproduce it:
{code}[ERROR] Tests run: 6, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
172.151 s <<< FAILURE! - in
org.apache.hadoop.fs.contract.s3a.ITestS3AContractDistCp
[ERROR]
testUpdateDeepDirectoryStructureToRemote(org.apache.hadoop.fs.contract.s3a.ITestS3AContractDistCp)
Time elapsed: 24.869 s <<< ERROR!
java.io.FileNotFoundException: Expected file: not found
s3a://mackrory/fork-0002/test/ITestS3AContractDistCp/testUpdateDeepDirectoryStructureToRemote/remote/DELAY_LISTING_ME/outputDir/inputDir/file1
in
s3a://mackrory/fork-0002/test/ITestS3AContractDistCp/testUpdateDeepDirectoryStructureToRemote/remote/DELAY_LISTING_ME/outputDir/inputDir
at
org.apache.hadoop.fs.contract.ContractTestUtils.verifyPathExists(ContractTestUtils.java:940)
at
org.apache.hadoop.fs.contract.ContractTestUtils.assertPathExists(ContractTestUtils.java:918)
at
org.apache.hadoop.fs.contract.ContractTestUtils.assertIsFile(ContractTestUtils.java:826)
at
org.apache.hadoop.fs.contract.ContractTestUtils.verifyFileContents(ContractTestUtils.java:235)
at
org.apache.hadoop.tools.contract.AbstractContractDistCpTest.distCpDeepDirectoryStructure(AbstractContractDistCpTest.java:499)
at
org.apache.hadoop.tools.contract.AbstractContractDistCpTest.testUpdateDeepDirectoryStructureToRemote(AbstractContractDistCpTest.java:223)
... 16 omitted by me
Caused by: java.io.FileNotFoundException: No such file or directory:
s3a://mackrory/fork-0002/test/ITestS3AContractDistCp/testUpdateDeepDirectoryStructureToRemote/remote/DELAY_LISTING_ME/outputDir/inputDir/file1
at
org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2280)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2174)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2112)
at
org.apache.hadoop.fs.contract.ContractTestUtils.verifyPathExists(ContractTestUtils.java:934)
... 21 more{code}
All the really scary results are enumerated here:
https://gist.github.com/mackrorysd/81eb96e91af1d05f59db9871da60b178
That's just too much variation for us to commit with confidence. We need to
figure out some central way to track these failures and make a concerted,
combined effort to get that down.
> S3A log message on rm s3a://bucket/ not intuitive
> -------------------------------------------------
>
> Key: HADOOP-15370
> URL: https://issues.apache.org/jira/browse/HADOOP-15370
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.1.0
> Reporter: Steve Loughran
> Assignee: Gabor Bota
> Priority: Trivial
> Attachments: HADOOP-15370.001.patch
>
>
> when you try to delete the root of a bucket from command line, e.g. {{hadoop
> fs -rm -r -skipTrash s3a://hwdev-steve-new/}}, the output isn't that useful
> {code}
> 2018-04-06 16:35:23,048 [main] INFO s3a.S3AFileSystem
> (S3AFileSystem.java:rejectRootDirectoryDelete(1837)) - s3a delete the
> hwdev-steve-new root directory of true
> rm: `s3a://hwdev-steve-new/': Input/output error
> 2018-04-06 16:35:23,050 [pool-2-thread-1] DEBUG s3a.S3AFileSystem
> {code}
> the single log message doesn't parse, and the error message raised is lost by
> the FS -rm CLI command (why?)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
