[
https://issues.apache.org/jira/browse/HADOOP-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15705056#comment-15705056
]
Steve Loughran edited comment on HADOOP-13811 at 11/29/16 11:45 AM:
--------------------------------------------------------------------
you are getting an exception on line 248 of S3a, where it's calling {{partSize
= conf.getLong(MULTIPART_SIZE, DEFAULT_MULTIPART_SIZE)}}.
Now, that line only exists on branch-2.7.x; it's not on the branch-2 line,
where we use {{getLongBytes()}} to support byte unit measurement s (M, K, P, T,
G). Which means that somehow you are getting to 2.7 binaries in your jobs.
You could make that error move off that line by changing the option
{{fs.s3a.multipart.size}} to {{104857600}}. But you've still got that mix of
binaries there, and that means your problem isn't going to go away.
was (Author: ste...@apache.org):
you are getting an exception on line 248 of S3a, where it's calling {{partSize
= conf.getLong(MULTIPART_SIZE, DEFAULT_MULTIPART_SIZE)}}.
Now, that line only exists on branch-2.7.x; it's not on the branch-2 line,
where we use getLongBytes() to support byte unit measurement s (M, K, P, T, G).
Which means that somehow you are getting to 2.7 binaries in your jobs.
You could make that error move off that line by changing the option
{{fs.s3a.multipart.size}} to {{104857600}}. But you've still got that mix of
binaries there, and that means your problem isn't going to go away.
> s3a: getFileStatus fails with com.amazonaws.AmazonClientException: Failed to
> sanitize XML document destined for handler class
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-13811
> URL: https://issues.apache.org/jira/browse/HADOOP-13811
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 2.8.0, 2.7.3
> Reporter: Steve Loughran
> Assignee: Steve Loughran
>
> Sometimes, occasionally, getFileStatus() fails with a stack trace starting
> with {{com.amazonaws.AmazonClientException: Failed to sanitize XML document
> destined for handler class}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
