[
https://issues.apache.org/jira/browse/PIG-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776666#comment-13776666
]
Dmitriy V. Ryaboy commented on PIG-3480:
----------------------------------------
[~knoguchi] yeah, I'm not sure the stack trace is relevant -- it's the only
part that's not consistent about this.
The problem goes away when I set pig.tmpfilecompression to false, or when I
replace TFile with SequenceFile.
I've also seen stack traces that were inside TFile, and had to do with some LZO
decoding issues.. the actual error is really hard to capture, other than the
fact that mappers fail consistently.
> TFile-based tmpfile compression crashes in some cases
> -----------------------------------------------------
>
> Key: PIG-3480
> URL: https://issues.apache.org/jira/browse/PIG-3480
> Project: Pig
> Issue Type: Bug
> Reporter: Dmitriy V. Ryaboy
> Fix For: 0.12
>
> Attachments: PIG-3480.patch
>
>
> When pig tmpfile compression is on, some jobs fail inside core hadoop
> internals.
> Suspect TFile is the problem, because an experiment in replacing TFile with
> SequenceFile succeeded.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
