[
https://issues.apache.org/jira/browse/PIG-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17725786#comment-17725786
]
Koji Noguchi commented on PIG-5441:
-----------------------------------
It would be nice if you can add a unit test.
(However, if you don't have bandwidth I understand. I can try to add the test
later as a separate jira.)
> Pig skew join tez grace reducer fails to find shuffle data
> ----------------------------------------------------------
>
> Key: PIG-5441
> URL: https://issues.apache.org/jira/browse/PIG-5441
> Project: Pig
> Issue Type: Bug
> Components: tez
> Affects Versions: 0.17.0
> Reporter: Yi Zhang
> Assignee: Yi Zhang
> Priority: Major
> Fix For: 0.18.0
>
>
> User pig tez skew join encountered issue of not finding shuffle data from the
> sampler aggregate vertex. The right side join has >1 reducers.
> For workaround adjust tez.runtime.transfer.data-via-events.max-size to avoid
> spill to disk for the sampler aggregation vertex.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
