[
https://issues.apache.org/jira/browse/PIG-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Santhosh Srinivasan updated PIG-646:
------------------------------------
Attachment: PIG-646.patch
Attached patch fixes the issue with reporting progress in Distinct.java and
also sets up the reporter correctly in PigCombiner.java and
PigMapReduce.ReduceWithComparator. In addition there are unit test cases in
TestBuiltin.java and TestEvalPipeline.java
All unit tests pass.
> Distinct UDF should report progress
> -----------------------------------
>
> Key: PIG-646
> URL: https://issues.apache.org/jira/browse/PIG-646
> Project: Pig
> Issue Type: Bug
> Reporter: Olga Natkovich
> Assignee: Santhosh Srinivasan
> Attachments: PIG-646.patch
>
>
> We have seen the case where if a bag passed to distinct UDF is too large to
> fit into main memory the job fails with a time out because no progress is
> reported.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.