[
https://issues.apache.org/jira/browse/PIG-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thejas M Nair updated PIG-1524:
-------------------------------
Attachment: PIG-1524.patch
In this patch (PIG-1524.patch) I have also re-factored the spill code in case
of InternalSortedBag and InternalDistinctBag into a common super class
SortedSpillBag.
I don't have any new test cases because the counter values will vary depending
on current max memory.
> 'Proactive spill count' is misleading
> -------------------------------------
>
> Key: PIG-1524
> URL: https://issues.apache.org/jira/browse/PIG-1524
> Project: Pig
> Issue Type: Bug
> Reporter: Thejas M Nair
> Assignee: Thejas M Nair
> Fix For: 0.8.0
>
> Attachments: PIG-1524.patch
>
>
> InternalCacheBag, InternalSortedBag, InternalDistinctBag increment this
> counter for every record that it writes to disk, once it exceeds the memory
> limit. This number is misleading.
> Instead, this counter should be increment it by 1 for each instance of these
> bags that has spilled to disk.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
