Dmitriy V. Ryaboy created PIG-2923: -------------------------------------- Summary: Lazily register bags with SpillableMemoryManager Key: PIG-2923 URL: https://issues.apache.org/jira/browse/PIG-2923 Project: Pig Issue Type: Improvement Reporter: Dmitriy V. Ryaboy
Currently, all Spillable DataBags get registered by the BagFactory at the moment of creation. In practice, a lot of these bags will not get large enough to be worth spilling; we can avoid a lot of memory overhead and cheapen the process of finding a bag to spill when we do need it, by allowing Bags themselves to register when they grow to some respectable threshold. Related JIRAs: PIG-2917, PIG-2918 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira