Dmitriy V. Ryaboy created PIG-2923:
--------------------------------------

             Summary: Lazily register bags with SpillableMemoryManager
                 Key: PIG-2923
                 URL: https://issues.apache.org/jira/browse/PIG-2923
             Project: Pig
          Issue Type: Improvement
            Reporter: Dmitriy V. Ryaboy


Currently, all Spillable DataBags get registered by the BagFactory at the 
moment of creation. In practice, a lot of these bags will not get large enough 
to be worth spilling; we can avoid a lot of memory overhead and cheapen the 
process of finding a bag to spill when we do need it, by allowing Bags 
themselves to register when they grow to some respectable threshold.

Related JIRAs: PIG-2917, PIG-2918

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to