[ https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254401#comment-13254401 ]
Julien Le Dem commented on PIG-2653: ------------------------------------ This is a good idea. It would also be nice if It did not take 1 or 2 minutes to compile the M/R plan. In some occasions Pig would do a lot of repeated class lookups when the scripts has many UDF calls. Is this the case ? It would be nice if you could provide a sample script that has this behavior. > Precompile option in PIG (Ability to store the plan for queries which are run > multiple times) > --------------------------------------------------------------------------------------------- > > Key: PIG-2653 > URL: https://issues.apache.org/jira/browse/PIG-2653 > Project: Pig > Issue Type: Improvement > Components: parser > Reporter: Rajesh Balamohan > > Based on the size of the PIG script, it takes 1 or 2 minutes in certain cases > for PIG compiler to create the MR plan. If the same script has to be run > later point in time, it has to go through this process again. > It would be nice, if PIG can store the result (execution plan) which can be > reused when the same script is run again. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira