[ 
https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254401#comment-13254401
 ] 

Julien Le Dem commented on PIG-2653:
------------------------------------

This is a good idea.
It would also be nice if It did not take 1 or 2 minutes to compile the M/R plan.
In some occasions Pig would do a lot of repeated class lookups when the scripts 
has many UDF calls.
Is this the case ? It would be nice if you could provide a sample script that 
has this behavior.
                
> Precompile option in PIG (Ability to store the plan for queries which are run 
> multiple times)
> ---------------------------------------------------------------------------------------------
>
>                 Key: PIG-2653
>                 URL: https://issues.apache.org/jira/browse/PIG-2653
>             Project: Pig
>          Issue Type: Improvement
>          Components: parser
>            Reporter: Rajesh Balamohan
>
> Based on the size of the PIG script, it takes 1 or 2 minutes in certain cases 
> for PIG compiler to create the MR plan. If the same script has to be run 
> later point in time, it has to go through this process again. 
> It would be nice, if PIG can store the result (execution plan) which can be 
> reused when the same script is run again. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to