[
https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254401#comment-13254401
]
Julien Le Dem commented on PIG-2653:
------------------------------------
This is a good idea.
It would also be nice if It did not take 1 or 2 minutes to compile the M/R plan.
In some occasions Pig would do a lot of repeated class lookups when the scripts
has many UDF calls.
Is this the case ? It would be nice if you could provide a sample script that
has this behavior.
> Precompile option in PIG (Ability to store the plan for queries which are run
> multiple times)
> ---------------------------------------------------------------------------------------------
>
> Key: PIG-2653
> URL: https://issues.apache.org/jira/browse/PIG-2653
> Project: Pig
> Issue Type: Improvement
> Components: parser
> Reporter: Rajesh Balamohan
>
> Based on the size of the PIG script, it takes 1 or 2 minutes in certain cases
> for PIG compiler to create the MR plan. If the same script has to be run
> later point in time, it has to go through this process again.
> It would be nice, if PIG can store the result (execution plan) which can be
> reused when the same script is run again.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira