[
https://issues.apache.org/jira/browse/PIG-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13254661#comment-13254661
]
Rajesh Balamohan commented on PIG-2653:
---------------------------------------
If there are hooks available for finding out the logical/physical plan timing,
I can get the relative timing from my scripts which are taking time. Or else,I
will patch manually to print the timings and post it here.
It would be really nice to start off with caching the logical plan. Hooks can
be provided which can store the cached information (with certain threshold) in
metastore (Hcatalog?).
> Precompile option in PIG (Ability to store the plan for queries which are run
> multiple times)
> ---------------------------------------------------------------------------------------------
>
> Key: PIG-2653
> URL: https://issues.apache.org/jira/browse/PIG-2653
> Project: Pig
> Issue Type: Improvement
> Components: parser
> Reporter: Rajesh Balamohan
>
> Based on the size of the PIG script, it takes 1 or 2 minutes in certain cases
> for PIG compiler to create the MR plan. If the same script has to be run
> later point in time, it has to go through this process again.
> It would be nice, if PIG can store the result (execution plan) which can be
> reused when the same script is run again.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
