[
https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Dai updated PIG-5210:
----------------------------
Description:
For pig script, users need to use {{pig -e "explain -script test.pig"}} to
print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to
explain the plan automatically. This option can help to print out MR/Tez plan
automatically before implement of MapReduce.
was:
h5. Adding an option to print out MR/Tez plan before launching
For pig script, users need to use {{pig -e "explain -script test.pig"}} to
print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to
explain the plan automatically. This option can help to print out MR/Tez plan
automatically before implement of MapReduce.
Steps:
- Get clone of 0.17.0 version PIG by git pull
- Set up Eclipse
- Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file
_JobControlCompiler.java_,_TezJobCompiler.java_ before Mapreduce starts
- Check for compiling {{ant}}
- After building successful, Start remote debugger in Eclipse {{export
PIG_OPTS="-
agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}} Or start
to run pig only in terminal {{unset PIG_OPTS}}
- Test cases: For MR engine {{-x local test.pig}}; For Tez engine {{-x
tez_local test.pig}}
- Get the plan and test results as expected
> Option to print MR/Tez plan before launching
> --------------------------------------------
>
> Key: PIG-5210
> URL: https://issues.apache.org/jira/browse/PIG-5210
> Project: Pig
> Issue Type: Improvement
> Affects Versions: 0.17.0
> Reporter: Lili Yu
> Assignee: Lili Yu
> Fix For: 0.17.0
>
> Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR
> plan.png, screenshot Tez Plan.png, test.pig
>
>
> For pig script, users need to use {{pig -e "explain -script test.pig"}} to
> print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to
> explain the plan automatically. This option can help to print out MR/Tez
> plan automatically before implement of MapReduce.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
