[
https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lili Yu updated PIG-5210:
-------------------------
Description:
h5. Adding an option to print out MR/Tez plan before launching
For pig script, users need to use {{pig -e "explain -script test.pig"}} to
print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to
explain the plan automatically. This option can help to print out MR/Tez plan
automatically before implement of MapReduce.
Steps:
- Get clone of 0.17.0 version PIG by git pull
- Set up Eclipse
- Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file
_JobControlCompiler.java_,_TezJobCompiler.java_ before Mapreduce starts
- Check for compiling {{ant}}
- After building successful, Start remote debugger in Eclipse {{export
PIG_OPTS="-
agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}} Or start
to run pig only in terminal {{unset PIG_OPTS}}
- Test cases: For MR engine {{-x local test.pig}}; For Tez engine {{-x
tez_local test.pig}}
- Get the plan and test results as expected
was:
Adding an option to print out MR/Tez plan before launching.
- Without this option, users can use `pig -e "explain -script 1.pig"`
> Option to print MR/Tez plan before launching
> --------------------------------------------
>
> Key: PIG-5210
> URL: https://issues.apache.org/jira/browse/PIG-5210
> Project: Pig
> Issue Type: Improvement
> Affects Versions: 0.17.0
> Reporter: Lili Yu
> Assignee: Lili Yu
> Fix For: 0.17.0
>
> Attachments: PrintPlan.patch, screenshot-change.png, screenshot MR
> plan.png, screenshot Tez Plan.png, test.pig
>
>
> h5. Adding an option to print out MR/Tez plan before launching
> For pig script, users need to use {{pig -e "explain -script test.pig"}} to
> print out MR/Tez Plan. But for Python script, it is a hard thing for PIG to
> explain the plan automatically. This option can help to print out MR/Tez
> plan automatically before implement of MapReduce.
> Steps:
> - Get clone of 0.17.0 version PIG by git pull
> - Set up Eclipse
> - Import Pig src to Eclipse, and set pig.print.exec.plan "true" in file
> _JobControlCompiler.java_,_TezJobCompiler.java_ before Mapreduce starts
> - Check for compiling {{ant}}
> - After building successful, Start remote debugger in Eclipse {{export
> PIG_OPTS="-
> agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=8000"}} Or start
> to run pig only in terminal {{unset PIG_OPTS}}
> - Test cases: For MR engine {{-x local test.pig}}; For Tez engine {{-x
> tez_local test.pig}}
> - Get the plan and test results as expected
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
