[ https://issues.apache.org/jira/browse/PIG-4374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xuefu Zhang resolved PIG-4374. ------------------------------ Resolution: Fixed Committed to Spark branch. Thanks, Liyun! > Add SparkPlan in spark package > ------------------------------ > > Key: PIG-4374 > URL: https://issues.apache.org/jira/browse/PIG-4374 > Project: Pig > Issue Type: Sub-task > Components: spark > Reporter: liyunzhang_intel > Assignee: liyunzhang_intel > Fix For: spark-branch > > Attachments: How to change a physical plan to a spark plan.docx, > PIG-4374_1.patch, PIG-4374_2.patch.1, PIG-4374_3.patch.1, PIG-4374_4.patch, > PIG-4374_4.patch_Jenkins_result.png, PIG-4374_6.patch, > PIG-4374_6_patch_jekins.png, PIG-4374_7.patch, PIG-4374_8.patch.jenkins.png, > Pig-spark #76 [Jenkins .png, jenkins_PIG-4374_1_patch.png.png > > > in current code, there are following class in mapreduce and tez package. > mapreduce: > MRCompiler > MROperPlan MROpPlanVisitor > MapReduceOper > tez: > TezCompiler > TezOperPlan TezOpPlanVisitor > TezOperator > Following class needs to be added in spark package: > SparkCompiler > SparkOperPlan SparkOpPlanVisitor > SparkOperator > Current code need to be refactored because of above adding classes. Some unit > tests like TestStoreInstances fail because of it. > following are the error of unit test TestStoreInstances: > Error Message > num jobs expected:<1> but was:<0> > Stacktrace > junit.framework.AssertionFailedError: num jobs expected:<1> but was:<0> > at > org.apache.pig.test.TestStoreInstances.testBackendStoreCommunication(TestStoreInstances.java:122) -- This message was sent by Atlassian JIRA (v6.3.4#6332)