[
https://issues.apache.org/jira/browse/PIG-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505453#comment-14505453
]
Mohit Sabharwal commented on PIG-4489:
--------------------------------------
With this patch, new tests ( in {{tests/spark-local-tests}}) are now running
that were not running previously. A total of 84 test files were enabled, out of
which 26 have at least one testcase failing. A total of 80 testcases are
failing. Following are the 26 test files that have failures:
{code}
[junit] Test org.apache.pig.backend.hadoop.accumulo.TestAccumuloPigCluster
FAILED
[junit] Test org.apache.pig.builtin.TestOrcStorage FAILED
[junit] Test org.apache.pig.builtin.TestOrcStoragePushdown FAILED
[junit] Test
org.apache.pig.newplan.logical.relational.TestLocationInPhysicalPlan FAILED
[junit] Test org.apache.pig.test.TestAssert FAILED
[junit] Test org.apache.pig.test.TestCase FAILED
[junit] Test org.apache.pig.test.TestDefaultDateTimeZone FAILED
[junit] Test org.apache.pig.test.TestEvalPipelineLocal FAILED
[junit] Test org.apache.pig.test.TestForEachNestedPlanLocal FAILED
[junit] Test org.apache.pig.test.TestHBaseStorage FAILED
[junit] Test org.apache.pig.test.TestJoinLocal FAILED
[junit] Test org.apache.pig.test.TestMultiQuery FAILED
[junit] Test org.apache.pig.test.TestMultiQueryBasic FAILED
[junit] Test org.apache.pig.test.TestMultiQueryLocal FAILED
[junit] Test org.apache.pig.test.TestNullConstant FAILED
[junit] Test org.apache.pig.test.TestPigContext FAILED
[junit] Test org.apache.pig.test.TestPigRunner FAILED
[junit] Test org.apache.pig.test.TestPigServerLocal FAILED
[junit] Test org.apache.pig.test.TestPoissonSampleLoader FAILED
[junit] Test org.apache.pig.test.TestPruneColumn FAILED
[junit] Test org.apache.pig.test.TestRank1 FAILED
[junit] Test org.apache.pig.test.TestRank3 FAILED
[junit] Test org.apache.pig.test.TestStoreLocal FAILED
[junit] Test org.apache.pig.test.TestUnion FAILED
[junit] Test org.apache.pig.test.TestUnionOnSchema FAILED
{code}
In contrast, {{test/spark-tests}} has 65 test files, of which there is at least
one testcase failing in 24 files, for a total of 73 testcases. This patch does
not add any new test failures for tests present in {{test/spark-tests}}
The bottom line is that we are seeing 80 new testcases fail.
[~praveenr019], we need to add these new tests (via {{test-spark-local}}) in
Jenkins as well.
> Enable local mode tests for Spark engine
> ----------------------------------------
>
> Key: PIG-4489
> URL: https://issues.apache.org/jira/browse/PIG-4489
> Project: Pig
> Issue Type: Sub-task
> Components: spark
> Reporter: Mohit Sabharwal
> Assignee: Mohit Sabharwal
> Fix For: spark-branch
>
> Attachments: PIG-4489.1.patch, PIG-4489.2.patch, PIG-4489.patch
>
>
> Util.getLocalTestMode() currently only returns "tez_local" or "local".
> I see that ~212 testcases do this check, and we are not running these tests
> against Spark at this point.
> Currently all Spark tests run in local mode ("local" as a the Spark Cluster
> URL passed to JavaSparkContext), so we should enable these tests as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
