[ https://issues.apache.org/jira/browse/HIVE-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225898#comment-14225898 ]
Hive QA commented on HIVE-8943: ------------------------------- {color:red}Overall{color}: -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12683740/HIVE-8943.1-spark.patch {color:red}ERROR:{color} -1 due to 53 failed/errored test(s), 7179 tests executed *Failed tests:* {noformat} TestAuthorizationApiAuthorizer - did not produce a TEST-*.xml file TestGenericUDFOPNumeric - did not produce a TEST-*.xml file TestHBaseKeyFactory - did not produce a TEST-*.xml file TestHBaseKeyFactory2 - did not produce a TEST-*.xml file TestHBaseKeyFactory3 - did not produce a TEST-*.xml file TestHBasePredicateDecomposer - did not produce a TEST-*.xml file TestHS2ImpersonationWithRemoteMS - did not produce a TEST-*.xml file TestTezSessionState - did not produce a TEST-*.xml file TestURLHook - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_stats org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_stats2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_auto_join32 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucket_map_join_1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucket_map_join_2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucketmapjoin1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_bucketmapjoin7 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_column_access_stats org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join19 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_hive_626 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_reorder2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_reorder3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_reorder4 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_join_view org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_mapjoin_subquery2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_mergejoins org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_mergejoins_mixed org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_optimize_nullscan org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join4 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_join5 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_ppd_outer_join5 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoin org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoin_union_remove_1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoin_union_remove_2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt1 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt11 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt12 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt13 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt14 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt16 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt17 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt19 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt20 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt3 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt4 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt5 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt6 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt7 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt8 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_skewjoinopt9 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_smb_mapjoin9 {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/442/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/442/console Test logs: http://ec2-50-18-27-0.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-442/ Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 53 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12683740 - PreCommit-HIVE-SPARK-Build > Fix memory limit check for combine nested mapjoins [Spark Branch] > ----------------------------------------------------------------- > > Key: HIVE-8943 > URL: https://issues.apache.org/jira/browse/HIVE-8943 > Project: Hive > Issue Type: Sub-task > Components: Spark > Affects Versions: spark-branch > Reporter: Szehon Ho > Assignee: Szehon Ho > Attachments: HIVE-8943.1-spark.patch, HIVE-8943.1-spark.patch > > > Its the opposite problem of what we thought in HIVE-8701. > SparkMapJoinOptimizer does combine nested mapjoins into one work due to > removal of RS for big-table. So we need to enhance the check to calculate if > all the MapJoins in that work (spark-stage) will fit into the memory, > otherwise it might overwhelm memory for that particular spark executor. -- This message was sent by Atlassian JIRA (v6.3.4#6332)