[jira] [Commented] (HIVE-12798) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector* queries failures due to NPE in Vectorizer.onExpressionHasNullSafes()
[ https://issues.apache.org/jira/browse/HIVE-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107648#comment-15107648 ] Sergey Shelukhin commented on HIVE-12798: - +1 > CBO: Calcite Operator To Hive Operator (Calcite Return Path): > MiniTezCliDriver.vector* queries failures due to NPE in > Vectorizer.onExpressionHasNullSafes() > --- > > Key: HIVE-12798 > URL: https://issues.apache.org/jira/browse/HIVE-12798 > Project: Hive > Issue Type: Sub-task > Components: CBO >Reporter: Hari Sankar Sivarama Subramaniyan >Assignee: Hari Sankar Sivarama Subramaniyan > Fix For: 2.1.0 > > Attachments: HIVE-12798.1.patch > > > As of 01/04/2016, the following tests fail in the MiniTezCliDriver mode when > the cbo return path is enabled. We need to fix them : > {code} > vector_leftsemi_mapjoin > vector_join_filters > vector_interval_mapjoin > vector_left_outer_join > vectorized_mapjoin > vector_inner_join > vectorized_context > tez_vector_dynpart_hashjoin_1 > count > auto_sortmerge_join_6 > skewjoin > vector_auto_smb_mapjoin_14 > auto_join_filters > vector_outer_join0 > vector_outer_join1 > vector_outer_join2 > vector_outer_join3 > vector_outer_join4 > vector_outer_join5 > hybridgrace_hashjoin_1 > vector_mapjoin_reduce > vectorized_nested_mapjoin > vector_left_outer_join2 > vector_char_mapjoin1 > vector_decimal_mapjoin > vectorized_dynamic_partition_pruning > vector_varchar_mapjoin1 > {code} > This jira is intended to cover the vectorization issues related to the > MiniTezCliDriver failures caused by NPE via nullSafes array as shown below : > {code} > private boolean onExpressionHasNullSafes(MapJoinDesc desc) { > boolean[] nullSafes = desc.getNullSafes(); > for (boolean nullSafe : nullSafes) { > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12798) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector* queries failures due to NPE in Vectorizer.onExpressionHasNullSafes()
[ https://issues.apache.org/jira/browse/HIVE-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107596#comment-15107596 ] Hari Sankar Sivarama Subramaniyan commented on HIVE-12798: -- I've comitted this to master. cc-ing [~sershe] for approval for commit to branch-2.0. This can lead to NPE even in regular code path with vectorization turned on. > CBO: Calcite Operator To Hive Operator (Calcite Return Path): > MiniTezCliDriver.vector* queries failures due to NPE in > Vectorizer.onExpressionHasNullSafes() > --- > > Key: HIVE-12798 > URL: https://issues.apache.org/jira/browse/HIVE-12798 > Project: Hive > Issue Type: Sub-task > Components: CBO >Reporter: Hari Sankar Sivarama Subramaniyan >Assignee: Hari Sankar Sivarama Subramaniyan > Attachments: HIVE-12798.1.patch > > > As of 01/04/2016, the following tests fail in the MiniTezCliDriver mode when > the cbo return path is enabled. We need to fix them : > {code} > vector_leftsemi_mapjoin > vector_join_filters > vector_interval_mapjoin > vector_left_outer_join > vectorized_mapjoin > vector_inner_join > vectorized_context > tez_vector_dynpart_hashjoin_1 > count > auto_sortmerge_join_6 > skewjoin > vector_auto_smb_mapjoin_14 > auto_join_filters > vector_outer_join0 > vector_outer_join1 > vector_outer_join2 > vector_outer_join3 > vector_outer_join4 > vector_outer_join5 > hybridgrace_hashjoin_1 > vector_mapjoin_reduce > vectorized_nested_mapjoin > vector_left_outer_join2 > vector_char_mapjoin1 > vector_decimal_mapjoin > vectorized_dynamic_partition_pruning > vector_varchar_mapjoin1 > {code} > This jira is intended to cover the vectorization issues related to the > MiniTezCliDriver failures caused by NPE via nullSafes array as shown below : > {code} > private boolean onExpressionHasNullSafes(MapJoinDesc desc) { > boolean[] nullSafes = desc.getNullSafes(); > for (boolean nullSafe : nullSafes) { > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12798) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector* queries failures due to NPE in Vectorizer.onExpressionHasNullSafes()
[ https://issues.apache.org/jira/browse/HIVE-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090546#comment-15090546 ] Hive QA commented on HIVE-12798: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12781050/HIVE-12798.1.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 14 failed/errored test(s), 9961 tests executed *Failed tests:* {noformat} TestHWISessionManager - did not produce a TEST-*.xml file TestMiniLlapCliDriver - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testMultiSessionMultipleUse org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testSingleSessionMultipleUse org.apache.hive.jdbc.TestSSL.testSSLVersion org.apache.hive.spark.client.TestSparkClient.testAddJarsAndFiles org.apache.hive.spark.client.TestSparkClient.testCounters org.apache.hive.spark.client.TestSparkClient.testErrorJob org.apache.hive.spark.client.TestSparkClient.testJobSubmission org.apache.hive.spark.client.TestSparkClient.testMetricsCollection org.apache.hive.spark.client.TestSparkClient.testRemoteClient org.apache.hive.spark.client.TestSparkClient.testSimpleSparkJob org.apache.hive.spark.client.TestSparkClient.testSyncRpc {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6561/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6561/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-6561/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 14 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12781050 - PreCommit-HIVE-TRUNK-Build > CBO: Calcite Operator To Hive Operator (Calcite Return Path): > MiniTezCliDriver.vector* queries failures due to NPE in > Vectorizer.onExpressionHasNullSafes() > --- > > Key: HIVE-12798 > URL: https://issues.apache.org/jira/browse/HIVE-12798 > Project: Hive > Issue Type: Sub-task > Components: CBO >Reporter: Hari Sankar Sivarama Subramaniyan >Assignee: Hari Sankar Sivarama Subramaniyan > Attachments: HIVE-12798.1.patch > > > As of 01/04/2016, the following tests fail in the MiniTezCliDriver mode when > the cbo return path is enabled. We need to fix them : > {code} > vector_leftsemi_mapjoin > vector_join_filters > vector_interval_mapjoin > vector_left_outer_join > vectorized_mapjoin > vector_inner_join > vectorized_context > tez_vector_dynpart_hashjoin_1 > count > auto_sortmerge_join_6 > skewjoin > vector_auto_smb_mapjoin_14 > auto_join_filters > vector_outer_join0 > vector_outer_join1 > vector_outer_join2 > vector_outer_join3 > vector_outer_join4 > vector_outer_join5 > hybridgrace_hashjoin_1 > vector_mapjoin_reduce > vectorized_nested_mapjoin > vector_left_outer_join2 > vector_char_mapjoin1 > vector_decimal_mapjoin > vectorized_dynamic_partition_pruning > vector_varchar_mapjoin1 > {code} > This jira is intended to cover the vectorization issues related to the > MiniTezCliDriver failures caused by NPE via nullSafes array as shown below : > {code} > private boolean onExpressionHasNullSafes(MapJoinDesc desc) { > boolean[] nullSafes = desc.getNullSafes(); > for (boolean nullSafe : nullSafes) { > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-12798) CBO: Calcite Operator To Hive Operator (Calcite Return Path): MiniTezCliDriver.vector* queries failures due to NPE in Vectorizer.onExpressionHasNullSafes()
[ https://issues.apache.org/jira/browse/HIVE-12798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15088166#comment-15088166 ] Matt McCline commented on HIVE-12798: - +1 > CBO: Calcite Operator To Hive Operator (Calcite Return Path): > MiniTezCliDriver.vector* queries failures due to NPE in > Vectorizer.onExpressionHasNullSafes() > --- > > Key: HIVE-12798 > URL: https://issues.apache.org/jira/browse/HIVE-12798 > Project: Hive > Issue Type: Sub-task > Components: CBO >Reporter: Hari Sankar Sivarama Subramaniyan >Assignee: Hari Sankar Sivarama Subramaniyan > Attachments: HIVE-12798.1.patch > > > As of 01/04/2016, the following tests fail in the MiniTezCliDriver mode when > the cbo return path is enabled. We need to fix them : > {code} > vector_leftsemi_mapjoin > vector_join_filters > vector_interval_mapjoin > vector_left_outer_join > vectorized_mapjoin > vector_inner_join > vectorized_context > tez_vector_dynpart_hashjoin_1 > count > auto_sortmerge_join_6 > skewjoin > vector_auto_smb_mapjoin_14 > auto_join_filters > vector_outer_join0 > vector_outer_join1 > vector_outer_join2 > vector_outer_join3 > vector_outer_join4 > vector_outer_join5 > hybridgrace_hashjoin_1 > vector_mapjoin_reduce > vectorized_nested_mapjoin > vector_left_outer_join2 > vector_char_mapjoin1 > vector_decimal_mapjoin > vectorized_dynamic_partition_pruning > vector_varchar_mapjoin1 > {code} > This jira is intended to cover the vectorization issues related to the > MiniTezCliDriver failures caused by NPE via nullSafes array as shown below : > {code} > private boolean onExpressionHasNullSafes(MapJoinDesc desc) { > boolean[] nullSafes = desc.getNullSafes(); > for (boolean nullSafe : nullSafes) { > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)