[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17379776#comment-17379776 ] louiechen commented on HIVE-11369: -- Although this problem has been corrected, I still encounter the same problem in future versions. What kind of information can I provide? Please help hadoop 3.1.3 (https://hadoop.apache.org/release/3.1.3.html) hive 3.1.2 ([https://downloads.apache.org/hive/hive-3.1.2/apache-hive-3.1.2-bin.tar.gz)] and my env enable kerberos and ranger hive plugin. > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel >Assignee: loushang >Priority: Major > Fix For: 2.0.0 > > Attachments: HIVE-11369.1.patch, HIVE-11369.2.patch > > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.3.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml >-jobconffile > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10006/jobconf.xml > 2015-07-24 17:19:28,499 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Execution failed with exit > status: 1 > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Obtaining error information > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > Task failed! > Task ID: > Stage-4 > Logs: > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > /tmp/hiveserver2_manual/hive-server2.log > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(308)) - Execution > failed with exit status: 1 > 2015-07-24 17:19:28,518 ERROR [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printError(921)) - FAILED: Execution Error, > return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,599 WARN [HiveServer2-Handler-Pool: Thread-22]: > security.UserGroupInformation (UserGroupInformation.java:doAs(1674)) - > PriviledgedActionException as:hive (auth:SIMPLE) > cause:org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,600 WARN [HiveServer2-Handler-Pool: Thread-22]: > thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(496)) - Error > executing statement: > org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, retu
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15076002#comment-15076002 ] Aihua Xu commented on HIVE-11369: - You are right. We need to keep such backward compatibility since usually we need to pass such opts to the child process. +1 on the new patch. > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel >Assignee: Jimmy Xiang > Attachments: HIVE-11369.1.patch, HIVE-11369.2.patch > > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.3.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml >-jobconffile > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10006/jobconf.xml > 2015-07-24 17:19:28,499 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Execution failed with exit > status: 1 > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Obtaining error information > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > Task failed! > Task ID: > Stage-4 > Logs: > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > /tmp/hiveserver2_manual/hive-server2.log > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(308)) - Execution > failed with exit status: 1 > 2015-07-24 17:19:28,518 ERROR [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printError(921)) - FAILED: Execution Error, > return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,599 WARN [HiveServer2-Handler-Pool: Thread-22]: > security.UserGroupInformation (UserGroupInformation.java:doAs(1674)) - > PriviledgedActionException as:hive (auth:SIMPLE) > cause:org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,600 WARN [HiveServer2-Handler-Pool: Thread-22]: > thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(496)) - Error > executing statement: > org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315) > at > org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:146) >
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075588#comment-15075588 ] Hive QA commented on HIVE-11369: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12780059/HIVE-11369.2.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 21 failed/errored test(s), 9994 tests executed *Failed tests:* {noformat} TestHWISessionManager - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_index_auto_mult_tables org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order2 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_columnstats_partlvl_multiple_part_clause org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testAddPartitions org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testFetchingPartitionsWithDifferentSchemas org.apache.hadoop.hive.metastore.TestHiveMetaStorePartitionSpecs.testGetPartitionSpecs_WithAndWithoutPartitionGrouping org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testMultiSessionMultipleUse org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testSingleSessionMultipleUse org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveOperationType.checkHiveOperationTypeMatch org.apache.hive.jdbc.TestSSL.testSSLVersion org.apache.hive.spark.client.TestSparkClient.testAddJarsAndFiles org.apache.hive.spark.client.TestSparkClient.testCounters org.apache.hive.spark.client.TestSparkClient.testErrorJob org.apache.hive.spark.client.TestSparkClient.testJobSubmission org.apache.hive.spark.client.TestSparkClient.testMetricsCollection org.apache.hive.spark.client.TestSparkClient.testRemoteClient org.apache.hive.spark.client.TestSparkClient.testSimpleSparkJob org.apache.hive.spark.client.TestSparkClient.testSyncRpc {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6505/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6505/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-6505/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 21 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12780059 - PreCommit-HIVE-TRUNK-Build > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel >Assignee: Jimmy Xiang > Attachments: HIVE-11369.1.patch, HIVE-11369.2.patch > > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15075338#comment-15075338 ] Aihua Xu commented on HIVE-11369: - Thanks [~jxiang] for the patch. Here are a few comments. 1. Seems we are redefining the same constants in MapRedTask.java and MapRedLocalTask.java. Can we try to avoid that? 2. Since the patch only replaces the opts when HIVE_LOCAL_TASK_CHILD_OPTS exists, then it will still have the same issue for this scenario. Probably we should still replace HADOOP_OPTS by removing HADOOP_CLIENT_OPTS when HIVE_LOCAL_TASK_CHILD_OPTS is not set? > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel >Assignee: Jimmy Xiang > Attachments: HIVE-11369.1.patch > > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.3.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml >-jobconffile > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10006/jobconf.xml > 2015-07-24 17:19:28,499 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Execution failed with exit > status: 1 > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Obtaining error information > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > Task failed! > Task ID: > Stage-4 > Logs: > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > /tmp/hiveserver2_manual/hive-server2.log > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(308)) - Execution > failed with exit status: 1 > 2015-07-24 17:19:28,518 ERROR [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printError(921)) - FAILED: Execution Error, > return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,599 WARN [HiveServer2-Handler-Pool: Thread-22]: > security.UserGroupInformation (UserGroupInformation.java:doAs(1674)) - > PriviledgedActionException as:hive (auth:SIMPLE) > cause:org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,600 WARN [HiveServer2-Handler-Pool: Thread-22]: > thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(496)) - Error > executing statement: > org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error,
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074987#comment-15074987 ] Hive QA commented on HIVE-11369: Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12779894/HIVE-11369.1.patch {color:red}ERROR:{color} -1 due to no test(s) being added or modified. {color:red}ERROR:{color} -1 due to 19 failed/errored test(s), 9992 tests executed *Failed tests:* {noformat} TestHWISessionManager - did not produce a TEST-*.xml file org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order2 org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_authorization_uri_import org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_columnstats_partlvl_multiple_part_clause org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testMultiSessionMultipleUse org.apache.hadoop.hive.ql.exec.spark.session.TestSparkSessionManagerImpl.testSingleSessionMultipleUse org.apache.hadoop.hive.ql.security.authorization.plugin.TestHiveOperationType.checkHiveOperationTypeMatch org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler.org.apache.hive.hcatalog.hbase.TestPigHBaseStorageHandler org.apache.hive.jdbc.TestJdbcWithMiniHS2.testAddJarDataNucleusUnCaching org.apache.hive.jdbc.TestSSL.testSSLVersion org.apache.hive.spark.client.TestSparkClient.testAddJarsAndFiles org.apache.hive.spark.client.TestSparkClient.testCounters org.apache.hive.spark.client.TestSparkClient.testErrorJob org.apache.hive.spark.client.TestSparkClient.testJobSubmission org.apache.hive.spark.client.TestSparkClient.testMetricsCollection org.apache.hive.spark.client.TestSparkClient.testRemoteClient org.apache.hive.spark.client.TestSparkClient.testSimpleSparkJob org.apache.hive.spark.client.TestSparkClient.testSyncRpc {noformat} Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6501/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/6501/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-6501/ Messages: {noformat} Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 19 tests failed {noformat} This message is automatically generated. ATTACHMENT ID: 12779894 - PreCommit-HIVE-TRUNK-Build > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel >Assignee: Jimmy Xiang > Attachments: HIVE-11369.1.patch > > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15074423#comment-15074423 ] Jimmy Xiang commented on HIVE-11369: We can remove these settings when spining up the child process. Let me come up a patch. > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel >Assignee: Jimmy Xiang > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.3.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml >-jobconffile > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10006/jobconf.xml > 2015-07-24 17:19:28,499 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Execution failed with exit > status: 1 > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Obtaining error information > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > Task failed! > Task ID: > Stage-4 > Logs: > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > /tmp/hiveserver2_manual/hive-server2.log > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(308)) - Execution > failed with exit status: 1 > 2015-07-24 17:19:28,518 ERROR [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printError(921)) - FAILED: Execution Error, > return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,599 WARN [HiveServer2-Handler-Pool: Thread-22]: > security.UserGroupInformation (UserGroupInformation.java:doAs(1674)) - > PriviledgedActionException as:hive (auth:SIMPLE) > cause:org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,600 WARN [HiveServer2-Handler-Pool: Thread-22]: > thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(496)) - Error > executing statement: > org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > at > org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:315) > at > org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:146) > at > org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:173) > at > org.apa
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14744219#comment-14744219 ] Andrew Mains commented on HIVE-11369: - As far as actual fixes... we could have hive specialcase the JMX options, but that seems ugly/error prone. Perhaps it would make sense to split out the options for the child JVM from those of the parent? They seem like they might be quite different in general--you almost certainly don't want to give every local task the same amount of memory as hive-server2. Could either configure that by way of hive-site.xml, or by way of another environment variable (HIVE_LOCAL_TASK_CHILD_OPTS?) > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.3.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml >-jobconffile > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10006/jobconf.xml > 2015-07-24 17:19:28,499 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Execution failed with exit > status: 1 > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Obtaining error information > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > Task failed! > Task ID: > Stage-4 > Logs: > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - > /tmp/hiveserver2_manual/hive-server2.log > 2015-07-24 17:19:28,501 ERROR [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(308)) - Execution > failed with exit status: 1 > 2015-07-24 17:19:28,518 ERROR [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printError(921)) - FAILED: Execution Error, > return code 1 from org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,599 WARN [HiveServer2-Handler-Pool: Thread-22]: > security.UserGroupInformation (UserGroupInformation.java:doAs(1674)) - > PriviledgedActionException as:hive (auth:SIMPLE) > cause:org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.mr.MapredLocalTask > 2015-07-24 17:19:28,600 WARN [HiveServer2-Handler-Pool: Thread-22]: > thrift.ThriftCLIService (ThriftCLIService.java:ExecuteStatement(496)) - Error > executing statement: > org.apache.hive.service.cli.HiveSQLException: Error while processing > statement: FAILED: Execution Error, return code 1 fro
[jira] [Commented] (HIVE-11369) Mapjoins in HiveServer2 fail when jmxremote is used
[ https://issues.apache.org/jira/browse/HIVE-11369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14744201#comment-14744201 ] Andrew Mains commented on HIVE-11369: - We've run into this same issue. As far as we can tell, it's due to the fact that hive-server2 passes through its environment, along with JVM startup options, to the MapRedLocalTask (which it runs in a separate process): {code} if (variables.containsKey(HADOOP_OPTS_KEY)) { variables.put(HADOOP_OPTS_KEY, variables.get(HADOOP_OPTS_KEY) + hadoopOpts); } else { variables.put(HADOOP_OPTS_KEY, hadoopOpts); } {code} (from [MapredLocalTask|https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java#L245]) When it tries to do this, the child JVM tries to listen on the same JMX port and fails to start, since the parent already owns it. This is of course a pain to debug, since for some reason the child job's stderr isn't bubbled up anywhere (that might be a separate ticket). After throwing in a debug log statement though, we can confirm this: {code} diff --git a/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java b/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java index 9f3df99..8cd65c0 100644 --- a/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java +++ b/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java @@ -305,6 +305,7 @@ public int executeInChildVM(DriverContext driverContext) { if (exitVal != 0) { LOG.error("Execution failed with exit status: " + exitVal); +LOG.error(errPrintStream.getOutput()); if (SessionState.get() != null) { SessionState.get().addLocalMapRedErrors(getId(), errPrintStream.getOutput()); } {code} will print: {code} 2015-09-12 10:54:45,634 ERROR mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(308)) - [Error: Exception thrown by the agent : java.rmi.server.ExportException: Port already in use: 9099; nested exception is: , java.net.BindException: Address already in use] {code} > Mapjoins in HiveServer2 fail when jmxremote is used > --- > > Key: HIVE-11369 > URL: https://issues.apache.org/jira/browse/HIVE-11369 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 1.1.0 > Environment: CDH 5.4.3, Centos 6.5, java version "1.7.0_67" >Reporter: David Morel > > having hive.auto.convert.join set to true works in the CLI with no issue, but > fails in HiveServer2 when jmx options are passed to the service on startup. > This (in hive-env.sh) is enough to make it fail: > {noformat} > -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.port=8009 > {noformat} > As soon as I remove the line, it works properly. I have *no*idea... > Here's the log from the service: > {noformat} > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Query ID = > hive_20150724171919_aaa88a89-dc6d-490b-821c-4eec6d4c0421 > 2015-07-24 17:19:27,457 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (SessionState.java:printInfo(912)) - Total jobs = 1 > 2015-07-24 17:19:27,465 INFO [HiveServer2-Handler-Pool: Thread-22]: > ql.Driver (Driver.java:launchTask(1638)) - Starting task > [Stage-4:MAPREDLOCAL] in serial mode > 2015-07-24 17:19:27,467 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(159)) - Generating > plan file > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml > 2015-07-24 17:19:27,625 WARN [HiveServer2-Handler-Pool: Thread-22]: > conf.HiveConf (HiveConf.java:initialize(2620)) - HiveConf of name > hive.files.umask.value does not exist > 2015-07-24 17:19:27,708 INFO [HiveServer2-Handler-Pool: Thread-22]: > mr.MapredLocalTask (MapredLocalTask.java:executeInChildVM(288)) - Executing: > /usr/lib/hadoop/bin/hadoop jar > /usr/lib/hive/lib/hive-common-1.1.0-cdh5.4.3.jar > org.apache.hadoop.hive.ql.exec.mr.ExecDriver -localtask -plan > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10005/plan.xml >-jobconffile > file:/tmp/hive/8932c206-5420-4b6f-9f1f-5f1706f30df8/hive_2015-07-24_17-19-26_552_5082133674120283907-1/-local-10006/jobconf.xml > 2015-07-24 17:19:28,499 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printError(921)) - Execution failed with exit > status: 1 > 2015-07-24 17:19:28,500 ERROR [HiveServer2-Handler-Pool: Thread-22]: > exec.Task (SessionState.java:printEr