[jira] [Assigned] (HIVE-22590) Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers as it causes issues with SSL and LB
[ https://issues.apache.org/jira/browse/HIVE-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing-Long Wu reassigned HIVE-22590: --- Assignee: Jing-Long Wu > Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers > as it causes issues with SSL and LB > - > > Key: HIVE-22590 > URL: https://issues.apache.org/jira/browse/HIVE-22590 > Project: Hive > Issue Type: Bug >Reporter: Peter Vary >Assignee: Jing-Long Wu >Priority: Major > Attachments: revert-HIVE-17218.patch > > > HIVE-17218 causes issues with Load balanced + SSL environments, like this: > {code} > java.net.SocketException: Socket is closed > at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1532) > at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) > at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) > at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) > at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) > at java.io.FilterOutputStream.close(FilterOutputStream.java:158) > at > org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) > > at org.apache.thrift.transport.TSocket.close(TSocket.java:235) > at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:318) > at > org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) > > at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204) > at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:169) > at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) > at java.sql.DriverManager.getConnection(DriverManager.java:664) > at java.sql.DriverManager.getConnection(DriverManager.java:208) > at > org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) > > at > org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) > > at org.apache.hive.beeline.Commands.connect(Commands.java:1496) > at org.apache.hive.beeline.Commands.connect(Commands.java:1391) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:52) > > at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1135) > at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1174) > at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1010) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:922) > at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:518) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:501) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > Unknown HS2 problem when communicating with Thrift server. > Error: Could not open client transport with JDBC Uri: jdbc:hive2:// For privacy> GSS initiate failed > Also, could not send response: > org.apache.thrift.transport.TTransportException: > javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: > No subject alternative names matching IP address 52 > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-22590) Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers as it causes issues with SSL and LB
[ https://issues.apache.org/jira/browse/HIVE-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing-Long Wu updated HIVE-22590: Attachment: revert-HIVE-17218.patch Status: Patch Available (was: Open) Dear team, [~campi01] and I have tested a patch for reverting the commit on version 3.1.3. It works fine on our environment. The patch is attached. Would be nice to have you to review it. Thanks. :) > Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers > as it causes issues with SSL and LB > - > > Key: HIVE-22590 > URL: https://issues.apache.org/jira/browse/HIVE-22590 > Project: Hive > Issue Type: Bug >Reporter: Peter Vary >Assignee: Jing-Long Wu >Priority: Major > Attachments: revert-HIVE-17218.patch > > > HIVE-17218 causes issues with Load balanced + SSL environments, like this: > {code} > java.net.SocketException: Socket is closed > at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1532) > at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) > at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) > at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) > at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) > at java.io.FilterOutputStream.close(FilterOutputStream.java:158) > at > org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) > > at org.apache.thrift.transport.TSocket.close(TSocket.java:235) > at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:318) > at > org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) > > at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204) > at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:169) > at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) > at java.sql.DriverManager.getConnection(DriverManager.java:664) > at java.sql.DriverManager.getConnection(DriverManager.java:208) > at > org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) > > at > org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) > > at org.apache.hive.beeline.Commands.connect(Commands.java:1496) > at org.apache.hive.beeline.Commands.connect(Commands.java:1391) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:52) > > at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1135) > at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1174) > at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1010) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:922) > at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:518) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:501) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > Unknown HS2 problem when communicating with Thrift server. > Error: Could not open client transport with JDBC Uri: jdbc:hive2:// For privacy> GSS initiate failed > Also, could not send response: > org.apache.thrift.transport.TTransportException: > javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: > No subject alternative names matching IP address 52 > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HIVE-22590) Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers as it causes issues with SSL and LB
[ https://issues.apache.org/jira/browse/HIVE-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17732928#comment-17732928 ] Jing-Long Wu commented on HIVE-22590: - Dear team, [~campi01] and I have tested a patch for reverting the commit on version 3.1.3. It works fine on our environment. The patch is attached. Would be nice to have you to review it. Thanks. :) > Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers > as it causes issues with SSL and LB > - > > Key: HIVE-22590 > URL: https://issues.apache.org/jira/browse/HIVE-22590 > Project: Hive > Issue Type: Bug >Reporter: Peter Vary >Priority: Major > > HIVE-17218 causes issues with Load balanced + SSL environments, like this: > {code} > java.net.SocketException: Socket is closed > at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1532) > at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) > at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) > at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) > at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) > at java.io.FilterOutputStream.close(FilterOutputStream.java:158) > at > org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) > > at org.apache.thrift.transport.TSocket.close(TSocket.java:235) > at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:318) > at > org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) > > at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204) > at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:169) > at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) > at java.sql.DriverManager.getConnection(DriverManager.java:664) > at java.sql.DriverManager.getConnection(DriverManager.java:208) > at > org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) > > at > org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) > > at org.apache.hive.beeline.Commands.connect(Commands.java:1496) > at org.apache.hive.beeline.Commands.connect(Commands.java:1391) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:52) > > at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1135) > at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1174) > at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1010) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:922) > at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:518) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:501) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > Unknown HS2 problem when communicating with Thrift server. > Error: Could not open client transport with JDBC Uri: jdbc:hive2:// For privacy> GSS initiate failed > Also, could not send response: > org.apache.thrift.transport.TTransportException: > javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: > No subject alternative names matching IP address 52 > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] (HIVE-22590) Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers as it causes issues with SSL and LB
[ https://issues.apache.org/jira/browse/HIVE-22590 ] Jing-Long Wu deleted comment on HIVE-22590: - was (Author: JIRAUSER300161): Dear team, [~campi01] and I have tested a patch for reverting the commit on version 3.1.3. It works fine on our environment. The patch is attached. Would be nice to have you to review it. Thanks. :) > Revert HIVE-17218 Canonical-ize hostnames for Hive metastore, and HS2 servers > as it causes issues with SSL and LB > - > > Key: HIVE-22590 > URL: https://issues.apache.org/jira/browse/HIVE-22590 > Project: Hive > Issue Type: Bug >Reporter: Peter Vary >Priority: Major > > HIVE-17218 causes issues with Load balanced + SSL environments, like this: > {code} > java.net.SocketException: Socket is closed > at sun.security.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1532) > at sun.security.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1553) > at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:71) > at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82) > at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140) > at java.io.FilterOutputStream.close(FilterOutputStream.java:158) > at > org.apache.thrift.transport.TIOStreamTransport.close(TIOStreamTransport.java:110) > > at org.apache.thrift.transport.TSocket.close(TSocket.java:235) > at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:318) > at > org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) > > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:422) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1917) > > at > org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) > > at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:204) > at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:169) > at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) > at java.sql.DriverManager.getConnection(DriverManager.java:664) > at java.sql.DriverManager.getConnection(DriverManager.java:208) > at > org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) > > at > org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) > > at org.apache.hive.beeline.Commands.connect(Commands.java:1496) > at org.apache.hive.beeline.Commands.connect(Commands.java:1391) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:52) > > at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1135) > at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1174) > at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1010) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:922) > at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:518) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:501) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > Unknown HS2 problem when communicating with Thrift server. > Error: Could not open client transport with JDBC Uri: jdbc:hive2:// For privacy> GSS initiate failed > Also, could not send response: > org.apache.thrift.transport.TTransportException: > javax.net.ssl.SSLHandshakeException: java.security.cert.CertificateException: > No subject alternative names matching IP address 52 > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27318) Hive CLI creates 2 Tez sessions
Jing-Long Wu created HIVE-27318: --- Summary: Hive CLI creates 2 Tez sessions Key: HIVE-27318 URL: https://issues.apache.org/jira/browse/HIVE-27318 Project: Hive Issue Type: Bug Components: Hive, Tez Affects Versions: 3.2.0 Environment: Bigtop 3.2.0 on Debian 10 h4. Reporter: Jing-Long Wu Running Hive CLI I noticed in the new version of Hive 3.1.3 and Tez 0.10.1 in Bigtop 3.2.0 (as opposed to Bigtop 1.5.0), there are now 2 Tez sessions created with "hive.execution.engine=tez" enabled as default: {code:java} 2023-05-04T13:46:19,189 INFO [main] SessionState: Hive Session ID = dbd5b26f-9904-44a1-b70b-9477287e0c03 2023-05-04T13:46:22,275 INFO [pool-6-thread-1] SessionState: Hive Session ID = 58d15cbd-f815-4c55-b323-02559dcacd61{code} When compared to previous behavior, there was only 1 session created with the main thread. Worst thing is that the session created by the pool thread is not even utilized at all, and will just linger and take up resources for the ApplicationMaster container, until it dies from timeout defined in "tez.session.am.dag.submit.timeout.secs". Running queries also only utilizes the session created by the main thread ie. {code:java} Status: Running (Executing on YARN cluster with App id application_1682588680048_0135) 2023-05-04T13:50:18,804 INFO [dbd5b26f-9904-44a1-b70b-9477287e0c03 main] SessionState: Status: Running (Executing on YARN cluster with App id application_1682588680048_0135) {code} This is using identical configs in Hive for both Hive 3.1.3 and Hive 2.3.6. This behavior is not present in Hiveserver2 though, and could only be observed when using the Hive CLI. -- This message was sent by Atlassian Jira (v8.20.10#820010)