[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33525: - Assignee: Yuming Wang > Upgrade hive-service-rpc to 3.1.2 > - > > Key: SPARK-33525 > URL: https://issues.apache.org/jira/browse/SPARK-33525 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Assignee: Yuming Wang >Priority: Major > > We supported Hive metastore are 0.12.0 through 3.1.2. but we supported > hive-jdbc are 0.12.0 through 2.3.7. It will throw TProtocolException if we > use hive-jdbc 3.x: > {noformat} > [root@spark-3267648 apache-hive-3.1.2-bin]# bin/beeline -u > jdbc:hive2://localhost:1/default > Connecting to jdbc:hive2://localhost:1/default > Connected to: Spark SQL (version 3.1.0-SNAPSHOT) > Driver: Hive JDBC (version 3.1.2) > Transaction isolation: TRANSACTION_REPEATABLE_READ > Beeline version 3.1.2 by Apache Hive > 0: jdbc:hive2://localhost:1/default> create table t1(id int) using > parquet; > Unexpected end of file when reading from HS2 server. The root cause might be > too many concurrent connections. Please ask the administrator to check the > number of active connections, and adjust > hive.server2.thrift.max.worker.threads if applicable. > Error: org.apache.thrift.transport.TTransportException (state=08S01,code=0) > {noformat} > {noformat} > org.apache.thrift.protocol.TProtocolException: Missing version in > readMessageBegin, old client? > at > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234) > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27) > at > org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:53) > at > org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) > at java.base/java.lang.Thread.run(Thread.java:832) > {noformat} > We can upgrade hive-service-rpc to 3.1.2 to fix this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33525: Assignee: Apache Spark > Upgrade hive-service-rpc to 3.1.2 > - > > Key: SPARK-33525 > URL: https://issues.apache.org/jira/browse/SPARK-33525 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Assignee: Apache Spark >Priority: Major > > We supported Hive metastore are 0.12.0 through 3.1.2. but we supported > hive-jdbc are 0.12.0 through 2.3.7. It will throw TProtocolException if we > use hive-jdbc 3.x: > {noformat} > [root@spark-3267648 apache-hive-3.1.2-bin]# bin/beeline -u > jdbc:hive2://localhost:1/default > Connecting to jdbc:hive2://localhost:1/default > Connected to: Spark SQL (version 3.1.0-SNAPSHOT) > Driver: Hive JDBC (version 3.1.2) > Transaction isolation: TRANSACTION_REPEATABLE_READ > Beeline version 3.1.2 by Apache Hive > 0: jdbc:hive2://localhost:1/default> create table t1(id int) using > parquet; > Unexpected end of file when reading from HS2 server. The root cause might be > too many concurrent connections. Please ask the administrator to check the > number of active connections, and adjust > hive.server2.thrift.max.worker.threads if applicable. > Error: org.apache.thrift.transport.TTransportException (state=08S01,code=0) > {noformat} > {noformat} > org.apache.thrift.protocol.TProtocolException: Missing version in > readMessageBegin, old client? > at > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234) > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27) > at > org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:53) > at > org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) > at java.base/java.lang.Thread.run(Thread.java:832) > {noformat} > We can upgrade hive-service-rpc to 3.1.2 to fix this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-33525) Upgrade hive-service-rpc to 3.1.2
[ https://issues.apache.org/jira/browse/SPARK-33525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33525: Assignee: (was: Apache Spark) > Upgrade hive-service-rpc to 3.1.2 > - > > Key: SPARK-33525 > URL: https://issues.apache.org/jira/browse/SPARK-33525 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.1.0 >Reporter: Yuming Wang >Priority: Major > > We supported Hive metastore are 0.12.0 through 3.1.2. but we supported > hive-jdbc are 0.12.0 through 2.3.7. It will throw TProtocolException if we > use hive-jdbc 3.x: > {noformat} > [root@spark-3267648 apache-hive-3.1.2-bin]# bin/beeline -u > jdbc:hive2://localhost:1/default > Connecting to jdbc:hive2://localhost:1/default > Connected to: Spark SQL (version 3.1.0-SNAPSHOT) > Driver: Hive JDBC (version 3.1.2) > Transaction isolation: TRANSACTION_REPEATABLE_READ > Beeline version 3.1.2 by Apache Hive > 0: jdbc:hive2://localhost:1/default> create table t1(id int) using > parquet; > Unexpected end of file when reading from HS2 server. The root cause might be > too many concurrent connections. Please ask the administrator to check the > number of active connections, and adjust > hive.server2.thrift.max.worker.threads if applicable. > Error: org.apache.thrift.transport.TTransportException (state=08S01,code=0) > {noformat} > {noformat} > org.apache.thrift.protocol.TProtocolException: Missing version in > readMessageBegin, old client? > at > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:234) > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27) > at > org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:53) > at > org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:310) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) > at java.base/java.lang.Thread.run(Thread.java:832) > {noformat} > We can upgrade hive-service-rpc to 3.1.2 to fix this issue. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org