[ https://issues.apache.org/jira/browse/SPARK-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648848#comment-14648848 ]
Kuldeep edited comment on SPARK-9333 at 7/31/15 8:21 AM: --------------------------------------------------------- Seems like I was on spark 1.3.1. Bigger problems than this with 1.4.1. JDBC connection is not working for me. With 1.4.1 I am getting following on server {code} 2015-07-31 12:25:29,477 INFO org.apache.hive.service.cli.thrift.ThriftCLIService: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V6 2015-07-31 12:25:29,480 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: No user is added in admin role, since config is empty 2015-07-31 12:25:29,480 INFO org.apache.hadoop.hive.ql.session.SessionState: No Tez session required at this point. hive.execution.engine=mr. 2015-07-31 12:25:29,481 INFO org.apache.hadoop.hive.ql.session.SessionState: No Tez session required at this point. hive.execution.engine=mr. 2015-07-31 12:25:29,482 WARN org.apache.hive.service.cli.thrift.ThriftCLIService: Error opening session: java.lang.NullPointerException at org.apache.spark.sql.hive.thriftserver.SparkSQLSessionManager.openSession(Shim13.scala:244) at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:161) at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:265) at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:191) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:55) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) {code} And this on client {code}org.apache.thrift.protocol.TProtocolException: Required field 'sessionHandle' is unset! Struct:TCloseSessionReq(sessionHandle:null) {code} was (Author: kul): -Seems like I was on spark 1.3.1. Bigger problems than this with 1.4.1. JDBC connection is not working for me. With 1.4.1 I am getting following on server {code} 2015-07-31 12:25:29,477 INFO org.apache.hive.service.cli.thrift.ThriftCLIService: Client protocol version: HIVE_CLI_SERVICE_PROTOCOL_V6 2015-07-31 12:25:29,480 INFO org.apache.hadoop.hive.metastore.HiveMetaStore: No user is added in admin role, since config is empty 2015-07-31 12:25:29,480 INFO org.apache.hadoop.hive.ql.session.SessionState: No Tez session required at this point. hive.execution.engine=mr. 2015-07-31 12:25:29,481 INFO org.apache.hadoop.hive.ql.session.SessionState: No Tez session required at this point. hive.execution.engine=mr. 2015-07-31 12:25:29,482 WARN org.apache.hive.service.cli.thrift.ThriftCLIService: Error opening session: java.lang.NullPointerException at org.apache.spark.sql.hive.thriftserver.SparkSQLSessionManager.openSession(Shim13.scala:244) at org.apache.hive.service.cli.CLIService.openSessionWithImpersonation(CLIService.java:161) at org.apache.hive.service.cli.thrift.ThriftCLIService.getSessionHandle(ThriftCLIService.java:265) at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:191) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1253) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1238) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:55) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) {code} And this on client {code}org.apache.thrift.protocol.TProtocolException: Required field 'sessionHandle' is unset! Struct:TCloseSessionReq(sessionHandle:null) {code} - > Tables are not listed in jdbc tools when connected to hivethrift server > ----------------------------------------------------------------------- > > Key: SPARK-9333 > URL: https://issues.apache.org/jira/browse/SPARK-9333 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 1.4.1 > Reporter: Kuldeep > > -Right now there is `registerTempTable` which registers table in sql/hive > context. Then there is `save` which registers it to hivestore but > materializes the df. Would it make sense to have a mid-path like > `registerTable` which registers to hivestore and points to table in sql > context without materializing it?- -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org