A-little-bit-of-data commented on issue #6724: URL: https://github.com/apache/kyuubi/issues/6724#issuecomment-2413161514
> if you set `spark.submit.deployMode=cluster` by either modifying `spark-defaults.conf` or `kyuubi-defaults.conf`, then run a `beeline` to trigger a `spark-submit`, a new Pod for spark driver will be launched, then deleting the kyuubi pod won't terminate the spark engine I set spark.submit.deployMode=cluster through the command. It is true that after deleting the kyuubi pod, the spark engine will not be terminated, but the running SQL will fail. My understanding of HA should be that when this kyuubi pod hangs up, the running SQL can be transferred to another kyuubi pod so as not to affect the normal operation of SQL. Otherwise, how can it be called HA? In addition, when submitting tasks through the way of connecting to zk in the document, /opt/kyuubi/bin/beeline -u 'jdbc:hive2://XXXX:2181/;kyuubi.engine.type=SPARK_SQL;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=kyuubi' -n batch3 -p, the engine cannot be specified, and only the default one configured in kyuubi-defaults.conf can be used; Also, when JDBC authentication is enabled, the same user can connect through the kyuubi beeline client, but through dolphin The Spark and CDH Beeline clients under the scheduler cannot connect, and keep reporting errors: 15:09:41.002 [main] ERROR org.apache.hive.jdbc.Utils - Unable to read HiveServer2 configs from ZooKeeper Unknown HS2 problem when communicating with Thrift server. Error: Could not open client transport for any of the Server URI's in ZooKeeper: Peer indicated failure: Error validating the login (state=08S01,code=0) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
