Re: [I] java.util.NoSuchElementException: None.get【kyuubi-spark-lineage】 [kyuubi]

2024-05-10 Thread via GitHub
2018yinjian commented on issue #6384: URL: https://github.com/apache/kyuubi/issues/6384#issuecomment-2105581067 df1 = spark.readStream \ .format("kafka") \ .options(**src_configs) \ .load() \ .selectExpr("offset",

Re: [PR] [KYUUBI #6281][PY] Enable hive test in python client [kyuubi]

2024-05-10 Thread via GitHub
sudohainguyen commented on PR #6381: URL: https://github.com/apache/kyuubi/pull/6381#issuecomment-2105541799 @pan3793 please take a look when you have time  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] [Bug] Jdbc connection always fails when retrying in zookeeper service discovery mode with kerberos. [kyuubi]

2024-05-10 Thread via GitHub
wForget closed issue #6337: [Bug] Jdbc connection always fails when retrying in zookeeper service discovery mode with kerberos. URL: https://github.com/apache/kyuubi/issues/6337 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [Bug] Jdbc connection always fails when retrying in zookeeper service discovery mode with kerberos. [kyuubi]

2024-05-10 Thread via GitHub
wForget commented on issue #6337: URL: https://github.com/apache/kyuubi/issues/6337#issuecomment-2105512392 This issue can be avoided by using server principal with `_HOST` instead of actual hostname. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Improve closeEngine method names and logs due to closeSession [kyuubi]

2024-05-10 Thread via GitHub
yikf commented on PR #6376: URL: https://github.com/apache/kyuubi/pull/6376#issuecomment-2105504397 thanks, merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Improve closeEngine method names and logs due to closeSession [kyuubi]

2024-05-10 Thread via GitHub
yikf closed pull request #6376: Improve closeEngine method names and logs due to closeSession URL: https://github.com/apache/kyuubi/pull/6376 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] SparkConnectEngineDemo [kyuubi]

2024-05-10 Thread via GitHub
davidyuan1223 commented on PR #6365: URL: https://github.com/apache/kyuubi/pull/6365#issuecomment-2105496394 @ulysses-you what do you think about the new module kyuubi-grpc(only structure, not write test case yet) -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] Fix isCommand check and set min rows threshold for saveToFile [kyuubi]

2024-05-10 Thread via GitHub
cfmcgrady commented on code in PR #6377: URL: https://github.com/apache/kyuubi/pull/6377#discussion_r1597332204 ## externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/spark/sql/kyuubi/SparkDatasetHelper.scala: ## @@ -270,7 +281,8 @@ object SparkDatasetHelper extends

Re: [I] java.util.NoSuchElementException: None.get【kyuubi-spark-lineage】 [kyuubi]

2024-05-10 Thread via GitHub
wForget commented on issue #6384: URL: https://github.com/apache/kyuubi/issues/6384#issuecomment-2105453627 Can you provide sql to reproduce? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Fix isCommand check and set min rows threshold for saveToFile [kyuubi]

2024-05-10 Thread via GitHub
turboFei commented on code in PR #6377: URL: https://github.com/apache/kyuubi/pull/6377#discussion_r1596806184 ## externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/spark/sql/kyuubi/SparkDatasetHelper.scala: ## @@ -270,7 +281,8 @@ object SparkDatasetHelper extends

Re: [PR] Fix isCommand check and set min rows threshold for saveToFile [kyuubi]

2024-05-10 Thread via GitHub
turboFei commented on code in PR #6377: URL: https://github.com/apache/kyuubi/pull/6377#discussion_r1596806184 ## externals/kyuubi-spark-sql-engine/src/main/scala/org/apache/spark/sql/kyuubi/SparkDatasetHelper.scala: ## @@ -270,7 +281,8 @@ object SparkDatasetHelper extends

Re: [I] [Bug] Kyuubi return query status (FINISH_STATE) quickly, but job still executing. [kyuubi]

2024-05-10 Thread via GitHub
DA1OOO commented on issue #6302: URL: https://github.com/apache/kyuubi/issues/6302#issuecomment-2104626242 ok, I will try to reproduce this case using some test dataset later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [Bug] Kyuubi return query status (FINISH_STATE) quickly, but job still executing. [kyuubi]

2024-05-10 Thread via GitHub
XorSum commented on issue #6302: URL: https://github.com/apache/kyuubi/issues/6302#issuecomment-2104578509 We don't need real datasets in the production environment. You just need to create a fake dataset with random data that is large enough to reproduce the bug. -- This is an

Re: [I] [Bug] Kyuubi return query status (FINISH_STATE) quickly, but job still executing. [kyuubi]

2024-05-10 Thread via GitHub
DA1OOO commented on issue #6302: URL: https://github.com/apache/kyuubi/issues/6302#issuecomment-2104561436 I think it maybe relative to the number of data rows, because when i not use explode in subquery. it will not be reproduced. i dont have any test dataset, we meet this case in our

Re: [I] [Improvement] Define a general Helm chart configuration approach [kyuubi]

2024-05-10 Thread via GitHub
chgl commented on issue #6123: URL: https://github.com/apache/kyuubi/issues/6123#issuecomment-2104507875 maybe just one minor detail: make sure all changed configs contribute to the checksum annotation for the statefulset so kyuubi is automatically restarted:

[I] java.util.NoSuchElementException: None.get【kyuubi-spark-lineage】 [kyuubi]

2024-05-10 Thread via GitHub
2018yinjian opened a new issue, #6384: URL: https://github.com/apache/kyuubi/issues/6384 ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched

Re: [PR] kyuubi-beeline auto constructs JDBC URL from kyuubi-defaults.conf [kyuubi]

2024-05-10 Thread via GitHub
codecov-commenter commented on PR #6339: URL: https://github.com/apache/kyuubi/pull/6339#issuecomment-2104200216 ## [Codecov](https://app.codecov.io/gh/apache/kyuubi/pull/6339?dropdown=coverage=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=apache) Report

Re: [PR] [KYUUBI #6368] Support impersonation mode for flink sql engine [kyuubi]

2024-05-10 Thread via GitHub
codecov-commenter commented on PR #6383: URL: https://github.com/apache/kyuubi/pull/6383#issuecomment-2104115651 ## [Codecov](https://app.codecov.io/gh/apache/kyuubi/pull/6383?dropdown=coverage=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=apache) Report

Re: [PR] Bump Delta from 3.1.0 to 3.2.0 for Spark 3.5 [kyuubi]

2024-05-10 Thread via GitHub
codecov-commenter commented on PR #6382: URL: https://github.com/apache/kyuubi/pull/6382#issuecomment-2104085106 ## [Codecov](https://app.codecov.io/gh/apache/kyuubi/pull/6382?dropdown=coverage=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=apache) Report

Re: [I] [Bug] Kyuubi return query status (FINISH_STATE) quickly, but job still executing. [kyuubi]

2024-05-10 Thread via GitHub
XorSum commented on issue #6302: URL: https://github.com/apache/kyuubi/issues/6302#issuecomment-2104082176 @DA1OOO I tried running the code below on Kyuubi 1.9 and Spark 3.4.2, but I couldn't reproduce your bug. In other words, I can see the `Asked to cancel job group` log. Does the

Re: [PR] kyuubi-beeline auto constructs JDBC URL from kyuubi-defaults.conf [kyuubi]

2024-05-10 Thread via GitHub
zhaohehuhu commented on code in PR #6339: URL: https://github.com/apache/kyuubi/pull/6339#discussion_r1596376060 ## kyuubi-hive-beeline/src/main/java/org/apache/hive/beeline/BeeLine.java: ## @@ -1012,6 +1010,14 @@ private String getDefaultConnectionUrl(CommandLine cl) throws

Re: [PR] Improve closeEngine method names and logs due to closeSession [kyuubi]

2024-05-10 Thread via GitHub
pan3793 commented on code in PR #6376: URL: https://github.com/apache/kyuubi/pull/6376#discussion_r1596344460 ## externals/kyuubi-chat-engine/src/main/scala/org/apache/kyuubi/engine/chat/session/ChatSessionManager.scala: ## @@ -59,12 +59,12 @@ class ChatSessionManager(name:

Re: [PR] Improve closeEngine method names and logs due to closeSession [kyuubi]

2024-05-10 Thread via GitHub
yikf commented on PR #6376: URL: https://github.com/apache/kyuubi/pull/6376#issuecomment-2103998965 @pan3793 Please take a look if you find a time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [KYUUBI #6348] Upgrade iceberg from 1.5.0 to 1.5.2 [kyuubi]

2024-05-10 Thread via GitHub
pan3793 commented on PR #6349: URL: https://github.com/apache/kyuubi/pull/6349#issuecomment-2103955800 Thanks, merged to master/1.9 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [KYUUBI #6348] Upgrade iceberg from 1.5.0 to 1.5.2 [kyuubi]

2024-05-10 Thread via GitHub
pan3793 closed pull request #6349: [KYUUBI #6348] Upgrade iceberg from 1.5.0 to 1.5.2 URL: https://github.com/apache/kyuubi/pull/6349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] [TEST][TRIVIAL] Upgrade iceberg from 1.5.0 to 1.5.2 [kyuubi]

2024-05-10 Thread via GitHub
pan3793 closed issue #6348: [TEST][TRIVIAL] Upgrade iceberg from 1.5.0 to 1.5.2 URL: https://github.com/apache/kyuubi/issues/6348 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] [KYUUBI #6368] Support impersonation mode for flink sql engine [kyuubi]

2024-05-10 Thread via GitHub
wForget opened a new pull request, #6383: URL: https://github.com/apache/kyuubi/pull/6383 # :mag: Description ## Issue References  This pull request fixes #6368 ## Describe Your Solution  Support impersonation mode for flink sql engine. ## Types

[PR] Bump Delta from 3.1.0 to 3.2.0 for Spark 3.5 [kyuubi]

2024-05-10 Thread via GitHub
zml1206 opened a new pull request, #6382: URL: https://github.com/apache/kyuubi/pull/6382 # :mag: Description ## Issue References  [Delta 3.2.0](https://github.com/delta-io/delta/releases/tag/v3.2.0) is available, which is built on top of Spark 3.5. ## Describe Your Solution 

Re: [PR] [KYUUBI #6281][PY] Enable hive test in python client [kyuubi]

2024-05-10 Thread via GitHub
codecov-commenter commented on PR #6381: URL: https://github.com/apache/kyuubi/pull/6381#issuecomment-2103944072 ## [Codecov](https://app.codecov.io/gh/apache/kyuubi/pull/6381?dropdown=coverage=pr=h1_medium=referral_source=github_content=comment_campaign=pr+comments_term=apache) Report

Re: [I] [Bug] Kyuubi return query status (FINISH_STATE) quickly, but job still executing. [kyuubi]

2024-05-10 Thread via GitHub
DA1OOO commented on issue #6302: URL: https://github.com/apache/kyuubi/issues/6302#issuecomment-2103933750 @XorSum is above information enough to reproduce this case? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use