[GitHub] [incubator-kyuubi] hddong commented on issue #834: Support server control of engine config

2021-07-20 Thread GitBox
hddong commented on issue #834: URL: https://github.com/apache/incubator-kyuubi/issues/834#issuecomment-882972284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #32: support for http frontend service

2021-07-20 Thread GitBox
yaooqinn commented on issue #32: URL: https://github.com/apache/incubator-kyuubi/issues/32#issuecomment-883005682 thanks @yanghua -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [incubator-kyuubi] yaooqinn edited a comment on issue #834: Support server control of engine config

2021-07-20 Thread GitBox
yaooqinn edited a comment on issue #834: URL: https://github.com/apache/incubator-kyuubi/issues/834#issuecomment-883003838 For now, 1. `kyuubi.engineEnv.SPARK_CONF_DIR` can be used to point isolated spark configuration environment 2. https://kyuubi.apache.org/docs/latest/deployment/

[GitHub] [incubator-kyuubi] lordk911 edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
lordk911 edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883009973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [incubator-kyuubi] yanghua closed issue #835: Support Restful API for Kyuubi server

2021-07-20 Thread GitBox
yanghua closed issue #835: URL: https://github.com/apache/incubator-kyuubi/issues/835 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #839: Fix load user specific defaults from properties file

2021-07-20 Thread GitBox
yaooqinn commented on issue #839: URL: https://github.com/apache/incubator-kyuubi/issues/839#issuecomment-883201463 nice catch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [incubator-kyuubi] yanghua commented on issue #32: support for http frontend service

2021-07-20 Thread GitBox
yanghua commented on issue #32: URL: https://github.com/apache/incubator-kyuubi/issues/32#issuecomment-882529444 As discussed under #835 , will create a proposal for this feature -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [incubator-kyuubi] yaooqinn edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
yaooqinn edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883172960 +1 for @cloud-fan's explanation. @lordk911 I would suggest you create an issue on the iceberg side and cc them with this ticket -- This is an automated message fro

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #835: Support Restful API for Kyuubi server

2021-07-20 Thread GitBox
yaooqinn commented on issue #835: URL: https://github.com/apache/incubator-kyuubi/issues/835#issuecomment-882479459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] changhuyan commented on issue #836: kyuubi读写orc和parquet格式的分区表报错

2021-07-20 Thread GitBox
changhuyan commented on issue #836: URL: https://github.com/apache/incubator-kyuubi/issues/836#issuecomment-882519192 经过排查发现,spark3.x的版本将parquet-hadoop-bundle-1.6.0.jar的功能合并到parquet-hadoop-1.10.1.jar中了,并且把类名其那面加了apache标识,导致该类型找不到,需要将parquet-hadoop-bundle-1.6.0.jar拷贝到spark的jar目录即可 -- T

[GitHub] [incubator-kyuubi] lordk911 commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
lordk911 commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883009973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883203338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-kyuubi] pan3793 commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
pan3793 commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883001193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-kyuubi] cloud-fan commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
cloud-fan commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883162937 It seems like Iceberg catalog has internal caches and `REFRESH TABLE` can't clear that cache. I'm not familiar with iceberg though/. -- This is an automated message from

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #834: Support server control of engine config

2021-07-20 Thread GitBox
yaooqinn commented on issue #834: URL: https://github.com/apache/incubator-kyuubi/issues/834#issuecomment-882426621 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] yanghua commented on issue #835: Support Restful API for Kyuubi server

2021-07-20 Thread GitBox
yanghua commented on issue #835: URL: https://github.com/apache/incubator-kyuubi/issues/835#issuecomment-882474122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883001193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [incubator-kyuubi] changhuyan closed issue #836: kyuubi读写orc和parquet格式的分区表报错

2021-07-20 Thread GitBox
changhuyan closed issue #836: URL: https://github.com/apache/incubator-kyuubi/issues/836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsub

[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883180294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883262696 From the table, Kyuubi will be broken if run jdk14+ with embedded zookeeper, and works fine with remote high version Zookeeper Cluster. But the upgrade means we drop t

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883262696 From the table, Kyuubi will be broken if run jdk14+ when embedded zookeeper, and works fine with remote high version Zookeeper Cluster. But the upgrade means we drop the supp

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883265634 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] lordk911 commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
lordk911 commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883268231 > +1 for @cloud-fan's explanation. @lordk911 I would suggest you create an issue on the iceberg side and cc them with this ticket ok I will -- This is a

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883253656 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [incubator-kyuubi] yaooqinn edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883267515 > hi @pan3793, when connect to the embedded zookeeper in own project, it throws `UnimplementedException`. > > It's ok if upgrate to zookeeper 3.5.5. > >

[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883275276 The root cause is zk3.4.x can not compatible with high version curator, but zk3.5.x can compatible with both zk3.4 and zk3.5. So, I think upgrade zk and cur

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883278220 if a higher curator can work with zk 3.4, that's ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883280859 > if a higher curator can work with zk 3.4, that's ok No, the main problem is the version of zk is low. -- This is an automated message from the Apache Git Servi

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883281766 It's nice that everything is ok after upgrade zk to 3.5.5. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883180294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883262696 From the table, Kyuubi will be broken if run jdk14+ with embedded zookeeper, and works fine with remote high version Zookeeper Cluster. But the upgrade means we drop t

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #661: Add UDF system_user

2021-07-20 Thread GitBox
yaooqinn commented on issue #661: URL: https://github.com/apache/incubator-kyuubi/issues/661#issuecomment-883017415 #758 fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883180294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883169823 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
yaooqinn commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883016136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] hddong commented on issue #834: Support server control of engine config

2021-07-20 Thread GitBox
hddong commented on issue #834: URL: https://github.com/apache/incubator-kyuubi/issues/834#issuecomment-882972284 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #32: support for http frontend service

2021-07-20 Thread GitBox
yaooqinn commented on issue #32: URL: https://github.com/apache/incubator-kyuubi/issues/32#issuecomment-883005682 thanks @yanghua -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [incubator-kyuubi] lordk911 edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
lordk911 edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883009973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [incubator-kyuubi] yaooqinn edited a comment on issue #834: Support server control of engine config

2021-07-20 Thread GitBox
yaooqinn edited a comment on issue #834: URL: https://github.com/apache/incubator-kyuubi/issues/834#issuecomment-883003838 For now, 1. `kyuubi.engineEnv.SPARK_CONF_DIR` can be used to point isolated spark configuration environment 2. https://kyuubi.apache.org/docs/latest/deployment/

[GitHub] [incubator-kyuubi] yanghua closed issue #835: Support Restful API for Kyuubi server

2021-07-20 Thread GitBox
yanghua closed issue #835: URL: https://github.com/apache/incubator-kyuubi/issues/835 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #839: Fix load user specific defaults from properties file

2021-07-20 Thread GitBox
yaooqinn commented on issue #839: URL: https://github.com/apache/incubator-kyuubi/issues/839#issuecomment-883201463 nice catch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #835: Support Restful API for Kyuubi server

2021-07-20 Thread GitBox
yaooqinn commented on issue #835: URL: https://github.com/apache/incubator-kyuubi/issues/835#issuecomment-882479459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] yanghua commented on issue #32: support for http frontend service

2021-07-20 Thread GitBox
yanghua commented on issue #32: URL: https://github.com/apache/incubator-kyuubi/issues/32#issuecomment-882529444 As discussed under #835 , will create a proposal for this feature -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [incubator-kyuubi] changhuyan closed issue #836: kyuubi读写orc和parquet格式的分区表报错

2021-07-20 Thread GitBox
changhuyan closed issue #836: URL: https://github.com/apache/incubator-kyuubi/issues/836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsub

[GitHub] [incubator-kyuubi] yaooqinn edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
yaooqinn edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883172960 +1 for @cloud-fan's explanation. @lordk911 I would suggest you create an issue on the iceberg side and cc them with this ticket -- This is an automated message fro

[GitHub] [incubator-kyuubi] lordk911 commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
lordk911 commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883009973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883203338 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-kyuubi] changhuyan commented on issue #836: kyuubi读写orc和parquet格式的分区表报错

2021-07-20 Thread GitBox
changhuyan commented on issue #836: URL: https://github.com/apache/incubator-kyuubi/issues/836#issuecomment-882519192 经过排查发现,spark3.x的版本将parquet-hadoop-bundle-1.6.0.jar的功能合并到parquet-hadoop-1.10.1.jar中了,并且把类名其那面加了apache标识,导致该类型找不到,需要将parquet-hadoop-bundle-1.6.0.jar拷贝到spark的jar目录即可 -- T

[GitHub] [incubator-kyuubi] pan3793 commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
pan3793 commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883001193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-kyuubi] yaooqinn edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883267515 > hi @pan3793, when connect to the embedded zookeeper in own project, it throws `UnimplementedException`. > > It's ok if upgrate to zookeeper 3.5.5. > >

[GitHub] [incubator-kyuubi] cloud-fan commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
cloud-fan commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883162937 It seems like Iceberg catalog has internal caches and `REFRESH TABLE` can't clear that cache. I'm not familiar with iceberg though/. -- This is an automated message from

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #834: Support server control of engine config

2021-07-20 Thread GitBox
yaooqinn commented on issue #834: URL: https://github.com/apache/incubator-kyuubi/issues/834#issuecomment-883003838 For now, 1. `kyuubi.engineEnv.SPARK_CONF_DIR` can be used to point isolated spark configuration environment 2. https://kyuubi.apache.org/docs/latest/deployment/setting

[GitHub] [incubator-kyuubi] yanghua commented on issue #835: Support Restful API for Kyuubi server

2021-07-20 Thread GitBox
yanghua commented on issue #835: URL: https://github.com/apache/incubator-kyuubi/issues/835#issuecomment-882474122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883001193 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883390749 Hi @yaooqinn @pan3793, Just only upgrade zk server to 3.5.5 is ok. I had test it just now. - kyuubi-ctl get engine ---> ok - `WARN utils.ZKPaths: The version of

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883393321 Upgrate zk server means upgrade `org.apache.zookeeper:zookeeper`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883393256 OK -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883393518 > Upgrate zk server means upgrade `org.apache.zookeeper:zookeeper`? right -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883394057 zookeeper client and server share the `org.apache.zookeeper:zookeeper`, you also upgraded the client. -- This is an automated message from the Apache Git Service. To respon

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883395906 > zookeeper client and server share the `org.apache.zookeeper:zookeeper`, you also upgraded the client. The zookeeper 3.5.5 can compatible with curator 2.12.0 and

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883396910 The key point here is Zookeeper 3.5.x clients are incompatible with 3.4 server, but CDH 6 and EMR only provided 3.4 server. -- This is an automated message from the Apache

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883396910 The key point here is Zookeeper 3.5.x clients are incompatible with 3.4 server, but CDH 6 and EMR only provide 3.4 server. -- This is an automated message from the A

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883409312 Wow, get your point. You mean use curator 2.12.0 with zk3.5.5 to connect zk cluster is 3.4. 🙁 -- This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883414894 @pan3793 Thanks for your advice and get your point, will close this issue. By the way, zk3.4 is now at end-of-life. In product we already use zk3.5.x, will come back

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883416928 can we add a zk profile instead? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883420963 > can we add a zk profile instead? Nice!!! The spark3.2 will include zk3.6.2, we can go back here when kyuubi support spark3.2 or 3.3 -- This is an automated me

[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883420963 > can we add a zk profile instead? Nice!!! The spark3.2 will include zk3.6.2, we can go back here to use zk profile when kyuubi support spark3.2 or spark3.3

[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883420963 > can we add a zk profile instead? Nice!!! The spark3.2 will include zk3.6.2, we can go back here to use zk profile when kyuubi support spark3.2 or spark3.3

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883423615 If we are able to bump up curator to 4.2.x then we are able to work with both zk 3.4 and 3.5? -- This is an automated message from the Apache Git Service. To respond to th

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883427067 this is also reported by meituan once, I am glad if we can have a proper solution here -- This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883429326 > If we are able to bump up curator to 4.2.x then we are able to work with both zk 3.4 and 3.5? Curator4.2.0 can work with zk3.4 and zk3.5. whether throw `Unimple

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883430984 > this is also reported by meituan once, I am glad if we can have a proper solution here I‘m glad to have a try to solve this issue. -- This is an automated me

[GitHub] [incubator-kyuubi] timothy65535 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883430984 > this is also reported by meituan once, I am glad if we can have a proper solution here ok, I‘m glad to have a try to solve this issue. -- This is an a

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
yaooqinn commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883436012 maybe we can use https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-zookeeper-3/3.5.6-13.0 ? -- This is an automated message from the Apache Git Service. To

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883439899 It seems not ok if we just use zk profile. - `dependencyList` just include only one zookeeper version - externals jars will inflict with spark jars ![ima

[GitHub] [incubator-kyuubi] timothy65535 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
timothy65535 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883441610 > maybe we can use https://mvnrepository.com/artifact/org.apache.flink/flink-shaded-zookeeper-3/3.5.6-13.0 ? nice, have a try. -- This is an automated message

[GitHub] [incubator-kyuubi] pan3793 commented on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 commented on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883471959 I'd like to talk about what I thought about this issue. Actually, we have tried to do something to solve the jar conflicts and try our best to keep the dependencies up-

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #838: Upgrade ZooKeeper 3.4.14 to 3.5.5

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #838: URL: https://github.com/apache/incubator-kyuubi/issues/838#issuecomment-883471959 I'd like to talk about what I thought about this issue. Actually, we have tried to do something to solve the jar conflicts and try our best to keep the dependenc

[GitHub] [incubator-kyuubi] timothy65535 opened a new issue #842: Fix meet rat check error when build kyuubi project

2021-07-20 Thread GitBox
timothy65535 opened a new issue #842: URL: https://github.com/apache/incubator-kyuubi/issues/842 ### 1. Describe the bug Meet rat check error when build kyuubi project ``` [ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.13:check (default-cli) on project kyuubi

[GitHub] [incubator-kyuubi] pan3793 commented on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
pan3793 commented on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883549652 Find one same issue reported by another guy, but he said that `refresh table` works. https://github.com/apache/iceberg/issues/2447 -- This is an automated message fr

[GitHub] [incubator-kyuubi] pan3793 edited a comment on issue #837: How to read the new data by spark which was writed by flink DataStream

2021-07-20 Thread GitBox
pan3793 edited a comment on issue #837: URL: https://github.com/apache/incubator-kyuubi/issues/837#issuecomment-883549652 Find one similar issue reported by another guy, but he said that `refresh table` works. He use hadoop catalog and you use hive catalog. https://github.co

[GitHub] [incubator-kyuubi] ulysses-you closed issue #839: Fix load user specific defaults from properties file

2021-07-20 Thread GitBox
ulysses-you closed issue #839: URL: https://github.com/apache/incubator-kyuubi/issues/839 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsu

[GitHub] [incubator-kyuubi] ulysses-you closed issue #842: Fix meet rat check error when build kyuubi project

2021-07-20 Thread GitBox
ulysses-you closed issue #842: URL: https://github.com/apache/incubator-kyuubi/issues/842 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsu

[GitHub] [incubator-kyuubi] hddong opened a new issue #844: Use NodePort to expose kyuubi port on k8s

2021-07-20 Thread GitBox
hddong opened a new issue #844: URL: https://github.com/apache/incubator-kyuubi/issues/844 ### 1. Describe the feature `kubectl port-forward` usually use to test, use `NodePort` to visit kyuubi service in pod. ### 2. Motivation ### 3. Describe the solution ##

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #844: Use NodePort to expose kyuubi port on k8s

2021-07-21 Thread GitBox
yaooqinn commented on issue #844: URL: https://github.com/apache/incubator-kyuubi/issues/844#issuecomment-883972421 sounds nice -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #845: Event tracking for stage: Getting metrics in stage's lifecycle and store them in mem

2021-07-21 Thread GitBox
zhang1002 opened a new issue #845: URL: https://github.com/apache/incubator-kyuubi/issues/845 ### 1. Describe the feature Event tracking for stage and store the metrics in mem for a short time. ### 2. Motivation 1. For statement, you can know each stage's metrics in its running

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #846: Dumpping statementInfo from mem

2021-07-21 Thread GitBox
zhang1002 opened a new issue #846: URL: https://github.com/apache/incubator-kyuubi/issues/846 ### 1. Describe the feature Dumpping statementInfo from mem into a file. Need to support local log file and remote file in hdfs. ### 2. Motivation ### 3. Describe the solutio

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #847: Dumpping jobInfo from mem into a file

2021-07-21 Thread GitBox
zhang1002 opened a new issue #847: URL: https://github.com/apache/incubator-kyuubi/issues/847 ### 1. Describe the feature Dumpping jobInfo from mem into a file. Need to support local log file and remote file in hdfs. ### 2. Motivation ### 3. Describe the solution

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #848: Dumpping stageInfo from mem

2021-07-21 Thread GitBox
zhang1002 opened a new issue #848: URL: https://github.com/apache/incubator-kyuubi/issues/848 ### 1. Describe the feature Dumpping stageInfo from mem into a file. Need to support local log file and remote file in hdfs. ### 2. Motivation ### 3. Describe the solution

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #850: Make threshold that trigger when to dump data into file configurable

2021-07-21 Thread GitBox
zhang1002 opened a new issue #850: URL: https://github.com/apache/incubator-kyuubi/issues/850 ### 1. Describe the feature Make threshold that trigger when to dump data into file configurable. There have two kinds of threshold: - time - the data's size in mem ### 2. Motivat

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #851: Thread safe consider: for statementInfo, jobInfo and stageInfo

2021-07-21 Thread GitBox
zhang1002 opened a new issue #851: URL: https://github.com/apache/incubator-kyuubi/issues/851 ### 1. Describe the feature StatementInfo, jobInfo and stageInfo will update in their running time. When you dump them by other thread, you need to consider thread safe. ### 2. Motivati

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #852: Kyuubi Spark Monitor: Getting metrics from statement and dumpping them into a file

2021-07-21 Thread GitBox
zhang1002 opened a new issue #852: URL: https://github.com/apache/incubator-kyuubi/issues/852 # Describe the proposal This module's major feature is event tracking and dumpping them into a file(local log file or remote file like hdfs). Now event granularity just have statement, jo

[GitHub] [incubator-kyuubi] ulysses-you opened a new issue #854: Add minikube for k8s integration test

2021-07-21 Thread GitBox
ulysses-you opened a new issue #854: URL: https://github.com/apache/incubator-kyuubi/issues/854 ### 1. Describe the feature Use `minikube` as k8s env to test Kyuubi. ### 2. Motivation Improve test coverage. ### 3. Describe the solution ### 4. Additional context

[GitHub] [incubator-kyuubi] ulysses-you opened a new issue #855: Add kubernetes pod label

2021-07-21 Thread GitBox
ulysses-you opened a new issue #855: URL: https://github.com/apache/incubator-kyuubi/issues/855 ### 1. Describe the feature Add some labels for Kyuubi Pod ### 2. Motivation Make it easy to maintain in k8s cluster ### 3. Describe the solution ### 4. Additional c

[GitHub] [incubator-kyuubi] yaooqinn closed issue #844: Use NodePort to expose kyuubi port on k8s

2021-07-22 Thread GitBox
yaooqinn closed issue #844: URL: https://github.com/apache/incubator-kyuubi/issues/844 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubsc

[GitHub] [incubator-kyuubi] hddong opened a new issue #859: Add kubernetes configmap

2021-07-22 Thread GitBox
hddong opened a new issue #859: URL: https://github.com/apache/incubator-kyuubi/issues/859 ### 1. Describe the feature Now, we need to rebuild docker image when config changed. Use `configmap` to save kyuubi config file, then we can change config by edit configmap and restart pod.

[GitHub] [incubator-kyuubi] yaooqinn commented on issue #859: Add kubernetes configmap

2021-07-22 Thread GitBox
yaooqinn commented on issue #859: URL: https://github.com/apache/incubator-kyuubi/issues/859#issuecomment-884973223 make sense -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [incubator-kyuubi] zhang1002 opened a new issue #860: Make queue's capacity that store the event tracking data in mem configurable

2021-07-22 Thread GitBox
zhang1002 opened a new issue #860: URL: https://github.com/apache/incubator-kyuubi/issues/860 ### 1. Describe the feature The queue that store the event tracking data: statement, jobInfo and stageInfo should make it configurable ### 2. Motivation ### 3. Describe the sol

[GitHub] [incubator-kyuubi] zhang1002 commented on issue #852: [Umbrella] Kyuubi Spark Monitor: Getting metrics from statement and dumpping them into a file

2021-07-23 Thread GitBox
zhang1002 commented on issue #852: URL: https://github.com/apache/incubator-kyuubi/issues/852#issuecomment-885459316 The feature: event tracking for stage, have finished. Now, develop #846, #860 and #850 -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [incubator-kyuubi] ulysses-you opened a new issue #863: Support test Spark engine using k8s master with minikube

2021-07-23 Thread GitBox
ulysses-you opened a new issue #863: URL: https://github.com/apache/incubator-kyuubi/issues/863 ### 1. Describe the feature Support use k8s master in Spark engine test. `spark.master=k8s://xxx` ### 2. Motivation Improve test coverage ### 3. Describe the solution

<    1   2   3   4   5   6   7   8   9   10   >