Re: spark thrift server as hive on spark running on kubernetes, and more.

2021-12-14 Thread Frank Hwa
what's the difference between DataRoaster and Dask? https://scalingpythonml.com/2020/11/03/a-first-look-at-dask-on-arm-on-k8s.html Thanks. On 2021/12/15 8:42, Kidong Lee wrote: Recently I have written a spark operator to deploy spark applications onto Kubernetes using custom resources. See

Re: spark thrift server as hive on spark running on kubernetes, and more.

2021-12-14 Thread Kidong Lee
Hi all, Recently I have written a spark operator to deploy spark applications onto Kubernetes using custom resources. See DataRoaster spark operator for more details: https://github.com/cloudcheflabs/dataroaster/tree/master/operators/spark Spark thrift server can be more easier deployed on

Re: spark thrift server as hive on spark running on kubernetes, and more.

2021-09-10 Thread Mich Talebzadeh
Hi, Are you implying that the tool uses spark on Kubernetes as the execution engine for Hive. What version of Spark are you running on Kubernetes please and the corresponding version of Hive? Back in 2016, I did some work

RE: spark thrift server as hive on spark running on kubernetes, and more.

2021-09-10 Thread Bode, Meikel, NMA-CFD
Hi, thx. Great work. Will test it  Best, Meikel Bode From: Kidong Lee Sent: Freitag, 10. September 2021 01:39 To: user@spark.apache.org Subject: spark thrift server as hive on spark running on kubernetes, and more. Hi, Recently, I have open-sourced a tool called

spark thrift server as hive on spark running on kubernetes, and more.

2021-09-09 Thread Kidong Lee
Hi, Recently, I have open-sourced a tool called DataRoaster( https://github.com/cloudcheflabs/dataroaster) to provide data platforms running on kubernetes with ease. In particular, with DataRoaster, you can deploy spark thrift server on kubernetes easily, which is originated from my blog of