Re: Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-03 Thread Nagatomi Yasukazu
; Have a nice day :) > Cley > > Nagatomi Yasukazu escreveu no dia sábado, > 2/09/2023 à(s) 15:37: > >> Hello Apache Spark community, >> >> I'm currently trying to run Spark Connect Server on Kubernetes in Cluster >> Mode and facing some challenges. Any guidance or hint

Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-02 Thread Nagatomi Yasukazu
Hello Apache Spark community, I'm currently trying to run Spark Connect Server on Kubernetes in Cluster Mode and facing some challenges. Any guidance or hints would be greatly appreciated. ## Environment: Apache Spark version: 3.4.1 Kubernetes version: 1.23 Command executed:

Re: Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-05 Thread Nagatomi Yasukazu
s, updates, or references to similar conversations or initiatives would be greatly appreciated. Thank you for your time and expertise! Best regards, Yasukazu 2023年9月5日(火) 12:09 Nagatomi Yasukazu : > Hello Mich, > Thank you for your questions. Here are my responses: > > > 1. What in

Re: Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-04 Thread Nagatomi Yasukazu
on of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 4 Sept 2023 at 04:57, Nagat

Re: Spark 3.4.1 and Hive 3.1.3

2023-09-07 Thread Nagatomi Yasukazu
Hi Sanket, While migrating to Hive 3.1.3 may resolve many issues, the link below suggests that there might still be some vulnerabilities present. Do you think the specific vulnerability you're concerned about can be addressed with Hive 3.1.3?

[Spark Connect]Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-02 Thread Nagatomi Yasukazu
Hello Apache Spark community, I'm currently trying to run Spark Connect Server on Kubernetes in Cluster Mode and facing some challenges. Any guidance or hints would be greatly appreciated. ## Environment: Apache Spark version: 3.4.1 Kubernetes version: 1.23 Command executed:

Re: Re: Running Spark Connect Server in Cluster Mode on Kubernetes

2023-10-29 Thread Nagatomi Yasukazu
t; eabour > > > *From:* eab...@163.com > *Date:* 2023-10-19 14:28 > *To:* Nagatomi Yasukazu ; user @spark > > *Subject:* Re: Re: Running Spark Connect Server in Cluster Mode on > Kubernetes > Hi all, > > Has the spark connect server running on k8s functionality been imple

Query Regarding UDF Support in Spark Connect with Kubernetes as Cluster Manager

2024-05-15 Thread Nagatomi Yasukazu
Hi Spark Community, I have a question regarding the support for User-Defined Functions (UDFs) in Spark Connect, specifically when using Kubernetes as the Cluster Manager. According to the Spark documentation, UDFs are supported by default for the shell and in standalone applications with