Re: Allow Spark on K8s to integrate w/ External Log Service

2022-11-02 Thread Cheng Pan
spark-dev > *Subject:* Allow Spark on K8s to integrate w/ External Log Service > > > EXTERNAL SENDER. Do not click links or open attachments unless you > recognize the sender and know the content is safe. DO NOT provide your > username or password. > > Hi Spark community

Re: Allow Spark on K8s to integrate w/ External Log Service

2022-11-02 Thread Martin Andersson
: Tuesday, November 1, 2022 17:03 To: spark-dev Subject: Allow Spark on K8s to integrate w/ External Log Service EXTERNAL SENDER. Do not click links or open attachments unless you recognize the sender and know the content is safe. DO NOT provide your username or password. Hi Spark community, I’m

Allow Spark on K8s to integrate w/ External Log Service

2022-11-01 Thread Cheng Pan
Hi Spark community, I’m recently working on migrating Spark workloads from Yarn to K8s, and one of the issue I found is that there is no out-of-box log solution for Spark applications on K8s as Yarn has, and Spark even does not provide a way to integrate w/ external log service. Based on the