Java 11 support in Spark 2.5

2020-01-01 Thread Sinha, Breeta (Nokia - IN/Bangalore)
Hi All, Wanted to know if Java 11 support is added in Spark 2.5. If so, what is the expected timeline for Spark 2.5 release? Kind Regards, Breeta Sinha

RE: RPC timeout error for AES based encryption between driver and executor

2019-03-27 Thread Sinha, Breeta (Nokia - IN/Bangalore)
hen we set, spark.network.crypto.enabled true to enable AES based encryption, we see RPC timeout error message sporadically. Kind Regards, Breeta -Original Message- From: Marcelo Vanzin Sent: Tuesday, March 26, 2019 9:10 PM To: Sinha, Breeta (Nokia - IN/Bangalore) Cc: user@spark.apache.o

RPC timeout error for AES based encryption between driver and executor

2019-03-26 Thread Sinha, Breeta (Nokia - IN/Bangalore)
Hi All, We are trying to enable RPC encryption between driver and executor. Currently we're working on Spark 2.4 on Kubernetes. According to Apache Spark Security document (https://spark.apache.org/docs/latest/security.html) and our understanding on the same, it is clear that Spark supports

RE: Got fatal error when running spark 2.4.0 on k8s

2019-02-13 Thread Sinha, Breeta (Nokia - IN/Bangalore)
Hi Dawn, Probably, you are providing the incorrect image(must be a java image) or the incorrect master ip or the service account. Please verify the pod’s permissions for the service account(‘spark’ in your case). I have tried executing the same program as below: ./spark-submit --master

Local Storage Encryption - Spark ioEncryption

2019-01-22 Thread Sinha, Breeta (Nokia - IN/Bangalore)
Hi All, We are trying to enable encryption between spark-shuffle and local FileSystem. We wanted to clarify our understanding on this. Currently we're working on Spark 2.4 According to our understanding of Spark supporting Local Storage Encryption, that is, "Enabling local disk I/O