[Spark K8] Kube2Iam Annotation Support

config, spark.kubernetes.driver.annotation.[AnnotationName] Eg. spark.kubernetes.driver.annotation.*iam.amazonaws.com/role <http://iam.amazonaws.com/role> = * Does anyone have any thought, how can we use kube2iam with Spark on kubernetes? Regards, Chandu

Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service

Thank you for the clarification. On Tue, Mar 5, 2019 at 11:59 PM Gabor Somogyi wrote: > Hi, > > It will be automatically assigned when one creates a PR. > > BR, > G > > > On Tue, Mar 5, 2019 at 4:51 PM Chandu Kavar wrote: > >> My Jira username is: *cckavar

Re: [Kubernets] [SPARK-27061] Need to expose 4040 port on driver service

My Jira username is: *cckavar* On Tue, Mar 5, 2019 at 11:46 PM Chandu Kavar wrote: > Hi Team, > I have created a JIRA ticket to expose 4040 port on driver service. Also, > added the details in the ticket. > > I am aware of the changes that we need to make and want to assign th

[Kubernets] [SPARK-27061] Need to expose 4040 port on driver service

, Chandu

Re: Spark Standalone Mode, application runs, but executor is killed

/Reply from Marco posted in another thread/ Re: Best active groups, forums or contacts for Spark ? Posted by Marco Mistroni on Jan 26, 2018; 9:08am URL: http://apache-spark-user-list.1001560.n3.nabble.com/Best-active-groups-forums-or-contacts-for-Spark-tp30744p30748.html Hi From personal

Re: Best active groups, forums or contacts for Spark ?

@Thanks Marco. I have provided information in my original post ( http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Standalone-Mode-application-runs-but-executor-is-killed-tc30739.html

Re: Spark Standalone Mode, application runs, but executor is killed

@Marco Thank you. I thought Standalone and Standalone cluster are the same? The app is not a huge app. It's just PI calculation example. The value of PI is calculated passed to the driver successfully. When I issue the spark.stop from my driver, that is when I see the KILLED message on the worker

Re: Spark Standalone Mode, application runs, but executor is killed

/Reply from Marco in another post/ Re: Best active groups, forums or contacts for Spark ? Posted by Marco Mistroni on Jan 26, 2018; 9:08am URL: http://apache-spark-user-list.1001560.n3.nabble.com/Best-active-groups-forums-or-contacts-for-Spark-tp30744p30748.html Hi From personal

Re: Spark Standalone Mode, application runs, but executor is killed

/Reply from Marco posted in another thread/ Re: Best active groups, forums or contacts for Spark ? Posted by Marco Mistroni on Jan 26, 2018; 9:08am URL: http://apache-spark-user-list.1001560.n3.nabble.com/Best-active-groups-forums-or-contacts-for-Spark-tp30744p30748.html Hi From personal

Re: Best active groups, forums or contacts for Spark ?

@Esa Thanks for posting this as I was thinking the same way when trying to get some help about Spark (I am just a beginner) @Jack I posted a question @ here ( http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Standalone-Mode-application-runs-but-executor-is-killed-tc30739.html

Spark Standalone Mode, application runs, but executor is killed

e code and logs are available @ https://gist.github.com/Chandu/a83c13c045f1d1b480d8839e145b2749 <https://gist.github.com/Chandu/a83c13c045f1d1b480d8839e145b2749> (trying to keep the email content short) I wantd to understand that if my assumption of an Executor should have a state of