[jira] [Created] (SPARK-30160) Extend ExecutorPodAllocator for arbitrary CRDs

2019-12-06 Thread Ilan Filonenko (Jira)
Ilan Filonenko created SPARK-30160: -- Summary: Extend ExecutorPodAllocator for arbitrary CRDs Key: SPARK-30160 URL: https://issues.apache.org/jira/browse/SPARK-30160 Project: Spark Issue Type

[jira] [Updated] (SPARK-30160) Extend ExecutorPodAllocator for arbitrary CRDs

2019-12-06 Thread Ilan Filonenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-30160: --- Priority: Minor (was: Major) > Extend ExecutorPodAllocator for arbitrary CRDs > ---

[jira] [Commented] (SPARK-30111) spark R dockerfile fails to build

2019-12-03 Thread Ilan Filonenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987372#comment-16987372 ] Ilan Filonenko commented on SPARK-30111: The error seems to be from: {code:yaml

[jira] [Updated] (SPARK-27812) kubernetes client import non-daemon thread which block jvm exit.

2019-10-11 Thread Ilan Filonenko (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-27812: --- Affects Version/s: 2.4.4 > kubernetes client import non-daemon thread which block jvm exit.

[jira] [Created] (SPARK-26238) Set SPARK_CONF_DIR to be ${SPARK_HOME}/conf for K8S

2018-11-30 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-26238: -- Summary: Set SPARK_CONF_DIR to be ${SPARK_HOME}/conf for K8S Key: SPARK-26238 URL: https://issues.apache.org/jira/browse/SPARK-26238 Project: Spark Issue

[jira] [Commented] (SPARK-25590) kubernetes-model-2.0.0.jar masks default Spark logging config

2018-10-29 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16667640#comment-16667640 ] Ilan Filonenko commented on SPARK-25590: Is this consistent with `kubernetes-mod

[jira] [Updated] (SPARK-25828) Bumping Version of kubernetes.client to latest version

2018-10-24 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25828: --- Description: Upgrade the Kubernetes client version to at least [4.0.0|https://mvnrepository

[jira] [Created] (SPARK-25828) Bumping Version of kubernetes.client to latest version

2018-10-24 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25828: -- Summary: Bumping Version of kubernetes.client to latest version Key: SPARK-25828 URL: https://issues.apache.org/jira/browse/SPARK-25828 Project: Spark Is

[jira] [Updated] (SPARK-25826) Kerberos Support in Kubernetes resource manager

2018-10-24 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25826: --- Description: This is the umbrella issue for all Kerberos related tasks with relation to Spar

[jira] [Created] (SPARK-25826) Kerberos Support in Kubernetes

2018-10-24 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25826: -- Summary: Kerberos Support in Kubernetes Key: SPARK-25826 URL: https://issues.apache.org/jira/browse/SPARK-25826 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-25825) Kerberos Support for Long Running Jobs in Kubernetes

2018-10-24 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25825: -- Summary: Kerberos Support for Long Running Jobs in Kubernetes Key: SPARK-25825 URL: https://issues.apache.org/jira/browse/SPARK-25825 Project: Spark Iss

[jira] [Created] (SPARK-25815) Kerberos Support in Kubernetes resource manager (Client Mode)

2018-10-23 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25815: -- Summary: Kerberos Support in Kubernetes resource manager (Client Mode) Key: SPARK-25815 URL: https://issues.apache.org/jira/browse/SPARK-25815 Project: Spark

[jira] [Updated] (SPARK-23257) Kerberos Support in Kubernetes resource manager (Cluster Mode)

2018-10-23 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-23257: --- Summary: Kerberos Support in Kubernetes resource manager (Cluster Mode) (was: Implement Ker

[jira] [Commented] (SPARK-25678) SPIP: Adding support in Spark for HPC cluster manager (PBS Professional)

2018-10-22 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16659756#comment-16659756 ] Ilan Filonenko commented on SPARK-25678: Would recommend to look at: https://jir

[jira] [Updated] (SPARK-25750) Integration Testing for Kerberos Support for Spark on Kubernetes

2018-10-16 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25750: --- Summary: Integration Testing for Kerberos Support for Spark on Kubernetes (was: Secure HDFS

[jira] [Created] (SPARK-25751) Unit Testing for Kerberos Support for Spark on Kubernetes

2018-10-16 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25751: -- Summary: Unit Testing for Kerberos Support for Spark on Kubernetes Key: SPARK-25751 URL: https://issues.apache.org/jira/browse/SPARK-25751 Project: Spark

[jira] [Created] (SPARK-25750) Secure HDFS Integration Testing

2018-10-16 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25750: -- Summary: Secure HDFS Integration Testing Key: SPARK-25750 URL: https://issues.apache.org/jira/browse/SPARK-25750 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

2018-10-08 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25681: -- Summary: Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation Key: SPARK-25681 URL: https://issues.apache.org/jira/browse/SPARK-25681 Pro

[jira] [Updated] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

2018-10-08 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25681: --- Labels: Hadoop Kerberos (was: ) > Delegation Tokens fetched twice upon HadoopFSDelegationTo

[jira] [Commented] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

2018-09-12 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612911#comment-16612911 ] Ilan Filonenko commented on SPARK-25291: [~skonto] the problem stems from the ex

[jira] [Created] (SPARK-25372) Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit

2018-09-07 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25372: -- Summary: Deprecate Yarn-specific configs in regards to keytab login for SparkSubmit Key: SPARK-25372 URL: https://issues.apache.org/jira/browse/SPARK-25372 Projec

[jira] [Created] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

2018-08-30 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25291: -- Summary: Flakiness of tests in terms of executor memory (SecretsTestSuite) Key: SPARK-25291 URL: https://issues.apache.org/jira/browse/SPARK-25291 Project: Spark

[jira] [Updated] (SPARK-25291) Flakiness of tests in terms of executor memory (SecretsTestSuite)

2018-08-30 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25291: --- Description: SecretsTestSuite shows flakiness in terms of correct setting of executor memor

[jira] [Updated] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner

2018-08-28 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-25264: --- Description: The arguments passed into the PythonRunner and RRunner are comma-delineated. 

[jira] [Created] (SPARK-25264) Fix comma-delineated arguments passed into PythonRunner and RRunner

2018-08-28 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-25264: -- Summary: Fix comma-delineated arguments passed into PythonRunner and RRunner Key: SPARK-25264 URL: https://issues.apache.org/jira/browse/SPARK-25264 Project: Spar

[jira] [Commented] (SPARK-24736) --py-files not functional for non local URLs. It appears to pass non-local URL's into PYTHONPATH directly.

2018-08-13 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16578882#comment-16578882 ] Ilan Filonenko commented on SPARK-24736: The URL, until a resource-staging-serve

[jira] [Closed] (SPARK-23984) PySpark Bindings for K8S

2018-07-19 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko closed SPARK-23984. -- > PySpark Bindings for K8S > > > Key: SPARK-23984 >

[jira] [Updated] (SPARK-23984) PySpark Bindings for K8S

2018-04-14 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-23984: --- Summary: PySpark Bindings for K8S (was: PySpark Bindings) > PySpark Bindings for K8S > -

[jira] [Updated] (SPARK-23984) PySpark Bindings

2018-04-14 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilan Filonenko updated SPARK-23984: --- Shepherd: (was: Holden Karau) > PySpark Bindings > > > Key

[jira] [Created] (SPARK-23984) PySpark Bindings

2018-04-14 Thread Ilan Filonenko (JIRA)
Ilan Filonenko created SPARK-23984: -- Summary: PySpark Bindings Key: SPARK-23984 URL: https://issues.apache.org/jira/browse/SPARK-23984 Project: Spark Issue Type: New Feature Compon

[jira] [Commented] (SPARK-23257) Implement Kerberos Support in Kubernetes resource manager

2018-01-31 Thread Ilan Filonenko (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16347303#comment-16347303 ] Ilan Filonenko commented on SPARK-23257: Hi [~RJKeevil], after the above PR is ha