[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos edited comment on SPARK-23153 at 9/17/21, 6:25 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos edited comment on SPARK-23153 at 9/17/21, 6:23 PM:

[jira] [Comment Edited] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos edited comment on SPARK-23153 at 9/17/21, 6:21 PM:

[jira] [Commented] (SPARK-23153) Support application dependencies in submission client's local file system

2021-09-17 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416846#comment-17416846 ] Stavros Kontopoulos commented on SPARK-23153: - [~xuzhoyin] sorry for the late reply, the

[jira] [Commented] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-11 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17247759#comment-17247759 ] Stavros Kontopoulos commented on SPARK-33737: - In addition current implementation has been

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Updated] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-33737: Description: Kubernetes backend uses Fabric8 client and a

[jira] [Created] (SPARK-33737) Use an Informer+Lister API in the ExecutorPodWatcher

2020-12-10 Thread Stavros Kontopoulos (Jira)
Stavros Kontopoulos created SPARK-33737: --- Summary: Use an Informer+Lister API in the ExecutorPodWatcher Key: SPARK-33737 URL: https://issues.apache.org/jira/browse/SPARK-33737 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-27936) Support local dependency uploading from --py-files

2019-09-20 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-27936: Comment: was deleted (was: Will create a PR shortly.) > Support local dependency

[jira] [Commented] (SPARK-27936) Support local dependency uploading from --py-files

2019-09-20 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934227#comment-16934227 ] Stavros Kontopoulos commented on SPARK-27936: - Will create a PR shortly. > Support local

[jira] [Comment Edited] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-04 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922547#comment-16922547 ] Stavros Kontopoulos edited comment on SPARK-28953 at 9/4/19 3:43 PM: -

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-04 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922547#comment-16922547 ] Stavros Kontopoulos commented on SPARK-28953: - [~srowen] thanks I will have a look need to

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-04 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922292#comment-16922292 ] Stavros Kontopoulos commented on SPARK-28953: - [~shaneknapp] I can attach the build log but

[jira] [Comment Edited] (SPARK-28895) Spark client process is unable to upload jars to hdfs while using ConfigMap not HADOOP_CONF_DIR

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921394#comment-16921394 ] Stavros Kontopoulos edited comment on SPARK-28895 at 9/3/19 1:24 PM: -

[jira] [Commented] (SPARK-28896) Spark client process is unable to upload jars to hdfs while using ConfigMap not HADOOP_CONF_DIR

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921397#comment-16921397 ] Stavros Kontopoulos commented on SPARK-28896: - Changed to Spark 3.0.0. I will review the PR.

[jira] [Updated] (SPARK-28896) Spark client process is unable to upload jars to hdfs while using ConfigMap not HADOOP_CONF_DIR

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28896: Affects Version/s: (was: 2.4.3) 3.0.0 > Spark client

[jira] [Commented] (SPARK-28895) Spark client process is unable to upload jars to hdfs while using ConfigMap not HADOOP_CONF_DIR

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921394#comment-16921394 ] Stavros Kontopoulos commented on SPARK-28895: - I changed the version to Spark 3.0.0 as this

[jira] [Updated] (SPARK-28895) Spark client process is unable to upload jars to hdfs while using ConfigMap not HADOOP_CONF_DIR

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28895: Affects Version/s: (was: 2.4.3) 3.0.0 > Spark client

[jira] [Comment Edited] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921315#comment-16921315 ] Stavros Kontopoulos edited comment on SPARK-28921 at 9/3/19 10:25 AM:

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10, 1.12.10, 1.11.10)

2019-09-03 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921315#comment-16921315 ] Stavros Kontopoulos commented on SPARK-28921: - [~andygrove] could you please clarify what do

[jira] [Comment Edited] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921087#comment-16921087 ] Stavros Kontopoulos edited comment on SPARK-28953 at 9/3/19 12:04 AM:

[jira] [Comment Edited] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921087#comment-16921087 ] Stavros Kontopoulos edited comment on SPARK-28953 at 9/3/19 12:03 AM:

[jira] [Commented] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921087#comment-16921087 ] Stavros Kontopoulos commented on SPARK-28953: - [~shaneknapp] I can fix this since I am

[jira] [Created] (SPARK-28953) Integration tests fail due to malformed URL

2019-09-02 Thread Stavros Kontopoulos (Jira)
Stavros Kontopoulos created SPARK-28953: --- Summary: Integration tests fail due to malformed URL Key: SPARK-28953 URL: https://issues.apache.org/jira/browse/SPARK-28953 Project: Spark

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

2019-08-30 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919583#comment-16919583 ] Stavros Kontopoulos commented on SPARK-28025: - Thanks I will have a look :) >

[jira] [Comment Edited] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

2019-08-30 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919577#comment-16919577 ] Stavros Kontopoulos edited comment on SPARK-28025 at 8/30/19 2:15 PM:

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

2019-08-30 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919577#comment-16919577 ] Stavros Kontopoulos commented on SPARK-28025: - [~kabhwan] which PR? >

[jira] [Comment Edited] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

2019-08-30 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919471#comment-16919471 ] Stavros Kontopoulos edited comment on SPARK-28025 at 8/30/19 11:54 AM:

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

2019-08-30 Thread Stavros Kontopoulos (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919471#comment-16919471 ] Stavros Kontopoulos commented on SPARK-28025: - @[~dongjoon] [~zsxwing] this needs to be

[jira] [Comment Edited] (SPARK-27936) Support local dependency uploading from --py-files

2019-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900411#comment-16900411 ] Stavros Kontopoulos edited comment on SPARK-27936 at 8/5/19 9:06 PM: -

[jira] [Commented] (SPARK-27936) Support local dependency uploading from --py-files

2019-08-05 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900411#comment-16900411 ] Stavros Kontopoulos commented on SPARK-27936: - [~eje] I have started working on this, maybe

[jira] [Updated] (SPARK-28465) K8s integration tests fail due to missing ceph-nano image

2019-07-21 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28465: Summary: K8s integration tests fail due to missing ceph-nano image (was: K8s

[jira] [Updated] (SPARK-28465) K8s integration tests fail due to non existent image

2019-07-21 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28465: Description: Image added here: 

[jira] [Updated] (SPARK-28465) K8s integration tests fail due to non existent image

2019-07-21 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28465: Description: Image added here: 

[jira] [Created] (SPARK-28465) K8s integration tests fail due to non existent image

2019-07-21 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-28465: --- Summary: K8s integration tests fail due to non existent image Key: SPARK-28465 URL: https://issues.apache.org/jira/browse/SPARK-28465 Project: Spark

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888970#comment-16888970 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 3:26 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888970#comment-16888970 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 3:26 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888970#comment-16888970 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 3:25 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888970#comment-16888970 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 3:25 PM:

[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888970#comment-16888970 ] Stavros Kontopoulos commented on SPARK-28444: - Right now on master we have [4.1.2 

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 1:46 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 1:46 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 1:45 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 1:45 PM:

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 1:44 PM:

[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1671#comment-1671 ] Stavros Kontopoulos commented on SPARK-28444: - Am I not sure this is a k8s client version

[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1639#comment-1639 ] Stavros Kontopoulos commented on SPARK-28444: - Probably you are hitting this one: 

[jira] [Updated] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby with udf() is used

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28445: Summary: Inconsistency between Scala and Python/Panda udfs when groupby with

[jira] [Updated] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby udef() is used

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stavros Kontopoulos updated SPARK-28445: Component/s: PySpark > Inconsistency between Scala and Python/Panda udfs when

[jira] [Created] (SPARK-28445) Inconsistency between Scala and Python/Panda udfs when groupby udef() is used

2019-07-19 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created SPARK-28445: --- Summary: Inconsistency between Scala and Python/Panda udfs when groupby udef() is used Key: SPARK-28445 URL: https://issues.apache.org/jira/browse/SPARK-28445

[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1608#comment-1608 ] Stavros Kontopoulos commented on SPARK-28444: - Hi [~patrick-winter-swisscard]. On our ci we

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

2019-07-19 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1608#comment-1608 ] Stavros Kontopoulos edited comment on SPARK-28444 at 7/19/19 11:44 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:43 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:42 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:41 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:40 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:39 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:38 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:37 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 1:35 PM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-15 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885234#comment-16885234 ] Stavros Kontopoulos commented on SPARK-27927: - np. There will be a 2.4.4 release so there is

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:41 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:38 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:38 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:37 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:36 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/15/19 12:35 AM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884791#comment-16884791 ] Stavros Kontopoulos commented on SPARK-27927: - I was able to reproduce it reasily with

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/14/19 1:50 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/14/19 1:23 PM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos commented on SPARK-27927: - That call, among others, creates a

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-14 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884675#comment-16884675 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/14/19 1:21 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 2:24 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 2:20 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 2:13 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 1:56 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 1:53 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 1:52 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 1:51 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 1:46 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 1:43 PM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-13 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884374#comment-16884374 ] Stavros Kontopoulos commented on SPARK-27927: - Yes, needs debugging not sure if the commit

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884250#comment-16884250 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 12:37 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884250#comment-16884250 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 12:37 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884250#comment-16884250 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 12:36 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884250#comment-16884250 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 12:35 AM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884250#comment-16884250 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/13/19 12:34 AM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884250#comment-16884250 ] Stavros Kontopoulos commented on SPARK-27927: - It is on 2.4.0:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884121#comment-16884121 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/12/19 7:41 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884121#comment-16884121 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/12/19 7:40 PM:

[jira] [Comment Edited] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884121#comment-16884121 ] Stavros Kontopoulos edited comment on SPARK-27927 at 7/12/19 7:40 PM:

[jira] [Commented] (SPARK-27927) driver pod hangs with pyspark 2.4.3 and master on kubenetes

2019-07-12 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16884121#comment-16884121 ] Stavros Kontopoulos commented on SPARK-27927: - I think the issue is here: ```

  1   2   3   4   5   6   7   8   9   10   >