[jira] [Commented] (SPARK-27030) DataFrameWriter.insertInto fails when writing in parallel to a hive table

2023-05-03 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17719158#comment-17719158 ] Shrikant Prasad commented on SPARK-27030: - [~lev] [~shivuson...@gmail.com] Did you find any

[jira] [Updated] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-42655: Description: val df1 =

[jira] [Updated] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-42655: Description: val df1 =

[jira] [Created] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Shrikant Prasad (Jira)
Shrikant Prasad created SPARK-42655: --- Summary: Incorrect ambiguous column reference error Key: SPARK-42655 URL: https://issues.apache.org/jira/browse/SPARK-42655 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42466) spark.kubernetes.file.upload.path not deleting files under HDFS after job completes

2023-02-23 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-42466: Affects Version/s: 3.3.2 > spark.kubernetes.file.upload.path not deleting files under

[jira] [Commented] (SPARK-42466) spark.kubernetes.file.upload.path not deleting files under HDFS after job completes

2023-02-17 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690381#comment-17690381 ] Shrikant Prasad commented on SPARK-42466: - working on the fix. >

[jira] [Updated] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-41719: Description: If ${ns}.enabled is false, there is no use of setting rest of ${ns}.*

[jira] [Updated] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2022-12-26 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-41719: Summary: Spark SSLOptions sub settings should be set only when ssl is enabled (was:

[jira] [Updated] (SPARK-41719) Spark SSL Options should be set only when ssl is enabled

2022-12-26 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-41719: Description: If ${ns}.enabled is false, there is no use of setting rest of ${ns}.*

[jira] [Created] (SPARK-41719) Spark SSL Options should be set only when ssl is enabled

2022-12-26 Thread Shrikant Prasad (Jira)
Shrikant Prasad created SPARK-41719: --- Summary: Spark SSL Options should be set only when ssl is enabled Key: SPARK-41719 URL: https://issues.apache.org/jira/browse/SPARK-41719 Project: Spark

[jira] [Commented] (SPARK-26365) spark-submit for k8s cluster doesn't propagate exit code

2022-09-08 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601827#comment-17601827 ] Shrikant Prasad commented on SPARK-26365: - Spark submit command exit code ($?) as 0 is okay as

[jira] [Commented] (SPARK-39399) proxy-user not working for Spark on k8s in cluster deploy mode

2022-08-18 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581495#comment-17581495 ] Shrikant Prasad commented on SPARK-39399: - [~dongjoon] [~hyukjin.kwon] Can you please have a

[jira] [Commented] (SPARK-39993) Spark on Kubernetes doesn't filter data by date

2022-08-18 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581492#comment-17581492 ] Shrikant Prasad commented on SPARK-39993: - [~h.liashchuk] The code snippet you have shared is