[jira] [Assigned] (SPARK-38392) [K8S] Improve the names used for K8S namespace and driver pod in integration tests

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38392: Assignee: Apache Spark > [K8S] Improve the names used for K8S namespace and driver pod

[jira] [Commented] (SPARK-38392) [K8S] Improve the names used for K8S namespace and driver pod in integration tests

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500158#comment-17500158 ] Apache Spark commented on SPARK-38392: -- User 'martin-g' has created a pull request for this issue:

[jira] [Created] (SPARK-38392) [K8S] Improve the names used for K8S namespace and driver pod in integration tests

2022-03-02 Thread Martin Tzvetanov Grigorov (Jira)
Martin Tzvetanov Grigorov created SPARK-38392: - Summary: [K8S] Improve the names used for K8S namespace and driver pod in integration tests Key: SPARK-38392 URL:

[jira] [Comment Edited] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

2022-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500130#comment-17500130 ] Bjørn Jørgensen edited comment on SPARK-38340 at 3/2/22, 1:01 PM: -- ok,

[jira] [Commented] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1

2022-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500130#comment-17500130 ] Bjørn Jørgensen commented on SPARK-38340: - ok, well all the test in github now are OK. "But It

[jira] [Commented] (SPARK-38391) Datasource v2 supports complete partial sort pushdown

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500104#comment-17500104 ] Apache Spark commented on SPARK-38391: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38391) Datasource v2 supports complete partial sort pushdown

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38391: Assignee: Apache Spark > Datasource v2 supports complete partial sort pushdown >

[jira] [Assigned] (SPARK-38391) Datasource v2 supports complete partial sort pushdown

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38391: Assignee: (was: Apache Spark) > Datasource v2 supports complete partial sort

[jira] [Created] (SPARK-38391) Datasource v2 supports complete partial sort pushdown

2022-03-02 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-38391: -- Summary: Datasource v2 supports complete partial sort pushdown Key: SPARK-38391 URL: https://issues.apache.org/jira/browse/SPARK-38391 Project: Spark Issue

[jira] [Commented] (SPARK-38390) Spark submit k8s with proxy user

2022-03-02 Thread MIKHAIL POCHATKIN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17500076#comment-17500076 ] MIKHAIL POCHATKIN commented on SPARK-38390: --- Correct command line {code:java} /usr/bin/kinit

[jira] [Created] (SPARK-38390) Spark submit k8s with proxy user

2022-03-02 Thread Mikhail Pochatkin (Jira)
Mikhail Pochatkin created SPARK-38390: - Summary: Spark submit k8s with proxy user Key: SPARK-38390 URL: https://issues.apache.org/jira/browse/SPARK-38390 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38389: Assignee: Max Gekk (was: Apache Spark) > Add the `DATEDIFF` and `DATE_DIFF` aliases for

[jira] [Assigned] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38389: Assignee: Apache Spark (was: Max Gekk) > Add the `DATEDIFF` and `DATE_DIFF` aliases for

[jira] [Commented] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

2022-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1755#comment-1755 ] Apache Spark commented on SPARK-38389: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

2022-03-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38389: - Description: Introduce the datediff()/date_diff() function, which takes three arguments: unit, and two

[jira] [Created] (SPARK-38389) Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()`

2022-03-02 Thread Max Gekk (Jira)
Max Gekk created SPARK-38389: Summary: Add the `DATEDIFF` and `DATE_DIFF` aliases for `TIMESTAMPDIFF()` Key: SPARK-38389 URL: https://issues.apache.org/jira/browse/SPARK-38389 Project: Spark

[jira] [Commented] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-02 Thread Jason Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499979#comment-17499979 ] Jason Xu commented on SPARK-38388: -- I think one potential solution is do not allow partial retry of the

[jira] [Updated] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-02 Thread Jason Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Xu updated SPARK-38388: - Description: Spark repartition uses RoundRobinPartitioning, the generated results is non-deterministic

[jira] [Created] (SPARK-38388) Repartition + Stage retries could lead to incorrect data

2022-03-02 Thread Jason Xu (Jira)
Jason Xu created SPARK-38388: Summary: Repartition + Stage retries could lead to incorrect data Key: SPARK-38388 URL: https://issues.apache.org/jira/browse/SPARK-38388 Project: Spark Issue

<    1   2