[jira] [Updated] (SPARK-33058) Fetch topic partitions once when getting offset ranges

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33058: Priority: Minor (was: Major) > Fetch topic partitions once when getting offset ranges > -

[jira] [Commented] (SPARK-33058) Fetch topic partitions once when getting offset ranges

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206623#comment-17206623 ] Apache Spark commented on SPARK-33058: -- User 'viirya' has created a pull request fo

[jira] [Commented] (SPARK-33058) Fetch topic partitions once when getting offset ranges

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206622#comment-17206622 ] Apache Spark commented on SPARK-33058: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-33058) Fetch topic partitions once when getting offset ranges

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33058: Assignee: L. C. Hsieh (was: Apache Spark) > Fetch topic partitions once when getting off

[jira] [Assigned] (SPARK-33058) Fetch topic partitions once when getting offset ranges

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33058: Assignee: Apache Spark (was: L. C. Hsieh) > Fetch topic partitions once when getting off

[jira] [Created] (SPARK-33058) Fetch topic partitions once when getting offset ranges

2020-10-02 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33058: --- Summary: Fetch topic partitions once when getting offset ranges Key: SPARK-33058 URL: https://issues.apache.org/jira/browse/SPARK-33058 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-33037: --- Assignee: BoYang > Remove knownManagers hardcoded list > --

[jira] [Updated] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33037: Fix Version/s: 3.1.0 > Remove knownManagers hardcoded list > --- >

[jira] [Commented] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206595#comment-17206595 ] L. C. Hsieh commented on SPARK-33037: - Resolved by https://github.com/apache/spark/p

[jira] [Resolved] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33037. - Resolution: Fixed > Remove knownManagers hardcoded list > --- >

[jira] [Assigned] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-33037: --- Assignee: (was: L. C. Hsieh) > Remove knownManagers hardcoded list > --

[jira] [Assigned] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-02 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-33037: --- Assignee: L. C. Hsieh > Remove knownManagers hardcoded list > -

[jira] [Updated] (SPARK-33057) Cannot use filter with window operations

2020-10-02 Thread Li Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-33057: --- Description: Current, trying to use filter with a window operations will fail:   {code:java} df = spark.ran

[jira] [Created] (SPARK-33057) Cannot use filter with window operations

2020-10-02 Thread Li Jin (Jira)
Li Jin created SPARK-33057: -- Summary: Cannot use filter with window operations Key: SPARK-33057 URL: https://issues.apache.org/jira/browse/SPARK-33057 Project: Spark Issue Type: Bug Compon

[jira] [Comment Edited] (SPARK-26043) Make SparkHadoopUtil private to Spark

2020-10-02 Thread Ryan Pifer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206418#comment-17206418 ] Ryan Pifer edited comment on SPARK-26043 at 10/2/20, 7:29 PM:

[jira] [Comment Edited] (SPARK-26043) Make SparkHadoopUtil private to Spark

2020-10-02 Thread Ryan Pifer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206418#comment-17206418 ] Ryan Pifer edited comment on SPARK-26043 at 10/2/20, 7:28 PM:

[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

2020-10-02 Thread Ryan Pifer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206418#comment-17206418 ] Ryan Pifer commented on SPARK-26043: Is there a new way to add credentials to UserGr

[jira] [Assigned] (SPARK-33055) Add support for CalendarIntervalType in PySpark schema

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33055: Assignee: (was: Apache Spark) > Add support for CalendarIntervalType in PySpark schem

[jira] [Commented] (SPARK-33055) Add support for CalendarIntervalType in PySpark schema

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206258#comment-17206258 ] Apache Spark commented on SPARK-33055: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-33055) Add support for CalendarIntervalType in PySpark schema

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33055: Assignee: Apache Spark > Add support for CalendarIntervalType in PySpark schema > ---

[jira] [Created] (SPARK-33056) Add mapping between external Python types and CalendarIntervalType

2020-10-02 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33056: -- Summary: Add mapping between external Python types and CalendarIntervalType Key: SPARK-33056 URL: https://issues.apache.org/jira/browse/SPARK-33056 Projec

[jira] [Created] (SPARK-33055) Add support for CalendarIntervalType in PySpark schema

2020-10-02 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33055: -- Summary: Add support for CalendarIntervalType in PySpark schema Key: SPARK-33055 URL: https://issues.apache.org/jira/browse/SPARK-33055 Project: Spark

[jira] [Created] (SPARK-33054) Support interval type in PySpark

2020-10-02 Thread Maciej Szymkiewicz (Jira)
Maciej Szymkiewicz created SPARK-33054: -- Summary: Support interval type in PySpark Key: SPARK-33054 URL: https://issues.apache.org/jira/browse/SPARK-33054 Project: Spark Issue Type: Impr

[jira] [Created] (SPARK-33053) Document driver states (difference between FAILED/ERROR/KILLED)

2020-10-02 Thread t oo (Jira)
t oo created SPARK-33053: Summary: Document driver states (difference between FAILED/ERROR/KILLED) Key: SPARK-33053 URL: https://issues.apache.org/jira/browse/SPARK-33053 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32047) Add provider disable possibility just like in delegation token provider

2020-10-02 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206208#comment-17206208 ] Gabor Somogyi commented on SPARK-32047: --- I'm intended to file a PR next week... >

[jira] [Commented] (SPARK-26533) Support query auto cancel on thriftserver

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206160#comment-17206160 ] Apache Spark commented on SPARK-26533: -- User 'maropu' has created a pull request fo

[jira] [Commented] (SPARK-26533) Support query auto cancel on thriftserver

2020-10-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206157#comment-17206157 ] Apache Spark commented on SPARK-26533: -- User 'maropu' has created a pull request fo

[jira] [Updated] (SPARK-33048) Fix SparkBuild.scala to recognize build settings for Scala 2.13

2020-10-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-33048: - Priority: Minor (was: Major) > Fix SparkBuild.scala to recognize build settings for Scala 2.13

[jira] [Commented] (SPARK-32067) [K8S] Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

2020-10-02 Thread Stijn De Haes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206082#comment-17206082 ] Stijn De Haes commented on SPARK-32067: --- Also ran into this today. This actually m

[jira] [Resolved] (SPARK-33030) Add nth_value in SparkR API

2020-10-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33030. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29905 [https://

[jira] [Assigned] (SPARK-33030) Add nth_value in SparkR API

2020-10-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33030: - Assignee: Maciej Szymkiewicz > Add nth_value in SparkR API > --

[jira] [Assigned] (SPARK-33050) Upgrade Apache ORC to 1.5.12

2020-10-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33050: - Assignee: Dongjoon Hyun > Upgrade Apache ORC to 1.5.12 > >

[jira] [Resolved] (SPARK-33050) Upgrade Apache ORC to 1.5.12

2020-10-02 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33050. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29930 [https://