[jira] [Comment Edited] (SPARK-25299) Use remote storage for persisting shuffle data

[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207093#comment-17207093 ] BoYang edited comment on SPARK-25299 at 10/4/20, 5:27 AM: -- Whil

[jira] [Comment Edited] (SPARK-25299) Use remote storage for persisting shuffle data

[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207093#comment-17207093 ] BoYang edited comment on SPARK-25299 at 10/4/20, 5:23 AM: -- Whil

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17207093#comment-17207093 ] BoYang commented on SPARK-25299: While people work on remote storage for persisting shuf

[jira] [Updated] (SPARK-31257) Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

[ https://issues.apache.org/jira/browse/SPARK-31257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-31257: Target Version/s: 3.1.0 > Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes >

[jira] [Updated] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32346: -- Fix Version/s: 3.1.0 > Support filters pushdown in Avro datasource > -

[jira] [Commented] (SPARK-32346) Support filters pushdown in Avro datasource

[ https://issues.apache.org/jira/browse/SPARK-32346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206894#comment-17206894 ] Dongjoon Hyun commented on SPARK-32346: --- I added the fix version, [~Gengliang.Wang

[jira] [Updated] (SPARK-12312) Support JDBC Kerberos w/ keytab

[ https://issues.apache.org/jira/browse/SPARK-12312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-12312: -- Summary: Support JDBC Kerberos w/ keytab (was: JDBC connection to Kerberos secured databases

[jira] [Updated] (SPARK-29250) Upgrade to Hadoop 3.2.1 Upgrade to Hadoop 3.2.1 and move to shaded client

[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29250: -- Summary: Upgrade to Hadoop 3.2.1 Upgrade to Hadoop 3.2.1 and move to shaded client (was: Upgr

[jira] [Updated] (SPARK-32058) Use Apache Hadoop 3.2.0 dependency by default

[ https://issues.apache.org/jira/browse/SPARK-32058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32058: -- Target Version/s: 3.1.0 > Use Apache Hadoop 3.2.0 dependency by default >

[jira] [Assigned] (SPARK-29250) Upgrade to Hadoop 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29250: - Assignee: Chao Sun > Upgrade to Hadoop 3.2.1 > --- > >

[jira] [Updated] (SPARK-32688) LiteralGenerator for float and double does not generate special values

[ https://issues.apache.org/jira/browse/SPARK-32688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32688: -- Fix Version/s: (was: 3.02) 3.0.2 > LiteralGenerator for float and doubl

[jira] [Updated] (SPARK-32981) Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution

[ https://issues.apache.org/jira/browse/SPARK-32981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32981: -- Target Version/s: 3.1.0 > Remove hive-1.2/hadoop-2.7 from Apache Spark 3.1 distribution >

[jira] [Assigned] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-20202: - Assignee: Dongjoon Hyun > Remove references to org.spark-project.hive > ---

[jira] [Updated] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20202: -- Affects Version/s: 3.1.0 > Remove references to org.spark-project.hive > -

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206870#comment-17206870 ] Apache Spark commented on SPARK-20202: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206869#comment-17206869 ] Apache Spark commented on SPARK-20202: -- User 'dongjoon-hyun' has created a pull req

[jira] [Resolved] (SPARK-33049) Decommission Core Integration Test is flaky.

[ https://issues.apache.org/jira/browse/SPARK-33049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33049. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29929 [https://

[jira] [Assigned] (SPARK-33049) Decommission Core Integration Test is flaky.

[ https://issues.apache.org/jira/browse/SPARK-33049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33049: - Assignee: Holden Karau > Decommission Core Integration Test is flaky. > ---

[jira] [Updated] (SPARK-32067) Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Summary: Executor pod template ConfigMap of ongoing submission got inadvertently altered by su

[jira] [Updated] (SPARK-32067) Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-32067: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > Executor pod template ConfigMap

[jira] [Comment Edited] (SPARK-26043) Make SparkHadoopUtil private to Spark

[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206418#comment-17206418 ] Ryan Pifer edited comment on SPARK-26043 at 10/3/20, 10:03 PM: ---

[jira] [Resolved] (SPARK-32958) Column pruning for JsonToStructs

[ https://issues.apache.org/jira/browse/SPARK-32958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32958. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29900 [https://

[jira] [Resolved] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33043. -- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33043: Assignee: Sean R. Owen > RowMatrix is incompatible with spark.driver.maxResultSize=0 > --

[jira] [Commented] (SPARK-32949) Add timestamp_seconds to SparkR

[ https://issues.apache.org/jira/browse/SPARK-32949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206830#comment-17206830 ] Apache Spark commented on SPARK-32949: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-33062) Make DataFrameReader.jdbc work for DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-33062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33062: Assignee: (was: Apache Spark) > Make DataFrameReader.jdbc work for DataSource V2 > -

[jira] [Assigned] (SPARK-33062) Make DataFrameReader.jdbc work for DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-33062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33062: Assignee: Apache Spark > Make DataFrameReader.jdbc work for DataSource V2 >

[jira] [Commented] (SPARK-33062) Make DataFrameReader.jdbc work for DataSource V2

[ https://issues.apache.org/jira/browse/SPARK-33062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206819#comment-17206819 ] Apache Spark commented on SPARK-33062: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-33062) Make DataFrameReader.jdbc work for DataSource V2

Huaxin Gao created SPARK-33062: -- Summary: Make DataFrameReader.jdbc work for DataSource V2 Key: SPARK-33062 URL: https://issues.apache.org/jira/browse/SPARK-33062 Project: Spark Issue Type: Sub

[jira] [Resolved] (SPARK-33058) Fetch topic partitions once when getting offset ranges

[ https://issues.apache.org/jira/browse/SPARK-33058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33058. - Resolution: Duplicate > Fetch topic partitions once when getting offset ranges > ---

[jira] [Assigned] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33061: Assignee: (was: Apache Spark) > Expose inverse hyperbolic functions through sql.funct

[jira] [Commented] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206785#comment-17206785 ] Apache Spark commented on SPARK-33061: -- User 'rwpenney' has created a pull request

[jira] [Assigned] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33061: Assignee: Apache Spark > Expose inverse hyperbolic functions through sql.functions API >

[jira] [Updated] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

[ https://issues.apache.org/jira/browse/SPARK-33061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Penney updated SPARK-33061: --- Description: Recent changes elsewhere have added inverse hyperbolic functions acosh, asinh,

[jira] [Created] (SPARK-33061) Expose inverse hyperbolic functions through sql.functions API

Richard Penney created SPARK-33061: -- Summary: Expose inverse hyperbolic functions through sql.functions API Key: SPARK-33061 URL: https://issues.apache.org/jira/browse/SPARK-33061 Project: Spark

[jira] [Updated] (SPARK-33060) approxSimilarityJoin in Structured Stream causes state to explode in size

[ https://issues.apache.org/jira/browse/SPARK-33060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bram van den Akker updated SPARK-33060: --- Attachment: Screenshot 2020-10-01 at 16.03.26.png > approxSimilarityJoin in Structur

[jira] [Commented] (SPARK-33060) approxSimilarityJoin in Structured Stream causes state to explode in size

[ https://issues.apache.org/jira/browse/SPARK-33060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206693#comment-17206693 ] Bram van den Akker commented on SPARK-33060: !Screenshot 2020-10-01 at 16.03

[jira] [Created] (SPARK-33060) approxSimilarityJoin in Structured Stream causes state to explode in size

Bram van den Akker created SPARK-33060: -- Summary: approxSimilarityJoin in Structured Stream causes state to explode in size Key: SPARK-33060 URL: https://issues.apache.org/jira/browse/SPARK-33060

[jira] [Created] (SPARK-33059) Bug with self joined tables after posexploded column

Struchkov Lookuut Fedorovich created SPARK-33059: Summary: Bug with self joined tables after posexploded column Key: SPARK-33059 URL: https://issues.apache.org/jira/browse/SPARK-33059 P

[jira] [Commented] (SPARK-32067) [K8S] Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206641#comment-17206641 ] Apache Spark commented on SPARK-32067: -- User 'stijndehaes' has created a pull reque

[jira] [Commented] (SPARK-32067) [K8S] Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17206640#comment-17206640 ] Apache Spark commented on SPARK-32067: -- User 'stijndehaes' has created a pull reque

[jira] [Assigned] (SPARK-32067) [K8S] Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32067: Assignee: (was: Apache Spark) > [K8S] Executor pod template ConfigMap of ongoing subm

[jira] [Assigned] (SPARK-32067) [K8S] Executor pod template ConfigMap of ongoing submission got inadvertently altered by subsequent submission

[ https://issues.apache.org/jira/browse/SPARK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32067: Assignee: Apache Spark > [K8S] Executor pod template ConfigMap of ongoing submission got