[jira] [Resolved] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34450. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31575 [https://gith

[jira] [Assigned] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34450: --- Assignee: Maxim Gekk > Unify v1 and v2 ALTER TABLE .. RENAME tests > --

[jira] [Resolved] (SPARK-34432) add a java implementation for the simple writable data source

[ https://issues.apache.org/jira/browse/SPARK-34432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34432. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31560 [https://gith

[jira] [Assigned] (SPARK-27500) Add tests for built-in Hive 2.3

[ https://issues.apache.org/jira/browse/SPARK-27500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-27500: --- Assignee: Yuming Wang > Add tests for built-in Hive 2.3 > --- >

[jira] [Resolved] (SPARK-27500) Add tests for built-in Hive 2.3

[ https://issues.apache.org/jira/browse/SPARK-27500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-27500. - Fix Version/s: 3.0.0 Resolution: Fixed > Add tests for built-in Hive 2.3 > --

[jira] [Commented] (SPARK-34488) Support task Metrics Distributions and executor Metrics Distributions in the REST API call for a specified stage

[ https://issues.apache.org/jira/browse/SPARK-34488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288312#comment-17288312 ] Apache Spark commented on SPARK-34488: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-34488) Support task Metrics Distributions and executor Metrics Distributions in the REST API call for a specified stage

[ https://issues.apache.org/jira/browse/SPARK-34488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34488: Assignee: Apache Spark > Support task Metrics Distributions and executor Metrics Distribu

[jira] [Assigned] (SPARK-34488) Support task Metrics Distributions and executor Metrics Distributions in the REST API call for a specified stage

[ https://issues.apache.org/jira/browse/SPARK-34488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34488: Assignee: (was: Apache Spark) > Support task Metrics Distributions and executor Metri

[jira] [Resolved] (SPARK-34473) avoid NPE in DataFrameReader.schema(StructType)

[ https://issues.apache.org/jira/browse/SPARK-34473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34473. - Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull re

[jira] [Assigned] (SPARK-34473) avoid NPE in DataFrameReader.schema(StructType)

[ https://issues.apache.org/jira/browse/SPARK-34473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34473: --- Assignee: Wenchen Fan > avoid NPE in DataFrameReader.schema(StructType) > -

[jira] [Resolved] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

[ https://issues.apache.org/jira/browse/SPARK-34496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34496. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31609 [https://gi

[jira] [Assigned] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

[ https://issues.apache.org/jira/browse/SPARK-34496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34496: Assignee: Dongjoon Hyun > Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility >

[jira] [Created] (SPARK-34497) JDBC connection provider is not removing kerberos credentials from JVM security context

Gabor Somogyi created SPARK-34497: - Summary: JDBC connection provider is not removing kerberos credentials from JVM security context Key: SPARK-34497 URL: https://issues.apache.org/jira/browse/SPARK-34497

[jira] [Created] (SPARK-34498) don't implement SessionConfigSupport in simple writable table data source

Kevin Pis created SPARK-34498: - Summary: don't implement SessionConfigSupport in simple writable table data source Key: SPARK-34498 URL: https://issues.apache.org/jira/browse/SPARK-34498 Project: Spark

[jira] [Updated] (SPARK-34498) fix the remaining problems in SPARK-34432

[ https://issues.apache.org/jira/browse/SPARK-34498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Pis updated SPARK-34498: -- Summary: fix the remaining problems in SPARK-34432 (was: don't implement SessionConfigSupport in simp

[jira] [Updated] (SPARK-34498) fix the remaining problems in SPARK-34432

[ https://issues.apache.org/jira/browse/SPARK-34498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Pis updated SPARK-34498: -- Description: the remaining problems : 1.  we don't need to implement SessionConfigSupport in simple w

[jira] [Commented] (SPARK-34498) fix the remaining problems in SPARK-34432

[ https://issues.apache.org/jira/browse/SPARK-34498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288386#comment-17288386 ] Kevin Pis commented on SPARK-34498: --- I will fix  the remaining problems. > fix the re

[jira] [Commented] (SPARK-34497) JDBC connection provider is not removing kerberos credentials from JVM security context

[ https://issues.apache.org/jira/browse/SPARK-34497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288387#comment-17288387 ] Gabor Somogyi commented on SPARK-34497: --- Working on this. > JDBC connection provi

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288388#comment-17288388 ] Simeon H.K. Fitch commented on SPARK-7768: -- [~srowen]Thanks so much for for all

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288423#comment-17288423 ] Sean R. Owen commented on SPARK-7768: - To be clear I just opened it. [~viirya] did mu

[jira] [Created] (SPARK-34499) improve the catalyst expression dsl internal APIs

Wenchen Fan created SPARK-34499: --- Summary: improve the catalyst expression dsl internal APIs Key: SPARK-34499 URL: https://issues.apache.org/jira/browse/SPARK-34499 Project: Spark Issue Type: I

[jira] [Commented] (SPARK-34476) Duplicate referenceNames are given for ambiguousReferences

[ https://issues.apache.org/jira/browse/SPARK-34476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288482#comment-17288482 ] Apache Spark commented on SPARK-34476: -- User 'tedyu' has created a pull request for

[jira] [Assigned] (SPARK-34476) Duplicate referenceNames are given for ambiguousReferences

[ https://issues.apache.org/jira/browse/SPARK-34476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34476: Assignee: Apache Spark > Duplicate referenceNames are given for ambiguousReferences > ---

[jira] [Assigned] (SPARK-34476) Duplicate referenceNames are given for ambiguousReferences

[ https://issues.apache.org/jira/browse/SPARK-34476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34476: Assignee: (was: Apache Spark) > Duplicate referenceNames are given for ambiguousRefer

[jira] [Assigned] (SPARK-34499) improve the catalyst expression dsl internal APIs

[ https://issues.apache.org/jira/browse/SPARK-34499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34499: Assignee: Apache Spark > improve the catalyst expression dsl internal APIs >

[jira] [Assigned] (SPARK-34499) improve the catalyst expression dsl internal APIs

[ https://issues.apache.org/jira/browse/SPARK-34499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34499: Assignee: (was: Apache Spark) > improve the catalyst expression dsl internal APIs > -

[jira] [Commented] (SPARK-34499) improve the catalyst expression dsl internal APIs

[ https://issues.apache.org/jira/browse/SPARK-34499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288483#comment-17288483 ] Apache Spark commented on SPARK-34499: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Affects Version/s: (was: 3.1.0) 3.2.0 > Support SQL INTERVAL types >

[jira] [Assigned] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27790: Assignee: Apache Spark > Support SQL INTERVAL types > -- > >

[jira] [Commented] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288526#comment-17288526 ] Apache Spark commented on SPARK-27790: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288527#comment-17288527 ] Apache Spark commented on SPARK-27790: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27790: Assignee: Apache Spark > Support SQL INTERVAL types > -- > >

[jira] [Assigned] (SPARK-27790) Support SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27790: Assignee: (was: Apache Spark) > Support SQL INTERVAL types >

[jira] [Commented] (SPARK-33600) Group exception messages in execution/datasources/v2

[ https://issues.apache.org/jira/browse/SPARK-33600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288584#comment-17288584 ] Karen Feng commented on SPARK-33600: I'm working on this. > Group exception message

[jira] [Commented] (SPARK-33602) Group exception messages in execution/datasources

[ https://issues.apache.org/jira/browse/SPARK-33602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288591#comment-17288591 ] Allison Wang commented on SPARK-33602: -- [~beliefer] Let's put AnalysisException in 

[jira] [Created] (SPARK-34500) Replace symbol literals with $"" in examples and documents

Kousuke Saruta created SPARK-34500: -- Summary: Replace symbol literals with $"" in examples and documents Key: SPARK-34500 URL: https://issues.apache.org/jira/browse/SPARK-34500 Project: Spark

[jira] [Assigned] (SPARK-34500) Replace symbol literals with $"" in examples and documents

[ https://issues.apache.org/jira/browse/SPARK-34500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34500: Assignee: Apache Spark (was: Kousuke Saruta) > Replace symbol literals with $"" in examp

[jira] [Commented] (SPARK-34500) Replace symbol literals with $"" in examples and documents

[ https://issues.apache.org/jira/browse/SPARK-34500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288616#comment-17288616 ] Apache Spark commented on SPARK-34500: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-34500) Replace symbol literals with $"" in examples and documents

[ https://issues.apache.org/jira/browse/SPARK-34500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288615#comment-17288615 ] Apache Spark commented on SPARK-34500: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34500) Replace symbol literals with $"" in examples and documents

[ https://issues.apache.org/jira/browse/SPARK-34500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34500: Assignee: Kousuke Saruta (was: Apache Spark) > Replace symbol literals with $"" in examp

[jira] [Commented] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288693#comment-17288693 ] Sungwon commented on SPARK-11844: - I'm seeing the same issue on spark-2.4 I'm able to r

[jira] [Resolved] (SPARK-34500) Replace symbol literals with $"" in examples and documents

[ https://issues.apache.org/jira/browse/SPARK-34500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34500. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31615 [https://gi

[jira] [Commented] (SPARK-33863) Pyspark UDF wrongly changes timestamps to UTC

[ https://issues.apache.org/jira/browse/SPARK-33863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288802#comment-17288802 ] Nasir Ali commented on SPARK-33863: --- [~hyukjin.kwon] and [~viirya] any update on this

[jira] [Resolved] (SPARK-34499) improve the catalyst expression dsl internal APIs

[ https://issues.apache.org/jira/browse/SPARK-34499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34499. - Resolution: Won't Fix > improve the catalyst expression dsl internal APIs >

[jira] [Updated] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34448: - Priority: Major (was: Critical) > Binary logistic regression incorrectly computes the intercept

[jira] [Commented] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288806#comment-17288806 ] Sean R. Owen commented on SPARK-34448: -- So one coarse response is - I'm surprised i

[jira] [Created] (SPARK-34501) Support of DELETE/UPDATE operation for Database (MySQL, Postgres etc.) level

Nishant Ranjan created SPARK-34501: -- Summary: Support of DELETE/UPDATE operation for Database (MySQL, Postgres etc.) level Key: SPARK-34501 URL: https://issues.apache.org/jira/browse/SPARK-34501 Proj

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288814#comment-17288814 ] Seth Tisue commented on SPARK-25075: Scala 2.13.5 is now available. > Build and tes

[jira] [Created] (SPARK-34502) Remove unused parameters in join methods

Huaxin Gao created SPARK-34502: -- Summary: Remove unused parameters in join methods Key: SPARK-34502 URL: https://issues.apache.org/jira/browse/SPARK-34502 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34502) Remove unused parameters in join methods

[ https://issues.apache.org/jira/browse/SPARK-34502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288844#comment-17288844 ] Apache Spark commented on SPARK-34502: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-34502) Remove unused parameters in join methods

[ https://issues.apache.org/jira/browse/SPARK-34502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34502: Assignee: (was: Apache Spark) > Remove unused parameters in join methods > --

[jira] [Assigned] (SPARK-34502) Remove unused parameters in join methods

[ https://issues.apache.org/jira/browse/SPARK-34502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34502: Assignee: Apache Spark > Remove unused parameters in join methods > -

[jira] [Commented] (SPARK-34502) Remove unused parameters in join methods

[ https://issues.apache.org/jira/browse/SPARK-34502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288845#comment-17288845 ] Apache Spark commented on SPARK-34502: -- User 'huaxingao' has created a pull request

[jira] [Created] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

Dongjoon Hyun created SPARK-34503: - Summary: Use zstd for spark.eventLog.compression.codec by default Key: SPARK-34503 URL: https://issues.apache.org/jira/browse/SPARK-34503 Project: Spark Is

[jira] [Updated] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-34503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34503: -- Labels: releasenotes (was: ) > Use zstd for spark.eventLog.compression.codec by default > ---

[jira] [Assigned] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-34503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34503: Assignee: Apache Spark > Use zstd for spark.eventLog.compression.codec by default > -

[jira] [Commented] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-34503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288850#comment-17288850 ] Apache Spark commented on SPARK-34503: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-34503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17288851#comment-17288851 ] Apache Spark commented on SPARK-34503: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-34503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34503: Assignee: (was: Apache Spark) > Use zstd for spark.eventLog.compression.codec by defa

[jira] [Created] (SPARK-34504) avoid unnecessary view resolving and remove the `performCheck` flag

Linhong Liu created SPARK-34504: --- Summary: avoid unnecessary view resolving and remove the `performCheck` flag Key: SPARK-34504 URL: https://issues.apache.org/jira/browse/SPARK-34504 Project: Spark

[jira] [Commented] (SPARK-33600) Group exception messages in execution/datasources/v2

[ https://issues.apache.org/jira/browse/SPARK-33600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1720#comment-1720 ] Apache Spark commented on SPARK-33600: -- User 'karenfeng' has created a pull request

[jira] [Assigned] (SPARK-33600) Group exception messages in execution/datasources/v2

[ https://issues.apache.org/jira/browse/SPARK-33600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33600: Assignee: Apache Spark > Group exception messages in execution/datasources/v2 > -

[jira] [Assigned] (SPARK-33600) Group exception messages in execution/datasources/v2

[ https://issues.apache.org/jira/browse/SPARK-33600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33600: Assignee: (was: Apache Spark) > Group exception messages in execution/datasources/v2