[jira] [Commented] (SPARK-33878) The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog

[ https://issues.apache.org/jira/browse/SPARK-33878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253312#comment-17253312 ] Apache Spark commented on SPARK-33878: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33878) The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog

[ https://issues.apache.org/jira/browse/SPARK-33878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33878: Assignee: Apache Spark > The test "SPARK-33305: DROP TABLE should also invalidate cache"

[jira] [Assigned] (SPARK-33878) The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog

[ https://issues.apache.org/jira/browse/SPARK-33878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33878: Assignee: (was: Apache Spark) > The test "SPARK-33305: DROP TABLE should also

[jira] [Created] (SPARK-33878) The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog

Maxim Gekk created SPARK-33878: -- Summary: The test "SPARK-33305: DROP TABLE should also invalidate cache" fails for v1 Hive catalog Key: SPARK-33878 URL: https://issues.apache.org/jira/browse/SPARK-33878

[jira] [Updated] (SPARK-33877) Documents a column list of INSERT in the SQL documents

[ https://issues.apache.org/jira/browse/SPARK-33877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33877: - Fix Version/s: (was: 3.1.0) > Documents a column list of INSERT in the SQL

[jira] [Created] (SPARK-33877) Documents a column list of INSERT in the SQL documents

Takeshi Yamamuro created SPARK-33877: Summary: Documents a column list of INSERT in the SQL documents Key: SPARK-33877 URL: https://issues.apache.org/jira/browse/SPARK-33877 Project: Spark

[jira] [Commented] (SPARK-33699) Spark web ui kill application but the thread still exists background

[ https://issues.apache.org/jira/browse/SPARK-33699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253305#comment-17253305 ] Xiaoming W commented on SPARK-33699: I found the 'kill' link on Web UI finally run

[jira] [Resolved] (SPARK-33860) Make CatalystTypeConverters.convertToCatalyst match special Array value

[ https://issues.apache.org/jira/browse/SPARK-33860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33860. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/30868 > Make

[jira] [Updated] (SPARK-33860) Make CatalystTypeConverters.convertToCatalyst match special Array value

[ https://issues.apache.org/jira/browse/SPARK-33860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33860: - Fix Version/s: 3.1.0 3.0.2 > Make CatalystTypeConverters.convertToCatalyst

[jira] [Commented] (SPARK-33398) AnalysisException when loading a PipelineModel with Spark 3

[ https://issues.apache.org/jira/browse/SPARK-33398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253293#comment-17253293 ] zhengruifeng commented on SPARK-33398: -- [~nmarcott]  I can reproduce this failure, and will look

[jira] [Commented] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

[ https://issues.apache.org/jira/browse/SPARK-33875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253291#comment-17253291 ] Maxim Gekk commented on SPARK-33875: [~imback82] Could you convert this to a sub-task of 

[jira] [Assigned] (SPARK-33876) Add length-check for reading char/varchar from tables w/ a external location

[ https://issues.apache.org/jira/browse/SPARK-33876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33876: Assignee: Apache Spark > Add length-check for reading char/varchar from tables w/ a

[jira] [Commented] (SPARK-33876) Add length-check for reading char/varchar from tables w/ a external location

[ https://issues.apache.org/jira/browse/SPARK-33876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253271#comment-17253271 ] Apache Spark commented on SPARK-33876: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33700) Try to push down filters for parquet and orc should add extra `filters.nonEmpty` condition

[ https://issues.apache.org/jira/browse/SPARK-33700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33700. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30663

[jira] [Assigned] (SPARK-33700) Try to push down filters for parquet and orc should add extra `filters.nonEmpty` condition

[ https://issues.apache.org/jira/browse/SPARK-33700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33700: - Assignee: Yang Jie > Try to push down filters for parquet and orc should add extra >

[jira] [Assigned] (SPARK-33876) Add length-check for reading char/varchar from tables w/ a external location

[ https://issues.apache.org/jira/browse/SPARK-33876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33876: Assignee: (was: Apache Spark) > Add length-check for reading char/varchar from

[jira] [Commented] (SPARK-33876) Add length-check for reading char/varchar from tables w/ a external location

[ https://issues.apache.org/jira/browse/SPARK-33876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253269#comment-17253269 ] Apache Spark commented on SPARK-33876: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

[ https://issues.apache.org/jira/browse/SPARK-33875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33875: Assignee: (was: Apache Spark) > Implement DESCRIBE COLUMN for v2 catalog >

[jira] [Commented] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

[ https://issues.apache.org/jira/browse/SPARK-33875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253244#comment-17253244 ] Apache Spark commented on SPARK-33875: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

[ https://issues.apache.org/jira/browse/SPARK-33875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33875: Assignee: Apache Spark > Implement DESCRIBE COLUMN for v2 catalog >

[jira] [Created] (SPARK-33876) Add length-check for reading char/varchar from tables w/ a external location

Kent Yao created SPARK-33876: Summary: Add length-check for reading char/varchar from tables w/ a external location Key: SPARK-33876 URL: https://issues.apache.org/jira/browse/SPARK-33876 Project: Spark

[jira] [Created] (SPARK-33875) Implement DESCRIBE COLUMN for v2 catalog

Terry Kim created SPARK-33875: - Summary: Implement DESCRIBE COLUMN for v2 catalog Key: SPARK-33875 URL: https://issues.apache.org/jira/browse/SPARK-33875 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

[ https://issues.apache.org/jira/browse/SPARK-33834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33834. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30833

[jira] [Assigned] (SPARK-33834) Verify ALTER TABLE CHANGE COLUMN with Char and Varchar

[ https://issues.apache.org/jira/browse/SPARK-33834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33834: --- Assignee: Kent Yao > Verify ALTER TABLE CHANGE COLUMN with Char and Varchar >

[jira] [Resolved] (SPARK-32106) Implement script transform in sql/core

[ https://issues.apache.org/jira/browse/SPARK-32106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32106. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolved

[jira] [Updated] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33873: -- Affects Version/s: (was: 3.2.0) 3.1.0 > Test all compression

[jira] [Assigned] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33873: - Assignee: Dongjoon Hyun > Test all compression codecs with encrypted spilling >

[jira] [Resolved] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33873. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30879

[jira] [Created] (SPARK-33874) Spark may report PodRunning if there is a sidecar that has not exited

Holden Karau created SPARK-33874: Summary: Spark may report PodRunning if there is a sidecar that has not exited Key: SPARK-33874 URL: https://issues.apache.org/jira/browse/SPARK-33874 Project: Spark

[jira] [Assigned] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33873: Assignee: (was: Apache Spark) > Test all compression codecs with encrypted spilling

[jira] [Commented] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253163#comment-17253163 ] Apache Spark commented on SPARK-33873: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33873: Assignee: Apache Spark > Test all compression codecs with encrypted spilling >

[jira] [Commented] (SPARK-33873) Test all compression codecs with encrypted spilling

[ https://issues.apache.org/jira/browse/SPARK-33873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253161#comment-17253161 ] Apache Spark commented on SPARK-33873: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33873) Test all compression codecs with encrypted spilling

Dongjoon Hyun created SPARK-33873: - Summary: Test all compression codecs with encrypted spilling Key: SPARK-33873 URL: https://issues.apache.org/jira/browse/SPARK-33873 Project: Spark Issue

[jira] [Commented] (SPARK-33872) Throw more specific exceptions when relations/namespaces are not found

[ https://issues.apache.org/jira/browse/SPARK-33872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253158#comment-17253158 ] Apache Spark commented on SPARK-33872: -- User 'imback82' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33872) Throw more specific exceptions when relations/namespaces are not found

[ https://issues.apache.org/jira/browse/SPARK-33872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33872: Assignee: Apache Spark > Throw more specific exceptions when relations/namespaces are

[jira] [Assigned] (SPARK-33872) Throw more specific exceptions when relations/namespaces are not found

[ https://issues.apache.org/jira/browse/SPARK-33872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33872: Assignee: (was: Apache Spark) > Throw more specific exceptions when

[jira] [Updated] (SPARK-33872) Throw more specific exceptions when relations/namespaces are not found

[ https://issues.apache.org/jira/browse/SPARK-33872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-33872: -- Description: Currently, when relations/namespaces are not found, a general `AnalysisException` is

[jira] [Created] (SPARK-33872) Throw more specific exceptions when relations/namespaces are not found

Terry Kim created SPARK-33872: - Summary: Throw more specific exceptions when relations/namespaces are not found Key: SPARK-33872 URL: https://issues.apache.org/jira/browse/SPARK-33872 Project: Spark

[jira] [Reopened] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas reopened SPARK-12890: -- Reopening because I think there is a valid potential improvement to be made here. If

[jira] [Updated] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-12890: - Labels: (was: bulk-closed) > Spark SQL query related to only partition fields should

[jira] [Updated] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-12890: - Priority: Minor (was: Major) > Spark SQL query related to only partition fields should

[jira] [Updated] (SPARK-33871) Cannot access to column after left semi join and left join

[ https://issues.apache.org/jira/browse/SPARK-33871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evgenii Samusenko updated SPARK-33871: -- Description: Cannot access to column after left semi join and left join val col =

[jira] [Created] (SPARK-33871) Cannot access to column after left semi join and left join

Evgenii Samusenko created SPARK-33871: - Summary: Cannot access to column after left semi join and left join Key: SPARK-33871 URL: https://issues.apache.org/jira/browse/SPARK-33871 Project: Spark

[jira] [Updated] (SPARK-33871) Cannot access to column after left semi join and left join

[ https://issues.apache.org/jira/browse/SPARK-33871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evgenii Samusenko updated SPARK-33871: -- Description: Cannot access to column after left semi join and left join > Cannot

[jira] [Resolved] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33869. --- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution:

[jira] [Assigned] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33869: - Assignee: Hyukjin Kwon > Have a separate metastore dir for each PySpark test process >

[jira] [Commented] (SPARK-12890) Spark SQL query related to only partition fields should not scan the whole data.

[ https://issues.apache.org/jira/browse/SPARK-12890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253044#comment-17253044 ] Nicholas Chammas commented on SPARK-12890: -- I think this is still an open issue. On Spark

[jira] [Assigned] (SPARK-33848) Push the cast into (if / case) branches

[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33848: - Assignee: Yuming Wang > Push the cast into (if / case) branches >

[jira] [Resolved] (SPARK-33848) Push the cast into (if / case) branches

[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33848. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30853

[jira] [Assigned] (SPARK-33870) Enable spark.storage.replication.proactive by default

[ https://issues.apache.org/jira/browse/SPARK-33870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33870: Assignee: (was: Apache Spark) > Enable spark.storage.replication.proactive by

[jira] [Commented] (SPARK-33870) Enable spark.storage.replication.proactive by default

[ https://issues.apache.org/jira/browse/SPARK-33870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253011#comment-17253011 ] Apache Spark commented on SPARK-33870: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-23862) Spark ExpressionEncoder should support java enum type in scala

[ https://issues.apache.org/jira/browse/SPARK-23862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253009#comment-17253009 ] Apache Spark commented on SPARK-23862: -- User 'xkrogen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33870) Enable spark.storage.replication.proactive by default

[ https://issues.apache.org/jira/browse/SPARK-33870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33870: Assignee: Apache Spark > Enable spark.storage.replication.proactive by default >

[jira] [Created] (SPARK-33870) Enable spark.storage.replication.proactive by default

Dongjoon Hyun created SPARK-33870: - Summary: Enable spark.storage.replication.proactive by default Key: SPARK-33870 URL: https://issues.apache.org/jira/browse/SPARK-33870 Project: Spark

[jira] [Commented] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252957#comment-17252957 ] Apache Spark commented on SPARK-33869: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252956#comment-17252956 ] Apache Spark commented on SPARK-33869: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33869: Assignee: (was: Apache Spark) > Have a separate metastore dir for each PySpark test

[jira] [Assigned] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33869: Assignee: Apache Spark > Have a separate metastore dir for each PySpark test process >

[jira] [Updated] (SPARK-33869) Have a separate metastore dir for each PySpark test process

[ https://issues.apache.org/jira/browse/SPARK-33869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33869: - Component/s: Tests > Have a separate metastore dir for each PySpark test process >

[jira] [Created] (SPARK-33869) Have a separate metastore dir for each PySpark test process

Hyukjin Kwon created SPARK-33869: Summary: Have a separate metastore dir for each PySpark test process Key: SPARK-33869 URL: https://issues.apache.org/jira/browse/SPARK-33869 Project: Spark

[jira] [Commented] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252948#comment-17252948 ] Apache Spark commented on SPARK-33836: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252950#comment-17252950 ] Apache Spark commented on SPARK-33836: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-28863) Add an AlreadyPlanned logical node that skips query planning

[ https://issues.apache.org/jira/browse/SPARK-28863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252938#comment-17252938 ] Apache Spark commented on SPARK-28863: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-33868) Normalize expressions passes to DS V2 from OverwriteByExpression

Anton Okolnychyi created SPARK-33868: Summary: Normalize expressions passes to DS V2 from OverwriteByExpression Key: SPARK-33868 URL: https://issues.apache.org/jira/browse/SPARK-33868 Project:

[jira] [Resolved] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33838. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30837

[jira] [Assigned] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33838: --- Assignee: Maxim Gekk > Add comments about `PURGE` in DropTable and in

[jira] [Updated] (SPARK-33838) Add comments about `PURGE` in DropTable and in AlterTableDropPartition

[ https://issues.apache.org/jira/browse/SPARK-33838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-33838: - Priority: Trivial (was: Major) > Add comments about `PURGE` in DropTable and in

[jira] [Comment Edited] (SPARK-33398) AnalysisException when loading a PipelineModel with Spark 3

[ https://issues.apache.org/jira/browse/SPARK-33398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252831#comment-17252831 ] Nicholas Brett Marcott edited comment on SPARK-33398 at 12/21/20, 12:56 PM:

[jira] [Created] (SPARK-33867) java.time.Instant and java.time.LocalDate not handled in org.apache.spark.sql.jdbc.JdbcDialect#compileValue

Cristi created SPARK-33867: -- Summary: java.time.Instant and java.time.LocalDate not handled in org.apache.spark.sql.jdbc.JdbcDialect#compileValue Key: SPARK-33867 URL: https://issues.apache.org/jira/browse/SPARK-33867

[jira] [Commented] (SPARK-33398) AnalysisException when loading a PipelineModel with Spark 3

[ https://issues.apache.org/jira/browse/SPARK-33398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252831#comment-17252831 ] Nicholas Brett Marcott commented on SPARK-33398: It appears rawCount is a new field

[jira] [Assigned] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

[ https://issues.apache.org/jira/browse/SPARK-33124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33124: - Assignee: Takeshi Yamamuro > Adds a group tag in all the expressions for built-in

[jira] [Resolved] (SPARK-33124) Adds a group tag in all the expressions for built-in functions

[ https://issues.apache.org/jira/browse/SPARK-33124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33124. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30867

[jira] [Assigned] (SPARK-33845) Improve SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33845: - Assignee: Yuming Wang > Improve SimplifyConditionals > -

[jira] [Resolved] (SPARK-33845) Improve SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33845. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30849

[jira] [Resolved] (SPARK-33862) Throw `PartitionAlreadyExistsException` if the target partition exists in Hive v1 Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-33862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33862. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30866

[jira] [Assigned] (SPARK-33862) Throw `PartitionAlreadyExistsException` if the target partition exists in Hive v1 Table Catalog

[ https://issues.apache.org/jira/browse/SPARK-33862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33862: - Assignee: Maxim Gekk > Throw `PartitionAlreadyExistsException` if the target partition

[jira] [Resolved] (SPARK-33853) EXPLAIN CODEGEN and BenchmarkQueryTest don't show subquery code

[ https://issues.apache.org/jira/browse/SPARK-33853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33853. --- Fix Version/s: 3.0.2 3.1.0 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-33593) Vector reader got incorrect data with binary partition value

[ https://issues.apache.org/jira/browse/SPARK-33593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33593: -- Fix Version/s: 2.4.8 > Vector reader got incorrect data with binary partition value >

[jira] [Commented] (SPARK-33594) Forbid binary type as partition column

[ https://issues.apache.org/jira/browse/SPARK-33594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252775#comment-17252775 ] Ala Luszczak commented on SPARK-33594: -- Big :+1: here. Having binary column as partition-by is a

[jira] [Assigned] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33836: Assignee: Jungtaek Lim > Expose DataStreamReader.table and DataStreamWriter.toTable to

[jira] [Resolved] (SPARK-33836) Expose DataStreamReader.table and DataStreamWriter.toTable to PySpark

[ https://issues.apache.org/jira/browse/SPARK-33836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33836. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30835

[jira] [Updated] (SPARK-33747) Avoid calling unregisterMapOutput when the map stage is being rerunning.

[ https://issues.apache.org/jira/browse/SPARK-33747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-33747: - Description: When a fetch failure happened, DAGScheduler will try to unregister the corresponding map

[jira] [Commented] (SPARK-28125) dataframes created by randomSplit have overlapping rows

[ https://issues.apache.org/jira/browse/SPARK-28125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252753#comment-17252753 ] Hyukjin Kwon commented on SPARK-28125: -- I removed the target version because it is usually reserved

[jira] [Resolved] (SPARK-33795) gapply fails execution with rbind error

[ https://issues.apache.org/jira/browse/SPARK-33795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33795. -- Resolution: Invalid > gapply fails execution with rbind error >

[jira] [Created] (SPARK-33866) Fix build error: Unused import CatalogV2Implicits

jiaan.geng created SPARK-33866: -- Summary: Fix build error: Unused import CatalogV2Implicits Key: SPARK-33866 URL: https://issues.apache.org/jira/browse/SPARK-33866 Project: Spark Issue Type:

[jira] [Commented] (SPARK-32048) PySpark: error in serializing ML pipelines with training strategy and pipeline as estimator

[ https://issues.apache.org/jira/browse/SPARK-32048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252726#comment-17252726 ] Nicholas Brett Marcott commented on SPARK-32048: I could not reproduce the stated

[jira] [Updated] (SPARK-32048) PySpark: error in serializing ML pipelines with training strategy and pipeline as estimator

[ https://issues.apache.org/jira/browse/SPARK-32048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Brett Marcott updated SPARK-32048: --- Description: Hi all, I get the following error when serializing a pipeline

[jira] [Commented] (SPARK-33541) Group exception messages in catalyst/expressions

[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252705#comment-17252705 ] jiaan.geng commented on SPARK-33541: I'm working on. > Group exception messages in

[jira] [Commented] (SPARK-33542) Group exception messages in catalyst/catalog

[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252704#comment-17252704 ] Apache Spark commented on SPARK-33542: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33542) Group exception messages in catalyst/catalog

[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33542: Assignee: Apache Spark > Group exception messages in catalyst/catalog >

[jira] [Assigned] (SPARK-33542) Group exception messages in catalyst/catalog

[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33542: Assignee: (was: Apache Spark) > Group exception messages in catalyst/catalog >

[jira] [Commented] (SPARK-33542) Group exception messages in catalyst/catalog

[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252703#comment-17252703 ] Apache Spark commented on SPARK-33542: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Description: All of LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE support IGNORE NULLS | RESPECT

[jira] [Assigned] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33849: --- Assignee: Maxim Gekk > Unify v1 and v2 DROP TABLE tests >

[jira] [Resolved] (SPARK-33849) Unify v1 and v2 DROP TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-33849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33849. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30854

[jira] [Comment Edited] (SPARK-28125) dataframes created by randomSplit have overlapping rows

[ https://issues.apache.org/jira/browse/SPARK-28125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252624#comment-17252624 ] Nicholas Brett Marcott edited comment on SPARK-28125 at 12/21/20, 8:11 AM: