[jira] [Commented] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255855#comment-17255855 ] Apache Spark commented on SPARK-33847: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255854#comment-17255854 ] Apache Spark commented on SPARK-33847: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33928: --- Assignee: wuyi > Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update

[jira] [Resolved] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33928. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30956

[jira] [Assigned] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33884: --- Assignee: Yuming Wang > Simplify CaseWhenclauses with (true and false) and (false and

[jira] [Resolved] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33884. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30898

[jira] [Resolved] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33924. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30952

[jira] [Updated] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33931: -- Priority: Blocker (was: Major) > Recover GitHub Action > - > >

[jira] [Updated] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33931: -- Target Version/s: 3.1.0, 3.2.0 > Recover GitHub Action > - > >

[jira] [Issue Comment Deleted] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33931: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33931: Assignee: (was: Apache Spark) > Recover GitHub Action > - > >

[jira] [Commented] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255825#comment-17255825 ] Apache Spark commented on SPARK-33931: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33931: Assignee: Apache Spark > Recover GitHub Action > - > >

[jira] [Commented] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255824#comment-17255824 ] Apache Spark commented on SPARK-33931: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33931) Recover GitHub Action

Dongjoon Hyun created SPARK-33931: - Summary: Recover GitHub Action Key: SPARK-33931 URL: https://issues.apache.org/jira/browse/SPARK-33931 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255819#comment-17255819 ] Apache Spark commented on SPARK-33930: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33930: Assignee: (was: Apache Spark) > Spark SQL no serde row format field delimit default

[jira] [Assigned] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33930: Assignee: Apache Spark > Spark SQL no serde row format field delimit default is '\u0001'

[jira] [Commented] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255818#comment-17255818 ] Apache Spark commented on SPARK-33930: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255815#comment-17255815 ] Apache Spark commented on SPARK-31937: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31937: Assignee: (was: Apache Spark) > Support processing array/map/struct type using spark

[jira] [Commented] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255814#comment-17255814 ] Apache Spark commented on SPARK-31937: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31937: Assignee: Apache Spark > Support processing array/map/struct type using spark noserde

[jira] [Updated] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31937: -- Summary: Support processing array/map/struct type using spark noserde mode (was: Support processing

[jira] [Commented] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255813#comment-17255813 ] angerszhu commented on SPARK-33930: --- raise a pr soon > Spark SQL no serde row format field delimit

[jira] [Updated] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33930: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Improvement) > Spark SQL no serde row format

[jira] [Created] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

angerszhu created SPARK-33930: - Summary: Spark SQL no serde row format field delimit default is '\u0001' Key: SPARK-33930 URL: https://issues.apache.org/jira/browse/SPARK-33930 Project: Spark

[jira] [Created] (SPARK-33929) Spark-submit with --package deequ doesn't pull all jars

Dustin Smith created SPARK-33929: Summary: Spark-submit with --package deequ doesn't pull all jars Key: SPARK-33929 URL: https://issues.apache.org/jira/browse/SPARK-33929 Project: Spark

[jira] [Updated] (SPARK-33929) Spark-submit with --package deequ doesn't pull all jars

[ https://issues.apache.org/jira/browse/SPARK-33929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Smith updated SPARK-33929: - Description: This issue was marked as solved SPARK-24074; however, another [~hyukjin.kwon]

[jira] [Assigned] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33928: Assignee: Apache Spark > Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't

[jira] [Commented] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255798#comment-17255798 ] Apache Spark commented on SPARK-33928: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33928: Assignee: (was: Apache Spark) > Flaky o.a.s.ExecutorAllocationManagerSuite -

[jira] [Commented] (SPARK-23365) DynamicAllocation with failure in straggler task can lead to a hung spark job

[ https://issues.apache.org/jira/browse/SPARK-23365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255799#comment-17255799 ] Apache Spark commented on SPARK-23365: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

wuyi created SPARK-33928: Summary: Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors" Key: SPARK-33928 URL:

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Commented] (SPARK-33848) Push the UnaryExpression into (if / case) branches

[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255790#comment-17255790 ] Apache Spark commented on SPARK-33848: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-33927) Fix Spark Release image

[ https://issues.apache.org/jira/browse/SPARK-33927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255777#comment-17255777 ] Dongjoon Hyun commented on SPARK-33927: --- cc [~hyukjin.kwon] > Fix Spark Release image >

[jira] [Created] (SPARK-33927) Fix Spark Release image

Dongjoon Hyun created SPARK-33927: - Summary: Fix Spark Release image Key: SPARK-33927 URL: https://issues.apache.org/jira/browse/SPARK-33927 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33925. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30945

[jira] [Assigned] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33925: - Assignee: Hyukjin Kwon > Remove unused SecurityManager in Utils.fetchFile >

[jira] [Assigned] (SPARK-33916) Fix fallback storage offset and improve compression codec test coverage

[ https://issues.apache.org/jira/browse/SPARK-33916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33916: - Assignee: Dongjoon Hyun > Fix fallback storage offset and improve compression codec

[jira] [Resolved] (SPARK-33916) Fix fallback storage offset and improve compression codec test coverage

[ https://issues.apache.org/jira/browse/SPARK-33916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33916. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30934

[jira] [Resolved] (SPARK-33871) Cannot access to column after left semi join and left join

[ https://issues.apache.org/jira/browse/SPARK-33871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33871. - Resolution: Not A Problem > Cannot access to column after left semi join and left join >

[jira] [Resolved] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33883. - Resolution: Invalid > Can repeat "where" twice without error in spark sql >

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255712#comment-17255712 ] Bryan Cutler commented on SPARK-24632: -- Ping [~huaxingao] in case you have some time to look into

[jira] [Assigned] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33029: Assignee: Apache Spark > Standalone mode blacklist executors page UI marks driver as

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255703#comment-17255703 ] Apache Spark commented on SPARK-33029: -- User 'baohe-zhang' has created a pull request for this

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255702#comment-17255702 ] Apache Spark commented on SPARK-33029: -- User 'baohe-zhang' has created a pull request for this

[jira] [Assigned] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33029: Assignee: (was: Apache Spark) > Standalone mode blacklist executors page UI marks

[jira] [Commented] (SPARK-33845) Improve SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255688#comment-17255688 ] Apache Spark commented on SPARK-33845: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33899: Fix Version/s: (was: 3.2.0) 3.1.0 > v1 SHOW TABLES fails with assert on

[jira] [Commented] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255685#comment-17255685 ] Baohe Zhang commented on SPARK-33031: - New tasks won't be scheduled because the node is marked as

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255682#comment-17255682 ] Baohe Zhang commented on SPARK-33029: - With the blacklist feature enabled, by default, a node will

[jira] [Commented] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255681#comment-17255681 ] L. C. Hsieh commented on SPARK-33920: - Could you elaborate more on the data and datatype you want

[jira] [Commented] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255631#comment-17255631 ] Ted Yu commented on SPARK-33915: [~codingcat] [~XuanYuan][~viirya][~Alex Herman] Can you provide your

[jira] [Commented] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255617#comment-17255617 ] Apache Spark commented on SPARK-33924: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33924: Assignee: Apache Spark > v2 INSERT INTO .. PARTITION drops the partition location >

[jira] [Assigned] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33924: Assignee: (was: Apache Spark) > v2 INSERT INTO .. PARTITION drops the partition

[jira] [Assigned] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33924: Assignee: Apache Spark > v2 INSERT INTO .. PARTITION drops the partition location >

[jira] [Commented] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255603#comment-17255603 ] Stu commented on SPARK-33883: - that makes so much sense, thanks! > Can repeat "where" twice without error

[jira] [Commented] (SPARK-33775) Suppress unimportant compilation warnings in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255581#comment-17255581 ] Apache Spark commented on SPARK-33775: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-33775) Suppress unimportant compilation warnings in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255580#comment-17255580 ] Apache Spark commented on SPARK-33775: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255567#comment-17255567 ] Apache Spark commented on SPARK-33899: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255566#comment-17255566 ] Apache Spark commented on SPARK-33899: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33639) The external table does not specify a location

[ https://issues.apache.org/jira/browse/SPARK-33639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1725#comment-1725 ] Apache Spark commented on SPARK-33639: -- User 'guixiaowen' has created a pull request for this

[jira] [Commented] (SPARK-33639) The external table does not specify a location

[ https://issues.apache.org/jira/browse/SPARK-33639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255549#comment-17255549 ] Apache Spark commented on SPARK-33639: -- User 'guixiaowen' has created a pull request for this

[jira] [Commented] (SPARK-33637) Spark sql drop non-existent table will not report an error after failure

[ https://issues.apache.org/jira/browse/SPARK-33637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255541#comment-17255541 ] Apache Spark commented on SPARK-33637: -- User 'guixiaowen' has created a pull request for this

[jira] [Assigned] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-33926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33926: Assignee: Apache Spark > Improve the error message in resolving of DSv1 multi-part

[jira] [Assigned] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-33926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33926: Assignee: (was: Apache Spark) > Improve the error message in resolving of DSv1

[jira] [Commented] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-33926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255524#comment-17255524 ] Apache Spark commented on SPARK-33926: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

Maxim Gekk created SPARK-33926: -- Summary: Improve the error message in resolving of DSv1 multi-part identifiers Key: SPARK-33926 URL: https://issues.apache.org/jira/browse/SPARK-33926 Project: Spark

[jira] [Closed] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

[ https://issues.apache.org/jira/browse/SPARK-32679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu closed SPARK-32679. - > update "no-serde" in the codebase in other TRANSFORM PRs. >

[jira] [Resolved] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

[ https://issues.apache.org/jira/browse/SPARK-32679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32679. --- Resolution: Not A Problem > update "no-serde" in the codebase in other TRANSFORM PRs. >

[jira] [Commented] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

[ https://issues.apache.org/jira/browse/SPARK-32679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255516#comment-17255516 ] angerszhu commented on SPARK-32679: --- No pr use default serde now, close this pr > update "no-serde"

[jira] [Commented] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255515#comment-17255515 ] Liu Neng commented on SPARK-33883: -- !image-2020-12-28-18-24-18-395.png! the first where is a table

[jira] [Updated] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Neng updated SPARK-33883: - Attachment: image-2020-12-28-18-32-25-960.png > Can repeat "where" twice without error in spark sql >

[jira] [Updated] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Neng updated SPARK-33883: - Attachment: image-2020-12-28-18-24-18-395.png > Can repeat "where" twice without error in spark sql >

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255502#comment-17255502 ] Kent Yao commented on SPARK-31685: -- Thanks for [~dongjoon] for the quick response. This issue is not

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdul Rafay Abdul Rafay updated SPARK-33920: Attachment: (was: Screenshot 2020-12-28 at 2.23.13 PM.png) > We

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdul Rafay Abdul Rafay updated SPARK-33920: Attachment: Screenshot 2020-12-28 at 2.23.13 PM.png > We cannot pass

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdul Rafay Abdul Rafay updated SPARK-33920: Attachment: Screenshot 2020-12-28 at 2.23.13 PM.png > We cannot pass

[jira] [Commented] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255481#comment-17255481 ] Abdul Rafay Abdul Rafay commented on SPARK-33920: - [~viirya] you're right and I know 

[jira] [Commented] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255482#comment-17255482 ] Apache Spark commented on SPARK-32684: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255485#comment-17255485 ] Apache Spark commented on SPARK-32684: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33925: Assignee: (was: Apache Spark) > Remove unused SecurityManager in Utils.fetchFile >

[jira] [Commented] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255479#comment-17255479 ] Apache Spark commented on SPARK-33925: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33925: Assignee: Apache Spark > Remove unused SecurityManager in Utils.fetchFile >

[jira] [Resolved] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33899. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30915

[jira] [Assigned] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33899: --- Assignee: Maxim Gekk > v1 SHOW TABLES fails with assert on spark_catalog >

[jira] [Commented] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255475#comment-17255475 ] angerszhu commented on SPARK-32684: --- Make a mistake, it don't need to fix  > Scrip transform hive

[jira] [Resolved] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32684. --- Resolution: Not A Bug > Scrip transform hive serde/default-serde mode null value keep same with

[jira] [Commented] (SPARK-33586) BisectingKMeansModel save and load implementation in pyspark

[ https://issues.apache.org/jira/browse/SPARK-33586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255471#comment-17255471 ] RISHAV DUTTA commented on SPARK-33586: -- Can you point me to the location where these save and load

[jira] [Commented] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255468#comment-17255468 ] Hyukjin Kwon commented on SPARK-33925: -- It's a improvement but I will add the affected version to

[jira] [Created] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

Hyukjin Kwon created SPARK-33925: Summary: Remove unused SecurityManager in Utils.fetchFile Key: SPARK-33925 URL: https://issues.apache.org/jira/browse/SPARK-33925 Project: Spark Issue Type:

[jira] [Created] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

Maxim Gekk created SPARK-33924: -- Summary: v2 INSERT INTO .. PARTITION drops the partition location Key: SPARK-33924 URL: https://issues.apache.org/jira/browse/SPARK-33924 Project: Spark Issue

[jira] [Resolved] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32685. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30942

[jira] [Assigned] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32685: --- Assignee: angerszhu > Script transform hive serde default field.delimit is '\t' >

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255462#comment-17255462 ] L. C. Hsieh commented on SPARK-31685: - Is this particularly related to SS? The issue described for

[jira] [Updated] (SPARK-33923) Fix some tests with AQE enabled

[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33923: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > Fix some tests with

[jira] [Assigned] (SPARK-33923) Fix some tests with AQE enabled

[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33923: - Assignee: wuyi > Fix some tests with AQE enabled > --- > >

  1   2   >