[jira] [Commented] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255855#comment-17255855 ] Apache Spark commented on SPARK-33847: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255854#comment-17255854 ] Apache Spark commented on SPARK-33847: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33928: --- Assignee: wuyi > Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update tar

[jira] [Resolved] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33928. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30956 [https://gith

[jira] [Assigned] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33884: --- Assignee: Yuming Wang > Simplify CaseWhenclauses with (true and false) and (false and true)

[jira] [Resolved] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33884. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30898 [https://gith

[jira] [Resolved] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33924. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30952 [https://gith

[jira] [Updated] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33931: -- Priority: Blocker (was: Major) > Recover GitHub Action > - > >

[jira] [Updated] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33931: -- Target Version/s: 3.1.0, 3.2.0 > Recover GitHub Action > - > >

[jira] [Issue Comment Deleted] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33931: -- Comment: was deleted (was: User 'dongjoon-hyun' has created a pull request for this issue: htt

[jira] [Assigned] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33931: Assignee: (was: Apache Spark) > Recover GitHub Action > - > >

[jira] [Commented] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255825#comment-17255825 ] Apache Spark commented on SPARK-33931: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33931: Assignee: Apache Spark > Recover GitHub Action > - > >

[jira] [Commented] (SPARK-33931) Recover GitHub Action

[ https://issues.apache.org/jira/browse/SPARK-33931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255824#comment-17255824 ] Apache Spark commented on SPARK-33931: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-33931) Recover GitHub Action

Dongjoon Hyun created SPARK-33931: - Summary: Recover GitHub Action Key: SPARK-33931 URL: https://issues.apache.org/jira/browse/SPARK-33931 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255819#comment-17255819 ] Apache Spark commented on SPARK-33930: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33930: Assignee: (was: Apache Spark) > Spark SQL no serde row format field delimit default i

[jira] [Assigned] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33930: Assignee: Apache Spark > Spark SQL no serde row format field delimit default is '\u0001'

[jira] [Commented] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255818#comment-17255818 ] Apache Spark commented on SPARK-33930: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255815#comment-17255815 ] Apache Spark commented on SPARK-31937: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31937: Assignee: (was: Apache Spark) > Support processing array/map/struct type using spark

[jira] [Commented] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255814#comment-17255814 ] Apache Spark commented on SPARK-31937: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31937: Assignee: Apache Spark > Support processing array/map/struct type using spark noserde mod

[jira] [Updated] (SPARK-31937) Support processing array/map/struct type using spark noserde mode

[ https://issues.apache.org/jira/browse/SPARK-31937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31937: -- Summary: Support processing array/map/struct type using spark noserde mode (was: Support processing a

[jira] [Commented] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255813#comment-17255813 ] angerszhu commented on SPARK-33930: --- raise a pr soon > Spark SQL no serde row format

[jira] [Updated] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

[ https://issues.apache.org/jira/browse/SPARK-33930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33930: -- Parent: SPARK-31936 Issue Type: Sub-task (was: Improvement) > Spark SQL no serde row format f

[jira] [Created] (SPARK-33930) Spark SQL no serde row format field delimit default is '\u0001'

angerszhu created SPARK-33930: - Summary: Spark SQL no serde row format field delimit default is '\u0001' Key: SPARK-33930 URL: https://issues.apache.org/jira/browse/SPARK-33930 Project: Spark Is

[jira] [Created] (SPARK-33929) Spark-submit with --package deequ doesn't pull all jars

Dustin Smith created SPARK-33929: Summary: Spark-submit with --package deequ doesn't pull all jars Key: SPARK-33929 URL: https://issues.apache.org/jira/browse/SPARK-33929 Project: Spark Issue

[jira] [Updated] (SPARK-33929) Spark-submit with --package deequ doesn't pull all jars

[ https://issues.apache.org/jira/browse/SPARK-33929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Smith updated SPARK-33929: - Description: This issue was marked as solved SPARK-24074; however, another [~hyukjin.kwon] poin

[jira] [Assigned] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33928: Assignee: Apache Spark > Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't

[jira] [Commented] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255798#comment-17255798 ] Apache Spark commented on SPARK-33928: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

[ https://issues.apache.org/jira/browse/SPARK-33928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33928: Assignee: (was: Apache Spark) > Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-2

[jira] [Commented] (SPARK-23365) DynamicAllocation with failure in straggler task can lead to a hung spark job

[ https://issues.apache.org/jira/browse/SPARK-23365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255799#comment-17255799 ] Apache Spark commented on SPARK-23365: -- User 'Ngone51' has created a pull request f

[jira] [Created] (SPARK-33928) Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors"

wuyi created SPARK-33928: Summary: Flaky o.a.s.ExecutorAllocationManagerSuite - "SPARK-23365 Don't update target num executors when killing idle executors" Key: SPARK-33928 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Updated] (SPARK-33910) Simplify/Optimize conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: 1. Push down the foldable expressions through CaseWhen/If 2. Simplify conditional in

[jira] [Commented] (SPARK-33848) Push the UnaryExpression into (if / case) branches

[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255790#comment-17255790 ] Apache Spark commented on SPARK-33848: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-33927) Fix Spark Release image

[ https://issues.apache.org/jira/browse/SPARK-33927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255777#comment-17255777 ] Dongjoon Hyun commented on SPARK-33927: --- cc [~hyukjin.kwon] > Fix Spark Release i

[jira] [Created] (SPARK-33927) Fix Spark Release image

Dongjoon Hyun created SPARK-33927: - Summary: Fix Spark Release image Key: SPARK-33927 URL: https://issues.apache.org/jira/browse/SPARK-33927 Project: Spark Issue Type: Bug Component

[jira] [Resolved] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33925. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30945 [https://

[jira] [Assigned] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33925: - Assignee: Hyukjin Kwon > Remove unused SecurityManager in Utils.fetchFile > ---

[jira] [Assigned] (SPARK-33916) Fix fallback storage offset and improve compression codec test coverage

[ https://issues.apache.org/jira/browse/SPARK-33916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33916: - Assignee: Dongjoon Hyun > Fix fallback storage offset and improve compression codec tes

[jira] [Resolved] (SPARK-33916) Fix fallback storage offset and improve compression codec test coverage

[ https://issues.apache.org/jira/browse/SPARK-33916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33916. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30934 [https://

[jira] [Resolved] (SPARK-33871) Cannot access to column after left semi join and left join

[ https://issues.apache.org/jira/browse/SPARK-33871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33871. - Resolution: Not A Problem > Cannot access to column after left semi join and left join > --

[jira] [Resolved] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33883. - Resolution: Invalid > Can repeat "where" twice without error in spark sql >

[jira] [Commented] (SPARK-24632) Allow 3rd-party libraries to use pyspark.ml abstractions for Java wrappers for persistence

[ https://issues.apache.org/jira/browse/SPARK-24632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255712#comment-17255712 ] Bryan Cutler commented on SPARK-24632: -- Ping [~huaxingao] in case you have some tim

[jira] [Assigned] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33029: Assignee: Apache Spark > Standalone mode blacklist executors page UI marks driver as blac

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255703#comment-17255703 ] Apache Spark commented on SPARK-33029: -- User 'baohe-zhang' has created a pull reque

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255702#comment-17255702 ] Apache Spark commented on SPARK-33029: -- User 'baohe-zhang' has created a pull reque

[jira] [Assigned] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33029: Assignee: (was: Apache Spark) > Standalone mode blacklist executors page UI marks dri

[jira] [Commented] (SPARK-33845) Improve SimplifyConditionals

[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255688#comment-17255688 ] Apache Spark commented on SPARK-33845: -- User 'cloud-fan' has created a pull request

[jira] [Updated] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33899: Fix Version/s: (was: 3.2.0) 3.1.0 > v1 SHOW TABLES fails with assert on spa

[jira] [Commented] (SPARK-33031) scheduler with blacklisting doesn't appear to pick up new executor added

[ https://issues.apache.org/jira/browse/SPARK-33031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255685#comment-17255685 ] Baohe Zhang commented on SPARK-33031: - New tasks won't be scheduled because the node

[jira] [Commented] (SPARK-33029) Standalone mode blacklist executors page UI marks driver as blacklisted

[ https://issues.apache.org/jira/browse/SPARK-33029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255682#comment-17255682 ] Baohe Zhang commented on SPARK-33029: - With the blacklist feature enabled, by defaul

[jira] [Commented] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255681#comment-17255681 ] L. C. Hsieh commented on SPARK-33920: - Could you elaborate more on the data and data

[jira] [Commented] (SPARK-33915) Allow json expression to be pushable column

[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255631#comment-17255631 ] Ted Yu commented on SPARK-33915: [~codingcat] [~XuanYuan][~viirya][~Alex Herman] Can you

[jira] [Commented] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255617#comment-17255617 ] Apache Spark commented on SPARK-33924: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33924: Assignee: Apache Spark > v2 INSERT INTO .. PARTITION drops the partition location > -

[jira] [Assigned] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33924: Assignee: (was: Apache Spark) > v2 INSERT INTO .. PARTITION drops the partition locat

[jira] [Assigned] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

[ https://issues.apache.org/jira/browse/SPARK-33924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33924: Assignee: Apache Spark > v2 INSERT INTO .. PARTITION drops the partition location > -

[jira] [Commented] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255603#comment-17255603 ] Stu commented on SPARK-33883: - that makes so much sense, thanks! > Can repeat "where" twice

[jira] [Commented] (SPARK-33775) Suppress unimportant compilation warnings in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255581#comment-17255581 ] Apache Spark commented on SPARK-33775: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-33775) Suppress unimportant compilation warnings in Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-33775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255580#comment-17255580 ] Apache Spark commented on SPARK-33775: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255567#comment-17255567 ] Apache Spark commented on SPARK-33899: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255566#comment-17255566 ] Apache Spark commented on SPARK-33899: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33639) The external table does not specify a location

[ https://issues.apache.org/jira/browse/SPARK-33639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1725#comment-1725 ] Apache Spark commented on SPARK-33639: -- User 'guixiaowen' has created a pull reques

[jira] [Commented] (SPARK-33639) The external table does not specify a location

[ https://issues.apache.org/jira/browse/SPARK-33639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255549#comment-17255549 ] Apache Spark commented on SPARK-33639: -- User 'guixiaowen' has created a pull reques

[jira] [Commented] (SPARK-33637) Spark sql drop non-existent table will not report an error after failure

[ https://issues.apache.org/jira/browse/SPARK-33637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255541#comment-17255541 ] Apache Spark commented on SPARK-33637: -- User 'guixiaowen' has created a pull reques

[jira] [Assigned] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-33926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33926: Assignee: Apache Spark > Improve the error message in resolving of DSv1 multi-part identi

[jira] [Assigned] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-33926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33926: Assignee: (was: Apache Spark) > Improve the error message in resolving of DSv1 multi-

[jira] [Commented] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

[ https://issues.apache.org/jira/browse/SPARK-33926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255524#comment-17255524 ] Apache Spark commented on SPARK-33926: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-33926) Improve the error message in resolving of DSv1 multi-part identifiers

Maxim Gekk created SPARK-33926: -- Summary: Improve the error message in resolving of DSv1 multi-part identifiers Key: SPARK-33926 URL: https://issues.apache.org/jira/browse/SPARK-33926 Project: Spark

[jira] [Closed] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

[ https://issues.apache.org/jira/browse/SPARK-32679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu closed SPARK-32679. - > update "no-serde" in the codebase in other TRANSFORM PRs. > -

[jira] [Resolved] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

[ https://issues.apache.org/jira/browse/SPARK-32679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32679. --- Resolution: Not A Problem > update "no-serde" in the codebase in other TRANSFORM PRs. > ---

[jira] [Commented] (SPARK-32679) update "no-serde" in the codebase in other TRANSFORM PRs.

[ https://issues.apache.org/jira/browse/SPARK-32679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255516#comment-17255516 ] angerszhu commented on SPARK-32679: --- No pr use default serde now, close this pr > up

[jira] [Commented] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255515#comment-17255515 ] Liu Neng commented on SPARK-33883: -- !image-2020-12-28-18-24-18-395.png! the first wher

[jira] [Updated] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Neng updated SPARK-33883: - Attachment: image-2020-12-28-18-32-25-960.png > Can repeat "where" twice without error in spark sql > --

[jira] [Updated] (SPARK-33883) Can repeat "where" twice without error in spark sql

[ https://issues.apache.org/jira/browse/SPARK-33883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu Neng updated SPARK-33883: - Attachment: image-2020-12-28-18-24-18-395.png > Can repeat "where" twice without error in spark sql > --

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255502#comment-17255502 ] Kent Yao commented on SPARK-31685: -- Thanks for [~dongjoon] for the quick response. Thi

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdul Rafay Abdul Rafay updated SPARK-33920: Attachment: (was: Screenshot 2020-12-28 at 2.23.13 PM.png) > We cannot

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdul Rafay Abdul Rafay updated SPARK-33920: Attachment: Screenshot 2020-12-28 at 2.23.13 PM.png > We cannot pass schem

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdul Rafay Abdul Rafay updated SPARK-33920: Attachment: Screenshot 2020-12-28 at 2.23.13 PM.png > We cannot pass schem

[jira] [Commented] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255481#comment-17255481 ] Abdul Rafay Abdul Rafay commented on SPARK-33920: - [~viirya] you're righ

[jira] [Commented] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255482#comment-17255482 ] Apache Spark commented on SPARK-32684: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255485#comment-17255485 ] Apache Spark commented on SPARK-32684: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33925: Assignee: (was: Apache Spark) > Remove unused SecurityManager in Utils.fetchFile > --

[jira] [Commented] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255479#comment-17255479 ] Apache Spark commented on SPARK-33925: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33925: Assignee: Apache Spark > Remove unused SecurityManager in Utils.fetchFile > -

[jira] [Resolved] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33899. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30915 [https://gith

[jira] [Assigned] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33899: --- Assignee: Maxim Gekk > v1 SHOW TABLES fails with assert on spark_catalog >

[jira] [Commented] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255475#comment-17255475 ] angerszhu commented on SPARK-32684: --- Make a mistake, it don't need to fix  > Scrip tr

[jira] [Resolved] (SPARK-32684) Scrip transform hive serde/default-serde mode null value keep same with hive as '\\N'

[ https://issues.apache.org/jira/browse/SPARK-32684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu resolved SPARK-32684. --- Resolution: Not A Bug > Scrip transform hive serde/default-serde mode null value keep same with hive

[jira] [Commented] (SPARK-33586) BisectingKMeansModel save and load implementation in pyspark

[ https://issues.apache.org/jira/browse/SPARK-33586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255471#comment-17255471 ] RISHAV DUTTA commented on SPARK-33586: -- Can you point me to the location where thes

[jira] [Commented] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

[ https://issues.apache.org/jira/browse/SPARK-33925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255468#comment-17255468 ] Hyukjin Kwon commented on SPARK-33925: -- It's a improvement but I will add the affec

[jira] [Created] (SPARK-33925) Remove unused SecurityManager in Utils.fetchFile

Hyukjin Kwon created SPARK-33925: Summary: Remove unused SecurityManager in Utils.fetchFile Key: SPARK-33925 URL: https://issues.apache.org/jira/browse/SPARK-33925 Project: Spark Issue Type:

[jira] [Created] (SPARK-33924) v2 INSERT INTO .. PARTITION drops the partition location

Maxim Gekk created SPARK-33924: -- Summary: v2 INSERT INTO .. PARTITION drops the partition location Key: SPARK-33924 URL: https://issues.apache.org/jira/browse/SPARK-33924 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32685. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30942 [https://gith

[jira] [Assigned] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32685: --- Assignee: angerszhu > Script transform hive serde default field.delimit is '\t' > -

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255462#comment-17255462 ] L. C. Hsieh commented on SPARK-31685: - Is this particularly related to SS? The issue

[jira] [Updated] (SPARK-33923) Fix some tests with AQE enabled

[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33923: -- Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > Fix some tests with AQE

[jira] [Assigned] (SPARK-33923) Fix some tests with AQE enabled

[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33923: - Assignee: wuyi > Fix some tests with AQE enabled > --- > >

  1   2   >