[jira] [Assigned] (SPARK-33827) Unload State Store asap once it becomes inactive

2020-12-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-33827: Assignee: L. C. Hsieh > Unload State Store asap once it becomes inactive >

[jira] [Resolved] (SPARK-33827) Unload State Store asap once it becomes inactive

2020-12-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33827. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30827

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

2020-12-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255446#comment-17255446 ] Dongjoon Hyun commented on SPARK-31685: --- Thank you for pinging me, [~Qin Yao]. cc [~viirya] since

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33920: - Component/s: (was: Build) > We cannot pass schema to a createDataFrame function in scala,

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33920: - Priority: Major (was: Critical) > We cannot pass schema to a createDataFrame function in

[jira] [Updated] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33920: - Target Version/s: (was: 3.0.1) > We cannot pass schema to a createDataFrame function in

[jira] [Commented] (SPARK-33922) Fix error test SparkLauncherSuite.testSparkLauncherGetError

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255445#comment-17255445 ] Hyukjin Kwon commented on SPARK-33922: -- [~dengziming] this passes in CI. Can you elaborate how you

[jira] [Commented] (SPARK-33923) Fix some tests with AQE enabled

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255439#comment-17255439 ] Apache Spark commented on SPARK-33923: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-33923) Fix some tests with AQE enabled

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255438#comment-17255438 ] Apache Spark commented on SPARK-33923: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33923) Fix some tests with AQE enabled

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33923: Assignee: Apache Spark > Fix some tests with AQE enabled >

[jira] [Assigned] (SPARK-33923) Fix some tests with AQE enabled

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33923: Assignee: (was: Apache Spark) > Fix some tests with AQE enabled >

[jira] [Created] (SPARK-33923) Fix some tests with AQE enabled

2020-12-27 Thread wuyi (Jira)
wuyi created SPARK-33923: Summary: Fix some tests with AQE enabled Key: SPARK-33923 URL: https://issues.apache.org/jira/browse/SPARK-33923 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255436#comment-17255436 ] Apache Spark commented on SPARK-33907: -- User 'viirya' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33914. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30929

[jira] [Assigned] (SPARK-33914) Describe the structure of unified v1 and v2 tests

2020-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33914: --- Assignee: Maxim Gekk > Describe the structure of unified v1 and v2 tests >

[jira] [Resolved] (SPARK-33908) Refact SparkSubmitUtils.resolveMavenCoordinates return parameter

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33908. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30922

[jira] [Assigned] (SPARK-33908) Refact SparkSubmitUtils.resolveMavenCoordinates return parameter

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33908: Assignee: angerszhu > Refact SparkSubmitUtils.resolveMavenCoordinates return parameter >

[jira] [Resolved] (SPARK-33901) Char and Varchar display error after DDLs

2020-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33901. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30918

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

2020-12-27 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255420#comment-17255420 ] Kent Yao commented on SPARK-31685: -- Hi, [~rajeevkumar], does this issue still exist in the latest

[jira] [Commented] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255418#comment-17255418 ] Apache Spark commented on SPARK-30789: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30789: Assignee: Apache Spark > Support (IGNORE | RESPECT) NULLS for

[jira] [Assigned] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30789: Assignee: Apache Spark > Support (IGNORE | RESPECT) NULLS for

[jira] [Assigned] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30789: Assignee: (was: Apache Spark) > Support (IGNORE | RESPECT) NULLS for

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

2020-12-27 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-30789: --- Description: All of LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE should support IGNORE NULLS |

[jira] [Commented] (SPARK-33801) Cleanup "Unicode escapes in triple quoted strings are deprecated" compilation warnings

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255410#comment-17255410 ] Apache Spark commented on SPARK-33801: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-33801) Cleanup "Unicode escapes in triple quoted strings are deprecated" compilation warnings

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255409#comment-17255409 ] Hyukjin Kwon commented on SPARK-33801: -- Fixed in https://github.com/apache/spark/pull/30926 >

[jira] [Resolved] (SPARK-33801) Cleanup "Unicode escapes in triple quoted strings are deprecated" compilation warnings

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33801. -- Fix Version/s: 3.2.0 Assignee: Yang Jie Resolution: Fixed > Cleanup "Unicode

[jira] [Updated] (SPARK-31168) Upgrade Scala to 2.12.13

2020-12-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31168: -- Affects Version/s: (was: 3.1.0) 3.2.0 > Upgrade Scala to 2.12.13 >

[jira] [Updated] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

2020-12-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33884: Description: Simplify CaseWhenclauses with (true and false) and (false and true):

[jira] [Updated] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

2020-12-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33884: Description: This pr simplify {{CaseWhen}} when only one branch and one clause is null and

[jira] [Updated] (SPARK-33884) Simplify CaseWhenclauses with (true and false) and (false and true)

2020-12-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33884: Summary: Simplify CaseWhenclauses with (true and false) and (false and true) (was: Simplify

[jira] [Commented] (SPARK-33913) Upgrade Kafka to 2.7.0

2020-12-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255395#comment-17255395 ] L. C. Hsieh commented on SPARK-33913: - Seems we cannot upgrade to Kafka 2.7.0. Because Kafka core

[jira] [Closed] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-33921. - We tried Scala 2.12.12 at SPARK-33168 already and revised SPARK-33168 to target Scala 2.12.13 to

[jira] [Comment Edited] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255394#comment-17255394 ] Dongjoon Hyun edited comment on SPARK-33921 at 12/28/20, 5:59 AM: -- We

[jira] [Resolved] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33921. --- Assignee: (was: L. C. Hsieh) Resolution: Duplicate > Upgrade Scala version to

[jira] [Resolved] (SPARK-33918) UnresolvedView should retain SQL text position

2020-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33918. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30936

[jira] [Commented] (SPARK-33915) Allow json expression to be pushable column

2020-12-27 Thread Ted Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255389#comment-17255389 ] Ted Yu commented on SPARK-33915: Here is the plan prior to predicate pushdown: {code} 2020-12-26

[jira] [Assigned] (SPARK-33918) UnresolvedView should retain SQL text position

2020-12-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33918: --- Assignee: Terry Kim > UnresolvedView should retain SQL text position >

[jira] [Commented] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255383#comment-17255383 ] Apache Spark commented on SPARK-33921: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255381#comment-17255381 ] Apache Spark commented on SPARK-33921: -- User 'viirya' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33532) Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33532. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30484

[jira] [Assigned] (SPARK-33532) Remove unreachable branch in SpecificParquetRecordReaderBase.initialize method

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33532: Assignee: Yang Jie > Remove unreachable branch in

[jira] [Resolved] (SPARK-24913) Make `AssertTrue` and `AssertNotNull` non-deterministic

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24913. -- Resolution: Not A Problem > Make `AssertTrue` and `AssertNotNull` non-deterministic >

[jira] [Assigned] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32685: Assignee: Apache Spark > Script transform hive serde default field.delimit is '\t' >

[jira] [Assigned] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32685: Assignee: (was: Apache Spark) > Script transform hive serde default field.delimit is

[jira] [Commented] (SPARK-32685) Script transform hive serde default field.delimit is '\t'

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255365#comment-17255365 ] Apache Spark commented on SPARK-32685: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255364#comment-17255364 ] Apache Spark commented on SPARK-33680: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-33680) Fix PrunePartitionSuiteBase/BucketedReadWithHiveSupportSuite not to depend on the default conf

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255362#comment-17255362 ] Apache Spark commented on SPARK-33680: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Created] (SPARK-33922) Fix error test SparkLauncherSuite.testSparkLauncherGetError

2020-12-27 Thread dengziming (Jira)
dengziming created SPARK-33922: -- Summary: Fix error test SparkLauncherSuite.testSparkLauncherGetError Key: SPARK-33922 URL: https://issues.apache.org/jira/browse/SPARK-33922 Project: Spark

[jira] [Commented] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255346#comment-17255346 ] Apache Spark commented on SPARK-33921: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33921: Assignee: Apache Spark (was: L. C. Hsieh) > Upgrade Scala version to 2.12.12 >

[jira] [Assigned] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33921: Assignee: L. C. Hsieh (was: Apache Spark) > Upgrade Scala version to 2.12.12 >

[jira] [Commented] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255345#comment-17255345 ] Apache Spark commented on SPARK-33921: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-33896) Make Spark DAGScheduler datasource cache aware when scheduling tasks in a multi-replication HDFS

2020-12-27 Thread Xudingyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255342#comment-17255342 ] Xudingyu commented on SPARK-33896: -- [~sro...@scient.com][~sro...@yahoo.com][~sowen] > Make Spark

[jira] [Created] (SPARK-33921) Upgrade Scala version to 2.12.12

2020-12-27 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33921: --- Summary: Upgrade Scala version to 2.12.12 Key: SPARK-33921 URL: https://issues.apache.org/jira/browse/SPARK-33921 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33913) Upgrade Kafka to 2.7.0

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255324#comment-17255324 ] Apache Spark commented on SPARK-33913: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33913) Upgrade Kafka to 2.7.0

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33913: Assignee: (was: Apache Spark) > Upgrade Kafka to 2.7.0 > -- > >

[jira] [Assigned] (SPARK-33913) Upgrade Kafka to 2.7.0

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33913: Assignee: Apache Spark > Upgrade Kafka to 2.7.0 > -- > >

[jira] [Commented] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

2020-12-27 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255321#comment-17255321 ] L. C. Hsieh commented on SPARK-33920: - There is `{{def createDataFrame(rowRDD: RDD[Row], schema:

[jira] [Commented] (SPARK-33824) Restructure and improve Python package management page

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255229#comment-17255229 ] Apache Spark commented on SPARK-33824: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-33824) Restructure and improve Python package management page

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255228#comment-17255228 ] Apache Spark commented on SPARK-33824: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-33920) We cannot pass schema to a createDataFrame function in scala, however we can do this in python.

2020-12-27 Thread Abdul Rafay Abdul Rafay (Jira)
Abdul Rafay Abdul Rafay created SPARK-33920: --- Summary: We cannot pass schema to a createDataFrame function in scala, however we can do this in python. Key: SPARK-33920 URL:

[jira] [Assigned] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33911: Assignee: Maxim Gekk > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Resolved] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33911. -- Fix Version/s: 2.4.8 3.1.0 Resolution: Fixed Issue resolved by pull

[jira] [Commented] (SPARK-33919) Unify v1 and v2 SHOW NAMESPACES tests

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255190#comment-17255190 ] Apache Spark commented on SPARK-33919: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33919) Unify v1 and v2 SHOW NAMESPACES tests

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33919: Assignee: (was: Apache Spark) > Unify v1 and v2 SHOW NAMESPACES tests >

[jira] [Assigned] (SPARK-33919) Unify v1 and v2 SHOW NAMESPACES tests

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33919: Assignee: Apache Spark > Unify v1 and v2 SHOW NAMESPACES tests >

[jira] [Commented] (SPARK-33919) Unify v1 and v2 SHOW NAMESPACES tests

2020-12-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255189#comment-17255189 ] Apache Spark commented on SPARK-33919: -- User 'MaxGekk' has created a pull request for this issue: