[jira] [Commented] (SPARK-33373) A serialized ImputerModel fails to be serialized again

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227743#comment-17227743 ] L. C. Hsieh commented on SPARK-33373: - I did not try, but looks like it is most like

[jira] [Commented] (SPARK-33327) grouped by first and last against date column returns incorrect results

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227742#comment-17227742 ] L. C. Hsieh commented on SPARK-33327: - So the rows in {{users.csv}} have the same {{

[jira] [Commented] (SPARK-33327) grouped by first and last against date column returns incorrect results

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227740#comment-17227740 ] L. C. Hsieh commented on SPARK-33327: - >From the doc of {{first}} function: {code} T

[jira] [Created] (SPARK-33380) Incorrect output from example script pi.py

2020-11-06 Thread Milind V Damle (Jira)
Milind V Damle created SPARK-33380: -- Summary: Incorrect output from example script pi.py Key: SPARK-33380 URL: https://issues.apache.org/jira/browse/SPARK-33380 Project: Spark Issue Type: Bu

[jira] [Comment Edited] (SPARK-33301) Code grows beyond 64 KB when compiling large CaseWhen

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227728#comment-17227728 ] L. C. Hsieh edited comment on SPARK-33301 at 11/7/20, 5:13 AM: ---

[jira] [Commented] (SPARK-33301) Code grows beyond 64 KB when compiling large CaseWhen

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227728#comment-17227728 ] L. C. Hsieh commented on SPARK-33301: - One cause of this issue here is because we do

[jira] [Commented] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227725#comment-17227725 ] Apache Spark commented on SPARK-33379: -- User 'dongkelun' has created a pull request

[jira] [Assigned] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33379: Assignee: (was: Apache Spark) > The link address of ‘’this page’’ in docs/pyspark-mig

[jira] [Assigned] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33379: Assignee: Apache Spark > The link address of ‘’this page’’ in docs/pyspark-migration-guid

[jira] [Commented] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227724#comment-17227724 ] Apache Spark commented on SPARK-33379: -- User 'dongkelun' has created a pull request

[jira] [Updated] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated SPARK-33379: Attachment: SPARK-33379.png > The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is > incorrect

[jira] [Updated] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated SPARK-33379: Attachment: (was: QQ图片20201107114422.png) > The link address of ‘’this page’’ in docs/pyspark-migration-guide.

[jira] [Updated] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-33379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 董可伦 updated SPARK-33379: Attachment: QQ图片20201107114422.png > The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is > in

[jira] [Created] (SPARK-33379) The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect

2020-11-06 Thread Jira
董可伦 created SPARK-33379: --- Summary: The link address of ‘’this page’’ in docs/pyspark-migration-guide.md is incorrect Key: SPARK-33379 URL: https://issues.apache.org/jira/browse/SPARK-33379 Project: Spark

[jira] [Updated] (SPARK-33229) Need to support partial CUBE/ROLLUP/GROUPING SETS and mixed case

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33229: -- Summary: Need to support partial CUBE/ROLLUP/GROUPING SETS and mixed case (was: Support partial CUBE/

[jira] [Commented] (SPARK-33229) Support partial CUBE/ROLLUP/GROUPING SETS and mixed case

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227713#comment-17227713 ] angerszhu commented on SPARK-33229: --- TeraData. PostgresSQL, SQLServer, Oracle both sup

[jira] [Updated] (SPARK-33229) Support partial CUBE/ROLLUP/GROUPING SETS and mixed case

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33229: -- Summary: Support partial CUBE/ROLLUP/GROUPING SETS and mixed case (was: UnsupportedOperationException

[jira] [Created] (SPARK-33378) Update doc about grouping analytics

2020-11-06 Thread angerszhu (Jira)
angerszhu created SPARK-33378: - Summary: Update doc about grouping analytics Key: SPARK-33378 URL: https://issues.apache.org/jira/browse/SPARK-33378 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33377) Support composite columns in cube/rollup

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33377: -- Description: Oracle: [https://docs.oracle.com/cd/E11882_01/server.112/e25554/aggreg.htm#DWHSG8634] !

[jira] [Updated] (SPARK-33377) Support composite columns in cube/rollup

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33377: -- Attachment: image-2020-11-07-09-49-59-190.png > Support composite columns in cube/rollup > ---

[jira] [Updated] (SPARK-33377) Support composite columns in cube/rollup

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33377: -- Attachment: image-2020-11-07-09-49-18-161.png > Support composite columns in cube/rollup > ---

[jira] [Updated] (SPARK-33377) Support composite columns in cube/rollup

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33377: -- Description: Oracle: [https://docs.oracle.com/cd/E11882_01/server.112/e25554/aggreg.htm#DWHSG8634] !

[jira] [Updated] (SPARK-33377) Support composite columns in cube/rollup

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-33377: -- Attachment: image-2020-11-07-09-48-17-739.png > Support composite columns in cube/rollup > ---

[jira] [Created] (SPARK-33377) Support composite columns in cube/rollup

2020-11-06 Thread angerszhu (Jira)
angerszhu created SPARK-33377: - Summary: Support composite columns in cube/rollup Key: SPARK-33377 URL: https://issues.apache.org/jira/browse/SPARK-33377 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-33367) Move the table commands from ddl.scala to table.scala

2020-11-06 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-33367. --- Resolution: Won't Fix Won't fix to maintain the commit history. > Move the table commands from ddl.

[jira] [Commented] (SPARK-33251) Migration to NumPy documentation style in ML (pyspark.ml.*)

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227660#comment-17227660 ] Apache Spark commented on SPARK-33251: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-33251) Migration to NumPy documentation style in ML (pyspark.ml.*)

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33251: Assignee: Apache Spark > Migration to NumPy documentation style in ML (pyspark.ml.*) > --

[jira] [Commented] (SPARK-33251) Migration to NumPy documentation style in ML (pyspark.ml.*)

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227659#comment-17227659 ] Apache Spark commented on SPARK-33251: -- User 'zero323' has created a pull request f

[jira] [Assigned] (SPARK-33251) Migration to NumPy documentation style in ML (pyspark.ml.*)

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33251: Assignee: (was: Apache Spark) > Migration to NumPy documentation style in ML (pyspark

[jira] [Assigned] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33376: Assignee: (was: Apache Spark) > Remove the option of "sharesHadoopClasses" in Hive Is

[jira] [Assigned] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33376: Assignee: Apache Spark > Remove the option of "sharesHadoopClasses" in Hive IsolatedClien

[jira] [Commented] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227657#comment-17227657 ] Apache Spark commented on SPARK-33376: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33376: Assignee: Apache Spark > Remove the option of "sharesHadoopClasses" in Hive IsolatedClien

[jira] [Commented] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227658#comment-17227658 ] Apache Spark commented on SPARK-33376: -- User 'sunchao' has created a pull request f

[jira] [Resolved] (SPARK-33371) Support Python 3.9+ in PySpark

2020-11-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33371. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30277 [https://

[jira] [Assigned] (SPARK-33371) Support Python 3.9+ in PySpark

2020-11-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33371: - Assignee: Hyukjin Kwon > Support Python 3.9+ in PySpark > -

[jira] [Created] (SPARK-33376) Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader

2020-11-06 Thread Chao Sun (Jira)
Chao Sun created SPARK-33376: Summary: Remove the option of "sharesHadoopClasses" in Hive IsolatedClientLoader Key: SPARK-33376 URL: https://issues.apache.org/jira/browse/SPARK-33376 Project: Spark

[jira] [Resolved] (SPARK-33347) Clean up useless variables in MutableApplicationInfo

2020-11-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33347. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30251 [https://gi

[jira] [Assigned] (SPARK-33347) Clean up useless variables in MutableApplicationInfo

2020-11-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-33347: Assignee: Yang Jie > Clean up useless variables in MutableApplicationInfo > -

[jira] [Assigned] (SPARK-33291) Inconsistent NULL conversions to strings redux

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-33291: --- Assignee: Stuart White > Inconsistent NULL conversions to strings redux > -

[jira] [Resolved] (SPARK-33291) Inconsistent NULL conversions to strings redux

2020-11-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-33291. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30189 [https://gith

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227609#comment-17227609 ] Apache Spark commented on SPARK-24266: -- User 'jkleckner' has created a pull request

[jira] [Commented] (SPARK-24266) Spark client terminates while driver is still running

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227608#comment-17227608 ] Apache Spark commented on SPARK-24266: -- User 'jkleckner' has created a pull request

[jira] [Assigned] (SPARK-33375) [CORE] Add config spark.yarn.pyspark.archives

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33375: Assignee: (was: Apache Spark) > [CORE] Add config spark.yarn.pyspark.archives > -

[jira] [Assigned] (SPARK-33375) [CORE] Add config spark.yarn.pyspark.archives

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33375: Assignee: Apache Spark > [CORE] Add config spark.yarn.pyspark.archives >

[jira] [Commented] (SPARK-33375) [CORE] Add config spark.yarn.pyspark.archives

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227598#comment-17227598 ] Apache Spark commented on SPARK-33375: -- User 'warrenzhu25' has created a pull reque

[jira] [Updated] (SPARK-33375) [CORE] Add config spark.yarn.pyspark.archives

2020-11-06 Thread Zhongwei Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongwei Zhu updated SPARK-33375: - Summary: [CORE] Add config spark.yarn.pyspark.archives (was: [CORE] config spark.yarn.pyspark.a

[jira] [Created] (SPARK-33375) [CORE] config spark.yarn.pyspark.archives

2020-11-06 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-33375: Summary: [CORE] config spark.yarn.pyspark.archives Key: SPARK-33375 URL: https://issues.apache.org/jira/browse/SPARK-33375 Project: Spark Issue Type: Improve

[jira] [Assigned] (SPARK-33374) [CORE] Remove unnecessary python path from spark home

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33374: Assignee: (was: Apache Spark) > [CORE] Remove unnecessary python path from spark home

[jira] [Assigned] (SPARK-33374) [CORE] Remove unnecessary python path from spark home

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33374: Assignee: Apache Spark > [CORE] Remove unnecessary python path from spark home >

[jira] [Commented] (SPARK-33374) [CORE] Remove unnecessary python path from spark home

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227591#comment-17227591 ] Apache Spark commented on SPARK-33374: -- User 'warrenzhu25' has created a pull reque

[jira] [Created] (SPARK-33374) [CORE] Remove unnecessary python path from spark home

2020-11-06 Thread Zhongwei Zhu (Jira)
Zhongwei Zhu created SPARK-33374: Summary: [CORE] Remove unnecessary python path from spark home Key: SPARK-33374 URL: https://issues.apache.org/jira/browse/SPARK-33374 Project: Spark Issue T

[jira] [Commented] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-11-06 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227580#comment-17227580 ] Cheng Su commented on SPARK-32577: -- Shuffled hash join will only be enabled with proper

[jira] [Commented] (SPARK-33370) Update PR labeler to add back in the negated file matches

2020-11-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227490#comment-17227490 ] Dongjoon Hyun commented on SPARK-33370: --- Thank you, [~kbendick]. > Update PR labe

[jira] [Assigned] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32577: Assignee: (was: Apache Spark) > Fix the config value for shuffled hash join in test i

[jira] [Commented] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227487#comment-17227487 ] Apache Spark commented on SPARK-32577: -- User 'warrenzhu25' has created a pull reque

[jira] [Commented] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227488#comment-17227488 ] Apache Spark commented on SPARK-32577: -- User 'warrenzhu25' has created a pull reque

[jira] [Assigned] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32577: Assignee: Apache Spark > Fix the config value for shuffled hash join in test in-joins.sql

[jira] [Updated] (SPARK-33333) Upgrade Jetty to 9.4.28.v20200408

2020-11-06 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-3: -- Fix Version/s: 2.4.8 > Upgrade Jetty to 9.4.28.v20200408 > - >

[jira] [Created] (SPARK-33373) A serialized ImputerModel fails to be serialized again

2020-11-06 Thread Andre Boechat (Jira)
Andre Boechat created SPARK-33373: - Summary: A serialized ImputerModel fails to be serialized again Key: SPARK-33373 URL: https://issues.apache.org/jira/browse/SPARK-33373 Project: Spark Issu

[jira] [Updated] (SPARK-33372) Fix InSet bucket pruning

2020-11-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33372: Description: This pr fix InSet bucket pruning because of it's values should not be Literal: https

[jira] [Assigned] (SPARK-33372) Fix InSet bucket pruning

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33372: Assignee: Apache Spark > Fix InSet bucket pruning > > >

[jira] [Assigned] (SPARK-33372) Fix InSet bucket pruning

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33372: Assignee: (was: Apache Spark) > Fix InSet bucket pruning > >

[jira] [Commented] (SPARK-33372) Fix InSet bucket pruning

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227442#comment-17227442 ] Apache Spark commented on SPARK-33372: -- User 'wangyum' has created a pull request f

[jira] [Created] (SPARK-33372) Fix InSet bucket pruning

2020-11-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33372: --- Summary: Fix InSet bucket pruning Key: SPARK-33372 URL: https://issues.apache.org/jira/browse/SPARK-33372 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-33128) mismatched input since Spark 3.0

2020-11-06 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227281#comment-17227281 ] angerszhu commented on SPARK-33128: --- Looking into this > mismatched input since Spark

[jira] [Resolved] (SPARK-33368) SimplifyConditionals simplifies non-deterministic expressions

2020-11-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33368. - Resolution: Not A Bug > SimplifyConditionals simplifies non-deterministic expressions >

[jira] [Resolved] (SPARK-33315) simplify CaseWhen with EqualTo

2020-11-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33315. - Resolution: Not A Problem > simplify CaseWhen with EqualTo > -- > >

[jira] [Commented] (SPARK-33302) Failed to push down filters through Expand

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227274#comment-17227274 ] Apache Spark commented on SPARK-33302: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-33302) Failed to push down filters through Expand

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33302: Assignee: (was: Apache Spark) > Failed to push down filters through Expand >

[jira] [Assigned] (SPARK-33302) Failed to push down filters through Expand

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33302: Assignee: Apache Spark > Failed to push down filters through Expand > ---

[jira] [Updated] (SPARK-33244) Block reading streaming temp view via `spark.table` API

2020-11-06 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-33244: Description: * Block reading streaming temp view via `spark.table` API  * The code paths of `spar

[jira] [Updated] (SPARK-33244) Block reading streaming temp view via `spark.table` API

2020-11-06 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-33244: Description:   The code paths of `spark.table` and `spark.read.table` should be the same. This b

[jira] [Updated] (SPARK-33244) Block reading streaming temp view via `spark.table` API

2020-11-06 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-33244: Summary: Block reading streaming temp view via `spark.table` API (was: Unify the code paths for s

[jira] [Updated] (SPARK-33244) Unify the code paths for spark.table and spark.read.table

2020-11-06 Thread Yuanjian Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-33244: Component/s: Structured Streaming > Unify the code paths for spark.table and spark.read.table > --

[jira] [Assigned] (SPARK-33370) Update PR labeler to add back in the negated file matches

2020-11-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33370: Assignee: Kyle Bendickson > Update PR labeler to add back in the negated file matches > -

[jira] [Assigned] (SPARK-33371) Support Python 3.9+ in PySpark

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33371: Assignee: Apache Spark > Support Python 3.9+ in PySpark > --

[jira] [Commented] (SPARK-33371) Support Python 3.9+ in PySpark

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227238#comment-17227238 ] Apache Spark commented on SPARK-33371: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-33371) Support Python 3.9+ in PySpark

2020-11-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33371: Assignee: (was: Apache Spark) > Support Python 3.9+ in PySpark >

[jira] [Created] (SPARK-33371) Support Python 3.9+ in PySpark

2020-11-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-33371: Summary: Support Python 3.9+ in PySpark Key: SPARK-33371 URL: https://issues.apache.org/jira/browse/SPARK-33371 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33370) Update PR labeler to add back in the negated file matches

2020-11-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227230#comment-17227230 ] Hyukjin Kwon commented on SPARK-33370: -- Thanks [~kbendick]. > Update PR labeler to

[jira] [Commented] (SPARK-33370) Update PR labeler to add back in the negated file matches

2020-11-06 Thread Kyle Bendickson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17227226#comment-17227226 ] Kyle Bendickson commented on SPARK-33370: - cc [~hyukjin.kwon] [~dongjoon] for fo

[jira] [Created] (SPARK-33370) Update PR labeler to add back in the negated file matches

2020-11-06 Thread Kyle Bendickson (Jira)
Kyle Bendickson created SPARK-33370: --- Summary: Update PR labeler to add back in the negated file matches Key: SPARK-33370 URL: https://issues.apache.org/jira/browse/SPARK-33370 Project: Spark