[jira] [Commented] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17463048#comment-17463048 ] jiaan.geng commented on SPARK-37702: I'm working on. > Support ANSI Aggregate Funct

[jira] [Created] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2021-12-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37702: -- Summary: Support ANSI Aggregate Function: regr_syy Key: SPARK-37702 URL: https://issues.apache.org/jira/browse/SPARK-37702 Project: Spark Issue Type: Sub-task

[jira] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681 ] jiaan.geng deleted comment on SPARK-37681: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_sxy > - > >

[jira] [Assigned] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37701: Assignee: (was: Apache Spark) > Implement `ps.to_timedelta` method >

[jira] [Commented] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17463013#comment-17463013 ] Apache Spark commented on SPARK-37701: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37701: Assignee: Apache Spark > Implement `ps.to_timedelta` method > ---

[jira] [Created] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-37701: Summary: Implement `ps.to_timedelta` method Key: SPARK-37701 URL: https://issues.apache.org/jira/browse/SPARK-37701 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462968#comment-17462968 ] Apache Spark commented on SPARK-37700: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37700: Assignee: (was: Apache Spark) > Add LoggingSuite and some improvements >

[jira] [Assigned] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37700: Assignee: Apache Spark > Add LoggingSuite and some improvements > ---

[jira] [Created] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-37700: --- Summary: Add LoggingSuite and some improvements Key: SPARK-37700 URL: https://issues.apache.org/jira/browse/SPARK-37700 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37681: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_sxy > -

[jira] [Commented] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462920#comment-17462920 ] Apache Spark commented on SPARK-37681: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462919#comment-17462919 ] Apache Spark commented on SPARK-37681: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37681: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_sxy >

[jira] [Commented] (SPARK-37692) sql-migration-guide wrong description

2021-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462897#comment-17462897 ] Hyukjin Kwon commented on SPARK-37692: -- cc [~maxgekk] FYI > sql-migration-guide wr

[jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37694: Assignee: Kent Yao > Disallow delete resources in spark sql cli > ---

[jira] [Resolved] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37694. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34960 [https://gi

[jira] [Assigned] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37699: Assignee: Apache Spark > Fix failed K8S integration test in SparkConfPropagateSuite > ---

[jira] [Assigned] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37699: Assignee: (was: Apache Spark) > Fix failed K8S integration test in SparkConfPropagate

[jira] [Commented] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462884#comment-17462884 ] Apache Spark commented on SPARK-37699: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-37699: --- Summary: Fix failed K8S integration test in SparkConfPropagateSuite Key: SPARK-37699 URL: https://issues.apache.org/jira/browse/SPARK-37699 Project: Spark Issu

[jira] [Resolved] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return

2021-12-20 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-37678. --- Fix Version/s: 3.2.1 3.3.0 Assignee: Maciej Szymkiewicz Re

[jira] [Resolved] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37698. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34962 [https://

[jira] [Assigned] (SPARK-37698) Update ORC to 1.7.2

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37698: - Assignee: William Hyun > Update ORC to 1.7.2 > --- > >

[jira] [Updated] (SPARK-37698) Update ORC to 1.7.2

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37698: -- Summary: Update ORC to 1.7.2 (was: Update orc to 1.7.2) > Update ORC to 1.7.2 > -

[jira] [Assigned] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37698: Assignee: (was: Apache Spark) > Update orc to 1.7.2 > --- > >

[jira] [Commented] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462807#comment-17462807 ] Apache Spark commented on SPARK-37698: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37698: Assignee: Apache Spark > Update orc to 1.7.2 > --- > > Ke

[jira] [Commented] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462806#comment-17462806 ] Apache Spark commented on SPARK-37698: -- User 'williamhyun' has created a pull reque

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462805#comment-17462805 ] Nicholas Chammas commented on SPARK-5997: - [~tenstriker] - I believe in your case

[jira] (SPARK-5997) Increase partition count without performing a shuffle

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5997 ] Nicholas Chammas deleted comment on SPARK-5997: - was (Author: nchammas): [~tenstriker] - I believe in your case you should be able to set {{spark.sql.files.maxRecordsPerFile}} to some num

[jira] [Created] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread William Hyun (Jira)
William Hyun created SPARK-37698: Summary: Update orc to 1.7.2 Key: SPARK-37698 URL: https://issues.apache.org/jira/browse/SPARK-37698 Project: Spark Issue Type: Improvement Compone

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462767#comment-17462767 ] Dongjoon Hyun commented on SPARK-24417: --- Hi, [~chasingegg]. If you are a beginner

[jira] [Created] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes

2021-12-20 Thread Douglas Moore (Jira)
Douglas Moore created SPARK-37697: - Summary: Make it easier to convert numpy arrays to Spark Dataframes Key: SPARK-37697 URL: https://issues.apache.org/jira/browse/SPARK-37697 Project: Spark

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462718#comment-17462718 ] Nicholas Chammas commented on SPARK-24853: -- I would expect something like that

[jira] [Resolved] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

2021-12-20 Thread Kellan B Cummings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings resolved SPARK-37667. --- Resolution: Fixed > Spark throws TreeNodeException ("Couldn't find gen_alias") durin

[jira] [Updated] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

2021-12-20 Thread Kellan B Cummings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings updated SPARK-37667: -- Fix Version/s: 3.2.0 > Spark throws TreeNodeException ("Couldn't find gen_alias") duri

[jira] [Commented] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

2021-12-20 Thread Kellan B Cummings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462677#comment-17462677 ] Kellan B Cummings commented on SPARK-37667: --- Seems like it's working in Spark

[jira] [Resolved] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37693. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34958 [https://gith

[jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37693: --- Assignee: Yang Jie > Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3

[jira] [Commented] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462599#comment-17462599 ] Apache Spark commented on SPARK-37695: -- User 'pan3793' has created a pull request f

[jira] [Assigned] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37695: Assignee: (was: Apache Spark) > Skip diagnosis ob merged blocks from push-based shuff

[jira] [Assigned] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37695: Assignee: Apache Spark > Skip diagnosis ob merged blocks from push-based shuffle > --

[jira] [Commented] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462598#comment-17462598 ] Apache Spark commented on SPARK-37695: -- User 'pan3793' has created a pull request f

[jira] [Updated] (SPARK-37696) Optimizer exceeds max iterations

2021-12-20 Thread Denis Tarima (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Tarima updated SPARK-37696: - Description: A specific scenario causing Spark's failure in tests and a warning in production:

[jira] [Created] (SPARK-37696) Optimizer exceeds max iterations

2021-12-20 Thread Denis Tarima (Jira)
Denis Tarima created SPARK-37696: Summary: Optimizer exceeds max iterations Key: SPARK-37696 URL: https://issues.apache.org/jira/browse/SPARK-37696 Project: Spark Issue Type: Bug Co

[jira] [Updated] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-37695: - Description: Shuffle  {code:java} 21/12/19 18:46:37 WARN TaskSetManager: Lost task 166.0 in stage 1921.0 (TID 1

[jira] [Updated] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-37695: - Description: Shuffle corruption diagnosis for push-based shuffle hasn't been supported yet. So we should skip d

[jira] [Created] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread wuyi (Jira)
wuyi created SPARK-37695: Summary: Skip diagnosis ob merged blocks from push-based shuffle Key: SPARK-37695 URL: https://issues.apache.org/jira/browse/SPARK-37695 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2021-12-20 Thread Chao Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462582#comment-17462582 ] Chao Gao commented on SPARK-24417: -- Hello,I'm a beginner to Spark. I'm wondering how to

[jira] [Commented] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462490#comment-17462490 ] Apache Spark commented on SPARK-37694: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37694: Assignee: (was: Apache Spark) > Disallow delete resources in spark sql cli >

[jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37694: Assignee: Apache Spark > Disallow delete resources in spark sql cli > ---

[jira] [Commented] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462489#comment-17462489 ] Apache Spark commented on SPARK-37694: -- User 'yaooqinn' has created a pull request

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462488#comment-17462488 ] Apache Spark commented on SPARK-6305: - User 'viirya' has created a pull request for t

[jira] [Created] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-37694: Summary: Disallow delete resources in spark sql cli Key: SPARK-37694 URL: https://issues.apache.org/jira/browse/SPARK-37694 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-37689) Expand should be supported PropagateEmptyRelation

2021-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37689. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34954 [https://gith

[jira] [Assigned] (SPARK-37689) Expand should be supported PropagateEmptyRelation

2021-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37689: --- Assignee: angerszhu > Expand should be supported PropagateEmptyRelation > -

[jira] [Updated] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-12-20 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-34763: Affects Version/s: (was: 2.4.7) (was: 3.0.2) > col(), $"" and df("name") sh

[jira] [Commented] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462473#comment-17462473 ] Apache Spark commented on SPARK-37693: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37693: Assignee: (was: Apache Spark) > Fix ChildProcAppHandleSuite failed in spark-master-te

[jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37693: Assignee: Apache Spark > Fix ChildProcAppHandleSuite failed in spark-master-test-maven-ha

[jira] [Created] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-37693: Summary: Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2 Key: SPARK-37693 URL: https://issues.apache.org/jira/browse/SPARK-37693 Project: Spark

[jira] [Resolved] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

2021-12-20 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-36406. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33628

[jira] [Assigned] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

2021-12-20 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-36406: -- Assignee: Yang Jie > No longer do file truncate operation before delete a wri

[jira] [Updated] (SPARK-37692) sql-migration-guide wrong description

2021-12-20 Thread JacobZheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JacobZheng updated SPARK-37692: --- Description: Description in the documentation: {code:java} In Spark 3.2, the unit list interval lite

[jira] [Created] (SPARK-37692) sql-migration-guide wrong description

2021-12-20 Thread JacobZheng (Jira)
JacobZheng created SPARK-37692: -- Summary: sql-migration-guide wrong description Key: SPARK-37692 URL: https://issues.apache.org/jira/browse/SPARK-37692 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37691: --- Description: PERCENTILE_DISC is an ANSI aggregate function. many database support it. > Support ANS

[jira] [Created] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37691: -- Summary: Support ANSI Aggregation Function: percentile_disc Key: SPARK-37691 URL: https://issues.apache.org/jira/browse/SPARK-37691 Project: Spark Issue Type: Ne

[jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462452#comment-17462452 ] Apache Spark commented on SPARK-37668: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37668: Assignee: (was: Apache Spark) > 'Index' object has no attribute 'levels' in > pyspa

[jira] [Assigned] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37668: Assignee: Apache Spark > 'Index' object has no attribute 'levels' in > pyspark.pandas.f

[jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462449#comment-17462449 ] Apache Spark commented on SPARK-37668: -- User 'itholic' has created a pull request f

[jira] [Comment Edited] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working

2021-12-20 Thread Bhavya Raj Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462441#comment-17462441 ] Bhavya Raj Sharma edited comment on SPARK-37660 at 12/20/21, 8:09 AM:

[jira] [Commented] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working

2021-12-20 Thread Bhavya Raj Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462441#comment-17462441 ] Bhavya Raj Sharma commented on SPARK-37660: --- We ae not getting any exception,

[jira] [Assigned] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37688: Assignee: Apache Spark > ExecutorMonitor should ignore SparkListenerBlockUpdated event if

[jira] [Commented] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462437#comment-17462437 ] Apache Spark commented on SPARK-37688: -- User 'sleep1661' has created a pull request

[jira] [Assigned] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37688: Assignee: (was: Apache Spark) > ExecutorMonitor should ignore SparkListenerBlockUpdat