[jira] [Commented] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463048#comment-17463048 ] jiaan.geng commented on SPARK-37702: I'm working on. > Support ANSI Aggregate Function: regr_syy >

[jira] [Created] (SPARK-37702) Support ANSI Aggregate Function: regr_syy

2021-12-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37702: -- Summary: Support ANSI Aggregate Function: regr_syy Key: SPARK-37702 URL: https://issues.apache.org/jira/browse/SPARK-37702 Project: Spark Issue Type: Sub-task

[jira] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681 ] jiaan.geng deleted comment on SPARK-37681: was (Author: beliefer): I'm working on. > Support ANSI Aggregate Function: regr_sxy > - > >

[jira] [Assigned] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37701: Assignee: (was: Apache Spark) > Implement `ps.to_timedelta` method >

[jira] [Commented] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463013#comment-17463013 ] Apache Spark commented on SPARK-37701: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37701: Assignee: Apache Spark > Implement `ps.to_timedelta` method >

[jira] [Created] (SPARK-37701) Implement `ps.to_timedelta` method

2021-12-20 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-37701: Summary: Implement `ps.to_timedelta` method Key: SPARK-37701 URL: https://issues.apache.org/jira/browse/SPARK-37701 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462968#comment-17462968 ] Apache Spark commented on SPARK-37700: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37700: Assignee: (was: Apache Spark) > Add LoggingSuite and some improvements >

[jira] [Assigned] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37700: Assignee: Apache Spark > Add LoggingSuite and some improvements >

[jira] [Created] (SPARK-37700) Add LoggingSuite and some improvements

2021-12-20 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-37700: --- Summary: Add LoggingSuite and some improvements Key: SPARK-37700 URL: https://issues.apache.org/jira/browse/SPARK-37700 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37681: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_sxy >

[jira] [Commented] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462920#comment-17462920 ] Apache Spark commented on SPARK-37681: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462919#comment-17462919 ] Apache Spark commented on SPARK-37681: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37681: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_sxy >

[jira] [Commented] (SPARK-37692) sql-migration-guide wrong description

2021-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462897#comment-17462897 ] Hyukjin Kwon commented on SPARK-37692: -- cc [~maxgekk] FYI > sql-migration-guide wrong description

[jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37694: Assignee: Kent Yao > Disallow delete resources in spark sql cli >

[jira] [Resolved] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37694. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34960

[jira] [Assigned] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37699: Assignee: Apache Spark > Fix failed K8S integration test in SparkConfPropagateSuite >

[jira] [Assigned] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37699: Assignee: (was: Apache Spark) > Fix failed K8S integration test in

[jira] [Commented] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462884#comment-17462884 ] Apache Spark commented on SPARK-37699: -- User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite

2021-12-20 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-37699: --- Summary: Fix failed K8S integration test in SparkConfPropagateSuite Key: SPARK-37699 URL: https://issues.apache.org/jira/browse/SPARK-37699 Project: Spark

[jira] [Resolved] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return

2021-12-20 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-37678. --- Fix Version/s: 3.2.1 3.3.0 Assignee: Maciej Szymkiewicz

[jira] [Resolved] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37698. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34962

[jira] [Assigned] (SPARK-37698) Update ORC to 1.7.2

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37698: - Assignee: William Hyun > Update ORC to 1.7.2 > --- > >

[jira] [Updated] (SPARK-37698) Update ORC to 1.7.2

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37698: -- Summary: Update ORC to 1.7.2 (was: Update orc to 1.7.2) > Update ORC to 1.7.2 >

[jira] [Assigned] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37698: Assignee: (was: Apache Spark) > Update orc to 1.7.2 > --- > >

[jira] [Commented] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462807#comment-17462807 ] Apache Spark commented on SPARK-37698: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37698: Assignee: Apache Spark > Update orc to 1.7.2 > --- > >

[jira] [Commented] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462806#comment-17462806 ] Apache Spark commented on SPARK-37698: -- User 'williamhyun' has created a pull request for this

[jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462805#comment-17462805 ] Nicholas Chammas commented on SPARK-5997: - [~tenstriker] - I believe in your case you should be

[jira] (SPARK-5997) Increase partition count without performing a shuffle

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-5997 ] Nicholas Chammas deleted comment on SPARK-5997: - was (Author: nchammas): [~tenstriker] - I believe in your case you should be able to set {{spark.sql.files.maxRecordsPerFile}} to some

[jira] [Created] (SPARK-37698) Update orc to 1.7.2

2021-12-20 Thread William Hyun (Jira)
William Hyun created SPARK-37698: Summary: Update orc to 1.7.2 Key: SPARK-37698 URL: https://issues.apache.org/jira/browse/SPARK-37698 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2021-12-20 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462767#comment-17462767 ] Dongjoon Hyun commented on SPARK-24417: --- Hi, [~chasingegg]. If you are a beginner to Apache Spark,

[jira] [Created] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes

2021-12-20 Thread Douglas Moore (Jira)
Douglas Moore created SPARK-37697: - Summary: Make it easier to convert numpy arrays to Spark Dataframes Key: SPARK-37697 URL: https://issues.apache.org/jira/browse/SPARK-37697 Project: Spark

[jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis

2021-12-20 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462718#comment-17462718 ] Nicholas Chammas commented on SPARK-24853: -- I would expect something like that to yield an

[jira] [Resolved] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

2021-12-20 Thread Kellan B Cummings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings resolved SPARK-37667. --- Resolution: Fixed > Spark throws TreeNodeException ("Couldn't find gen_alias")

[jira] [Updated] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

2021-12-20 Thread Kellan B Cummings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kellan B Cummings updated SPARK-37667: -- Fix Version/s: 3.2.0 > Spark throws TreeNodeException ("Couldn't find gen_alias")

[jira] [Commented] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion

2021-12-20 Thread Kellan B Cummings (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462677#comment-17462677 ] Kellan B Cummings commented on SPARK-37667: --- Seems like it's working in Spark 3.2. So I guess

[jira] [Resolved] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37693. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34958

[jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37693: --- Assignee: Yang Jie > Fix ChildProcAppHandleSuite failed in

[jira] [Commented] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462599#comment-17462599 ] Apache Spark commented on SPARK-37695: -- User 'pan3793' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37695: Assignee: (was: Apache Spark) > Skip diagnosis ob merged blocks from push-based

[jira] [Assigned] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37695: Assignee: Apache Spark > Skip diagnosis ob merged blocks from push-based shuffle >

[jira] [Commented] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462598#comment-17462598 ] Apache Spark commented on SPARK-37695: -- User 'pan3793' has created a pull request for this issue:

[jira] [Updated] (SPARK-37696) Optimizer exceeds max iterations

2021-12-20 Thread Denis Tarima (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Tarima updated SPARK-37696: - Description: A specific scenario causing Spark's failure in tests and a warning in production:

[jira] [Created] (SPARK-37696) Optimizer exceeds max iterations

2021-12-20 Thread Denis Tarima (Jira)
Denis Tarima created SPARK-37696: Summary: Optimizer exceeds max iterations Key: SPARK-37696 URL: https://issues.apache.org/jira/browse/SPARK-37696 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-37695: - Description: Shuffle  {code:java} 21/12/19 18:46:37 WARN TaskSetManager: Lost task 166.0 in stage 1921.0 (TID

[jira] [Updated] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-37695: - Description: Shuffle corruption diagnosis for push-based shuffle hasn't been supported yet. So we should skip

[jira] [Created] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle

2021-12-20 Thread wuyi (Jira)
wuyi created SPARK-37695: Summary: Skip diagnosis ob merged blocks from push-based shuffle Key: SPARK-37695 URL: https://issues.apache.org/jira/browse/SPARK-37695 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2021-12-20 Thread Chao Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462582#comment-17462582 ] Chao Gao commented on SPARK-24417: -- Hello,I'm a beginner to Spark. I'm wondering how to upgrade Java

[jira] [Commented] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462490#comment-17462490 ] Apache Spark commented on SPARK-37694: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37694: Assignee: (was: Apache Spark) > Disallow delete resources in spark sql cli >

[jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37694: Assignee: Apache Spark > Disallow delete resources in spark sql cli >

[jira] [Commented] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462489#comment-17462489 ] Apache Spark commented on SPARK-37694: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462488#comment-17462488 ] Apache Spark commented on SPARK-6305: - User 'viirya' has created a pull request for this issue:

[jira] [Created] (SPARK-37694) Disallow delete resources in spark sql cli

2021-12-20 Thread Kent Yao (Jira)
Kent Yao created SPARK-37694: Summary: Disallow delete resources in spark sql cli Key: SPARK-37694 URL: https://issues.apache.org/jira/browse/SPARK-37694 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-37689) Expand should be supported PropagateEmptyRelation

2021-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37689. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34954

[jira] [Assigned] (SPARK-37689) Expand should be supported PropagateEmptyRelation

2021-12-20 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37689: --- Assignee: angerszhu > Expand should be supported PropagateEmptyRelation >

[jira] [Updated] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly.

2021-12-20 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-34763: Affects Version/s: (was: 2.4.7) (was: 3.0.2) > col(), $"" and df("name")

[jira] [Commented] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462473#comment-17462473 ] Apache Spark commented on SPARK-37693: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37693: Assignee: (was: Apache Spark) > Fix ChildProcAppHandleSuite failed in

[jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37693: Assignee: Apache Spark > Fix ChildProcAppHandleSuite failed in

[jira] [Created] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2

2021-12-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-37693: Summary: Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2 Key: SPARK-37693 URL: https://issues.apache.org/jira/browse/SPARK-37693 Project: Spark

[jira] [Resolved] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

2021-12-20 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-36406. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter

2021-12-20 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-36406: -- Assignee: Yang Jie > No longer do file truncate operation before delete a

[jira] [Updated] (SPARK-37692) sql-migration-guide wrong description

2021-12-20 Thread JacobZheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JacobZheng updated SPARK-37692: --- Description: Description in the documentation: {code:java} In Spark 3.2, the unit list interval

[jira] [Created] (SPARK-37692) sql-migration-guide wrong description

2021-12-20 Thread JacobZheng (Jira)
JacobZheng created SPARK-37692: -- Summary: sql-migration-guide wrong description Key: SPARK-37692 URL: https://issues.apache.org/jira/browse/SPARK-37692 Project: Spark Issue Type: Documentation

[jira] [Updated] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-20 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37691: --- Description: PERCENTILE_DISC is an ANSI aggregate function. many database support it. > Support

[jira] [Created] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc

2021-12-20 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37691: -- Summary: Support ANSI Aggregation Function: percentile_disc Key: SPARK-37691 URL: https://issues.apache.org/jira/browse/SPARK-37691 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462452#comment-17462452 ] Apache Spark commented on SPARK-37668: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37668: Assignee: (was: Apache Spark) > 'Index' object has no attribute 'levels' in >

[jira] [Assigned] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37668: Assignee: Apache Spark > 'Index' object has no attribute 'levels' in >

[jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462449#comment-17462449 ] Apache Spark commented on SPARK-37668: -- User 'itholic' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working

2021-12-20 Thread Bhavya Raj Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462441#comment-17462441 ] Bhavya Raj Sharma edited comment on SPARK-37660 at 12/20/21, 8:09 AM:

[jira] [Commented] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working

2021-12-20 Thread Bhavya Raj Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462441#comment-17462441 ] Bhavya Raj Sharma commented on SPARK-37660: --- We ae not getting any exception, or output. Its

[jira] [Assigned] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37688: Assignee: Apache Spark > ExecutorMonitor should ignore SparkListenerBlockUpdated event

[jira] [Commented] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462437#comment-17462437 ] Apache Spark commented on SPARK-37688: -- User 'sleep1661' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active

2021-12-20 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37688: Assignee: (was: Apache Spark) > ExecutorMonitor should ignore