[jira] [Created] (SPARK-35281) StaticInvoke should not apply boxing if return type is primitive

2021-04-30 Thread Chao Sun (Jira)
Chao Sun created SPARK-35281: Summary: StaticInvoke should not apply boxing if return type is primitive Key: SPARK-35281 URL: https://issues.apache.org/jira/browse/SPARK-35281 Project: Spark Iss

[jira] [Updated] (SPARK-35281) StaticInvoke should not apply boxing if return type is primitive

2021-04-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-35281: - Priority: Minor (was: Major) > StaticInvoke should not apply boxing if return type is primitive > -

[jira] [Commented] (SPARK-35054) Getting Critical Vulnerability CVE-2021-20231 on spark 3.0.0 branch

2021-04-30 Thread Shashank Jain (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337161#comment-17337161 ] Shashank Jain commented on SPARK-35054: --- hi [~dongjoon] / [~hyukjin.kwon] can you

[jira] [Assigned] (SPARK-35264) Support AQE side broadcastJoin threshold

2021-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35264: --- Assignee: ulysses you > Support AQE side broadcastJoin threshold >

[jira] [Resolved] (SPARK-35264) Support AQE side broadcastJoin threshold

2021-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35264. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32391 [https://gith

[jira] [Created] (SPARK-35282) Support AQE side shuffled hash join formula

2021-04-30 Thread ulysses you (Jira)
ulysses you created SPARK-35282: --- Summary: Support AQE side shuffled hash join formula Key: SPARK-35282 URL: https://issues.apache.org/jira/browse/SPARK-35282 Project: Spark Issue Type: New Fea

[jira] [Created] (SPARK-35283) Support query some DDL with CTES

2021-04-30 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-35283: -- Summary: Support query some DDL with CTES Key: SPARK-35283 URL: https://issues.apache.org/jira/browse/SPARK-35283 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-35284) Kubernetes Fabric exception with Scala programs in Spark 3.x

2021-04-30 Thread Ketan Doshi (Jira)
Ketan Doshi created SPARK-35284: --- Summary: Kubernetes Fabric exception with Scala programs in Spark 3.x Key: SPARK-35284 URL: https://issues.apache.org/jira/browse/SPARK-35284 Project: Spark I

[jira] [Created] (SPARK-35285) Parse ANSI interval types in SQL

2021-04-30 Thread Max Gekk (Jira)
Max Gekk created SPARK-35285: Summary: Parse ANSI interval types in SQL Key: SPARK-35285 URL: https://issues.apache.org/jira/browse/SPARK-35285 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-35285) Parse ANSI interval types in SQL

2021-04-30 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337441#comment-17337441 ] Max Gekk commented on SPARK-35285: -- I am working on this sub-task. > Parse ANSI interv

[jira] [Assigned] (SPARK-35285) Parse ANSI interval types in SQL

2021-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35285: Assignee: Apache Spark (was: Max Gekk) > Parse ANSI interval types in SQL >

[jira] [Commented] (SPARK-35285) Parse ANSI interval types in SQL

2021-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337443#comment-17337443 ] Apache Spark commented on SPARK-35285: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-35285) Parse ANSI interval types in SQL

2021-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35285: Assignee: Max Gekk (was: Apache Spark) > Parse ANSI interval types in SQL >

[jira] [Updated] (SPARK-35264) Support AQE side broadcastJoin threshold

2021-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35264: -- Parent: SPARK-33828 Issue Type: Sub-task (was: New Feature) > Support AQE side broadc

[jira] [Commented] (SPARK-35054) Getting Critical Vulnerability CVE-2021-20231 on spark 3.0.0 branch

2021-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337470#comment-17337470 ] Dongjoon Hyun commented on SPARK-35054: --- [~jainshasha]. We recommend to use the la

[jira] [Commented] (SPARK-34805) PySpark loses metadata in DataFrame fields when selecting nested columns

2021-04-30 Thread Michel Trottier-McDonald (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337491#comment-17337491 ] Michel Trottier-McDonald commented on SPARK-34805: -- I believe this is n

[jira] [Resolved] (SPARK-35280) Promote KubernetesUtils to DeveloperApi

2021-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35280. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32406 [https://

[jira] [Assigned] (SPARK-35280) Promote KubernetesUtils to DeveloperApi

2021-04-30 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35280: - Assignee: Dongjoon Hyun > Promote KubernetesUtils to DeveloperApi > ---

[jira] [Commented] (SPARK-35265) abs return negative

2021-04-30 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337571#comment-17337571 ] Saurabh Chawla commented on SPARK-35265: This is not the bug check this scenario

[jira] [Comment Edited] (SPARK-35265) abs return negative

2021-04-30 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337571#comment-17337571 ] Saurabh Chawla edited comment on SPARK-35265 at 4/30/21, 6:44 PM:

[jira] [Commented] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

2021-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337732#comment-17337732 ] Apache Spark commented on SPARK-28551: -- User 'vinodkc' has created a pull request f

[jira] [Commented] (SPARK-28551) CTAS SQL with LOCATION properties won't check location path, cause data under this location lose

2021-04-30 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17337731#comment-17337731 ] Apache Spark commented on SPARK-28551: -- User 'vinodkc' has created a pull request f

[jira] [Assigned] (SPARK-35273) CombineFilters support non-deterministic expressions

2021-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35273: --- Assignee: Yuming Wang > CombineFilters support non-deterministic expressions >

[jira] [Resolved] (SPARK-35273) CombineFilters support non-deterministic expressions

2021-04-30 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35273. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32405 [https://gith