[jira] [Created] (SPARK-32949) Add timestamp_seconds to SparkR

Maciej Szymkiewicz created SPARK-32949: -- Summary: Add timestamp_seconds to SparkR Key: SPARK-32949 URL: https://issues.apache.org/jira/browse/SPARK-32949 Project: Spark Issue Type: Impro

[jira] [Created] (SPARK-32948) Optimize Json expression chain

L. C. Hsieh created SPARK-32948: --- Summary: Optimize Json expression chain Key: SPARK-32948 URL: https://issues.apache.org/jira/browse/SPARK-32948 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-32096) Improve sorting performance for Spark SQL rank window function​

[ https://issues.apache.org/jira/browse/SPARK-32096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-32096: -- Description: Spark SQL rank window function needs to sort the data in each window partition,  and it relies on

[jira] [Created] (SPARK-32947) Support top-N sort for Spark SQL window function

Zikun created SPARK-32947: - Summary: Support top-N sort for Spark SQL window function Key: SPARK-32947 URL: https://issues.apache.org/jira/browse/SPARK-32947 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-32189) Development - Setting up PyCharm

[ https://issues.apache.org/jira/browse/SPARK-32189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32189. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29781 [https://gi

[jira] [Commented] (SPARK-32937) DecomissionSuite in k8s integration tests is failing.

[ https://issues.apache.org/jira/browse/SPARK-32937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199125#comment-17199125 ] wuyi commented on SPARK-32937: -- I'm looking at it. Thanks for reporting! > DecomissionSuit

[jira] [Updated] (SPARK-32821) cannot group by with window in sql statement for structured streaming with watermark

[ https://issues.apache.org/jira/browse/SPARK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Bai updated SPARK-32821: --- Attachment: the watermark grammer.md > cannot group by with window in sql statement for structured s

[jira] [Commented] (SPARK-32821) cannot group by with window in sql statement for structured streaming with watermark

[ https://issues.apache.org/jira/browse/SPARK-32821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199110#comment-17199110 ] Johnny Bai commented on SPARK-32821: [~hyukjin.kwon] sorry, I'm busy recently, I sho

[jira] [Assigned] (SPARK-32799) Make unionByName optionally fill missing columns with nulls in SparkR

[ https://issues.apache.org/jira/browse/SPARK-32799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32799: Assignee: Maciej Szymkiewicz > Make unionByName optionally fill missing columns with null

[jira] [Resolved] (SPARK-32799) Make unionByName optionally fill missing columns with nulls in SparkR

[ https://issues.apache.org/jira/browse/SPARK-32799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32799. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29813 [https://gi

[jira] [Updated] (SPARK-32932) AQE local shuffle reader breaks repartitioning for dynamic partition overwrite

[ https://issues.apache.org/jira/browse/SPARK-32932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang updated SPARK-32932: --- Priority: Major (was: Minor) > AQE local shuffle reader breaks repartitioning for dynamic partition

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199064#comment-17199064 ] Alex Hoffer commented on SPARK-19335: - +1, this would be really helpful. We have agg

[jira] [Comment Edited] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199041#comment-17199041 ] Aman Rastogi edited comment on SPARK-32778 at 9/20/20, 4:22 PM: --

[jira] [Comment Edited] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199041#comment-17199041 ] Aman Rastogi edited comment on SPARK-32778 at 9/20/20, 4:22 PM: --

[jira] [Comment Edited] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199041#comment-17199041 ] Aman Rastogi edited comment on SPARK-32778 at 9/20/20, 4:21 PM: --

[jira] [Commented] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199041#comment-17199041 ] Aman Rastogi commented on SPARK-32778: -- This does not look like a bug, it is by des