[jira] [Updated] (SPARK-34416) Support avroSchemaUrl in addition to avroSchema

2021-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34416: - Affects Version/s: (was: 2.4.0) (was: 2.3.0) > Support avroSchema

[jira] [Updated] (SPARK-34416) Support avroSchemaUrl in addition to avroSchema

2021-02-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34416: - Issue Type: Improvement (was: Bug) > Support avroSchemaUrl in addition to avroSchema >

[jira] [Commented] (SPARK-34429) KMeansSummary class is omitted from PySpark documentation

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284082#comment-17284082 ] Apache Spark commented on SPARK-34429: -- User 'JohnHBauer' has created a pull reques

[jira] [Commented] (SPARK-34429) KMeansSummary class is omitted from PySpark documentation

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284081#comment-17284081 ] Apache Spark commented on SPARK-34429: -- User 'JohnHBauer' has created a pull reques

[jira] [Assigned] (SPARK-34429) KMeansSummary class is omitted from PySpark documentation

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34429: Assignee: (was: Apache Spark) > KMeansSummary class is omitted from PySpark documenta

[jira] [Assigned] (SPARK-34429) KMeansSummary class is omitted from PySpark documentation

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34429: Assignee: Apache Spark > KMeansSummary class is omitted from PySpark documentation >

[jira] [Updated] (SPARK-34429) KMeansSummary class is omitted from PySpark documentation

2021-02-12 Thread John Bauer (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Bauer updated SPARK-34429: --- Summary: KMeansSummary class is omitted from PySpark documentation (was: KMeansSummary class is omi

[jira] [Created] (SPARK-34429) KMeansSummary class is omitted from PySPark documentation

2021-02-12 Thread John Bauer (Jira)
John Bauer created SPARK-34429: -- Summary: KMeansSummary class is omitted from PySPark documentation Key: SPARK-34429 URL: https://issues.apache.org/jira/browse/SPARK-34429 Project: Spark Issue T

[jira] [Comment Edited] (SPARK-34427) Session window support in SS

2021-02-12 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284076#comment-17284076 ] L. C. Hsieh edited comment on SPARK-34427 at 2/13/21, 4:00 AM: ---

[jira] [Commented] (SPARK-34427) Session window support in SS

2021-02-12 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284076#comment-17284076 ] L. C. Hsieh commented on SPARK-34427: - Thanks for the quick feedback. I didn't find

[jira] [Assigned] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34428: - Assignee: William Hyun > Update sbt version to 1.4.7 > --- > >

[jira] [Resolved] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34428. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31555 [https://

[jira] [Resolved] (SPARK-34380) Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES

2021-02-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34380. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31494 [https://

[jira] [Assigned] (SPARK-34380) Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES

2021-02-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34380: - Assignee: Terry Kim > Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES > --

[jira] [Commented] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284053#comment-17284053 ] Apache Spark commented on SPARK-34428: -- User 'williamhyun' has created a pull reque

[jira] [Commented] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284052#comment-17284052 ] Apache Spark commented on SPARK-34428: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34428: Assignee: (was: Apache Spark) > Update sbt version to 1.4.7 > ---

[jira] [Assigned] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34428: Assignee: Apache Spark > Update sbt version to 1.4.7 > --- > >

[jira] [Created] (SPARK-34428) Update sbt version to 1.4.7

2021-02-12 Thread William Hyun (Jira)
William Hyun created SPARK-34428: Summary: Update sbt version to 1.4.7 Key: SPARK-34428 URL: https://issues.apache.org/jira/browse/SPARK-34428 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-34425) Improve error message in default spark session catalog

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34425: Assignee: Apache Spark (was: Holden Karau) > Improve error message in default spark sess

[jira] [Commented] (SPARK-34425) Improve error message in default spark session catalog

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284046#comment-17284046 ] Apache Spark commented on SPARK-34425: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-34425) Improve error message in default spark session catalog

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34425: Assignee: Holden Karau (was: Apache Spark) > Improve error message in default spark sess

[jira] [Assigned] (SPARK-34418) Check v1 TRUNCATE TABLE preserves partitions

2021-02-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34418: - Assignee: Maxim Gekk > Check v1 TRUNCATE TABLE preserves partitions > -

[jira] [Resolved] (SPARK-34418) Check v1 TRUNCATE TABLE preserves partitions

2021-02-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34418. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31544 [https://

[jira] [Commented] (SPARK-34427) Session window support in SS

2021-02-12 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284041#comment-17284041 ] Jungtaek Lim commented on SPARK-34427: -- You'd need to provide the actual use case (

[jira] [Commented] (SPARK-34427) Session window support in SS

2021-02-12 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284038#comment-17284038 ] Jungtaek Lim commented on SPARK-34427: -- Duplicate of SPARK-10816. I'm happy to revi

[jira] [Commented] (SPARK-34427) Session window support in SS

2021-02-12 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284033#comment-17284033 ] L. C. Hsieh commented on SPARK-34427: - cc [~dbtsai] > Session window support in SS

[jira] [Created] (SPARK-34427) Session window support in SS

2021-02-12 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-34427: --- Summary: Session window support in SS Key: SPARK-34427 URL: https://issues.apache.org/jira/browse/SPARK-34427 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-34426) Add driver and executors POD logs to integration-tests log when the test fails

2021-02-12 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-34426: -- Summary: Add driver and executors POD logs to integration-tests log when the test fails Key: SPARK-34426 URL: https://issues.apache.org/jira/browse/SPARK-34426

[jira] [Commented] (SPARK-34426) Add driver and executors POD logs to integration-tests log when the test fails

2021-02-12 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283974#comment-17283974 ] Attila Zsolt Piros commented on SPARK-34426: I am working on this. > Add dr

[jira] [Updated] (SPARK-34426) Add driver and executors POD logs to integration tests log when the test fails

2021-02-12 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-34426: --- Summary: Add driver and executors POD logs to integration tests log when the test fa

[jira] [Created] (SPARK-34425) Improve error message in default spark session catalog

2021-02-12 Thread Holden Karau (Jira)
Holden Karau created SPARK-34425: Summary: Improve error message in default spark session catalog Key: SPARK-34425 URL: https://issues.apache.org/jira/browse/SPARK-34425 Project: Spark Issue

[jira] [Assigned] (SPARK-34424) HiveOrcHadoopFsRelationSuite fails with seed 610710213676

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34424: Assignee: (was: Apache Spark) > HiveOrcHadoopFsRelationSuite fails with seed 61071021

[jira] [Assigned] (SPARK-34424) HiveOrcHadoopFsRelationSuite fails with seed 610710213676

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34424: Assignee: Apache Spark > HiveOrcHadoopFsRelationSuite fails with seed 610710213676 >

[jira] [Commented] (SPARK-34424) HiveOrcHadoopFsRelationSuite fails with seed 610710213676

2021-02-12 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283960#comment-17283960 ] Apache Spark commented on SPARK-34424: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34424) HiveOrcHadoopFsRelationSuite fails with seed 610710213676

2021-02-12 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34424: -- Summary: HiveOrcHadoopFsRelationSuite fails with seed 610710213676 Key: SPARK-34424 URL: https://issues.apache.org/jira/browse/SPARK-34424 Project: Spark Issue T

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-02-12 Thread Tyson Condie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283737#comment-17283737 ] Tyson Condie edited comment on SPARK-4105 at 2/12/21, 2:47 PM:

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2021-02-12 Thread Tyson Condie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283737#comment-17283737 ] Tyson Condie commented on SPARK-4105: - [~joshrosen] We just experienced a similar sta

[jira] [Comment Edited] (SPARK-34389) Spark job on Kubernetes scheduled For Zero or less than minimum number of executors and Wait indefinitely under resource starvation

2021-02-12 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282614#comment-17282614 ] Attila Zsolt Piros edited comment on SPARK-34389 at 2/12/21, 8:36 AM: