[jira] [Assigned] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31765: Assignee: (was: Apache Spark) > Upgrade HtmlUnit >= 2.37.0 >

[jira] [Assigned] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31765: Assignee: Apache Spark > Upgrade HtmlUnit >= 2.37.0 > -- > >

[jira] [Reopened] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-31765: -- Assignee: (was: Kousuke Saruta) Reverted at

[jira] [Updated] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31765: - Fix Version/s: (was: 3.1.0) > Upgrade HtmlUnit >= 2.37.0 > -- > >

[jira] [Commented] (SPARK-31897) Enable codegen for GenerateExec

[ https://issues.apache.org/jira/browse/SPARK-31897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124603#comment-17124603 ] Apache Spark commented on SPARK-31897: -- User 'karuppayya' has created a pull request for this

[jira] [Assigned] (SPARK-31897) Enable codegen for GenerateExec

[ https://issues.apache.org/jira/browse/SPARK-31897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31897: Assignee: (was: Apache Spark) > Enable codegen for GenerateExec >

[jira] [Commented] (SPARK-31897) Enable codegen for GenerateExec

[ https://issues.apache.org/jira/browse/SPARK-31897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124601#comment-17124601 ] Apache Spark commented on SPARK-31897: -- User 'karuppayya' has created a pull request for this

[jira] [Assigned] (SPARK-31897) Enable codegen for GenerateExec

[ https://issues.apache.org/jira/browse/SPARK-31897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31897: Assignee: Apache Spark > Enable codegen for GenerateExec >

[jira] [Created] (SPARK-31897) Enable codegen for GenerateExec

Karuppayya created SPARK-31897: -- Summary: Enable codegen for GenerateExec Key: SPARK-31897 URL: https://issues.apache.org/jira/browse/SPARK-31897 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-31896) Handle am-pm timestamp parsing when hour is missing

[ https://issues.apache.org/jira/browse/SPARK-31896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124581#comment-17124581 ] Apache Spark commented on SPARK-31896: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31896) Handle am-pm timestamp parsing when hour is missing

[ https://issues.apache.org/jira/browse/SPARK-31896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31896: Assignee: Apache Spark > Handle am-pm timestamp parsing when hour is missing >

[jira] [Assigned] (SPARK-31896) Handle am-pm timestamp parsing when hour is missing

[ https://issues.apache.org/jira/browse/SPARK-31896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31896: Assignee: (was: Apache Spark) > Handle am-pm timestamp parsing when hour is missing

[jira] [Commented] (SPARK-31896) Handle am-pm timestamp parsing when hour is missing

[ https://issues.apache.org/jira/browse/SPARK-31896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124580#comment-17124580 ] Apache Spark commented on SPARK-31896: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-31896) Handle am-pm timestamp parsing when hour is missing

Kent Yao created SPARK-31896: Summary: Handle am-pm timestamp parsing when hour is missing Key: SPARK-31896 URL: https://issues.apache.org/jira/browse/SPARK-31896 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

[ https://issues.apache.org/jira/browse/SPARK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31895. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28711

[jira] [Assigned] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

[ https://issues.apache.org/jira/browse/SPARK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31895: Assignee: Hyukjin Kwon > df.explain("mode") should work in PySpark side as well for

[jira] [Updated] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28067: Target Version/s: (was: 3.0.0) > Incorrect results in decimal aggregation with whole-stage code gen

[jira] [Commented] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

[ https://issues.apache.org/jira/browse/SPARK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124495#comment-17124495 ] Apache Spark commented on SPARK-31895: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

[ https://issues.apache.org/jira/browse/SPARK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124494#comment-17124494 ] Apache Spark commented on SPARK-31895: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

[ https://issues.apache.org/jira/browse/SPARK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31895: Assignee: Apache Spark > df.explain("mode") should work in PySpark side as well for

[jira] [Assigned] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

[ https://issues.apache.org/jira/browse/SPARK-31895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31895: Assignee: (was: Apache Spark) > df.explain("mode") should work in PySpark side as

[jira] [Created] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

Hyukjin Kwon created SPARK-31895: Summary: df.explain("mode") should work in PySpark side as well for consistency Key: SPARK-31895 URL: https://issues.apache.org/jira/browse/SPARK-31895 Project:

[jira] [Resolved] (SPARK-29431) Improve Web UI / Sql tab visualization with cached dataframes.

[ https://issues.apache.org/jira/browse/SPARK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-29431. Resolution: Fixed The issue is resolved in https://github.com/apache/spark/pull/26082 >

[jira] [Assigned] (SPARK-29431) Improve Web UI / Sql tab visualization with cached dataframes.

[ https://issues.apache.org/jira/browse/SPARK-29431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-29431: -- Assignee: Pablo Langa Blanco > Improve Web UI / Sql tab visualization with cached

[jira] [Assigned] (SPARK-31893) Add a generic ClassificationSummary trait

[ https://issues.apache.org/jira/browse/SPARK-31893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31893: Assignee: Apache Spark > Add a generic ClassificationSummary trait >

[jira] [Commented] (SPARK-31893) Add a generic ClassificationSummary trait

[ https://issues.apache.org/jira/browse/SPARK-31893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124441#comment-17124441 ] Apache Spark commented on SPARK-31893: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31893) Add a generic ClassificationSummary trait

[ https://issues.apache.org/jira/browse/SPARK-31893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124442#comment-17124442 ] Apache Spark commented on SPARK-31893: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31893) Add a generic ClassificationSummary trait

[ https://issues.apache.org/jira/browse/SPARK-31893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31893: Assignee: (was: Apache Spark) > Add a generic ClassificationSummary trait >

[jira] [Assigned] (SPARK-31876) Upgrade to Zstd 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-31876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-31876: --- Assignee: William Hyun > Upgrade to Zstd 1.4.5 > - > > Key:

[jira] [Resolved] (SPARK-31876) Upgrade to Zstd 1.4.5

[ https://issues.apache.org/jira/browse/SPARK-31876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-31876. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28682

[jira] [Commented] (SPARK-20629) Copy shuffle data when nodes are being shut down

[ https://issues.apache.org/jira/browse/SPARK-20629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124228#comment-17124228 ] Apache Spark commented on SPARK-20629: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31894) Introduce UnsafeRow format validation for streaming state store

[ https://issues.apache.org/jira/browse/SPARK-31894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31894: Assignee: (was: Apache Spark) > Introduce UnsafeRow format validation for streaming

[jira] [Commented] (SPARK-31894) Introduce UnsafeRow format validation for streaming state store

[ https://issues.apache.org/jira/browse/SPARK-31894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124197#comment-17124197 ] Apache Spark commented on SPARK-31894: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-31894) Introduce UnsafeRow format validation for streaming state store

[ https://issues.apache.org/jira/browse/SPARK-31894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31894: Assignee: Apache Spark > Introduce UnsafeRow format validation for streaming state store

[jira] [Created] (SPARK-31894) Introduce UnsafeRow format validation for streaming state store

Yuanjian Li created SPARK-31894: --- Summary: Introduce UnsafeRow format validation for streaming state store Key: SPARK-31894 URL: https://issues.apache.org/jira/browse/SPARK-31894 Project: Spark

[jira] [Resolved] (SPARK-31778) Support cross-building docker images

[ https://issues.apache.org/jira/browse/SPARK-31778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31778. -- Fix Version/s: 3.1.0 3.0.1 3.0.0 Assignee:

[jira] [Resolved] (SPARK-31860) Only push release tags on success

[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31860. -- Fix Version/s: 2.4.7 3.1.0 3.0.1

[jira] [Comment Edited] (SPARK-31799) Spark Datasource Tables Creating Incorrect Hive Metadata

[ https://issues.apache.org/jira/browse/SPARK-31799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124158#comment-17124158 ] Anoop Johnson edited comment on SPARK-31799 at 6/2/20, 6:09 PM: Sorry to

[jira] [Reopened] (SPARK-31799) Spark Datasource Tables Creating Incorrect Hive Metadata

[ https://issues.apache.org/jira/browse/SPARK-31799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anoop Johnson reopened SPARK-31799: --- Sorry to reopen, but could you please provide some context on why Spark is not able to store

[jira] [Created] (SPARK-31893) Add a generic ClassificationSummary trait

Huaxin Gao created SPARK-31893: -- Summary: Add a generic ClassificationSummary trait Key: SPARK-31893 URL: https://issues.apache.org/jira/browse/SPARK-31893 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31887) Date casting to string is giving wrong value

[ https://issues.apache.org/jira/browse/SPARK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123835#comment-17123835 ] pavithra ramachandran commented on SPARK-31887: --- i would like to check this. > Date

[jira] [Resolved] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31765. -- Fix Version/s: 3.1.0 Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-31765) Upgrade HtmlUnit >= 2.37.0

[ https://issues.apache.org/jira/browse/SPARK-31765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31765: - Priority: Minor (was: Major) > Upgrade HtmlUnit >= 2.37.0 > -- > >

[jira] [Updated] (SPARK-31755) allow missing year/hour when parsing date/timestamp

[ https://issues.apache.org/jira/browse/SPARK-31755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31755: - Fix Version/s: 3.0.0 > allow missing year/hour when parsing date/timestamp >

[jira] [Updated] (SPARK-31888) Support `java.time.Instant` in Parquet filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-31888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31888: Fix Version/s: (was: 3.1.0) 3.0.0 > Support `java.time.Instant` in Parquet

[jira] [Resolved] (SPARK-31834) Improve error message for incompatible data types

[ https://issues.apache.org/jira/browse/SPARK-31834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31834. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28654

[jira] [Resolved] (SPARK-31888) Support `java.time.Instant` in Parquet filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-31888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31888. - Fix Version/s: (was: 3.0.0) 3.1.0 Resolution: Fixed Issue

[jira] [Assigned] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28067: --- Assignee: Sunitha Kambhampati > Incorrect results in decimal aggregation with whole-stage

[jira] [Resolved] (SPARK-28067) Incorrect results in decimal aggregation with whole-stage code gen enabled

[ https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28067. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27627

[jira] [Assigned] (SPARK-31892) Disable week-based date filed for parsing

[ https://issues.apache.org/jira/browse/SPARK-31892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31892: Assignee: Apache Spark > Disable week-based date filed for parsing >

[jira] [Assigned] (SPARK-31892) Disable week-based date filed for parsing

[ https://issues.apache.org/jira/browse/SPARK-31892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31892: Assignee: (was: Apache Spark) > Disable week-based date filed for parsing >

[jira] [Commented] (SPARK-31892) Disable week-based date filed for parsing

[ https://issues.apache.org/jira/browse/SPARK-31892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123565#comment-17123565 ] Apache Spark commented on SPARK-31892: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123557#comment-17123557 ] Apache Spark commented on SPARK-30808: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-30808) Thrift server returns wrong timestamps/dates strings before 1582

[ https://issues.apache.org/jira/browse/SPARK-30808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123555#comment-17123555 ] Apache Spark commented on SPARK-30808: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-31892) Disable week-based date filed for parsing

[ https://issues.apache.org/jira/browse/SPARK-31892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-31892: - Summary: Disable week-based date filed for parsing (was: Disable week-base date filed for parsing) >

[jira] [Assigned] (SPARK-31777) CrossValidator supports user-supplied folds

[ https://issues.apache.org/jira/browse/SPARK-31777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31777: Assignee: (was: Apache Spark) > CrossValidator supports user-supplied folds >

[jira] [Commented] (SPARK-31777) CrossValidator supports user-supplied folds

[ https://issues.apache.org/jira/browse/SPARK-31777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123516#comment-17123516 ] Apache Spark commented on SPARK-31777: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31777) CrossValidator supports user-supplied folds

[ https://issues.apache.org/jira/browse/SPARK-31777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31777: Assignee: Apache Spark > CrossValidator supports user-supplied folds >

[jira] [Created] (SPARK-31892) Disable week-base date filed for parsing

Kent Yao created SPARK-31892: Summary: Disable week-base date filed for parsing Key: SPARK-31892 URL: https://issues.apache.org/jira/browse/SPARK-31892 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-29897) Implicit cast to timestamp is failing

[ https://issues.apache.org/jira/browse/SPARK-29897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29897: Assignee: Apache Spark > Implicit cast to timestamp is failing >

[jira] [Commented] (SPARK-29897) Implicit cast to timestamp is failing

[ https://issues.apache.org/jira/browse/SPARK-29897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123497#comment-17123497 ] Apache Spark commented on SPARK-29897: -- User 'sathyaprakashg' has created a pull request for this

[jira] [Assigned] (SPARK-29897) Implicit cast to timestamp is failing

[ https://issues.apache.org/jira/browse/SPARK-29897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-29897: Assignee: (was: Apache Spark) > Implicit cast to timestamp is failing >

[jira] [Commented] (SPARK-31526) Add a new test suite for ExperssionInfo

[ https://issues.apache.org/jira/browse/SPARK-31526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123481#comment-17123481 ] Apache Spark commented on SPARK-31526: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-31756) Add real headless browser support for UI test

[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123463#comment-17123463 ] Apache Spark commented on SPARK-31756: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-31756) Add real headless browser support for UI test

[ https://issues.apache.org/jira/browse/SPARK-31756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123462#comment-17123462 ] Apache Spark commented on SPARK-31756: -- User 'sarutak' has created a pull request for this issue: