[jira] [Resolved] (SPARK-31623) Benchmark rebasing of INT96 and TIMESTAMP_MILLIS timestamps in read/write

2020-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31623. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28431

[jira] [Assigned] (SPARK-31623) Benchmark rebasing of INT96 and TIMESTAMP_MILLIS timestamps in read/write

2020-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31623: --- Assignee: Maxim Gekk > Benchmark rebasing of INT96 and TIMESTAMP_MILLIS timestamps in

[jira] [Commented] (SPARK-31579) Replace floorDiv by / in localRebaseGregorianToJulianDays()

2020-05-04 Thread Sudharshann D. (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099493#comment-17099493 ] Sudharshann D. commented on SPARK-31579: May I please work on this? > Replace floorDiv by / in

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099462#comment-17099462 ] Apache Spark commented on SPARK-27963: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099461#comment-17099461 ] Apache Spark commented on SPARK-27963: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31639. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28450

[jira] [Assigned] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31639: - Assignee: Maxim Gekk > Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099372#comment-17099372 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099371#comment-17099371 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Created] (SPARK-31640) Support SHOW PARTITIONS for DataSource V2 tables

2020-05-04 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31640: --- Summary: Support SHOW PARTITIONS for DataSource V2 tables Key: SPARK-31640 URL: https://issues.apache.org/jira/browse/SPARK-31640 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31639: Assignee: (was: Apache Spark) > Revert SPARK-27528 Use Parquet logical type

[jira] [Commented] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099264#comment-17099264 ] Apache Spark commented on SPARK-31639: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31639: Assignee: Apache Spark > Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by

[jira] [Created] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31639: - Summary: Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default Key: SPARK-31639 URL: https://issues.apache.org/jira/browse/SPARK-31639 Project:

[jira] [Updated] (SPARK-31639) Revert SPARK-27528 Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31639: -- Reporter: Maxim Gekk (was: Dongjoon Hyun) > Revert SPARK-27528 Use Parquet logical type

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099259#comment-17099259 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099257#comment-17099257 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-27528) Use Parquet logical type TIMESTAMP_MICROS by default

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099226#comment-17099226 ] Apache Spark commented on SPARK-27528: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099171#comment-17099171 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31636: Assignee: Apache Spark > Remove HTML syntax in SQL reference >

[jira] [Assigned] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31636: Assignee: (was: Apache Spark) > Remove HTML syntax in SQL reference >

[jira] [Commented] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099169#comment-17099169 ] Apache Spark commented on SPARK-31636: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099100#comment-17099100 ] Apache Spark commented on SPARK-31638: -- User 'iRakson' has created a pull request for this issue:

[jira] [Commented] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099096#comment-17099096 ] Apache Spark commented on SPARK-31638: -- User 'iRakson' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31638: Assignee: (was: Apache Spark) > Clean code for pagination for all pages >

[jira] [Assigned] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31638: Assignee: Apache Spark > Clean code for pagination for all pages >

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Description: Clean code for pagination for different pages of spark webUI (was: Clean code

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Description: Clean code for pagination for different pages of spark web > Clean code for

[jira] [Created] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
Rakesh Raushan created SPARK-31638: -- Summary: Clean code for pagination for all pages Key: SPARK-31638 URL: https://issues.apache.org/jira/browse/SPARK-31638 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31638) Clean code for pagination for all pages

2020-05-04 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-31638: --- Environment: (was: Clean code for pagination for different pages of webUI) > Clean

[jira] [Created] (SPARK-31637) Stage Level Scheduling UI - add tooltips for resource profile ino

2020-05-04 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-31637: - Summary: Stage Level Scheduling UI - add tooltips for resource profile ino Key: SPARK-31637 URL: https://issues.apache.org/jira/browse/SPARK-31637 Project: Spark

[jira] [Resolved] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31633. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28446

[jira] [Assigned] (SPARK-31633) Upgrade SLF4J from 1.7.16 to 1.7.30

2020-05-04 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31633: - Assignee: Dongjoon Hyun > Upgrade SLF4J from 1.7.16 to 1.7.30 >

[jira] [Created] (SPARK-31636) Remove HTML syntax in SQL reference

2020-05-04 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-31636: -- Summary: Remove HTML syntax in SQL reference Key: SPARK-31636 URL: https://issues.apache.org/jira/browse/SPARK-31636 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-31585) Support Z-order curve

2020-05-04 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-31585: Description: Z-ordering is a technique that allows you to map multidimensional data to a single

[jira] [Updated] (SPARK-31629) "py4j.protocol.Py4JJavaError: An error occurred while calling o90.save" in pyspark 2.3.1

2020-05-04 Thread appleyuchi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] appleyuchi updated SPARK-31629: --- Component/s: (was: Java API) PySpark > "py4j.protocol.Py4JJavaError: An error

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class

[jira] [Resolved] (SPARK-31624) SHOW TBLPROPERTIES doesn't handle Session Catalog correctly

2020-05-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31624. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28434

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java} case class

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:    Please have a look at the example below:  {code:java}   case class

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:  Please have a look at the example below:  {code:java}   case class

[jira] [Updated] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George George updated SPARK-31635: -- Description:    Please have a look at the example below:  {code:java}   case class

[jira] [Created] (SPARK-31635) Spark SQL Sort fails when sorting big data points

2020-05-04 Thread George George (Jira)
George George created SPARK-31635: - Summary: Spark SQL Sort fails when sorting big data points Key: SPARK-31635 URL: https://issues.apache.org/jira/browse/SPARK-31635 Project: Spark Issue

[jira] [Updated] (SPARK-31590) Metadata-only queries should not include subquery in partition filters

2020-05-04 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-31590: --- Summary: Metadata-only queries should not include subquery in partition filters (was: The filter used by

[jira] [Commented] (SPARK-26385) YARN - Spark Stateful Structured streaming HDFS_DELEGATION_TOKEN not found in cache

2020-05-04 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098723#comment-17098723 ] Jungtaek Lim commented on SPARK-26385: -- [~rajeevkumar] Yes please raise a separate JIRA issue.

[jira] [Resolved] (SPARK-31606) reduce the perf regression of vectorized parquet reader caused by datetime rebase

2020-05-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31606. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28406

[jira] [Resolved] (SPARK-31626) Port HIVE-10415: hive.start.cleanup.scratchdir configuration is not taking effect

2020-05-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31626. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28436

[jira] [Assigned] (SPARK-31626) Port HIVE-10415: hive.start.cleanup.scratchdir configuration is not taking effect

2020-05-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31626: Assignee: Yuming Wang > Port HIVE-10415: hive.start.cleanup.scratchdir configuration is