[jira] [Resolved] (SPARK-33477) Hive partition pruning support date type

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33477. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30408 [https://gi

[jira] [Commented] (SPARK-33548) Peak Execution Memory not display on Spark Executor UI intuitively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238525#comment-17238525 ] Apache Spark commented on SPARK-33548: -- User 'JQ-Cao' has created a pull request fo

[jira] [Assigned] (SPARK-33548) Peak Execution Memory not display on Spark Executor UI intuitively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33548: Assignee: (was: Apache Spark) > Peak Execution Memory not display on Spark Executor U

[jira] [Assigned] (SPARK-33548) Peak Execution Memory not display on Spark Executor UI intuitively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33548: Assignee: Apache Spark > Peak Execution Memory not display on Spark Executor UI intuitive

[jira] [Commented] (SPARK-33548) Peak Execution Memory not display on Spark Executor UI intuitively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238522#comment-17238522 ] Apache Spark commented on SPARK-33548: -- User 'JQ-Cao' has created a pull request fo

[jira] [Updated] (SPARK-31710) Fail casting numeric to timestamp by default

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31710: -- Labels: (was: correctness) > Fail casting numeric to timestamp by default >

[jira] [Commented] (SPARK-33551) Do not use custom shuffle reader for repartition

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238516#comment-17238516 ] Apache Spark commented on SPARK-33551: -- User 'maryannxue' has created a pull reques

[jira] [Assigned] (SPARK-33551) Do not use custom shuffle reader for repartition

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33551: Assignee: Apache Spark > Do not use custom shuffle reader for repartition > -

[jira] [Assigned] (SPARK-33551) Do not use custom shuffle reader for repartition

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33551: Assignee: (was: Apache Spark) > Do not use custom shuffle reader for repartition > --

[jira] [Created] (SPARK-33551) Do not use custom shuffle reader for repartition

2020-11-24 Thread Wei Xue (Jira)
Wei Xue created SPARK-33551: --- Summary: Do not use custom shuffle reader for repartition Key: SPARK-33551 URL: https://issues.apache.org/jira/browse/SPARK-33551 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-33550) Recover hive-service-rpc to built-in Hive version when we upgrade built-in Hive to 3.1.2

2020-11-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33550: Description: https://github.com/apache/spark/pull/30478#discussion_r529179587 > Recover hive-serv

[jira] [Updated] (SPARK-33550) Recover hive-service-rpc to built-in Hive version when we upgrade built-in Hive to 3.1.2

2020-11-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33550: Description: Recover hive-service-rpc to built-in Hive version when we upgrade built-in Hive to 3

[jira] [Created] (SPARK-33550) Recover hive-service-rpc to built-in Hive version when we upgrade built-in Hive to 3.1.2

2020-11-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33550: --- Summary: Recover hive-service-rpc to built-in Hive version when we upgrade built-in Hive to 3.1.2 Key: SPARK-33550 URL: https://issues.apache.org/jira/browse/SPARK-33550

[jira] [Updated] (SPARK-31710) Fail casting numeric to timestamp by default

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31710: -- Labels: correctness (was: ) > Fail casting numeric to timestamp by default >

[jira] [Assigned] (SPARK-33549) Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33549: Assignee: Gengliang Wang (was: Apache Spark) > Remove configuration spark.sql.legacy.all

[jira] [Commented] (SPARK-33549) Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238501#comment-17238501 ] Apache Spark commented on SPARK-33549: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-33549) Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33549: Assignee: Apache Spark (was: Gengliang Wang) > Remove configuration spark.sql.legacy.all

[jira] [Resolved] (SPARK-33533) BasicConnectionProvider should consider case-sensitivity for properties.

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33533. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30485 [https://

[jira] [Assigned] (SPARK-33224) Expose watermark information on SS UI

2020-11-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-33224: Assignee: Jungtaek Lim > Expose watermark information on SS UI >

[jira] [Updated] (SPARK-33533) BasicConnectionProvider should consider case-sensitivity for properties.

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33533: -- Priority: Critical (was: Major) > BasicConnectionProvider should consider case-sensitivity fo

[jira] [Resolved] (SPARK-33224) Expose watermark information on SS UI

2020-11-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33224. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30427 [https://gi

[jira] [Created] (SPARK-33549) Remove configuration spark.sql.legacy.allowCastNumericToTimestamp

2020-11-24 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-33549: -- Summary: Remove configuration spark.sql.legacy.allowCastNumericToTimestamp Key: SPARK-33549 URL: https://issues.apache.org/jira/browse/SPARK-33549 Project: Spark

[jira] [Updated] (SPARK-33542) Group exception messages in catalyst/catalog

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33542: - Summary: Group exception messages in catalyst/catalog (was: Group exceptions in catalyst/catalo

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, there are three major improv

[jira] [Updated] (SPARK-33541) Group exception messages in catalyst/expressions

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33541: - Summary: Group exception messages in catalyst/expressions (was: Group exceptions in catalyst/ex

[jira] [Assigned] (SPARK-33071) Join with ambiguous column succeeding but giving wrong output

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33071: Assignee: Apache Spark > Join with ambiguous column succeeding but giving wrong output >

[jira] [Commented] (SPARK-33071) Join with ambiguous column succeeding but giving wrong output

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238481#comment-17238481 ] Apache Spark commented on SPARK-33071: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-33071) Join with ambiguous column succeeding but giving wrong output

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33071: Assignee: (was: Apache Spark) > Join with ambiguous column succeeding but giving wron

[jira] [Resolved] (SPARK-33543) Migrate SHOW COLUMNS to new resolution framework

2020-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33543. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30490 [https://gith

[jira] [Assigned] (SPARK-33543) Migrate SHOW COLUMNS to new resolution framework

2020-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33543: --- Assignee: Terry Kim > Migrate SHOW COLUMNS to new resolution framework > --

[jira] [Commented] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-24 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238473#comment-17238473 ] L. C. Hsieh commented on SPARK-33544: - Thanks [~hyukjin.kwon]. Will help review if [

[jira] [Commented] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238469#comment-17238469 ] Hyukjin Kwon commented on SPARK-33544: -- cc [~viirya] FYI > explode should not filt

[jira] [Commented] (SPARK-33548) Peak Execution Memory not display on Spark Executor UI intuitively

2020-11-24 Thread xuziqiJS (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238466#comment-17238466 ] xuziqiJS commented on SPARK-33548: -- i will fix it,please assign the task to me  > Peak

[jira] [Created] (SPARK-33548) Peak Execution Memory not display on Spark Executor UI intuitively

2020-11-24 Thread xuziqiJS (Jira)
xuziqiJS created SPARK-33548: Summary: Peak Execution Memory not display on Spark Executor UI intuitively Key: SPARK-33548 URL: https://issues.apache.org/jira/browse/SPARK-33548 Project: Spark I

[jira] [Resolved] (SPARK-33494) Do not use local shuffle reader for repartition

2020-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33494. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30432 [https://gith

[jira] [Created] (SPARK-33547) Doc Type Construct Literal usage

2020-11-24 Thread angerszhu (Jira)
angerszhu created SPARK-33547: - Summary: Doc Type Construct Literal usage Key: SPARK-33547 URL: https://issues.apache.org/jira/browse/SPARK-33547 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33547) Doc Type Construct Literal usage

2020-11-24 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238453#comment-17238453 ] angerszhu commented on SPARK-33547: --- Working on this > Doc Type Construct Literal usa

[jira] [Updated] (SPARK-33546) CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE

2020-11-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33546: Description: Currently there are several inconsistency: # CREATE TABLE LIKE does not validate the

[jira] [Resolved] (SPARK-33252) Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33252. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30413 [https://gi

[jira] [Created] (SPARK-33546) CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE

2020-11-24 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-33546: --- Summary: CREATE TABLE LIKE should resolve hive serde correctly like CREATE TABLE Key: SPARK-33546 URL: https://issues.apache.org/jira/browse/SPARK-33546 Project: Spark

[jira] [Assigned] (SPARK-33252) Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33252: Assignee: Maciej Szymkiewicz > Migration to NumPy documentation style in MLlib (pyspark.m

[jira] [Updated] (SPARK-33252) Migration to NumPy documentation style in MLlib (pyspark.mllib.*)

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33252: - Fix Version/s: (was: 3.2.0) 3.1.0 > Migration to NumPy documentation styl

[jira] [Updated] (SPARK-33534) Allow specifying a minimum number of bytes in a split of a file

2020-11-24 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33534: - Component/s: (was: Input/Output) SQL > Allow specifying a minimum n

[jira] [Assigned] (SPARK-33457) Adjust mypy configuration

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-33457: Assignee: Maciej Szymkiewicz > Adjust mypy configuration > - > >

[jira] [Resolved] (SPARK-33457) Adjust mypy configuration

2020-11-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-33457. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30382 [https://gi

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2020-11-24 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/24/20, 11:43 PM: -- [~ma

[jira] [Commented] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2020-11-24 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411 ] Asif commented on SPARK-19875: -- [~maropu] I have generated a PR for SPARK-3152 which fixes

[jira] [Comment Edited] (SPARK-19875) Map->filter on many columns gets stuck in constraint inference optimization code

2020-11-24 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238411#comment-17238411 ] Asif edited comment on SPARK-19875 at 11/24/20, 11:42 PM: -- [~ma

[jira] [Assigned] (SPARK-33287) Expose state custom metrics information on SS UI

2020-11-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-33287: Assignee: Gabor Somogyi > Expose state custom metrics information on SS UI >

[jira] [Resolved] (SPARK-33287) Expose state custom metrics information on SS UI

2020-11-24 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-33287. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30336 [https://gi

[jira] [Assigned] (SPARK-33545) Support Fallback Storage during Worker decommission

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33545: Assignee: (was: Apache Spark) > Support Fallback Storage during Worker decommission >

[jira] [Commented] (SPARK-33545) Support Fallback Storage during Worker decommission

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238392#comment-17238392 ] Apache Spark commented on SPARK-33545: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-33545) Support Fallback Storage during Worker decommission

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33545: Assignee: (was: Apache Spark) > Support Fallback Storage during Worker decommission >

[jira] [Assigned] (SPARK-33545) Support Fallback Storage during Worker decommission

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33545: Assignee: Apache Spark > Support Fallback Storage during Worker decommission > --

[jira] [Created] (SPARK-33545) Support Fallback Storage during Worker decommission

2020-11-24 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33545: - Summary: Support Fallback Storage during Worker decommission Key: SPARK-33545 URL: https://issues.apache.org/jira/browse/SPARK-33545 Project: Spark Issue T

[jira] [Commented] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-24 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238371#comment-17238371 ] Thomas Graves commented on SPARK-33544: --- I'm working on a patch for this. > explo

[jira] [Created] (SPARK-33544) explode should not filter when used with CreateArray

2020-11-24 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-33544: - Summary: explode should not filter when used with CreateArray Key: SPARK-33544 URL: https://issues.apache.org/jira/browse/SPARK-33544 Project: Spark Issue

[jira] [Commented] (SPARK-33492) DSv2: Append/Overwrite/ReplaceTable should invalidate cache

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238363#comment-17238363 ] Apache Spark commented on SPARK-33492: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

2020-11-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-32670: --- Assignee: Xinyi Yu (was: Xiao Li) > Group exception messages in Catalyst Analyzer in one file > --

[jira] [Updated] (SPARK-32670) Group exception messages in Catalyst Analyzer in one file

2020-11-24 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-32670: Parent: SPARK-33539 Issue Type: Sub-task (was: Improvement) > Group exception messages in Catalys

[jira] [Assigned] (SPARK-33543) Migrate SHOW COLUMNS to new resolution framework

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33543: Assignee: Apache Spark > Migrate SHOW COLUMNS to new resolution framework > -

[jira] [Assigned] (SPARK-33543) Migrate SHOW COLUMNS to new resolution framework

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33543: Assignee: (was: Apache Spark) > Migrate SHOW COLUMNS to new resolution framework > --

[jira] [Commented] (SPARK-33543) Migrate SHOW COLUMNS to new resolution framework

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238343#comment-17238343 ] Apache Spark commented on SPARK-33543: -- User 'imback82' has created a pull request

[jira] [Created] (SPARK-33543) Migrate SHOW COLUMNS to new resolution framework

2020-11-24 Thread Terry Kim (Jira)
Terry Kim created SPARK-33543: - Summary: Migrate SHOW COLUMNS to new resolution framework Key: SPARK-33543 URL: https://issues.apache.org/jira/browse/SPARK-33543 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-33542) Group exceptions in catalyst/catalog

2020-11-24 Thread Allison Wang (Jira)
Allison Wang created SPARK-33542: Summary: Group exceptions in catalyst/catalog Key: SPARK-33542 URL: https://issues.apache.org/jira/browse/SPARK-33542 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-33541) Group exceptions in catalyst/expressions

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33541: - Summary: Group exceptions in catalyst/expressions (was: Group AnalysisException in catalyst/exp

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, we have proposed three major

[jira] [Created] (SPARK-33541) Group AnalysisException in catalyst/expressions into QueryCompilationErrors

2020-11-24 Thread Allison Wang (Jira)
Allison Wang created SPARK-33541: Summary: Group AnalysisException in catalyst/expressions into QueryCompilationErrors Key: SPARK-33541 URL: https://issues.apache.org/jira/browse/SPARK-33541 Project:

[jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24266: -- Fix Version/s: 2.4.8 > Spark client terminates while driver is still running > ---

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, we have proposed three major

[jira] [Updated] (SPARK-33539) Standardize exception messages in Spark

2020-11-24 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-33539: - Description: In the SPIP: Standardize Exception Messages in Spark, we have proposed three major

[jira] [Created] (SPARK-33540) Subexpression elimination for interpreted predicate

2020-11-24 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33540: --- Summary: Subexpression elimination for interpreted predicate Key: SPARK-33540 URL: https://issues.apache.org/jira/browse/SPARK-33540 Project: Spark Issue Type:

[jira] [Created] (SPARK-33539) Standardize exception messages in Spark

2020-11-24 Thread Allison Wang (Jira)
Allison Wang created SPARK-33539: Summary: Standardize exception messages in Spark Key: SPARK-33539 URL: https://issues.apache.org/jira/browse/SPARK-33539 Project: Spark Issue Type: Improveme

[jira] [Resolved] (SPARK-33535) export LANG to en_US.UTF-8 in jenkins test script

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33535. --- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution: Fix

[jira] [Assigned] (SPARK-33535) export LANG to en_US.UTF-8 in jenkins test script

2020-11-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33535: - Assignee: Yang Jie > export LANG to en_US.UTF-8 in jenkins test script > --

[jira] [Updated] (SPARK-33531) [SQL] Avoid shuffle when calling CollectLimitExec#executeToIterator

2020-11-24 Thread Mori[A]rty (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mori[A]rty updated SPARK-33531: --- Description: Using a new method SparkPlan#executeTakeToIterator to implement CollectLimitExec#execu

[jira] [Assigned] (SPARK-33531) [SQL] Avoid shuffle when calling CollectLimitExec#executeToIterator

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33531: Assignee: (was: Apache Spark) > [SQL] Avoid shuffle when calling CollectLimitExec#exe

[jira] [Commented] (SPARK-33531) [SQL] Avoid shuffle when calling CollectLimitExec#executeToIterator

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238257#comment-17238257 ] Apache Spark commented on SPARK-33531: -- User 'hammertank' has created a pull reques

[jira] [Assigned] (SPARK-33531) [SQL] Avoid shuffle when calling CollectLimitExec#executeToIterator

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33531: Assignee: Apache Spark > [SQL] Avoid shuffle when calling CollectLimitExec#executeToItera

[jira] [Updated] (SPARK-32792) Improve in filter pushdown for ParquetFilters

2020-11-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32792: Parent: SPARK-25419 Issue Type: Sub-task (was: Improvement) > Improve in filter pushdown

[jira] [Created] (SPARK-33538) Directly push IN predicates to the Hive Metastore

2020-11-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33538: --- Summary: Directly push IN predicates to the Hive Metastore Key: SPARK-33538 URL: https://issues.apache.org/jira/browse/SPARK-33538 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-33477) Hive partition pruning support date type

2020-11-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33477: Parent: SPARK-33537 Issue Type: Sub-task (was: Improvement) > Hive partition pruning sup

[jira] [Updated] (SPARK-27421) RuntimeException when querying a view on a partitioned parquet table

2020-11-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-27421: Parent: SPARK-33537 Issue Type: Sub-task (was: Bug) > RuntimeException when querying a vi

[jira] [Updated] (SPARK-33458) Hive partition pruning support Contains, StartsWith and EndsWith predicate

2020-11-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33458: Parent: SPARK-33537 Issue Type: Sub-task (was: Improvement) > Hive partition pruning supp

[jira] [Created] (SPARK-33537) Hive Metastore filter pushdown improvement

2020-11-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33537: --- Summary: Hive Metastore filter pushdown improvement Key: SPARK-33537 URL: https://issues.apache.org/jira/browse/SPARK-33537 Project: Spark Issue Type: Umbrella

[jira] [Updated] (SPARK-33531) [SQL] Avoid shuffle when calling CollectLimitExec#executeToIterator

2020-11-24 Thread Mori[A]rty (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mori[A]rty updated SPARK-33531: --- Description: CollectLimitExec#executeToIterator should be implemented using  CollectLimitExec#execut

[jira] [Commented] (SPARK-33536) Incorrect join results when joining twice with the same DF

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238174#comment-17238174 ] Apache Spark commented on SPARK-33536: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-33536) Incorrect join results when joining twice with the same DF

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33536: Assignee: (was: Apache Spark) > Incorrect join results when joining twice with the sa

[jira] [Assigned] (SPARK-33536) Incorrect join results when joining twice with the same DF

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33536: Assignee: Apache Spark > Incorrect join results when joining twice with the same DF > ---

[jira] [Commented] (SPARK-33536) Incorrect join results when joining twice with the same DF

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238173#comment-17238173 ] Apache Spark commented on SPARK-33536: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-33535) export LANG to en_US.UTF-8 in jenkins test script

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238170#comment-17238170 ] Apache Spark commented on SPARK-33535: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-33535) export LANG to en_US.UTF-8 in jenkins test script

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33535: Assignee: (was: Apache Spark) > export LANG to en_US.UTF-8 in jenkins test script > -

[jira] [Assigned] (SPARK-33535) export LANG to en_US.UTF-8 in jenkins test script

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33535: Assignee: Apache Spark > export LANG to en_US.UTF-8 in jenkins test script >

[jira] [Commented] (SPARK-33535) export LANG to en_US.UTF-8 in jenkins test script

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238169#comment-17238169 ] Apache Spark commented on SPARK-33535: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-33530) Support --archives option natively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238165#comment-17238165 ] Apache Spark commented on SPARK-33530: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-33530) Support --archives option natively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238167#comment-17238167 ] Apache Spark commented on SPARK-33530: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-33530) Support --archives option natively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33530: Assignee: Apache Spark > Support --archives option natively > ---

[jira] [Assigned] (SPARK-33530) Support --archives option natively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33530: Assignee: (was: Apache Spark) > Support --archives option natively >

[jira] [Commented] (SPARK-33530) Support --archives option natively

2020-11-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17238166#comment-17238166 ] Apache Spark commented on SPARK-33530: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-33536) Incorrect join results when joining twice with the same DF

2020-11-24 Thread wuyi (Jira)
wuyi created SPARK-33536: Summary: Incorrect join results when joining twice with the same DF Key: SPARK-33536 URL: https://issues.apache.org/jira/browse/SPARK-33536 Project: Spark Issue Type: Bug

  1   2   >