[jira] [Commented] (SPARK-34238) Unify output of SHOW PARTITIONS and pass output attributes

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271947#comment-17271947 ] Apache Spark commented on SPARK-34238: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-34238) Unify output of SHOW PARTITIONS and pass output attributes

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34238: Assignee: (was: Apache Spark) > Unify output of SHOW PARTITIONS and pass output attri

[jira] [Assigned] (SPARK-34238) Unify output of SHOW PARTITIONS and pass output attributes

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34238: Assignee: Apache Spark > Unify output of SHOW PARTITIONS and pass output attributes > ---

[jira] [Commented] (SPARK-34238) Unify output of SHOW PARTITIONS and pass output attributes

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271948#comment-17271948 ] Apache Spark commented on SPARK-34238: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-34232) redact credentials not working when log slow event enabled

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34232: Assignee: Zhongwei Zhu > redact credentials not working when log slow event enabled > ---

[jira] [Resolved] (SPARK-34232) redact credentials not working when log slow event enabled

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34232. -- Fix Version/s: 3.1.2 3.0.2 Resolution: Fixed Fixed in https://github

[jira] [Updated] (SPARK-34238) Unify output of SHOW PARTITIONS pass output attributes properly

2021-01-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-34238: -- Summary: Unify output of SHOW PARTITIONS pass output attributes properly (was: Unify output of SHOW P

[jira] [Assigned] (SPARK-34235) Make spark.sql.hive as a private package

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34235: Assignee: Yuanjian Li > Make spark.sql.hive as a private package > --

[jira] [Resolved] (SPARK-34235) Make spark.sql.hive as a private package

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34235. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31321 [https://gi

[jira] [Created] (SPARK-34239) Unify output of SHOW COLUMNS pass output attributes properly

2021-01-26 Thread angerszhu (Jira)
angerszhu created SPARK-34239: - Summary: Unify output of SHOW COLUMNS pass output attributes properly Key: SPARK-34239 URL: https://issues.apache.org/jira/browse/SPARK-34239 Project: Spark Issue

[jira] [Created] (SPARK-34240) Unify output of SHOW TBLPROPERTIES pass output attributes properly

2021-01-26 Thread angerszhu (Jira)
angerszhu created SPARK-34240: - Summary: Unify output of SHOW TBLPROPERTIES pass output attributes properly Key: SPARK-34240 URL: https://issues.apache.org/jira/browse/SPARK-34240 Project: Spark

[jira] [Created] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread angerszhu (Jira)
angerszhu created SPARK-34241: - Summary: Make Command's producedAttribute as it's output Key: SPARK-34241 URL: https://issues.apache.org/jira/browse/SPARK-34241 Project: Spark Issue Type: Sub-tas

[jira] [Assigned] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34241: Assignee: (was: Apache Spark) > Make Command's producedAttribute as it's output > ---

[jira] [Assigned] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34241: Assignee: Apache Spark > Make Command's producedAttribute as it's output > --

[jira] [Commented] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271971#comment-17271971 ] Apache Spark commented on SPARK-34241: -- User 'AngersZh' has created a pull requ

[jira] [Resolved] (SPARK-34227) WindowFunctionFrame should clear its states during preparation

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34227. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31325 [https://gith

[jira] [Created] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread haiyangyu (Jira)
haiyangyu created SPARK-34242: - Summary: Use getPartitionByNames to filter partition to avoid partition scan Key: SPARK-34242 URL: https://issues.apache.org/jira/browse/SPARK-34242 Project: Spark

[jira] [Updated] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread haiyangyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyangyu updated SPARK-34242: -- Description: In HiveShim, {code:java} getPartitionByFilters{code} will lead parttion scan in special ,

[jira] [Updated] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread haiyangyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haiyangyu updated SPARK-34242: -- Description: In HiveShim, `getPartitionByFilters` will lead parttion scan in special , ec:  concat(dt

[jira] [Assigned] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34242: Assignee: (was: Apache Spark) > Use getPartitionByNames to filter partition to avoid

[jira] [Assigned] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34242: Assignee: Apache Spark > Use getPartitionByNames to filter partition to avoid partition s

[jira] [Commented] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271996#comment-17271996 ] Apache Spark commented on SPARK-34242: -- User 'seayoun' has created a pull request f

[jira] [Commented] (SPARK-34242) Use getPartitionByNames to filter partition to avoid partition scan

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271997#comment-17271997 ] Apache Spark commented on SPARK-34242: -- User 'seayoun' has created a pull request f

[jira] [Commented] (SPARK-23543) Automatic Module creation fails in Java 9

2021-01-26 Thread Naman Nigam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272006#comment-17272006 ] Naman Nigam commented on SPARK-23543: - Spark still(with 3.0.1 dependencies) struggle

[jira] [Created] (SPARK-34243) Update the spark libraries to expose Java module name

2021-01-26 Thread Naman Nigam (Jira)
Naman Nigam created SPARK-34243: --- Summary: Update the spark libraries to expose Java module name Key: SPARK-34243 URL: https://issues.apache.org/jira/browse/SPARK-34243 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34243) Update the spark libraries to expose Java module names

2021-01-26 Thread Naman Nigam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naman Nigam updated SPARK-34243: Summary: Update the spark libraries to expose Java module names (was: Update the spark libraries

[jira] [Updated] (SPARK-34243) Update the spark libraries to expose Java module names

2021-01-26 Thread Naman Nigam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naman Nigam updated SPARK-34243: Description: Trying to derive the automatic module name for any of the spark related artifacts cu

[jira] [Updated] (SPARK-34243) Update the spark libraries to expose Java module names

2021-01-26 Thread Naman Nigam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naman Nigam updated SPARK-34243: Environment: Making use of a `module-info.java` with the application based out of Spark would fail

[jira] [Updated] (SPARK-34243) Update the spark libraries to expose Java module names

2021-01-26 Thread Naman Nigam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naman Nigam updated SPARK-34243: Environment: Making use of a `module-info.java` with the application based out of Spark would resu

[jira] [Commented] (SPARK-34224) Ensure all resource opened by `Source.fromXXX` method are closed

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272039#comment-17272039 ] Apache Spark commented on SPARK-34224: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34224) Ensure all resource opened by `Source.fromXXX` method are closed

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272048#comment-17272048 ] Apache Spark commented on SPARK-34224: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-34224) Ensure all resource opened by `Source.fromXXX` method are closed

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272050#comment-17272050 ] Apache Spark commented on SPARK-34224: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-34244: -- Summary: Remove the Scala function version of regexp_extract_all Key: SPARK-34244 URL: https://issues.apache.org/jira/browse/SPARK-34244 Project: Spark Issue Typ

[jira] [Updated] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34244: --- Description: SPARK-24884 implement regexp_extract_all and added > Remove the Scala function version

[jira] [Updated] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34244: --- Description: SPARK-24884 implement regexp_extract_all and added mplement regexp_extract_all (was: S

[jira] [Updated] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34244: --- Description: SPARK-24884 implement regexp_extract_all and added the scala function version of it.

[jira] [Updated] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-34244: --- Description: SPARK-24884 implement regexp_extract_all and added the scala function version of it. A

[jira] [Assigned] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34244: Assignee: (was: Apache Spark) > Remove the Scala function version of regexp_extract_a

[jira] [Commented] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272079#comment-17272079 ] Apache Spark commented on SPARK-34244: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34244: Assignee: Apache Spark > Remove the Scala function version of regexp_extract_all > --

[jira] [Commented] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

2021-01-26 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272102#comment-17272102 ] Peter Toth commented on SPARK-32041: Let me reopen this ticket as this is not a dupl

[jira] [Reopened] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

2021-01-26 Thread Peter Toth (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth reopened SPARK-32041: > Exchange reuse won't work in cases when DPP, subqueries are involved > -

[jira] [Resolved] (SPARK-34214) Expose regexp_extract_all to PySpark

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34214. -- Resolution: Won't Fix > Expose regexp_extract_all to PySpark > ---

[jira] [Commented] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272128#comment-17272128 ] Apache Spark commented on SPARK-34212: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-34224) Ensure all resource opened by `Source.fromXXX` method are closed

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34224: Assignee: Yang Jie > Ensure all resource opened by `Source.fromXXX` method are closed > -

[jira] [Resolved] (SPARK-34224) Ensure all resource opened by `Source.fromXXX` method are closed

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34224. -- Fix Version/s: 3.0.2 Resolution: Fixed Issue resolved by pull request 31344 [https://gi

[jira] [Updated] (SPARK-34224) Ensure all resource opened by `Source.fromXXX` method are closed

2021-01-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34224: - Fix Version/s: 3.1.2 > Ensure all resource opened by `Source.fromXXX` method are closed > --

[jira] [Created] (SPARK-34245) Master may not remove the finished executor when Worker fails to send ExecutorStateChanged

2021-01-26 Thread wuyi (Jira)
wuyi created SPARK-34245: Summary: Master may not remove the finished executor when Worker fails to send ExecutorStateChanged Key: SPARK-34245 URL: https://issues.apache.org/jira/browse/SPARK-34245 Project: S

[jira] [Assigned] (SPARK-34026) DataSource V2: Inject repartition and sort nodes to satisfy required distribution and ordering

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34026: --- Assignee: Anton Okolnychyi > DataSource V2: Inject repartition and sort nodes to satisfy re

[jira] [Resolved] (SPARK-34026) DataSource V2: Inject repartition and sort nodes to satisfy required distribution and ordering

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34026. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31083 [https://gith

[jira] [Resolved] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34241. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31342 [https://gith

[jira] [Assigned] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34241: --- Assignee: angerszhu > Make Command's producedAttribute as it's output > ---

[jira] [Created] (SPARK-34246) New implicit cast syntax rules in ANSI mode

2021-01-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34246: -- Summary: New implicit cast syntax rules in ANSI mode Key: SPARK-34246 URL: https://issues.apache.org/jira/browse/SPARK-34246 Project: Spark Issue Type: N

[jira] [Updated] (SPARK-34246) New implicit cast syntax rules in ANSI mode

2021-01-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34246: --- Description: Add new implicit cast syntax rules in ANSI mode. In Spark ANSI mode, the type c

[jira] [Assigned] (SPARK-34245) Master may not remove the finished executor when Worker fails to send ExecutorStateChanged

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34245: Assignee: (was: Apache Spark) > Master may not remove the finished executor when Work

[jira] [Commented] (SPARK-34245) Master may not remove the finished executor when Worker fails to send ExecutorStateChanged

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272170#comment-17272170 ] Apache Spark commented on SPARK-34245: -- User 'Ngone51' has created a pull request f

[jira] [Assigned] (SPARK-34245) Master may not remove the finished executor when Worker fails to send ExecutorStateChanged

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34245: Assignee: Apache Spark > Master may not remove the finished executor when Worker fails to

[jira] [Assigned] (SPARK-34215) Keep table cached after truncation

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34215: --- Assignee: Maxim Gekk > Keep table cached after truncation > ---

[jira] [Resolved] (SPARK-34215) Keep table cached after truncation

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34215. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31308 [https://gith

[jira] [Commented] (SPARK-34246) New implicit cast syntax rules in ANSI mode

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272182#comment-17272182 ] Apache Spark commented on SPARK-34246: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-34246) New implicit cast syntax rules in ANSI mode

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34246: Assignee: Gengliang Wang (was: Apache Spark) > New implicit cast syntax rules in ANSI mo

[jira] [Assigned] (SPARK-34246) New implicit cast syntax rules in ANSI mode

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34246: Assignee: Apache Spark (was: Gengliang Wang) > New implicit cast syntax rules in ANSI mo

[jira] [Created] (SPARK-34247) Add end-to-end tests for ANSI implicit cast rules

2021-01-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34247: -- Summary: Add end-to-end tests for ANSI implicit cast rules Key: SPARK-34247 URL: https://issues.apache.org/jira/browse/SPARK-34247 Project: Spark Issue T

[jira] [Created] (SPARK-34249) Add documentation for ANSI implicit cast rules

2021-01-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34249: -- Summary: Add documentation for ANSI implicit cast rules Key: SPARK-34249 URL: https://issues.apache.org/jira/browse/SPARK-34249 Project: Spark Issue Type

[jira] [Created] (SPARK-34248) Allow implicit casting string literal to other data types under ANSI mode

2021-01-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34248: -- Summary: Allow implicit casting string literal to other data types under ANSI mode Key: SPARK-34248 URL: https://issues.apache.org/jira/browse/SPARK-34248 Project

[jira] [Created] (SPARK-34250) Add rule WindowFrameCoercion into ANSI implicit cast rules

2021-01-26 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-34250: -- Summary: Add rule WindowFrameCoercion into ANSI implicit cast rules Key: SPARK-34250 URL: https://issues.apache.org/jira/browse/SPARK-34250 Project: Spark

[jira] [Updated] (SPARK-34246) New type coercion syntax rules in ANSI mode

2021-01-26 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-34246: --- Summary: New type coercion syntax rules in ANSI mode (was: New implicit cast syntax rules i

[jira] [Updated] (SPARK-33726) Duplicate field names causes wrong answers during aggregation

2021-01-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-33726: Fix Version/s: 2.4.8 > Duplicate field names causes wrong answers during aggregation > ---

[jira] [Commented] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272231#comment-17272231 ] Maxim Gekk commented on SPARK-34251: I am working on bug fix. > TRUNCATE TABLE rese

[jira] [Created] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34251: -- Summary: TRUNCATE TABLE resets stats for non-empty v1 table Key: SPARK-34251 URL: https://issues.apache.org/jira/browse/SPARK-34251 Project: Spark Issue Type: Bu

[jira] [Assigned] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32041: Assignee: Apache Spark > Exchange reuse won't work in cases when DPP, subqueries are invo

[jira] [Assigned] (SPARK-32041) Exchange reuse won't work in cases when DPP, subqueries are involved

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32041: Assignee: (was: Apache Spark) > Exchange reuse won't work in cases when DPP, subqueri

[jira] [Commented] (SPARK-34241) Make Command's producedAttribute as it's output

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272242#comment-17272242 ] Apache Spark commented on SPARK-34241: -- User 'xkrogen' has created a pull request f

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

2021-01-26 Thread Ajith S (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272272#comment-17272272 ] Ajith S commented on SPARK-26961: - Scala issue : https://github.com/scala/bug/issues/114

[jira] [Assigned] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34251: Assignee: Apache Spark > TRUNCATE TABLE resets stats for non-empty v1 table > ---

[jira] [Commented] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272285#comment-17272285 ] Apache Spark commented on SPARK-34251: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34251) TRUNCATE TABLE resets stats for non-empty v1 table

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34251: Assignee: (was: Apache Spark) > TRUNCATE TABLE resets stats for non-empty v1 table >

[jira] [Created] (SPARK-34252) Subquery in aggregate's grouping expression fails the analysis check

2021-01-26 Thread Terry Kim (Jira)
Terry Kim created SPARK-34252: - Summary: Subquery in aggregate's grouping expression fails the analysis check Key: SPARK-34252 URL: https://issues.apache.org/jira/browse/SPARK-34252 Project: Spark

[jira] [Commented] (SPARK-34252) Subquery in aggregate's grouping expression fails the analysis check

2021-01-26 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272294#comment-17272294 ] Terry Kim commented on SPARK-34252: --- I am working on the fix. > Subquery in aggregate

[jira] [Updated] (SPARK-34252) Subquery (views) in aggregate's grouping expression fails the analysis check

2021-01-26 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34252: -- Summary: Subquery (views) in aggregate's grouping expression fails the analysis check (was: Subquery

[jira] [Commented] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272295#comment-17272295 ] Terry Kim commented on SPARK-34252: --- [~cloud_fan], [~dongjoon] Would this be a blocker

[jira] [Updated] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34252: -- Summary: View subqueries in aggregate's grouping expression fail during the analysis check (was: Subq

[jira] [Updated] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-34252: -- Description: To repro: {code:java} sql("create temporary view ta(a, b) as select 1, 2") sql("create t

[jira] [Commented] (SPARK-34052) A cached view should become invalid after a table is dropped

2021-01-26 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272333#comment-17272333 ] Chao Sun commented on SPARK-34052: -- [~hyukjin.kwon] [~cloud_fan] do you think we should

[jira] [Commented] (SPARK-34052) A cached view should become invalid after a table is dropped

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272381#comment-17272381 ] Apache Spark commented on SPARK-34052: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-34052) A cached view should become invalid after a table is dropped

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272382#comment-17272382 ] Apache Spark commented on SPARK-34052: -- User 'sunchao' has created a pull request f

[jira] [Assigned] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34252: Assignee: Apache Spark > View subqueries in aggregate's grouping expression fail during t

[jira] [Commented] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272389#comment-17272389 ] Apache Spark commented on SPARK-34252: -- User 'imback82' has created a pull request

[jira] [Assigned] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34252: Assignee: (was: Apache Spark) > View subqueries in aggregate's grouping expression fa

[jira] [Commented] (SPARK-27196) Beginning offset 115204574 is after the ending offset 115204516 for topic

2021-01-26 Thread Mustafa Aksakal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272431#comment-17272431 ] Mustafa Aksakal commented on SPARK-27196: - Is there any update? I have the same

[jira] [Issue Comment Deleted] (SPARK-27196) Beginning offset 115204574 is after the ending offset 115204516 for topic

2021-01-26 Thread Mustafa Aksakal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mustafa Aksakal updated SPARK-27196: Comment: was deleted (was: Is there any update? I have the same issue for a long time and

[jira] [Commented] (SPARK-34252) View subqueries in aggregate's grouping expression fail during the analysis check

2021-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272437#comment-17272437 ] Dongjoon Hyun commented on SPARK-34252: --- Hi, [~imback82]. I cannot reproduce the e

[jira] [Assigned] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34244: - Assignee: jiaan.geng > Remove the Scala function version of regexp_extract_all > --

[jira] [Resolved] (SPARK-34244) Remove the Scala function version of regexp_extract_all

2021-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34244. --- Fix Version/s: 3.1.1 Resolution: Fixed Issue resolved by pull request 31346 [https://

[jira] [Resolved] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34212. --- Fix Version/s: 2.4.8 3.0.2 3.1.0 Resolution: Fix

[jira] [Updated] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34212: -- Fix Version/s: (was: 3.1.0) 3.1.1 > For parquet table, after changing t

[jira] [Assigned] (SPARK-34212) For parquet table, after changing the precision and scale of decimal type in hive, spark reads incorrect value

2021-01-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34212: - Assignee: Dongjoon Hyun > For parquet table, after changing the precision and scale of

[jira] [Created] (SPARK-34253) Object hash aggregate should not fallback if no more input rows

2021-01-26 Thread Cheng Su (Jira)
Cheng Su created SPARK-34253: Summary: Object hash aggregate should not fallback if no more input rows Key: SPARK-34253 URL: https://issues.apache.org/jira/browse/SPARK-34253 Project: Spark Issu

[jira] [Commented] (SPARK-34253) Object hash aggregate should not fallback if no more input rows

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272495#comment-17272495 ] Apache Spark commented on SPARK-34253: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-34253) Object hash aggregate should not fallback if no more input rows

2021-01-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34253: Assignee: (was: Apache Spark) > Object hash aggregate should not fallback if no more

  1   2   >