[jira] [Commented] (SPARK-36022) Respect interval fields in extract

2021-07-06 Thread dgd_contributor (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376334#comment-17376334 ] dgd_contributor commented on SPARK-36022: - as they are calendarInterval, which i

[jira] [Assigned] (SPARK-35929) Schema inference of nested structs defaults to map

2021-07-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35929: Assignee: Haejoon Lee > Schema inference of nested structs defaults to map >

[jira] [Resolved] (SPARK-35929) Schema inference of nested structs defaults to map

2021-07-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35929. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33214 [https://gi

[jira] [Updated] (SPARK-35991) Add PlanStability suite for TPCH

2021-07-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35991: Affects Version/s: (was: 3.1.2) (was: 3.2.0)

[jira] [Updated] (SPARK-35991) Add PlanStability suite for TPCH

2021-07-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35991: Issue Type: Improvement (was: Bug) > Add PlanStability suite for TPCH > -

[jira] [Resolved] (SPARK-35684) Bump up mypy version in GitHub Actions

2021-07-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35684. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33223 [https://gi

[jira] [Assigned] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36028: --- Assignee: Allison Wang > Allow Project to host outer references in scalar subqueries >

[jira] [Resolved] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36028. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33235 [https://gith

[jira] [Commented] (SPARK-36015) Support TimestampNTZ in the Window spec definition

2021-07-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376235#comment-17376235 ] jiaan.geng commented on SPARK-36015: OK. Let me do it. > Support TimestampNTZ in th

[jira] [Commented] (SPARK-36016) Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376232#comment-17376232 ] Apache Spark commented on SPARK-36016: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-36016) Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36016: Assignee: Apache Spark > Support TimestampNTZType in expression ApproxCountDistinctForInt

[jira] [Assigned] (SPARK-36016) Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36016: Assignee: (was: Apache Spark) > Support TimestampNTZType in expression ApproxCountDis

[jira] [Updated] (SPARK-36016) Support TimestampNTZType in expression ApproxCountDistinctForIntervals

2021-07-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36016: --- Summary: Support TimestampNTZType in expression ApproxCountDistinctForIntervals (was: Support Times

[jira] [Resolved] (SPARK-36026) Upgrade Kubernetes Client Version to 5.5.0

2021-07-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36026. -- Fix Version/s: 3.3.0 Resolution: Fixed Fixed in https://github.com/apache/spark/pull/33

[jira] [Commented] (SPARK-35735) Take into account day-time interval fields in cast

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376214#comment-17376214 ] Apache Spark commented on SPARK-35735: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-36017) Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376207#comment-17376207 ] Apache Spark commented on SPARK-36017: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-36017) Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376206#comment-17376206 ] Apache Spark commented on SPARK-36017: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-36017) Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36017: Assignee: Apache Spark > Support TimestampNTZType in expression ApproximatePercentile > -

[jira] [Assigned] (SPARK-36017) Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36017: Assignee: (was: Apache Spark) > Support TimestampNTZType in expression ApproximatePer

[jira] [Commented] (SPARK-36016) Support TimestampNTZ in expression ApproxCountDistinctForIntervals

2021-07-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376199#comment-17376199 ] jiaan.geng commented on SPARK-36016: [~Gengliang.Wang]Thanks ping me. I will take a

[jira] [Commented] (SPARK-35906) Remove order by if the maximum number of rows less than or equal to 1

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376182#comment-17376182 ] Apache Spark commented on SPARK-35906: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-36024) Switch the datasource example due to the depreciation of the dataset

2021-07-06 Thread Leona Yoda (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376178#comment-17376178 ] Leona Yoda commented on SPARK-36024: Sorry, I forgot to refer to  [HADOOP-17784|http

[jira] [Commented] (SPARK-36030) Support DS v2 metrics at writing path

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376177#comment-17376177 ] Apache Spark commented on SPARK-36030: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-36030) Support DS v2 metrics at writing path

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36030: Assignee: Apache Spark (was: L. C. Hsieh) > Support DS v2 metrics at writing path >

[jira] [Assigned] (SPARK-36030) Support DS v2 metrics at writing path

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36030: Assignee: L. C. Hsieh (was: Apache Spark) > Support DS v2 metrics at writing path >

[jira] [Commented] (SPARK-36030) Support DS v2 metrics at writing path

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376176#comment-17376176 ] Apache Spark commented on SPARK-36030: -- User 'viirya' has created a pull request fo

[jira] [Created] (SPARK-36030) Support DS v2 metrics at writing path

2021-07-06 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-36030: --- Summary: Support DS v2 metrics at writing path Key: SPARK-36030 URL: https://issues.apache.org/jira/browse/SPARK-36030 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-36017) Support TimestampNTZType in expression ApproximatePercentile

2021-07-06 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36017: --- Summary: Support TimestampNTZType in expression ApproximatePercentile (was: Support TimestampTNZ in

[jira] [Created] (SPARK-36029) Interval str should handle start field == end Field

2021-07-06 Thread angerszhu (Jira)
angerszhu created SPARK-36029: - Summary: Interval str should handle start field == end Field Key: SPARK-36029 URL: https://issues.apache.org/jira/browse/SPARK-36029 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-36020) Check logical link in remove redundant projects

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376154#comment-17376154 ] Apache Spark commented on SPARK-36020: -- User 'ulysses-you' has created a pull reque

[jira] [Updated] (SPARK-36012) Lost the null flag info when show create table

2021-07-06 Thread PengLei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PengLei updated SPARK-36012: Summary: Lost the null flag info when show create table (was: Lost the null flag info when show create ta

[jira] [Assigned] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35340: Assignee: (was: Apache Spark) > Standardize TypeError messages for unsupported basic

[jira] [Updated] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35340: - Description: Inconsistent TypeError messages are shown for unsupported data-type-based basic op

[jira] [Updated] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35340: - Description: Inconsistent TypeError messages are shown for unsupported data-type-based basic op

[jira] [Commented] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376116#comment-17376116 ] Apache Spark commented on SPARK-35340: -- User 'xinrong-databricks' has created a pul

[jira] [Updated] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35340: - Description: Inconsistent TypeError messages are shown for unsupported data-type-based basic op

[jira] [Assigned] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35340: Assignee: Apache Spark > Standardize TypeError messages for unsupported basic operations

[jira] [Updated] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35340: - Description: Inconsistent TypeError messages are shown for unsupported data-type-based operatio

[jira] [Updated] (SPARK-35340) Standardize TypeError messages for unsupported basic operations

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35340: - Summary: Standardize TypeError messages for unsupported basic operations (was: Standardize Type

[jira] [Commented] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376074#comment-17376074 ] Apache Spark commented on SPARK-32577: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-32577) Fix the config value for shuffled hash join in test in-joins.sql

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376075#comment-17376075 ] Apache Spark commented on SPARK-32577: -- User 'c21' has created a pull request for t

[jira] [Commented] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376041#comment-17376041 ] Apache Spark commented on SPARK-36028: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36028: Assignee: Apache Spark > Allow Project to host outer references in scalar subqueries > --

[jira] [Commented] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376040#comment-17376040 ] Apache Spark commented on SPARK-36028: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36028: Assignee: (was: Apache Spark) > Allow Project to host outer references in scalar subq

[jira] [Updated] (SPARK-36028) Allow Project to host outer references in scalar subqueries

2021-07-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-36028: - Summary: Allow Project to host outer references in scalar subqueries (was: Support outer refere

[jira] [Updated] (SPARK-36028) Support outer references in Project

2021-07-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-36028: - Description: Support Project to host outer references in subqueries, for example: {code:sql} SEL

[jira] [Updated] (SPARK-36028) Support outer references in Project

2021-07-06 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-36028: - Summary: Support outer references in Project (was: Support Project to host outer references) >

[jira] [Resolved] (SPARK-28360) The serviceAccountName configuration item does not take effect in client mode.

2021-07-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-28360. -- Resolution: Won't Fix We can't change the service account of a running pod, which in client mo

[jira] [Commented] (SPARK-35702) Kubernetes: Allow different namespaces for Driver and Executors

2021-07-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375941#comment-17375941 ] Holden Karau commented on SPARK-35702: -- If you're running in client mode (e.g. note

[jira] [Created] (SPARK-36028) Support Project to host outer references

2021-07-06 Thread Allison Wang (Jira)
Allison Wang created SPARK-36028: Summary: Support Project to host outer references Key: SPARK-36028 URL: https://issues.apache.org/jira/browse/SPARK-36028 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-33178) Dynamic Scaling In/Scaling out of executors - Kubernetes

2021-07-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375938#comment-17375938 ] Holden Karau commented on SPARK-33178: -- We do have dynamic scaling, can you elabora

[jira] [Updated] (SPARK-35615) Make unary and comparison operators data-type-based

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35615: - Description: We have been refactoring basic operators to be data-type-based for readability, fl

[jira] [Updated] (SPARK-35615) Make unary and comparison operators data-type-based

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35615: - Summary: Make unary and comparison operators data-type-based (was: Refactor python/pyspark/pand

[jira] [Resolved] (SPARK-35984) Add a config to force using ShuffledHashJoin for test purpose

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35984. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33182 [https://gith

[jira] [Assigned] (SPARK-35984) Add a config to force using ShuffledHashJoin for test purpose

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35984: --- Assignee: Linhong Liu > Add a config to force using ShuffledHashJoin for test purpose > ---

[jira] [Commented] (SPARK-36002) Consolidate tests for data-type-based operations of decimal Series

2021-07-06 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375826#comment-17375826 ] Xinrong Meng commented on SPARK-36002: -- Thank you [~yikunkero]! > Consolidate test

[jira] [Commented] (SPARK-36011) Disallow altering permanent views based on temporary views or UDFs

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375810#comment-17375810 ] Apache Spark commented on SPARK-36011: -- User 'jerqi' has created a pull request for

[jira] [Updated] (SPARK-36027) Push down Filter in case of filter having child as TypedFilter

2021-07-06 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saurabh Chawla updated SPARK-36027: --- Description: In case of Filter having child as TypedFilter, Pushdown of Filters does not ta

[jira] [Assigned] (SPARK-36026) Upgrade Kubernetes Client Version to 5.5.0

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36026: Assignee: Apache Spark (was: Attila Zsolt Piros) > Upgrade Kubernetes Client Version to

[jira] [Commented] (SPARK-36026) Upgrade Kubernetes Client Version to 5.5.0

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375785#comment-17375785 ] Apache Spark commented on SPARK-36026: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-36026) Upgrade Kubernetes Client Version to 5.5.0

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36026: Assignee: Attila Zsolt Piros (was: Apache Spark) > Upgrade Kubernetes Client Version to

[jira] [Commented] (SPARK-36026) Upgrade Kubernetes Client Version to 5.5.0

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375784#comment-17375784 ] Apache Spark commented on SPARK-36026: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-36027) Push down Filter in case of filter having child as TypedFilter

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36027: Assignee: Apache Spark > Push down Filter in case of filter having child as TypedFilter >

[jira] [Assigned] (SPARK-36027) Push down Filter in case of filter having child as TypedFilter

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36027: Assignee: (was: Apache Spark) > Push down Filter in case of filter having child as Ty

[jira] [Commented] (SPARK-36027) Push down Filter in case of filter having child as TypedFilter

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375778#comment-17375778 ] Apache Spark commented on SPARK-36027: -- User 'SaurabhChawla100' has created a pull

[jira] [Created] (SPARK-36027) Push down Filter in case of filter having child as TypedFilter

2021-07-06 Thread Saurabh Chawla (Jira)
Saurabh Chawla created SPARK-36027: -- Summary: Push down Filter in case of filter having child as TypedFilter Key: SPARK-36027 URL: https://issues.apache.org/jira/browse/SPARK-36027 Project: Spark

[jira] [Updated] (SPARK-36026) Upgrade Kubernetes Client Version to 5.5.0

2021-07-06 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-36026: --- Summary: Upgrade Kubernetes Client Version to 5.5.0 (was: Bump Kubernetes Client Ve

[jira] [Created] (SPARK-36026) Bump Kubernetes Client Version to 5.5.0

2021-07-06 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-36026: -- Summary: Bump Kubernetes Client Version to 5.5.0 Key: SPARK-36026 URL: https://issues.apache.org/jira/browse/SPARK-36026 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-36020) Check logical link in remove redundant projects

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36020. - Fix Version/s: 3.2.0 Resolution: Fixed > Check logical link in remove redundant projects

[jira] [Commented] (SPARK-36021) Incorrect parsing of the start field in interval literals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375717#comment-17375717 ] Apache Spark commented on SPARK-36021: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-36020) Check logical link in remove redundant projects

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36020: --- Assignee: Wenchen Fan > Check logical link in remove redundant projects > -

[jira] [Assigned] (SPARK-36021) Incorrect parsing of the start field in interval literals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36021: Assignee: (was: Apache Spark) > Incorrect parsing of the start field in interval lite

[jira] [Assigned] (SPARK-36021) Incorrect parsing of the start field in interval literals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36021: Assignee: Apache Spark > Incorrect parsing of the start field in interval literals >

[jira] [Commented] (SPARK-36021) Incorrect parsing of the start field in interval literals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375716#comment-17375716 ] Apache Spark commented on SPARK-36021: -- User 'AngersZh' has created a pull requ

[jira] [Comment Edited] (SPARK-32467) Avoid encoding URL twice on https redirect

2021-07-06 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368005#comment-17368005 ] dzcxzl edited comment on SPARK-32467 at 7/6/21, 1:16 PM: - YARN-3

[jira] [Commented] (SPARK-36011) Disallow altering permanent views based on temporary views or UDFs

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375702#comment-17375702 ] Apache Spark commented on SPARK-36011: -- User 'jerqi' has created a pull request for

[jira] [Commented] (SPARK-36011) Disallow altering permanent views based on temporary views or UDFs

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375701#comment-17375701 ] Apache Spark commented on SPARK-36011: -- User 'jerqi' has created a pull request for

[jira] [Resolved] (SPARK-36009) Missing GraphX classes in registerKryoClasses util method

2021-07-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36009. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 32973 [https://gi

[jira] [Assigned] (SPARK-36009) Missing GraphX classes in registerKryoClasses util method

2021-07-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-36009: Assignee: Matthew > Missing GraphX classes in registerKryoClasses util method > -

[jira] [Resolved] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36025. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33229 [https:

[jira] [Resolved] (SPARK-36004) Update MiMa and audit Scala/Java API changes

2021-07-06 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36004. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33199 [https://gi

[jira] [Updated] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36025: --- Priority: Trivial (was: Major) > Reduce the run time of DateExpressionsSuite >

[jira] [Resolved] (SPARK-36023) Confusing error from casting a string to ANSI interval

2021-07-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36023. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33217 [https://github.com

[jira] [Assigned] (SPARK-36023) Confusing error from casting a string to ANSI interval

2021-07-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36023: Assignee: angerszhu > Confusing error from casting a string to ANSI interval > --

[jira] [Resolved] (SPARK-35999) Make from_csv/to_csv to handle day-time intervals properly

2021-07-06 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35999. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33226 [https://gith

[jira] [Commented] (SPARK-36024) Switch the datasource example due to the depreciation of the dataset

2021-07-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375400#comment-17375400 ] Steve Loughran commented on SPARK-36024: similar to HADOOP-17784 I'm "in discus

[jira] [Comment Edited] (SPARK-36024) Switch the datasource example due to the depreciation of the dataset

2021-07-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375400#comment-17375400 ] Steve Loughran edited comment on SPARK-36024 at 7/6/21, 9:32 AM: -

[jira] [Commented] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375399#comment-17375399 ] Apache Spark commented on SPARK-36025: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36025: Assignee: Apache Spark (was: Gengliang Wang) > Reduce the run time of DateExpressionsSui

[jira] [Assigned] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36025: Assignee: Gengliang Wang (was: Apache Spark) > Reduce the run time of DateExpressionsSui

[jira] [Commented] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375395#comment-17375395 ] Apache Spark commented on SPARK-36025: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-36025) Reduce the run time of DateExpressionsSuite

2021-07-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-36025: -- Summary: Reduce the run time of DateExpressionsSuite Key: SPARK-36025 URL: https://issues.apache.org/jira/browse/SPARK-36025 Project: Spark Issue Type: T

[jira] [Resolved] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

2021-07-06 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36019. Resolution: Duplicate > Cannot run leveldb related UTs on Mac OS of M1 architecture >

[jira] [Commented] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture

2021-07-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375380#comment-17375380 ] Yang Jie commented on SPARK-36019: -- [~sarutak] yes , it's duplicated > Cannot run leve

[jira] [Commented] (SPARK-36024) Switch the datasource example due to the depreciation of the dataset

2021-07-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375371#comment-17375371 ] Hyukjin Kwon commented on SPARK-36024: -- cc [~ste...@apache.org] FYI. > Switch the

[jira] [Resolved] (SPARK-35983) Allow from_json/to_json for map types where value types are day-time intervals

2021-07-06 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35983. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33225 [https://github.com

[jira] [Commented] (SPARK-35972) When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

2021-07-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375319#comment-17375319 ] Apache Spark commented on SPARK-35972: -- User 'AngersZh' has created a pull requ

[jira] [Updated] (SPARK-35972) When replace ExtractValue in NestedColumnAliasing we should use semanticEquals

2021-07-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35972: Summary: When replace ExtractValue in NestedColumnAliasing we should use semanticEquals (was: Nes

[jira] [Commented] (SPARK-35972) NestColumnPruning cause execute loss output

2021-07-06 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375304#comment-17375304 ] L. C. Hsieh commented on SPARK-35972: - Fixed at https://github.com/apache/spark/pull

  1   2   >