[jira] [Resolved] (SPARK-35687) PythonUDFSuite move assume into its methods

2021-06-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35687. -- Fix Version/s: 3.0.3 3.1.3 3.2.0 Resolution: Fixed

[jira] [Assigned] (SPARK-35687) PythonUDFSuite move assume into its methods

2021-06-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35687: Assignee: XiDuo You > PythonUDFSuite move assume into its methods > -

[jira] [Resolved] (SPARK-35664) Support java.time. LocalDateTime as an external type of TimestampWithoutTZ type

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35664. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32814 [https:

[jira] [Comment Edited] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359704#comment-17359704 ] Fu Chen edited comment on SPARK-35673 at 6/9/21, 7:10 AM: -- No,

[jira] [Created] (SPARK-35692) Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes

2021-06-09 Thread Kent Yao (Jira)
Kent Yao created SPARK-35692: Summary: Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes Key: SPARK-35692 URL: https://issues.apache.org/jira/browse/SPARK-35692 Project: Spark Issue

[jira] [Created] (SPARK-35693) Add plan check for stream-stream join unit test

2021-06-09 Thread Cheng Su (Jira)
Cheng Su created SPARK-35693: Summary: Add plan check for stream-stream join unit test Key: SPARK-35693 URL: https://issues.apache.org/jira/browse/SPARK-35693 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-35693) Add plan check for stream-stream join unit test

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359828#comment-17359828 ] Apache Spark commented on SPARK-35693: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-35693) Add plan check for stream-stream join unit test

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35693: Assignee: Apache Spark > Add plan check for stream-stream join unit test > --

[jira] [Assigned] (SPARK-35693) Add plan check for stream-stream join unit test

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35693: Assignee: (was: Apache Spark) > Add plan check for stream-stream join unit test > ---

[jira] [Assigned] (SPARK-35693) Add plan check for stream-stream join unit test

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35693: Assignee: Apache Spark > Add plan check for stream-stream join unit test > --

[jira] [Assigned] (SPARK-35692) Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35692: Assignee: Apache Spark > Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes >

[jira] [Commented] (SPARK-35692) Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359830#comment-17359830 ] Apache Spark commented on SPARK-35692: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-35692) Use int to replace long for EXECUTOR_ID_COUNTER in Kubernetes

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35692: Assignee: (was: Apache Spark) > Use int to replace long for EXECUTOR_ID_COUNTER in Ku

[jira] [Commented] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359835#comment-17359835 ] Fu Chen commented on SPARK-35673: - {quote}Can we simply change `UnresolvedHint.resolved`

[jira] [Comment Edited] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread Fu Chen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359835#comment-17359835 ] Fu Chen edited comment on SPARK-35673 at 6/9/21, 7:34 AM: -- {quo

[jira] [Created] (SPARK-35694) Increase the default JVM stack size of SBT

2021-06-09 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35694: -- Summary: Increase the default JVM stack size of SBT Key: SPARK-35694 URL: https://issues.apache.org/jira/browse/SPARK-35694 Project: Spark Issue Type: Ta

[jira] [Commented] (SPARK-35694) Increase the default JVM stack size of SBT

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359837#comment-17359837 ] Apache Spark commented on SPARK-35694: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35694) Increase the default JVM stack size of SBT

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35694: Assignee: (was: Apache Spark) > Increase the default JVM stack size of SBT >

[jira] [Assigned] (SPARK-35694) Increase the default JVM stack size of SBT

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35694: Assignee: Apache Spark > Increase the default JVM stack size of SBT > ---

[jira] [Reopened] (SPARK-35668) Use "concurrency" setting on Github Actions

2021-06-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-35668: -- Assignee: (was: Yikun Jiang) > Use "concurrency" setting on Github Actions > ---

[jira] [Updated] (SPARK-35668) Use "concurrency" setting on Github Actions

2021-06-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-35668: - Fix Version/s: (was: 3.2.0) > Use "concurrency" setting on Github Actions >

[jira] [Assigned] (SPARK-35668) Use "concurrency" setting on Github Actions

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35668: Assignee: (was: Apache Spark) > Use "concurrency" setting on Github Actions > ---

[jira] [Commented] (SPARK-35668) Use "concurrency" setting on Github Actions

2021-06-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359840#comment-17359840 ] Hyukjin Kwon commented on SPARK-35668: -- Reverted at https://github.com/apache/spar

[jira] [Assigned] (SPARK-35668) Use "concurrency" setting on Github Actions

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35668: Assignee: Apache Spark > Use "concurrency" setting on Github Actions > --

[jira] [Assigned] (SPARK-35679) Overflow on converting valid Timestamp to Microseconds

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35679: Assignee: Apache Spark > Overflow on converting valid Timestamp to Microseconds > ---

[jira] [Commented] (SPARK-35679) Overflow on converting valid Timestamp to Microseconds

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359841#comment-17359841 ] Apache Spark commented on SPARK-35679: -- User 'dgd-contributor' has created a pull r

[jira] [Assigned] (SPARK-35679) Overflow on converting valid Timestamp to Microseconds

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35679: Assignee: (was: Apache Spark) > Overflow on converting valid Timestamp to Microsecond

[jira] [Assigned] (SPARK-35679) Overflow on converting valid Timestamp to Microseconds

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35679: Assignee: Apache Spark > Overflow on converting valid Timestamp to Microseconds > ---

[jira] [Updated] (SPARK-35694) Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35694: --- Summary: Increase the default JVM stack size of SBT/Maven (was: Increase the default JVM st

[jira] [Updated] (SPARK-35694) Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35694: --- Description: The jenkins SBT/Maven keep failing with stack overflow error: https://amplab.cs

[jira] [Updated] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-35695: --- Description: This example properly fires the event {code} spark.range(100) .observe( name = "o

[jira] [Updated] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-35695: --- Description: This example properly fires the event {code} spark.range(100) .observe( name = "o

[jira] [Updated] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-35695: --- Description: This example properly fires the event {code} spark.range(100) .observe( name = "o

[jira] [Commented] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359849#comment-17359849 ] Tanel Kiis commented on SPARK-35695: [~cloud_fan] and [~sarutak], you are currently

[jira] [Updated] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-35695: --- Description: This example properly fires the event {code} spark.range(100) .observe( name = "o

[jira] [Updated] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanel Kiis updated SPARK-35695: --- Description: This example properly fires the event {code} spark.range(100) .observe( name = "o

[jira] [Created] (SPARK-35695) QueryExecutionListener does not see any observed metrics fired before persist/cache

2021-06-09 Thread Tanel Kiis (Jira)
Tanel Kiis created SPARK-35695: -- Summary: QueryExecutionListener does not see any observed metrics fired before persist/cache Key: SPARK-35695 URL: https://issues.apache.org/jira/browse/SPARK-35695 Proje

[jira] [Assigned] (SPARK-35058) Group exception messages in hive/client

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35058: --- Assignee: jiaan.geng > Group exception messages in hive/client > --

[jira] [Resolved] (SPARK-35058) Group exception messages in hive/client

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35058. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32763 [https://gith

[jira] [Created] (SPARK-35696) Refine the code examples in the pandas APIs on Spark documentation.

2021-06-09 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-35696: --- Summary: Refine the code examples in the pandas APIs on Spark documentation. Key: SPARK-35696 URL: https://issues.apache.org/jira/browse/SPARK-35696 Project: Spark

[jira] [Commented] (SPARK-35674) Test timestamp without time zone in UDF

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359883#comment-17359883 ] Apache Spark commented on SPARK-35674: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35674) Test timestamp without time zone in UDF

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359884#comment-17359884 ] Apache Spark commented on SPARK-35674: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35674) Test timestamp without time zone in UDF

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35674: Assignee: Apache Spark > Test timestamp without time zone in UDF > --

[jira] [Assigned] (SPARK-35674) Test timestamp without time zone in UDF

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35674: Assignee: (was: Apache Spark) > Test timestamp without time zone in UDF > ---

[jira] [Assigned] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35673: Assignee: (was: Apache Spark) > Spark fails on unrecognized hint in subquery > --

[jira] [Commented] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359908#comment-17359908 ] Apache Spark commented on SPARK-35673: -- User 'cfmcgrady' has created a pull request

[jira] [Assigned] (SPARK-35673) Spark fails on unrecognized hint in subquery

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35673: Assignee: Apache Spark > Spark fails on unrecognized hint in subquery > -

[jira] [Commented] (SPARK-29626) notEqual() should return true when the one is null, the other is not null

2021-06-09 Thread dc-heros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359900#comment-17359900 ] dc-heros commented on SPARK-29626: -- [~cloud_fan] could you give your opinion?   > not

[jira] [Resolved] (SPARK-35674) Test timestamp without time zone in UDF

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35674. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32840 [https:

[jira] [Assigned] (SPARK-35674) Test timestamp without time zone in UDF

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35674: -- Assignee: Gengliang Wang > Test timestamp without time zone in UDF >

[jira] [Comment Edited] (SPARK-35667) spark.speculation causes incorrect query results with TRANSFORM

2021-06-09 Thread yuanxm (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359710#comment-17359710 ] yuanxm edited comment on SPARK-35667 at 6/9/21, 11:36 AM: -- Trie

[jira] [Assigned] (SPARK-35694) Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35694: -- Assignee: Gengliang Wang > Increase the default JVM stack size of SBT/Maven > ---

[jira] [Resolved] (SPARK-35694) Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35694. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32838 [https:

[jira] [Created] (SPARK-35697) Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35697: -- Summary: Test TimestampWithoutTZType as ordered and atomic type Key: SPARK-35697 URL: https://issues.apache.org/jira/browse/SPARK-35697 Project: Spark Is

[jira] [Created] (SPARK-35698) Support casting of timestamp without time zone to strings

2021-06-09 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-35698: -- Summary: Support casting of timestamp without time zone to strings Key: SPARK-35698 URL: https://issues.apache.org/jira/browse/SPARK-35698 Project: Spark

[jira] [Assigned] (SPARK-35650) Coalesce small output files through AQE

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35650: --- Assignee: Yuming Wang > Coalesce small output files through AQE > -

[jira] [Resolved] (SPARK-35650) Coalesce small output files through AQE

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35650. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32781 [https://gith

[jira] [Resolved] (SPARK-35390) Handle type coercion when resolving V2 functions

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35390. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32764 [https://gith

[jira] [Assigned] (SPARK-35390) Handle type coercion when resolving V2 functions

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35390: --- Assignee: Chao Sun > Handle type coercion when resolving V2 functions > --

[jira] [Assigned] (SPARK-35697) Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35697: Assignee: Apache Spark > Test TimestampWithoutTZType as ordered and atomic type > ---

[jira] [Assigned] (SPARK-35697) Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35697: Assignee: Apache Spark > Test TimestampWithoutTZType as ordered and atomic type > ---

[jira] [Commented] (SPARK-35697) Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360065#comment-17360065 ] Apache Spark commented on SPARK-35697: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35697) Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35697: Assignee: (was: Apache Spark) > Test TimestampWithoutTZType as ordered and atomic typ

[jira] [Commented] (SPARK-29626) notEqual() should return true when the one is null, the other is not null

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360070#comment-17360070 ] Wenchen Fan commented on SPARK-29626: - Yea this is the expected behavior. Perhaps we

[jira] [Commented] (SPARK-29626) notEqual() should return true when the one is null, the other is not null

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360071#comment-17360071 ] Wenchen Fan commented on SPARK-29626: - Note: once there is a null value, both `eq` a

[jira] [Created] (SPARK-35699) Improve error message when creating k8s pod failed.

2021-06-09 Thread Kevin Su (Jira)
Kevin Su created SPARK-35699: Summary: Improve error message when creating k8s pod failed. Key: SPARK-35699 URL: https://issues.apache.org/jira/browse/SPARK-35699 Project: Spark Issue Type: Impro

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Environment: Spark 3.1.1 on K8S (was: **Spark 3.1.1 on K8S**) > spark.sql.orc.filterPushdown not

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Summary: spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data ty

[jira] [Created] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar(12) data type

2021-06-09 Thread Arghya Saha (Jira)
Arghya Saha created SPARK-35700: --- Summary: spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar(12) data type Key: SPARK-35700 URL: https://issues.apache.org/jira/browse/SPARK-35700

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Resolved] (SPARK-35693) Add plan check for stream-stream join unit test

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35693. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32836 [https://gith

[jira] [Updated] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

2021-06-09 Thread Arghya Saha (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arghya Saha updated SPARK-35700: Description: We are not able to upgrade to Spark 3.1.1 from Spark 2.4.x as the join on varchar co

[jira] [Assigned] (SPARK-35661) Allow deserialized off-heap memory entry

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35661: --- Assignee: Wenchen Fan > Allow deserialized off-heap memory entry >

[jira] [Resolved] (SPARK-35661) Allow deserialized off-heap memory entry

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35661. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32800 [https://gith

[jira] [Commented] (SPARK-35625) Spark on k8s zombie executors

2021-06-09 Thread Liran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360111#comment-17360111 ] Liran commented on SPARK-35625: --- We will do the update soon to verify if it was fixed, in

[jira] [Assigned] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35691: Assignee: Apache Spark > addFile/addJar/addDirectory should put CanonicalFile > -

[jira] [Assigned] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35691: Assignee: (was: Apache Spark) > addFile/addJar/addDirectory should put CanonicalFile

[jira] [Created] (SPARK-35701) Contention on SQLConf.sqlConfEntries and SQLConf.staticConfKeys

2021-06-09 Thread Haiyang Sun (Jira)
Haiyang Sun created SPARK-35701: --- Summary: Contention on SQLConf.sqlConfEntries and SQLConf.staticConfKeys Key: SPARK-35701 URL: https://issues.apache.org/jira/browse/SPARK-35701 Project: Spark

[jira] [Commented] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360117#comment-17360117 ] Apache Spark commented on SPARK-35691: -- User 'pingsutw' has created a pull request

[jira] [Commented] (SPARK-35691) addFile/addJar/addDirectory should put CanonicalFile

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360118#comment-17360118 ] Apache Spark commented on SPARK-35691: -- User 'pingsutw' has created a pull request

[jira] [Resolved] (SPARK-35697) Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35697. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32843 [https://gith

[jira] [Assigned] (SPARK-35423) The output of PCA is inconsistent

2021-06-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-35423: Assignee: shahid > The output of PCA is inconsistent > -

[jira] [Resolved] (SPARK-35423) The output of PCA is inconsistent

2021-06-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35423. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32734 [https://gi

[jira] [Updated] (SPARK-35423) The output of PCA is inconsistent

2021-06-09 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-35423: - Priority: Minor (was: Major) > The output of PCA is inconsistent >

[jira] [Commented] (SPARK-35698) Support casting of timestamp without time zone to strings

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360177#comment-17360177 ] Apache Spark commented on SPARK-35698: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-35698) Support casting of timestamp without time zone to strings

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35698: Assignee: Apache Spark > Support casting of timestamp without time zone to strings >

[jira] [Assigned] (SPARK-35698) Support casting of timestamp without time zone to strings

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35698: Assignee: (was: Apache Spark) > Support casting of timestamp without time zone to str

[jira] [Commented] (SPARK-32709) Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2)

2021-06-09 Thread Shashank Pedamallu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360179#comment-17360179 ] Shashank Pedamallu commented on SPARK-32709: [~chengsu], Is this actively be

[jira] [Resolved] (SPARK-34382) ANSI SQL: LATERAL derived table(T491)

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34382. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32303 [https://gith

[jira] [Assigned] (SPARK-34382) ANSI SQL: LATERAL derived table(T491)

2021-06-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34382: --- Assignee: Allison Wang > ANSI SQL: LATERAL derived table(T491) > --

[jira] [Created] (SPARK-35702) Kubernetes: Allow different namespaces for Driver and Executors

2021-06-09 Thread Christian Thiel (Jira)
Christian Thiel created SPARK-35702: --- Summary: Kubernetes: Allow different namespaces for Driver and Executors Key: SPARK-35702 URL: https://issues.apache.org/jira/browse/SPARK-35702 Project: Spark

[jira] [Assigned] (SPARK-35701) Contention on SQLConf.sqlConfEntries and SQLConf.staticConfKeys

2021-06-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-35701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-35701: - Assignee: Haiyang Sun > Contention on SQLConf.sqlConfEntries and SQLConf.static

[jira] [Commented] (SPARK-35616) Make astype data-type-based

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360269#comment-17360269 ] Apache Spark commented on SPARK-35616: -- User 'xinrong-databricks' has created a pul

[jira] [Assigned] (SPARK-35616) Make astype data-type-based

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35616: Assignee: Apache Spark > Make astype data-type-based > --- > >

[jira] [Assigned] (SPARK-35616) Make astype data-type-based

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35616: Assignee: (was: Apache Spark) > Make astype data-type-based > ---

[jira] [Assigned] (SPARK-35698) Support casting of timestamp without time zone to strings

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-35698: -- Assignee: Gengliang Wang > Support casting of timestamp without time zone to strings

[jira] [Resolved] (SPARK-35698) Support casting of timestamp without time zone to strings

2021-06-09 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35698. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32846 [https:

[jira] [Commented] (SPARK-32709) Write Hive ORC/Parquet bucketed table with hivehash (for Hive 1,2)

2021-06-09 Thread Cheng Su (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360287#comment-17360287 ] Cheng Su commented on SPARK-32709: -- [~spedamallu] - yes I am still working on it. It's

[jira] [Commented] (SPARK-35194) Improve readability of NestingColumnAliasing

2021-06-09 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360297#comment-17360297 ] Apache Spark commented on SPARK-35194: -- User 'sarutak' has created a pull request f

  1   2   >