[jira] [Created] (SPARK-39478) Support timestampdiff function

2022-06-14 Thread melin (Jira)
melin created SPARK-39478: - Summary: Support timestampdiff function Key: SPARK-39478 URL: https://issues.apache.org/jira/browse/SPARK-39478 Project: Spark Issue Type: Improvement Components

[jira] [Assigned] (SPARK-39477) Remove "Number of queries" info from the golden files of SQLQueryTestSuite

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39477: Assignee: Gengliang Wang (was: Apache Spark) > Remove "Number of queries" info from the

[jira] [Assigned] (SPARK-39477) Remove "Number of queries" info from the golden files of SQLQueryTestSuite

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39477: Assignee: Apache Spark (was: Gengliang Wang) > Remove "Number of queries" info from the

[jira] [Commented] (SPARK-39477) Remove "Number of queries" info from the golden files of SQLQueryTestSuite

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554395#comment-17554395 ] Apache Spark commented on SPARK-39477: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-39477) Remove "Number of queries" info from the golden files of SQLQueryTestSuite

2022-06-14 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-39477: -- Summary: Remove "Number of queries" info from the golden files of SQLQueryTestSuite Key: SPARK-39477 URL: https://issues.apache.org/jira/browse/SPARK-39477 Projec

[jira] [Updated] (SPARK-39355) Single column uses quoted to construct UnresolvedAttribute

2022-06-14 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated SPARK-39355: --- Summary: Single column uses quoted to construct UnresolvedAttribute (was: Avoid UnresolvedAttribute.apply t

[jira] [Commented] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554375#comment-17554375 ] Apache Spark commented on SPARK-39476: -- User 'WangGuangxin' has created a pull requ

[jira] [Commented] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554373#comment-17554373 ] Apache Spark commented on SPARK-39476: -- User 'WangGuangxin' has created a pull requ

[jira] [Assigned] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39476: Assignee: Apache Spark > Disable Unwrap cast optimize when casting from Long to Float/ Do

[jira] [Assigned] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39476: Assignee: (was: Apache Spark) > Disable Unwrap cast optimize when casting from Long t

[jira] [Created] (SPARK-39476) Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float

2022-06-14 Thread EdisonWang (Jira)
EdisonWang created SPARK-39476: -- Summary: Disable Unwrap cast optimize when casting from Long to Float/ Double or from Integer to Float Key: SPARK-39476 URL: https://issues.apache.org/jira/browse/SPARK-39476

[jira] [Commented] (SPARK-24994) Add UnwrapCastInBinaryComparison optimizer to simplify literal types

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554355#comment-17554355 ] Apache Spark commented on SPARK-24994: -- User 'WangGuangxin' has created a pull requ

[jira] [Updated] (SPARK-39475) Pull out complex join keys for shuffled join

2022-06-14 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-39475: -- Summary: Pull out complex join keys for shuffled join (was: Pull out complex join keys) > Pull out c

[jira] [Commented] (SPARK-39475) Pull out complex join keys for shuffled join

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554359#comment-17554359 ] Apache Spark commented on SPARK-39475: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-39475) Pull out complex join keys for shuffled join

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39475: Assignee: (was: Apache Spark) > Pull out complex join keys for shuffled join > --

[jira] [Assigned] (SPARK-39475) Pull out complex join keys for shuffled join

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39475: Assignee: Apache Spark > Pull out complex join keys for shuffled join > -

[jira] [Commented] (SPARK-39475) Pull out complex join keys for shuffled join

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554358#comment-17554358 ] Apache Spark commented on SPARK-39475: -- User 'ulysses-you' has created a pull reque

[jira] [Created] (SPARK-39475) Pull out complex join keys

2022-06-14 Thread XiDuo You (Jira)
XiDuo You created SPARK-39475: - Summary: Pull out complex join keys Key: SPARK-39475 URL: https://issues.apache.org/jira/browse/SPARK-39475 Project: Spark Issue Type: Improvement Compon

[jira] [Commented] (SPARK-36252) Add log files rolling policy for driver running in cluster mode with spark standalone cluster

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554351#comment-17554351 ] Apache Spark commented on SPARK-36252: -- User 'jhu-chang' has created a pull request

[jira] [Commented] (SPARK-36252) Add log files rolling policy for driver running in cluster mode with spark standalone cluster

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554352#comment-17554352 ] Apache Spark commented on SPARK-36252: -- User 'jhu-chang' has created a pull request

[jira] [Assigned] (SPARK-36252) Add log files rolling policy for driver running in cluster mode with spark standalone cluster

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36252: Assignee: Apache Spark > Add log files rolling policy for driver running in cluster mode

[jira] [Assigned] (SPARK-36252) Add log files rolling policy for driver running in cluster mode with spark standalone cluster

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36252: Assignee: (was: Apache Spark) > Add log files rolling policy for driver running in cl

[jira] [Resolved] (SPARK-39468) Improve RpcAddress to add [] to IPv6 if needed

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39468. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36868 [https://

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my {{delta}} tables.

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my {{delta}} tables.

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my {{delta}} tables.

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my {{delta}} tables.

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my {{delta}} tables.

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my {{delta}} tables.

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my `delta` tables. S

[jira] [Updated] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Mahoney updated SPARK-39474: -- Description: Hi Team! I'd like to set up a much easier way to optimize my `delta` tables. Sp

[jira] [Created] (SPARK-39474) Streamline the options for the `.write` method of a Spark DataFrame

2022-06-14 Thread Chris Mahoney (Jira)
Chris Mahoney created SPARK-39474: - Summary: Streamline the options for the `.write` method of a Spark DataFrame Key: SPARK-39474 URL: https://issues.apache.org/jira/browse/SPARK-39474 Project: Spark

[jira] [Resolved] (SPARK-39444) Add OptimizeSubqueries into nonExcludableRules list

2022-06-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39444. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36841 [https://gi

[jira] [Resolved] (SPARK-39472) Refactor InMemoryTableCatalog classes hierarchy

2022-06-14 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan resolved SPARK-39472. --- Resolution: Not A Problem > Refactor InMemoryTableCatalog classes hierarchy > --

[jira] [Resolved] (SPARK-39473) NullPointerException in SparkRackResolver

2022-06-14 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros resolved SPARK-39473. Resolution: Invalid This is because of Scala 2.11 on latter version *asScala* is p

[jira] [Created] (SPARK-39473) NullPointerException in SparkRackResolver

2022-06-14 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-39473: -- Summary: NullPointerException in SparkRackResolver Key: SPARK-39473 URL: https://issues.apache.org/jira/browse/SPARK-39473 Project: Spark Issue

[jira] [Assigned] (SPARK-39472) Refactor InMemoryTableCatalog classes hierarchy

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39472: Assignee: Apache Spark > Refactor InMemoryTableCatalog classes hierarchy > --

[jira] [Assigned] (SPARK-39472) Refactor InMemoryTableCatalog classes hierarchy

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39472: Assignee: (was: Apache Spark) > Refactor InMemoryTableCatalog classes hierarchy > ---

[jira] [Commented] (SPARK-39472) Refactor InMemoryTableCatalog classes hierarchy

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554297#comment-17554297 ] Apache Spark commented on SPARK-39472: -- User 'pan3793' has created a pull request f

[jira] [Created] (SPARK-39472) Refactor InMemoryTableCatalog classes hierarchy

2022-06-14 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-39472: - Summary: Refactor InMemoryTableCatalog classes hierarchy Key: SPARK-39472 URL: https://issues.apache.org/jira/browse/SPARK-39472 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-39468) Improve RpcAddress to add [] to IPv6 if needed

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39468: -- Summary: Improve RpcAddress to add [] to IPv6 if needed (was: Support IPv6 in RpcAddress) >

[jira] [Resolved] (SPARK-39471) ExternalShuffleService port is extracted from the confs everytime a block manager gets registered

2022-06-14 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh resolved SPARK-39471. --- Resolution: Not A Problem Created by mistake. This is not a problem in the master > Externa

[jira] [Created] (SPARK-39471) ExternalShuffleService port is extracted from the confs everytime a block manager gets registered

2022-06-14 Thread Chandni Singh (Jira)
Chandni Singh created SPARK-39471: - Summary: ExternalShuffleService port is extracted from the confs everytime a block manager gets registered Key: SPARK-39471 URL: https://issues.apache.org/jira/browse/SPARK-3947

[jira] [Assigned] (SPARK-39468) Support IPv6 in RpcAddress

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39468: - Assignee: Dongjoon Hyun > Support IPv6 in RpcAddress > -- > >

[jira] [Updated] (SPARK-39457) Support IPv6-only environment

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39457: -- Summary: Support IPv6-only environment (was: Support pure IPV6 environment without IPV4) > S

[jira] [Commented] (SPARK-39470) Support cast of ANSI intervals to decimals

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554244#comment-17554244 ] Apache Spark commented on SPARK-39470: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-39470) Support cast of ANSI intervals to decimals

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554243#comment-17554243 ] Apache Spark commented on SPARK-39470: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-39470) Support cast of ANSI intervals to decimals

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39470: Assignee: Max Gekk (was: Apache Spark) > Support cast of ANSI intervals to decimals > --

[jira] [Assigned] (SPARK-39470) Support cast of ANSI intervals to decimals

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39470: Assignee: Apache Spark (was: Max Gekk) > Support cast of ANSI intervals to decimals > --

[jira] [Created] (SPARK-39470) Support cast of ANSI intervals to decimals

2022-06-14 Thread Max Gekk (Jira)
Max Gekk created SPARK-39470: Summary: Support cast of ANSI intervals to decimals Key: SPARK-39470 URL: https://issues.apache.org/jira/browse/SPARK-39470 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-39469) Infer date type for CSV schema inference

2022-06-14 Thread Jonathan Cui (Jira)
Jonathan Cui created SPARK-39469: Summary: Infer date type for CSV schema inference Key: SPARK-39469 URL: https://issues.apache.org/jira/browse/SPARK-39469 Project: Spark Issue Type: Improvem

[jira] [Assigned] (SPARK-39468) Support IPv6 in RpcAddress

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39468: Assignee: Apache Spark > Support IPv6 in RpcAddress > -- > >

[jira] [Assigned] (SPARK-39468) Support IPv6 in RpcAddress

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39468: Assignee: (was: Apache Spark) > Support IPv6 in RpcAddress >

[jira] [Commented] (SPARK-39468) Support IPv6 in RpcAddress

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554233#comment-17554233 ] Apache Spark commented on SPARK-39468: -- User 'dongjoon-hyun' has created a pull req

[jira] [Created] (SPARK-39468) Support IPv6 in RpcAddress

2022-06-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39468: - Summary: Support IPv6 in RpcAddress Key: SPARK-39468 URL: https://issues.apache.org/jira/browse/SPARK-39468 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-39459) local*HostName* methods should support IPv6

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39459: -- Summary: local*HostName* methods should support IPv6 (was: LocalSchedulerBackend doesn't supp

[jira] [Resolved] (SPARK-39397) Relax AliasAwareOutputExpression to support alias with expression

2022-06-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39397. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36785 [https://gith

[jira] [Assigned] (SPARK-39397) Relax AliasAwareOutputExpression to support alias with expression

2022-06-14 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39397: --- Assignee: XiDuo You > Relax AliasAwareOutputExpression to support alias with expression > -

[jira] [Resolved] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39466. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36867 [https://

[jira] [Assigned] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39466: - Assignee: Yang Jie > Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

[jira] [Assigned] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39464: - Assignee: Dongjoon Hyun > Use `Utils.localCanonicalHostName` instead of `localhost` in

[jira] [Resolved] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39464. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36866 [https://

[jira] [Resolved] (SPARK-39298) Change to use `seq.indices` constructing ranges

2022-06-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39298. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36679 [https://gi

[jira] [Assigned] (SPARK-39298) Change to use `seq.indices` constructing ranges

2022-06-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39298: Assignee: Yang Jie > Change to use `seq.indices` constructing ranges > --

[jira] [Updated] (SPARK-39467) Count on distinct asterisk not equals to the count with column names provided

2022-06-14 Thread Michael Taranov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Taranov updated SPARK-39467: Description: Hi everyone, We came across a case when count distinct with asterisk produce

[jira] [Updated] (SPARK-39467) Count on distinct asterisk not equals to the count with column names provided

2022-06-14 Thread Michael Taranov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Taranov updated SPARK-39467: Description: Hi everyone, We came across a case when count distinct with asterisk produce

[jira] [Updated] (SPARK-39467) Count on distinct asterisk not equals to the count with column names provided

2022-06-14 Thread Michael Taranov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Taranov updated SPARK-39467: Description: Hi everyone, We came across a case when count distinct with asterisk produce

[jira] [Updated] (SPARK-39467) Count on distinct asterisk not equals to the count with column names provided

2022-06-14 Thread Michael Taranov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Taranov updated SPARK-39467: Component/s: SQL > Count on distinct asterisk not equals to the count with column names pr

[jira] [Created] (SPARK-39467) Count on distinct asterisk not equals to the count with column names provided

2022-06-14 Thread Michael Taranov (Jira)
Michael Taranov created SPARK-39467: --- Summary: Count on distinct asterisk not equals to the count with column names provided Key: SPARK-39467 URL: https://issues.apache.org/jira/browse/SPARK-39467 P

[jira] [Assigned] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39466: Assignee: Apache Spark > Clean `core/temp-secrets/` after executing `SecurityManagerSuite

[jira] [Assigned] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39466: Assignee: (was: Apache Spark) > Clean `core/temp-secrets/` after executing `SecurityM

[jira] [Commented] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554019#comment-17554019 ] Apache Spark commented on SPARK-39466: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554018#comment-17554018 ] Apache Spark commented on SPARK-39466: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-39302) Spark SQL - wrong field selection in group by

2022-06-14 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554015#comment-17554015 ] Sean R. Owen commented on SPARK-39302: -- The error seems correct. You group the resu

[jira] [Resolved] (SPARK-39459) LocalSchedulerBackend doesn't support IPV6

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39459. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36863 [https://

[jira] [Created] (SPARK-39466) Clean `core/temp-secrets/` after executing `SecurityManagerSuite`

2022-06-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-39466: Summary: Clean `core/temp-secrets/` after executing `SecurityManagerSuite` Key: SPARK-39466 URL: https://issues.apache.org/jira/browse/SPARK-39466 Project: Spark Is

[jira] [Created] (SPARK-39465) Log4j version upgrade to 2.17.2

2022-06-14 Thread Chethan G B (Jira)
Chethan G B created SPARK-39465: --- Summary: Log4j version upgrade to 2.17.2 Key: SPARK-39465 URL: https://issues.apache.org/jira/browse/SPARK-39465 Project: Spark Issue Type: Dependency upgrade

[jira] [Assigned] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39464: Assignee: (was: Apache Spark) > Use `Utils.localCanonicalHostName` instead of `localh

[jira] [Commented] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553982#comment-17553982 ] Apache Spark commented on SPARK-39464: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553980#comment-17553980 ] Apache Spark commented on SPARK-39464: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39464: Assignee: Apache Spark > Use `Utils.localCanonicalHostName` instead of `localhost` in tes

[jira] [Updated] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost` in tests

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39464: -- Summary: Use `Utils.localCanonicalHostName` instead of `localhost` in tests (was: Use `Utils.

[jira] [Created] (SPARK-39464) Use `Utils.localCanonicalHostName` instead of `localhost`

2022-06-14 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39464: - Summary: Use `Utils.localCanonicalHostName` instead of `localhost` Key: SPARK-39464 URL: https://issues.apache.org/jira/browse/SPARK-39464 Project: Spark I

[jira] [Comment Edited] (SPARK-39269) spark3.2.0 commit tmp file is not found when rename

2022-06-14 Thread cxb (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553957#comment-17553957 ] cxb edited comment on SPARK-39269 at 6/14/22 7:57 AM: -- [~srowen]  m

[jira] [Commented] (SPARK-39269) spark3.2.0 commit tmp file is not found when rename

2022-06-14 Thread cxb (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553957#comment-17553957 ] cxb commented on SPARK-39269: - [~srowen]  my problem is spark still rename the temporary com

[jira] [Assigned] (SPARK-39381) Make vectorized orc columar writer batch size configurable

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39381: - Assignee: dzcxzl > Make vectorized orc columar writer batch size configurable > ---

[jira] [Resolved] (SPARK-39381) Make vectorized orc columar writer batch size configurable

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39381. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36769 [https://

[jira] [Updated] (SPARK-39448) Add ReplaceCTERefWithRepartition into nonExcludableRules list

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39448: -- Fix Version/s: 3.3.1 (was: 3.3.0) > Add ReplaceCTERefWithRepartition in

[jira] [Resolved] (SPARK-39448) Add ReplaceCTERefWithRepartition into nonExcludableRules list

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39448. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36847 [https://

[jira] [Updated] (SPARK-39448) Add ReplaceCTERefWithRepartition into nonExcludableRules list

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39448: -- Fix Version/s: 3.4.0 > Add ReplaceCTERefWithRepartition into nonExcludableRules list > ---

[jira] [Assigned] (SPARK-39448) Add ReplaceCTERefWithRepartition into nonExcludableRules list

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39448: - Assignee: Yuming Wang > Add ReplaceCTERefWithRepartition into nonExcludableRules list >

[jira] [Comment Edited] (SPARK-39302) Spark SQL - wrong field selection in group by

2022-06-14 Thread shaharl...@gmail.com (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553939#comment-17553939 ] shaharl...@gmail.com edited comment on SPARK-39302 at 6/14/22 7:24 AM: ---

[jira] [Commented] (SPARK-39302) Spark SQL - wrong field selection in group by

2022-06-14 Thread shaharl...@gmail.com (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553939#comment-17553939 ] shaharl...@gmail.com commented on SPARK-39302: -- [~srowen] , You are absolut

[jira] [Updated] (SPARK-39302) Spark SQL - wrong field selection in group by

2022-06-14 Thread shaharl...@gmail.com (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shaharl...@gmail.com updated SPARK-39302: - Description: SQL parser select wrong field to group by. See following example. S

[jira] [Resolved] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39463. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36864 [https://

[jira] [Assigned] (SPARK-39463) Use UUID for test database location in JavaJdbcRDDSuite

2022-06-14 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39463: - Assignee: Dongjoon Hyun > Use UUID for test database location in JavaJdbcRDDSuite > ---