[jira] [Created] (SPARK-47434) Streaming Statistics link redirect causing 302 error

2024-03-17 Thread Huw (Jira)
Huw created SPARK-47434: --- Summary: Streaming Statistics link redirect causing 302 error Key: SPARK-47434 URL: https://issues.apache.org/jira/browse/SPARK-47434 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-19 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1502#comment-1502 ] Huw commented on SPARK-45583: - Ahh, apologies, it looks like I was running 3.4.1 when I found this issue.

[jira] [Updated] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-19 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45583: Affects Version/s: 3.4.1 (was: 3.5.0) > Spark SQL returning incorrect values for full

[jira] [Updated] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-19 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45583: Fix Version/s: 3.5.0 > Spark SQL returning incorrect values for full outer join on keys with the > same name. >

[jira] [Updated] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-17 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45583: Description: {{The following query gives the wrong results.}}   {{WITH people as (}} {{  SELECT * FROM (VALUES 

[jira] [Created] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-17 Thread Huw (Jira)
Huw created SPARK-45583: --- Summary: Spark SQL returning incorrect values for full outer join on keys with the same name. Key: SPARK-45583 URL: https://issues.apache.org/jira/browse/SPARK-45583 Project: Spark

[jira] [Updated] (SPARK-45583) Spark SQL returning incorrect values for full outer join on keys with the same name.

2023-10-17 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45583: Description: {{The following query gives the wrong results.}}   {{WITH people as (}} {{  SELECT * FROM (VALUES 

[jira] [Updated] (SPARK-45176) AggregatingAccumulator with TypedImperativeAggregate throwing ClassCastException

2023-09-14 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45176: Description: Probably related to SPARK-39044. But potentially also this comment in Executor.scala. {quote}//

[jira] [Created] (SPARK-45176) AggregatingAccumulator with TypedImperativeAggregate throwing ClassCastException

2023-09-14 Thread Huw (Jira)
Huw created SPARK-45176: --- Summary: AggregatingAccumulator with TypedImperativeAggregate throwing ClassCastException Key: SPARK-45176 URL: https://issues.apache.org/jira/browse/SPARK-45176 Project: Spark

[jira] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

2023-09-14 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37487 ] Huw deleted comment on SPARK-37487: - was (Author: JIRAUSER288917): I think I've seen crashes because of this in production. I can't reproduce locally, but I believe that Imperative aggregates are

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Description: When performing a 'using' join with a sort hint in a full outer, the ResolveNaturalAndUsingJoin

[jira] [Updated] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-45099: Priority: Minor (was: Major) > SortMergeExec with Outer using join forgets sort information >

[jira] [Created] (SPARK-45099) SortMergeExec with Outer using join forgets sort information

2023-09-07 Thread Huw (Jira)
Huw created SPARK-45099: --- Summary: SortMergeExec with Outer using join forgets sort information Key: SPARK-45099 URL: https://issues.apache.org/jira/browse/SPARK-45099 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort

2023-08-12 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753471#comment-17753471 ] Huw commented on SPARK-37487: - I think I've seen crashes because of this in production. I can't reproduce

[jira] [Commented] (SPARK-26655) Support multiple aggregates in Structured Streaming append mode

2022-05-05 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17532614#comment-17532614 ] Huw commented on SPARK-26655: - I hit the guards in UnsupportedOperationChecker recently, and considered that

[jira] [Updated] (SPARK-39091) SQL Expression traits don't compose due to nodePatterns being final.

2022-05-02 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-39091: Summary: SQL Expression traits don't compose due to nodePatterns being final. (was: SQL Expression traits

[jira] [Updated] (SPARK-39091) SQL Expression traits compose due to nodePatterns being final.

2022-05-02 Thread Huw (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huw updated SPARK-39091: Description: In Spark 3.1 I have an expression which contains these parts: {code:scala} case class MyExploder(

[jira] [Created] (SPARK-39091) SQL Expression traits compose due to nodePatterns being final.

2022-05-02 Thread Huw (Jira)
Huw created SPARK-39091: --- Summary: SQL Expression traits compose due to nodePatterns being final. Key: SPARK-39091 URL: https://issues.apache.org/jira/browse/SPARK-39091 Project: Spark Issue Type: