[jira] [Resolved] (SPARK-52852) Remove spark_conf argument from create_streaming_table

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52852. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51607 [https://gi

[jira] [Assigned] (SPARK-52852) Remove spark_conf argument from create_streaming_table

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52852: Assignee: Sandy Ryza > Remove spark_conf argument from create_streaming_table > -

[jira] [Resolved] (SPARK-52869) Add FrameLessOffsetWindowFunction validation to validateResolvedWindowExpression for reuse in single-pass analyzer

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52869. - Resolution: Fixed Issue resolved by pull request 51559 [https://github.com/apache/spark/pull/515

[jira] [Assigned] (SPARK-52869) Add FrameLessOffsetWindowFunction validation to validateResolvedWindowExpression for reuse in single-pass analyzer

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52869: --- Assignee: Nikola Jovićević > Add FrameLessOffsetWindowFunction validation to > validateRes

[jira] [Updated] (SPARK-52788) Failed to convert value [B@2fb2f244 (class of class [B) in type BinaryType to XML

2025-07-21 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-52788: - Fix Version/s: 4.0.1 > Failed to convert value [B@2fb2f244 (class of class [B) in type BinaryType to >

[jira] [Comment Edited] (SPARK-52819) Structured Streaming: FlatMapGroupsWithState: java.io.NotSerializableException: org.apache.spark.sql.catalyst.encoders.KryoSerializationCodec$

2025-07-21 Thread Kristin Cowalcijk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008883#comment-18008883 ] Kristin Cowalcijk edited comment on SPARK-52819 at 7/22/25 4:05 AM: --

[jira] [Commented] (SPARK-52819) Structured Streaming: FlatMapGroupsWithState: java.io.NotSerializableException: org.apache.spark.sql.catalyst.encoders.KryoSerializationCodec$

2025-07-21 Thread Kristin Cowalcijk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008883#comment-18008883 ] Kristin Cowalcijk commented on SPARK-52819: --- I have ran into a similar problem

[jira] [Updated] (SPARK-52767) Hidden performance issues with join and union

2025-07-21 Thread Mingliang Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Zhu updated SPARK-52767: -- Description: The maxRows of join needs to calculate the maxRows of left and right twice respe

[jira] [Updated] (SPARK-52915) Support TTL for Spark apps

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52915: --- Labels: pull-request-available (was: ) > Support TTL for Spark apps > -

[jira] [Created] (SPARK-52915) Support TTL for Spark apps

2025-07-21 Thread Zhou JIANG (Jira)
Zhou JIANG created SPARK-52915: -- Summary: Support TTL for Spark apps Key: SPARK-52915 URL: https://issues.apache.org/jira/browse/SPARK-52915 Project: Spark Issue Type: Sub-task Compone

[jira] [Resolved] (SPARK-52912) Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)`

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52912. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51603 [https://

[jira] [Updated] (SPARK-52852) Remove spark_conf argument from create_streaming_table

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52852: --- Labels: pull-request-available (was: ) > Remove spark_conf argument from create_streaming_t

[jira] [Resolved] (SPARK-52771) Fix float32 type widening in `truediv`/`floordiv`

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52771. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51456 [https://gi

[jira] [Assigned] (SPARK-52771) Fix float32 type widening in `truediv`/`floordiv`

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52771: Assignee: Xinrong Meng > Fix float32 type widening in `truediv`/`floordiv` >

[jira] [Resolved] (SPARK-52448) Add simplified Struct Expression.Literal

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-52448. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51561 [https://gi

[jira] [Assigned] (SPARK-52448) Add simplified Struct Expression.Literal

2025-07-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-52448: Assignee: Yihong He > Add simplified Struct Expression.Literal >

[jira] [Resolved] (SPARK-52880) Improve `toString` by JEP-280 instead of `ToStringBuilder`

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52880. --- Fix Version/s: 4.1.0 Resolution: Fixed This is resolved via https://github.com/apache

[jira] [Assigned] (SPARK-52914) Support `On-Demand Log Loading` in `History Server`

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52914: - Assignee: Dongjoon Hyun > Support `On-Demand Log Loading` in `History Server` > ---

[jira] [Assigned] (SPARK-52912) Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)`

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52912: - Assignee: Dongjoon Hyun > Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)`

[jira] [Updated] (SPARK-52914) Support `On-Demand Log Loading` in `History Server`

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52914: --- Labels: pull-request-available (was: ) > Support `On-Demand Log Loading` in `History Server

[jira] [Created] (SPARK-52914) Support `On-Demand Log Loading` in `History Server`

2025-07-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52914: - Summary: Support `On-Demand Log Loading` in `History Server` Key: SPARK-52914 URL: https://issues.apache.org/jira/browse/SPARK-52914 Project: Spark Issue T

[jira] [Commented] (SPARK-52851) Remove public APIs for append once flows

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008825#comment-18008825 ] Dongjoon Hyun commented on SPARK-52851: --- I collected this as a subtask of SPARK-51

[jira] [Updated] (SPARK-52851) Remove public APIs for append once flows

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52851: -- Parent: SPARK-51727 Issue Type: Sub-task (was: Improvement) > Remove public APIs for

[jira] [Resolved] (SPARK-52851) Remove public APIs for append once flows

2025-07-21 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-52851. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51563 [https://github

[jira] [Assigned] (SPARK-52851) Remove public APIs for append once flows

2025-07-21 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-52851: -- Assignee: Jacky Wang > Remove public APIs for append once flows > ---

[jira] [Assigned] (SPARK-52913) Upgrade `grpc-swift-2` to 2.1.0

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52913: - Assignee: Dongjoon Hyun > Upgrade `grpc-swift-2` to 2.1.0 > ---

[jira] [Updated] (SPARK-52913) Upgrade `grpc-swift-2` to 2.1.0

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52913: --- Labels: pull-request-available (was: ) > Upgrade `grpc-swift-2` to 2.1.0 >

[jira] [Created] (SPARK-52913) Upgrade `grpc-swift-2` to 2.1.0

2025-07-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52913: - Summary: Upgrade `grpc-swift-2` to 2.1.0 Key: SPARK-52913 URL: https://issues.apache.org/jira/browse/SPARK-52913 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-52912) Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)`

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52912: --- Labels: pull-request-available (was: ) > Improve `SparkStringUtils` to support `is(Not)?(Bl

[jira] [Created] (SPARK-52912) Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)`

2025-07-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52912: - Summary: Improve `SparkStringUtils` to support `is(Not)?(Blank|Empty)` Key: SPARK-52912 URL: https://issues.apache.org/jira/browse/SPARK-52912 Project: Spark

[jira] [Resolved] (SPARK-52911) Remove `StringUtils.(split|chop)` usage

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52911. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51602 [https://

[jira] [Assigned] (SPARK-52911) Remove `StringUtils.(split|chop)` usage

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52911: - Assignee: Dongjoon Hyun > Remove `StringUtils.(split|chop)` usage > ---

[jira] [Updated] (SPARK-52911) Remove `StringUtils.(split|chop)` usage

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52911: --- Labels: pull-request-available (was: ) > Remove `StringUtils.(split|chop)` usage >

[jira] [Created] (SPARK-52911) Remove `StringUtils.(split|chop)` usage

2025-07-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-52911: - Summary: Remove `StringUtils.(split|chop)` usage Key: SPARK-52911 URL: https://issues.apache.org/jira/browse/SPARK-52911 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-52846) Log fetch time for from JDBC remote source

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52846: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > Log fetch time for from

[jira] [Updated] (SPARK-52902) K8s image configs support {{SPARK_VERSION}} placeholder

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-52902: -- Parent: SPARK-51166 Issue Type: Sub-task (was: Improvement) > K8s image configs suppo

[jira] [Commented] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008757#comment-18008757 ] Dongjoon Hyun commented on SPARK-41719: --- To [~sandeep.katta2007] , could you file

[jira] [Resolved] (SPARK-52902) K8s image configs support {{SPARK_VERSION}} placeholder

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-52902. --- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51592 [https://

[jira] [Assigned] (SPARK-52902) K8s image configs support {{SPARK_VERSION}} placeholder

2025-07-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-52902: - Assignee: Cheng Pan > K8s image configs support {{SPARK_VERSION}} placeholder > ---

[jira] [Updated] (SPARK-52910) Remove the explicit specification of -Djava.version in the maven_test.yml file.

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52910: --- Labels: pull-request-available (was: ) > Remove the explicit specification of -Djava.versio

[jira] [Created] (SPARK-52910) Remove the explicit specification of -Djava.version in the maven_test.yml file.

2025-07-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-52910: Summary: Remove the explicit specification of -Djava.version in the maven_test.yml file. Key: SPARK-52910 URL: https://issues.apache.org/jira/browse/SPARK-52910 Project: Spar

[jira] [Resolved] (SPARK-52432) [SDP] DataflowGraphRegistry should be scoped to a session

2025-07-21 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza resolved SPARK-52432. Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51544 [https://github

[jira] [Assigned] (SPARK-52432) [SDP] DataflowGraphRegistry should be scoped to a session

2025-07-21 Thread Sandy Ryza (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-52432: -- Assignee: Jacky Wang > [SDP] DataflowGraphRegistry should be scoped to a session > --

[jira] [Updated] (SPARK-52909) Enable ANSI in JDBCV2JoinPushdownSuite

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52909: --- Labels: pull-request-available (was: ) > Enable ANSI in JDBCV2JoinPushdownSuite > -

[jira] [Created] (SPARK-52909) Enable ANSI in JDBCV2JoinPushdownSuite

2025-07-21 Thread Petar Vasiljevic (Jira)
Petar Vasiljevic created SPARK-52909: Summary: Enable ANSI in JDBCV2JoinPushdownSuite Key: SPARK-52909 URL: https://issues.apache.org/jira/browse/SPARK-52909 Project: Spark Issue Type: Te

[jira] [Commented] (SPARK-52407) Add Native Support for Apache Theta Sketches

2025-07-21 Thread Christopher Boumalhab (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008726#comment-18008726 ] Christopher Boumalhab commented on SPARK-52407: --- PR #51298 has benchmark r

[jira] [Resolved] (SPARK-52846) Log fetch time for from JDBC remote source

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52846. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51536 [https://gith

[jira] [Assigned] (SPARK-52846) Log fetch time for from JDBC remote source

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52846: --- Assignee: Alek Jarmov > Log fetch time for from JDBC remote source > --

[jira] [Commented] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2025-07-21 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008714#comment-18008714 ] Sandeep Katta commented on SPARK-41719: --- Thanks for the ongoing improvements. I’ve

[jira] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2025-07-21 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719 ] Sandeep Katta deleted comment on SPARK-41719: --- was (Author: sandeep.katta2007): Thanks for the ongoing improvements. I’ve encountered a silent regression related to this bug  that impacts

[jira] [Commented] (SPARK-41719) Spark SSLOptions sub settings should be set only when ssl is enabled

2025-07-21 Thread Sandeep Katta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008712#comment-18008712 ] Sandeep Katta commented on SPARK-41719: --- Thanks for the ongoing improvements. I’ve

[jira] [Updated] (SPARK-52904) make python worker throw on int overflow / float truncation (default-enable convertToArrowArraySafely)

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52904: --- Labels: pull-request-available (was: ) > make python worker throw on int overflow / float t

[jira] [Updated] (SPARK-52904) make python worker throw on int overflow / float truncation (default-enable convertToArrowArraySafely)

2025-07-21 Thread Ben Hurdelhey (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Hurdelhey updated SPARK-52904: -- Summary: make python worker throw on int overflow / float truncation (default-enable convertTo

[jira] [Updated] (SPARK-52870) FOR statement errors when referenced columns have whitespace, or are int literals

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-52870: Fix Version/s: 4.0.1 (was: 4.1.0) > FOR statement errors when referenced co

[jira] [Assigned] (SPARK-52870) FOR statement errors when referenced columns have whitespace, or are int literals

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52870: --- Assignee: Dusan Tisma > FOR statement errors when referenced columns have whitespace, or ar

[jira] [Resolved] (SPARK-52870) FOR statement errors when referenced columns have whitespace, or are int literals

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52870. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51560 [https://gith

[jira] [Assigned] (SPARK-52872) Improve test coverage for `HigherOrderFunctions`

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52872: --- Assignee: Mihailo Timotic > Improve test coverage for `HigherOrderFunctions` >

[jira] [Resolved] (SPARK-52872) Improve test coverage for `HigherOrderFunctions`

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52872. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51564 [https://gith

[jira] [Updated] (SPARK-52896) Match attribute `ExprId` in `OuterReference` with `ExprId` of exposed outer attribute

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52896: --- Labels: pull-request-available (was: ) > Match attribute `ExprId` in `OuterReference` with

[jira] [Assigned] (SPARK-52895) Don't add duplicate elements in `resolveExprsWithAggregate`

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-52895: --- Assignee: Mihailo Timotic > Don't add duplicate elements in `resolveExprsWithAggregate` > -

[jira] [Resolved] (SPARK-52895) Don't add duplicate elements in `resolveExprsWithAggregate`

2025-07-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-52895. - Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51567 [https://gith

[jira] [Updated] (SPARK-52908) Prevent for iterator variable name clashing with names of labels in the path to the root of AST

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52908: --- Labels: pull-request-available (was: ) > Prevent for iterator variable name clashing with n

[jira] [Created] (SPARK-52908) Prevent for iterator variable name clashing with names of labels in the path to the root of AST

2025-07-21 Thread Teodor (Jira)
Teodor created SPARK-52908: -- Summary: Prevent for iterator variable name clashing with names of labels in the path to the root of AST Key: SPARK-52908 URL: https://issues.apache.org/jira/browse/SPARK-52908 P

[jira] [Updated] (SPARK-52906) Support Postgres connector for DSv2 Join pushdown

2025-07-21 Thread Petar Vasiljevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Petar Vasiljevic updated SPARK-52906: - Issue Type: New Feature (was: Test) > Support Postgres connector for DSv2 Join pushdown

[jira] [Created] (SPARK-52907) Support SqlServer connector for DSv2 Join pushdown

2025-07-21 Thread Petar Vasiljevic (Jira)
Petar Vasiljevic created SPARK-52907: Summary: Support SqlServer connector for DSv2 Join pushdown Key: SPARK-52907 URL: https://issues.apache.org/jira/browse/SPARK-52907 Project: Spark Is

[jira] [Created] (SPARK-52906) Support Postgres connector for DSv2 Join pushdown

2025-07-21 Thread Petar Vasiljevic (Jira)
Petar Vasiljevic created SPARK-52906: Summary: Support Postgres connector for DSv2 Join pushdown Key: SPARK-52906 URL: https://issues.apache.org/jira/browse/SPARK-52906 Project: Spark Iss

[jira] [Updated] (SPARK-52905) Arrow UDF for window

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52905: --- Labels: pull-request-available (was: ) > Arrow UDF for window > > >

[jira] [Created] (SPARK-52905) Arrow UDF for window

2025-07-21 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-52905: - Summary: Arrow UDF for window Key: SPARK-52905 URL: https://issues.apache.org/jira/browse/SPARK-52905 Project: Spark Issue Type: Sub-task Compone

[jira] [Assigned] (SPARK-52899) Fix QueryExecutionErrorsSuite test to register H2Dialect back

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52899: Assignee: Petar Vasiljevic > Fix QueryExecutionErrorsSuite test to register H2Dialect back >

[jira] [Resolved] (SPARK-52899) Fix QueryExecutionErrorsSuite test to register H2Dialect back

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52899. -- Fix Version/s: (was: 3.4.0) (was: 3.5.0) (was: 3.4.1)

[jira] [Resolved] (SPARK-52885) Implement the hour function in Scala for TIME type

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52885. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51576 [https://github.com

[jira] [Assigned] (SPARK-52886) Implement the minute function in Scala for TIME type

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52886: Assignee: Uroš Bojanić > Implement the minute function in Scala for TIME type > -

[jira] [Resolved] (SPARK-52887) Implement the second function in Scala for TIME type

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52887. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51576 [https://github.com

[jira] [Assigned] (SPARK-52887) Implement the second function in Scala for TIME type

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52887: Assignee: Uroš Bojanić > Implement the second function in Scala for TIME type > -

[jira] [Assigned] (SPARK-52885) Implement the hour function in Scala for TIME type

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-52885: Assignee: Uroš Bojanić > Implement the hour function in Scala for TIME type > ---

[jira] [Resolved] (SPARK-52886) Implement the minute function in Scala for TIME type

2025-07-21 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-52886. -- Fix Version/s: 4.1.0 Resolution: Fixed Issue resolved by pull request 51576 [https://github.com

[jira] [Created] (SPARK-52904) make python worker throw on int overflow / float truncation by default (convertToArrowArraySafely)

2025-07-21 Thread Ben Hurdelhey (Jira)
Ben Hurdelhey created SPARK-52904: - Summary: make python worker throw on int overflow / float truncation by default (convertToArrowArraySafely) Key: SPARK-52904 URL: https://issues.apache.org/jira/browse/SPARK-529

[jira] [Updated] (SPARK-52902) K8s image configs support {{SPARK_VERSION}} placeholder

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52902: --- Labels: pull-request-available (was: ) > K8s image configs support {{SPARK_VERSION}} placeh

[jira] [Updated] (SPARK-52903) Trim non-top-level aliases before LCA resolution

2025-07-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-52903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-52903: --- Labels: pull-request-available (was: ) > Trim non-top-level aliases before LCA resolution >

[jira] [Created] (SPARK-52903) Trim non-top-level aliases before LCA resolution

2025-07-21 Thread Mihailo Timotic (Jira)
Mihailo Timotic created SPARK-52903: --- Summary: Trim non-top-level aliases before LCA resolution Key: SPARK-52903 URL: https://issues.apache.org/jira/browse/SPARK-52903 Project: Spark Issue

[jira] [Created] (SPARK-52902) K8s image configs support {{SPARK_VERSION}} placeholder

2025-07-21 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-52902: - Summary: K8s image configs support {{SPARK_VERSION}} placeholder Key: SPARK-52902 URL: https://issues.apache.org/jira/browse/SPARK-52902 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-52898) Add TIMEs

2025-07-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-52898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić resolved SPARK-52898. -- Resolution: Won't Do Unlike the - operator, the + operator for 2 TIMEs is actually not in the