[jira] [Assigned] (SPARK-44691) Move Subclasses of Analysis to sql/api

2023-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44691: --- Assignee: Yihong He > Move Subclasses of Analysis to sql/api >

[jira] [Resolved] (SPARK-44691) Move Subclasses of Analysis to sql/api

2023-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44691. - Fix Version/s: 3.5.0 Resolution: Fixed > Move Subclasses of Analysis to sql/api > ---

[jira] [Created] (SPARK-44755) Local tmp data is not cleared while using spark streaming consuming from kafka

2023-08-09 Thread leesf (Jira)
leesf created SPARK-44755: - Summary: Local tmp data is not cleared while using spark streaming consuming from kafka Key: SPARK-44755 URL: https://issues.apache.org/jira/browse/SPARK-44755 Project: Spark

[jira] [Updated] (SPARK-44754) Improve DeduplicateRelations rewriteAttrs compatibility

2023-08-09 Thread Jia Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan updated SPARK-44754: Description: {{Follow [https://github.com/apache/spark/pull/41554,] we should add test for }} {{{}MapPart

[jira] [Created] (SPARK-44754) Improve DeduplicateRelations rewriteAttrs compatibility

2023-08-09 Thread Jia Fan (Jira)
Jia Fan created SPARK-44754: --- Summary: Improve DeduplicateRelations rewriteAttrs compatibility Key: SPARK-44754 URL: https://issues.apache.org/jira/browse/SPARK-44754 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-44461) Enable Process Isolation for streaming python worker

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-44461: - Fix Version/s: (was: 3.5.0) (was: 4.0.0) > Enable Process Isolation f

[jira] [Reopened] (SPARK-44461) Enable Process Isolation for streaming python worker

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-44461: -- > Enable Process Isolation for streaming python worker > -

[jira] [Commented] (SPARK-44729) Add canonical links to the PySpark docs page

2023-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752599#comment-17752599 ] Ruifeng Zheng commented on SPARK-44729: --- [~panbingkun] Thanks! > Add canonical li

[jira] [Resolved] (SPARK-44461) Enable Process Isolation for streaming python worker

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44461. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-44753) XML: Add Python and sparkR binding including Spark Connect

2023-08-09 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44753: --- Summary: XML: Add Python and sparkR binding including Spark Connect Key: SPARK-44753 URL: https://issues.apache.org/jira/browse/SPARK-44753 Project: Spark

[jira] [Created] (SPARK-44752) XML: Update Spark Docs

2023-08-09 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44752: --- Summary: XML: Update Spark Docs Key: SPARK-44752 URL: https://issues.apache.org/jira/browse/SPARK-44752 Project: Spark Issue Type: Sub-task C

[jira] [Updated] (SPARK-44751) XML: Implement FIleFormat Interface

2023-08-09 Thread Sandip Agarwala (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandip Agarwala updated SPARK-44751: Description: This will also address most of the review comments from the first XML PR: ht

[jira] [Created] (SPARK-44751) XML: Implement FIleFormat Interface

2023-08-09 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-44751: --- Summary: XML: Implement FIleFormat Interface Key: SPARK-44751 URL: https://issues.apache.org/jira/browse/SPARK-44751 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-44750) SparkSession.Builder should respect the options

2023-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44750: -- Description: In connect session builder, users use {{config}} method to set options. However,

[jira] [Updated] (SPARK-44750) SparkSession.Builder should respect the options

2023-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-44750: -- Description: In connect session builder, we use {{config}} method to set options. However, the

[jira] [Assigned] (SPARK-44750) SparkSession.Builder should respect the options

2023-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44750: - Assignee: Ruifeng Zheng > SparkSession.Builder should respect the options > ---

[jira] [Created] (SPARK-44750) SparkSession.Builder should respect the options

2023-08-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44750: - Summary: SparkSession.Builder should respect the options Key: SPARK-44750 URL: https://issues.apache.org/jira/browse/SPARK-44750 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-44732) Port the initial implementation of Spark XML data source

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44732: Assignee: Hyukjin Kwon > Port the initial implementation of Spark XML data source > -

[jira] [Resolved] (SPARK-44732) Port the initial implementation of Spark XML data source

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44732. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41832 [https://gi

[jira] [Resolved] (SPARK-42621) Add `inclusive` parameter for date_range

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42621. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 40665 [https://gi

[jira] [Commented] (SPARK-44729) Add canonical links to the PySpark docs page

2023-08-09 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752575#comment-17752575 ] BingKun Pan commented on SPARK-44729: - Okay, let me do it. > Add canonical links to

[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions

2023-08-09 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752572#comment-17752572 ] BingKun Pan commented on SPARK-44580: - I have observed the logs of the above cases,

[jira] [Updated] (SPARK-44580) RocksDB crashed when testing in GitHub Actions

2023-08-09 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44580: Attachment: image-2023-08-10-09-44-19-341.png > RocksDB crashed when testing in GitHub Actions > -

[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions

2023-08-09 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752564#comment-17752564 ] BingKun Pan commented on SPARK-44580: - >From this error, it seems that it is caused

[jira] [Commented] (SPARK-44729) Add canonical links to the PySpark docs page

2023-08-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752561#comment-17752561 ] Ruifeng Zheng commented on SPARK-44729: --- [~panbingkun] HI, bingkun, would you mind

[jira] [Resolved] (SPARK-44747) Add Dataset.Builder methods to Scala Client

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44747. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-44749) Support named arguments in Python UDTF

2023-08-09 Thread Takuya Ueshin (Jira)
Takuya Ueshin created SPARK-44749: - Summary: Support named arguments in Python UDTF Key: SPARK-44749 URL: https://issues.apache.org/jira/browse/SPARK-44749 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-44740) Allow configuring the session ID for a spark connect client in the remote string

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44740: Assignee: Martin Grund > Allow configuring the session ID for a spark connect client in t

[jira] [Resolved] (SPARK-44740) Allow configuring the session ID for a spark connect client in the remote string

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44740. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-44745) Document shuffle data recovery from the remounted K8s PVCs

2023-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44745: - Assignee: Dongjoon Hyun > Document shuffle data recovery from the remounted K8s PVCs >

[jira] [Resolved] (SPARK-44745) Document shuffle data recovery from the remounted K8s PVCs

2023-08-09 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44745. --- Fix Version/s: 3.5.0 4.0.0 3.4.2 Resolution: Fix

[jira] [Commented] (SPARK-44748) Query execution to support PARTITION BY and ORDER BY clause for table arguments

2023-08-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752531#comment-17752531 ] Daniel commented on SPARK-44748: I can work on this one > Query execution to support PA

[jira] [Resolved] (SPARK-44503) Query planning to support PARTITION BY and ORDER BY clause for table arguments

2023-08-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-44503. Resolution: Fixed > Query planning to support PARTITION BY and ORDER BY clause for table arguments > -

[jira] [Created] (SPARK-44748) Query execution to support PARTITION BY and ORDER BY clause for table arguments

2023-08-09 Thread Daniel (Jira)
Daniel created SPARK-44748: -- Summary: Query execution to support PARTITION BY and ORDER BY clause for table arguments Key: SPARK-44748 URL: https://issues.apache.org/jira/browse/SPARK-44748 Project: Spark

[jira] [Updated] (SPARK-44503) Query planning to support PARTITION BY and ORDER BY clause for table arguments

2023-08-09 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-44503: --- Summary: Query planning to support PARTITION BY and ORDER BY clause for table arguments (was: Support PARTI

[jira] [Commented] (SPARK-44646) Migrate Log4j 2.x in Spark 3.4.1 to Logback

2023-08-09 Thread Yu Tian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752524#comment-17752524 ] Yu Tian commented on SPARK-44646: - Hi [~viirya]  Thanks for the suggestion, we spent so

[jira] [Updated] (SPARK-44646) Migrate Log4j 2.x in Spark 3.4.1 to Logback

2023-08-09 Thread Yu Tian (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Tian updated SPARK-44646: Attachment: Screenshot 2023-08-09 at 2.40.12 PM.png > Migrate Log4j 2.x in Spark 3.4.1 to Logback > --

[jira] [Created] (SPARK-44747) Add Dataset.Builder methods to Scala Client

2023-08-09 Thread Jira
Herman van Hövell created SPARK-44747: - Summary: Add Dataset.Builder methods to Scala Client Key: SPARK-44747 URL: https://issues.apache.org/jira/browse/SPARK-44747 Project: Spark Issue T

[jira] [Created] (SPARK-44746) Improve the documentation for TABLE input arguments for UDTFs

2023-08-09 Thread Allison Wang (Jira)
Allison Wang created SPARK-44746: Summary: Improve the documentation for TABLE input arguments for UDTFs Key: SPARK-44746 URL: https://issues.apache.org/jira/browse/SPARK-44746 Project: Spark

[jira] [Updated] (SPARK-44508) Add user guide for Python UDTFs

2023-08-09 Thread Allison Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-44508: - Component/s: Documentation > Add user guide for Python UDTFs > --- >

[jira] [Updated] (SPARK-44738) Spark Connect Reattach misses metadata propagation

2023-08-09 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-44738: -- Epic Link: SPARK-43754 > Spark Connect Reattach misses metadata propagation >

[jira] [Created] (SPARK-44745) Document shuffle data recovery from the remounted K8s PVCs

2023-08-09 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-44745: - Summary: Document shuffle data recovery from the remounted K8s PVCs Key: SPARK-44745 URL: https://issues.apache.org/jira/browse/SPARK-44745 Project: Spark

[jira] [Updated] (SPARK-42035) Add a config flag to force exit on JDK major version mismatch

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-42035: - Target Version/s: 4.0.0 > Add a config flag to force exit on JDK major version mismatch > --

[jira] [Updated] (SPARK-42261) K8s will not allocate more execs if there are any pending execs until next snapshot

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-42261: - Target Version/s: 4.0.0 > K8s will not allocate more execs if there are any pending execs until

[jira] [Updated] (SPARK-44511) Allow insertInto to succeed with partion columns specified when they match those on the target table

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-44511: - Target Version/s: 4.0.0 > Allow insertInto to succeed with partion columns specified when they m

[jira] [Updated] (SPARK-42361) Add an option to use external storage to distribute JAR set in cluster mode on Kube

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-42361: - Target Version/s: 4.0.0 > Add an option to use external storage to distribute JAR set in cluster

[jira] [Updated] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-42260: - Target Version/s: 4.0.0 > Log when the K8s Exec Pods Allocator Stalls >

[jira] [Commented] (SPARK-44727) Improve the error message for dynamic allocation conditions

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752496#comment-17752496 ] Holden Karau commented on SPARK-44727: -- Do you have more context [~chengpan] ? > I

[jira] [Updated] (SPARK-42035) Add a config flag to force exit on JDK major version mismatch

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-42035: - Description: JRE version mismatches can cause errors which are difficult to debug (potentially

[jira] [Updated] (SPARK-34337) Reject disk blocks when out of disk space

2023-08-09 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-34337: - Target Version/s: 4.0.0 > Reject disk blocks when out of disk space > --

[jira] [Created] (SPARK-44744) Move DS v2 API to sql/api module

2023-08-09 Thread Yihong He (Jira)
Yihong He created SPARK-44744: - Summary: Move DS v2 API to sql/api module Key: SPARK-44744 URL: https://issues.apache.org/jira/browse/SPARK-44744 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-44743) Reflect function behavior different from Hive

2023-08-09 Thread Nikhil Goyal (Jira)
Nikhil Goyal created SPARK-44743: Summary: Reflect function behavior different from Hive Key: SPARK-44743 URL: https://issues.apache.org/jira/browse/SPARK-44743 Project: Spark Issue Type: New

[jira] [Created] (SPARK-44742) Add Spark version drop down to the PySpark doc site

2023-08-09 Thread Allison Wang (Jira)
Allison Wang created SPARK-44742: Summary: Add Spark version drop down to the PySpark doc site Key: SPARK-44742 URL: https://issues.apache.org/jira/browse/SPARK-44742 Project: Spark Issue Typ

[jira] [Commented] (SPARK-44741) Spark StatsD metrics reported to support metrics filter option

2023-08-09 Thread rameshkrishnan muthusamy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752456#comment-17752456 ] rameshkrishnan muthusamy commented on SPARK-44741: -- I am working on PR

[jira] [Created] (SPARK-44741) Spark StatsD metrics reported to support metrics filter option

2023-08-09 Thread rameshkrishnan muthusamy (Jira)
rameshkrishnan muthusamy created SPARK-44741: Summary: Spark StatsD metrics reported to support metrics filter option Key: SPARK-44741 URL: https://issues.apache.org/jira/browse/SPARK-44741

[jira] [Created] (SPARK-44740) Allow configuring the session ID for a spark connect client in the remote string

2023-08-09 Thread Martin Grund (Jira)
Martin Grund created SPARK-44740: Summary: Allow configuring the session ID for a spark connect client in the remote string Key: SPARK-44740 URL: https://issues.apache.org/jira/browse/SPARK-44740 Proj

[jira] [Resolved] (SPARK-44720) Make Dataset use Encoder instead of AgnosticEncoder

2023-08-09 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-44720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-44720. --- Fix Version/s: 3.5.0 Resolution: Fixed > Make Dataset use Encoder instead of

[jira] [Updated] (SPARK-44580) RocksDB crashed when testing in GitHub Actions

2023-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44580: - Attachment: image-2023-08-09-20-26-11-507.png > RocksDB crashed when testing in GitHub Actions > ---

[jira] [Commented] (SPARK-44580) RocksDB crashed when testing in GitHub Actions

2023-08-09 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752402#comment-17752402 ] Yang Jie commented on SPARK-44580: -- A new crash case [https://github.com/yaooqinn/spar

[jira] [Resolved] (SPARK-43429) Add default/active SparkSession APIs

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43429. -- Fix Version/s: 3.5.0 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-42620) Add `inclusive` parameter for (DataFrame|Series).between_time

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42620. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 40370 [https://gi

[jira] [Commented] (SPARK-44721) Retry Policy Revamp

2023-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752349#comment-17752349 ] ASF GitHub Bot commented on SPARK-44721: User 'cdkrot' has created a pull reques

[jira] [Commented] (SPARK-40909) Reuse the broadcast exchange for bloom filter

2023-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752348#comment-17752348 ] ASF GitHub Bot commented on SPARK-40909: User 'beliefer' has created a pull requ

[jira] [Commented] (SPARK-44738) Spark Connect Reattach misses metadata propagation

2023-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752343#comment-17752343 ] ASF GitHub Bot commented on SPARK-44738: User 'grundprinzip' has created a pull

[jira] [Resolved] (SPARK-44738) Spark Connect Reattach misses metadata propagation

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44738. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42409 [https://gi

[jira] [Assigned] (SPARK-44738) Spark Connect Reattach misses metadata propagation

2023-08-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44738: Assignee: Martin Grund > Spark Connect Reattach misses metadata propagation > ---

[jira] [Updated] (SPARK-44739) Conflicting attribute during join two times the same table (AQE is disabled)

2023-08-09 Thread kondziolka9ld (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kondziolka9ld updated SPARK-44739: -- Description: h2. Issue I come across a something that seems to be bug in *pyspark* (when I di

[jira] [Created] (SPARK-44739) Conflicting attribute during join two times the same table (AQE is disabled)

2023-08-09 Thread kondziolka9ld (Jira)
kondziolka9ld created SPARK-44739: - Summary: Conflicting attribute during join two times the same table (AQE is disabled) Key: SPARK-44739 URL: https://issues.apache.org/jira/browse/SPARK-44739 Projec

[jira] [Resolved] (SPARK-42849) Session variables

2023-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42849. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 40474 [https://gith

[jira] [Assigned] (SPARK-42849) Session variables

2023-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42849: --- Assignee: Serge Rielau > Session variables > - > > Key: SPA

[jira] [Created] (SPARK-44738) Spark Connect Reattach misses metadata propagation

2023-08-09 Thread Martin Grund (Jira)
Martin Grund created SPARK-44738: Summary: Spark Connect Reattach misses metadata propagation Key: SPARK-44738 URL: https://issues.apache.org/jira/browse/SPARK-44738 Project: Spark Issue Type

[jira] [Resolved] (SPARK-44551) Wrong semantics for null IN (empty list) - IN expression execution

2023-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44551. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 42163 [https://gith

[jira] [Assigned] (SPARK-44551) Wrong semantics for null IN (empty list) - IN expression execution

2023-08-09 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-44551: --- Assignee: Jack Chen > Wrong semantics for null IN (empty list) - IN expression execution >