[jira] [Commented] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780850#comment-17780850 ] Dongjoon Hyun commented on SPARK-45592: --- Thank you, [~eejbyfeldt]. I added a label, `correctness`,

[jira] [Updated] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45592: -- Labels: correctness pull-request-available (was: pull-request-available) > AQE and

[jira] [Updated] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45592: -- Priority: Blocker (was: Major) > AQE and InMemoryTableScanExec correctness bug >

[jira] [Resolved] (SPARK-45685) Use `LazyList` instead of `Stream`

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45685. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43563

[jira] [Resolved] (SPARK-45707) Simplify `DataFrameStatFunctions. countMinSketch` with `CountMinSketchAgg `

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45707. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43560

[jira] [Assigned] (SPARK-45707) Simplify `DataFrameStatFunctions. countMinSketch` with `CountMinSketchAgg `

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45707: - Assignee: Ruifeng Zheng > Simplify `DataFrameStatFunctions. countMinSketch` with

[jira] [Resolved] (SPARK-45682) Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated"

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45682. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43573

[jira] [Assigned] (SPARK-45682) Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated"

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45682: - Assignee: Yang Jie > Fix "method + in class Byte/Short/Char/Long/Double/Int is

[jira] [Resolved] (SPARK-45664) Introduce a mapper for orc compression codecs

2023-10-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45664. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43528

[jira] [Commented] (SPARK-45691) Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either`

2023-10-29 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780836#comment-17780836 ] Snoot.io commented on SPARK-45691: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Commented] (SPARK-45690) Clean up type use of `BufferedIterator/CanBuildFrom/Traversable`

2023-10-29 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780835#comment-17780835 ] Snoot.io commented on SPARK-45690: -- User 'LuciferYang' has created a pull request for this issue:

[jira] [Updated] (SPARK-44098) Introduce python breaking change detection

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44098: --- Labels: pull-request-available (was: ) > Introduce python breaking change detection >

[jira] [Resolved] (SPARK-44790) XML: to_xml

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44790. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43503

[jira] [Assigned] (SPARK-44790) XML: to_xml

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44790: Assignee: Sandip Agarwala > XML: to_xml > --- > > Key:

[jira] (SPARK-45689) Clean up the deprecated API usage related to `StringContext/StringOps`

2023-10-29 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45689 ] BingKun Pan deleted comment on SPARK-45689: - was (Author: panbingkun): I work on it. > Clean up the deprecated API usage related to `StringContext/StringOps` >

[jira] [Reopened] (SPARK-45673) Enhancing clarity and usability of PySpark error messages

2023-10-29 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reopened SPARK-45673: - > Enhancing clarity and usability of PySpark error messages >

[jira] [Resolved] (SPARK-45673) Enhancing clarity and usability of PySpark error messages

2023-10-29 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-45673. - Resolution: Fixed > Enhancing clarity and usability of PySpark error messages >

[jira] [Resolved] (SPARK-45554) Introduce flexible parameter to assertSchemaEqual

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45554. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43450

[jira] [Assigned] (SPARK-45552) Introduce flexible parameters to assertDataFrameEqual

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45552: Assignee: Haejoon Lee > Introduce flexible parameters to assertDataFrameEqual >

[jira] [Resolved] (SPARK-45552) Introduce flexible parameters to assertDataFrameEqual

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45552. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43433

[jira] [Resolved] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

2023-10-29 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-45544. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-45544) [CORE] Integrate SSL support into TransportContext

2023-10-29 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-45544: --- Assignee: Hasnain Lakhani > [CORE] Integrate SSL support into

[jira] [Updated] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44301: --- Labels: pull-request-available (was: ) > Add Support for TPCH Micro Benchmark >

[jira] [Updated] (SPARK-44473) Overwriting the same partition of a partitioned table multiple times with empty data yields non-idempotent results

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44473: --- Labels: pull-request-available (was: ) > Overwriting the same partition of a partitioned

[jira] [Resolved] (SPARK-45571) Spark connect executor ignore jars in classpath

2023-10-29 Thread Liran Y (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liran Y resolved SPARK-45571. - Resolution: Invalid I had wrong permissions on the files in the jars directory > Spark connect

[jira] [Updated] (SPARK-39931) Improve performance of applyInPandas for very small groups

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-39931: --- Labels: pull-request-available (was: ) > Improve performance of applyInPandas for very

[jira] [Updated] (SPARK-44472) change the external catalog thread safety way

2023-10-29 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-44472: Labels: (was: spark-) > change the external catalog thread safety way >

[jira] [Updated] (SPARK-44472) change the external catalog thread safety way

2023-10-29 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Izek Greenfield updated SPARK-44472: Labels: spark- (was: ) > change the external catalog thread safety way >

[jira] [Commented] (SPARK-44472) change the external catalog thread safety way

2023-10-29 Thread Izek Greenfield (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17780741#comment-17780741 ] Izek Greenfield commented on SPARK-44472: - Hi, Any comments about this? > change the external

[jira] [Updated] (SPARK-45605) Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues`

2023-10-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45605: - Priority: Minor (was: Major) >Replace `s.c.MapOps.mapValues` with

[jira] [Resolved] (SPARK-45605) Replace `s.c.MapOps.mapValues` with `s.c.MapOps.view.mapValues`

2023-10-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45605. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43448

[jira] [Resolved] (SPARK-45636) Upgrade jersey to 2.41

2023-10-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45636. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43490

[jira] [Assigned] (SPARK-45636) Upgrade jersey to 2.41

2023-10-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45636: Assignee: Yang Jie > Upgrade jersey to 2.41 > -- > >

[jira] [Updated] (SPARK-45636) Upgrade jersey to 2.41

2023-10-29 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45636: - Priority: Minor (was: Major) > Upgrade jersey to 2.41 > -- > >

[jira] [Updated] (SPARK-45689) Clean up the deprecated API usage related to `StringContext/StringOps`

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45689: --- Labels: pull-request-available (was: ) > Clean up the deprecated API usage related to

[jira] [Updated] (SPARK-45598) Delta table 3.0.0 not working with Spark Connect 3.5.0

2023-10-29 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Faiz Halde updated SPARK-45598: --- Description: Spark version 3.5.0 Spark Connect version 3.5.0 Delta table 3.0.0 Spark connect

[jira] [Updated] (SPARK-45598) Delta table 3.0.0 not working with Spark Connect 3.5.0

2023-10-29 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Faiz Halde updated SPARK-45598: --- Description: Spark version 3.5.0 Spark Connect version 3.5.0 Delta table 3.0.0 Spark connect

[jira] [Updated] (SPARK-45598) Delta table 3.0.0 not working with Spark Connect 3.5.0

2023-10-29 Thread Faiz Halde (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Faiz Halde updated SPARK-45598: --- Description: Spark version 3.5.0 Spark Connect version 3.5.0 Delta table 3.0.0 Spark connect

[jira] [Updated] (SPARK-45701) Clean up the deprecated API usage related to `SetOps`

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45701: --- Labels: pull-request-available (was: ) > Clean up the deprecated API usage related to

[jira] [Updated] (SPARK-45691) Clean up the deprecated API usage related to `RightProjection/LeftProjection/Either`

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45691: --- Labels: pull-request-available (was: ) > Clean up the deprecated API usage related to >

[jira] [Updated] (SPARK-45682) Fix "method + in class Byte/Short/Char/Long/Double/Int is deprecated"

2023-10-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45682: --- Labels: pull-request-available (was: ) > Fix "method + in class

[jira] [Resolved] (SPARK-45674) Improve error message for JVM-dependent attributes on Spark Connect.

2023-10-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45674. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43537