[jira] [Created] (SPARK-44308) Spark 3.0.1 functions.scala -> posexplode_outer API not flattening data

2023-07-04 Thread Chirag Sanghvi (Jira)
Chirag Sanghvi created SPARK-44308: -- Summary: Spark 3.0.1 functions.scala -> posexplode_outer API not flattening data Key: SPARK-44308 URL: https://issues.apache.org/jira/browse/SPARK-44308 Project:

[jira] [Created] (SPARK-44307) Bloom filter is not added for left outer join if the left side table is smaller than broadcast threshold.

2023-07-04 Thread mahesh kumar behera (Jira)
mahesh kumar behera created SPARK-44307: --- Summary: Bloom filter is not added for left outer join if the left side table is smaller than broadcast threshold. Key: SPARK-44307 URL: https://issues.apache.org/ji

[jira] [Commented] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-04 Thread Chandni Singh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740023#comment-17740023 ] Chandni Singh commented on SPARK-44215: --- PR to backport the change to 3.3 https://

[jira] [Created] (SPARK-44306) Group FileStatus with few RPC calls within Yarn Client

2023-07-04 Thread SHU WANG (Jira)
SHU WANG created SPARK-44306: Summary: Group FileStatus with few RPC calls within Yarn Client Key: SPARK-44306 URL: https://issues.apache.org/jira/browse/SPARK-44306 Project: Spark Issue Type: Ne

[jira] [Commented] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17740018#comment-17740018 ] 7mming7 commented on SPARK-44305: - cc [~yuming]   > Broadcast operation is not required

[jira] [Updated] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 7mming7 updated SPARK-44305: Description: The ability introduced by SPARK-14912, we can broadcast the parameters of the data source to

[jira] [Updated] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 7mming7 updated SPARK-44305: Attachment: image-2023-07-05-11-51-41-708.png > Broadcast operation is not required when no parameters are

[jira] [Created] (SPARK-44305) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
7mming7 created SPARK-44305: --- Summary: Broadcast operation is not required when no parameters are specified Key: SPARK-44305 URL: https://issues.apache.org/jira/browse/SPARK-44305 Project: Spark I

[jira] [Created] (SPARK-44304) Broadcast operation is not required when no parameters are specified

2023-07-04 Thread 7mming7 (Jira)
7mming7 created SPARK-44304: --- Summary: Broadcast operation is not required when no parameters are specified Key: SPARK-44304 URL: https://issues.apache.org/jira/browse/SPARK-44304 Project: Spark I

[jira] [Created] (SPARK-44303) Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324]

2023-07-04 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-44303: -- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_[2320-2324] Key: SPARK-44303 URL: https://issues.apache.org/jira/browse/SPARK-44303 Project: Spark I

[jira] [Resolved] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44300. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41854 [https://gi

[jira] [Assigned] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44300: Assignee: Venkata Sai Akhil Gudesa > SparkConnectArtifactManager#cleanUpResources deletes

[jira] [Created] (SPARK-44302) Reenable PySpark test on the daily test of Java 21 after the new arrow version release

2023-07-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44302: --- Summary: Reenable PySpark test on the daily test of Java 21 after the new arrow version release Key: SPARK-44302 URL: https://issues.apache.org/jira/browse/SPARK-44302

[jira] [Assigned] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44298: Assignee: BingKun Pan > Disable PySpark test on the daily test of Java 21 before the new arrow >

[jira] [Resolved] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44298. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41826 [https://github.com

[jira] [Commented] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739994#comment-17739994 ] Hyukjin Kwon commented on SPARK-43476: -- Reverted at https://github.com/apache/spar

[jira] [Updated] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-43476: - Fix Version/s: (was: 3.5.0) > Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

[jira] [Reopened] (SPARK-43476) Enable SeriesStringTests.test_string_replace for pandas 2.0.0.

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-43476: -- Assignee: (was: Haejoon Lee) > Enable SeriesStringTests.test_string_replace for pandas 2

[jira] [Assigned] (SPARK-44245) pyspark.sql.dataframe doctests can behave differently

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44245: Assignee: Alice Sayutina > pyspark.sql.dataframe doctests can behave differently > --

[jira] [Resolved] (SPARK-44245) pyspark.sql.dataframe doctests can behave differently

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44245. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41787 [https://gi

[jira] [Resolved] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-44215. - Assignee: Chandni Singh Resolution: Fixed > Client receives zero number of

[jira] [Updated] (SPARK-44215) Client receives zero number of chunks in merge meta response which doesn't trigger fallback to unmerged blocks

2023-07-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan updated SPARK-44215: Fix Version/s: 3.5.0 3.4.2 > Client receives zero number of chu

[jira] [Resolved] (SPARK-44293) Task failures during custom JAR fetch in executors

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44293. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41844 [https://gi

[jira] [Assigned] (SPARK-44293) Task failures during custom JAR fetch in executors

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44293: Assignee: Venkata Sai Akhil Gudesa > Task failures during custom JAR fetch in executors >

[jira] [Assigned] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44292: Assignee: jiaan.geng > Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319] > -

[jira] [Resolved] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44292. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41850 [https://github.com

[jira] [Commented] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-07-04 Thread Suraj Naik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739962#comment-17739962 ] Suraj Naik commented on SPARK-44301: I have raised the PR here - https://github.com/

[jira] [Created] (SPARK-44301) Add Support for TPCH Micro Benchmark

2023-07-04 Thread Suraj Naik (Jira)
Suraj Naik created SPARK-44301: -- Summary: Add Support for TPCH Micro Benchmark Key: SPARK-44301 URL: https://issues.apache.org/jira/browse/SPARK-44301 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44296. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41849 [https://github.com

[jira] [Assigned] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44296: Assignee: Yang Jie > Upgrade dropwizard metrics 4.2.19 > - > >

[jira] [Resolved] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44297. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41852 [https://github.com

[jira] [Assigned] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44297: Assignee: Yang Jie > Make `ClassLoaderIsolationSuite` test pass with Scala 2.13 > ---

[jira] [Updated] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-44300: - Epic Link: SPARK-42554 > SparkConnectArtifactManager#cleanUpResources de

[jira] [Created] (SPARK-44300) SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts

2023-07-04 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-44300: Summary: SparkConnectArtifactManager#cleanUpResources deletes all artifacts instead of session-specific artifacts Key: SPARK-44300 URL: https://issues.apac

[jira] [Created] (SPARK-44299) Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8]

2023-07-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44299: --- Summary: Assign names to the error class _LEGACY_ERROR_TEMP_227[4-6,8] Key: SPARK-44299 URL: https://issues.apache.org/jira/browse/SPARK-44299 Project: Spark

[jira] [Commented] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

2023-07-04 Thread PJ Fanning (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739895#comment-17739895 ] PJ Fanning commented on SPARK-35253: Janino 3.1.10 is out today and resolves [https

[jira] [Updated] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-44298: Affects Version/s: 3.5.0 (was: 4.0.0) > Disable PySpark test on the dai

[jira] [Created] (SPARK-44298) Disable PySpark test on the daily test of Java 21 before the new arrow version release

2023-07-04 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44298: --- Summary: Disable PySpark test on the daily test of Java 21 before the new arrow version release Key: SPARK-44298 URL: https://issues.apache.org/jira/browse/SPARK-44298

[jira] [Resolved] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44295. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41848 [https://gi

[jira] [Assigned] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44295: Assignee: Yang Jie > Upgrade scala-parser-combinators to 2.3 > --

[jira] [Commented] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739861#comment-17739861 ] ASF GitHub Bot commented on SPARK-44297: User 'LuciferYang' has created a pull r

[jira] [Updated] (SPARK-44297) Make `ClassLoaderIsolationSuite` test pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44297: - Summary: Make `ClassLoaderIsolationSuite` test pass with Scala 2.13 (was: Make `ClassLoaderIsolationSui

[jira] [Created] (SPARK-44297) Make `ClassLoaderIsolationSuite` pass with Scala 2.13

2023-07-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44297: Summary: Make `ClassLoaderIsolationSuite` pass with Scala 2.13 Key: SPARK-44297 URL: https://issues.apache.org/jira/browse/SPARK-44297 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739857#comment-17739857 ] ASF GitHub Bot commented on SPARK-44296: User 'LuciferYang' has created a pull r

[jira] [Commented] (SPARK-44263) Allow ChannelBuilder extensions -- Scala

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739853#comment-17739853 ] ASF GitHub Bot commented on SPARK-44263: User 'cdkrot' has created a pull reques

[jira] [Commented] (SPARK-44292) Assign names to the error class _LEGACY_ERROR_TEMP_[2315-2319]

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739852#comment-17739852 ] ASF GitHub Bot commented on SPARK-44292: User 'beliefer' has created a pull requ

[jira] [Commented] (SPARK-43851) Support LCA in grouping expressions

2023-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739851#comment-17739851 ] ASF GitHub Bot commented on SPARK-43851: User 'Hisoka-X' has created a pull requ

[jira] [Commented] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739838#comment-17739838 ] Ignite TC Bot commented on SPARK-44295: --- User 'LuciferYang' has created a pull req

[jira] [Created] (SPARK-44296) Upgrade dropwizard metrics 4.2.19

2023-07-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44296: Summary: Upgrade dropwizard metrics 4.2.19 Key: SPARK-44296 URL: https://issues.apache.org/jira/browse/SPARK-44296 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44295: - Description: [https://github.com/scala/scala-parser-combinators/releases/tag/v2.3.0]   new version: *

[jira] [Created] (SPARK-44295) Upgrade scala-parser-combinators to 2.3

2023-07-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-44295: Summary: Upgrade scala-parser-combinators to 2.3 Key: SPARK-44295 URL: https://issues.apache.org/jira/browse/SPARK-44295 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44294) HeapHistogram column shows unexpectedly w/ select-all-box

2023-07-04 Thread Kent Yao (Jira)
Kent Yao created SPARK-44294: Summary: HeapHistogram column shows unexpectedly w/ select-all-box Key: SPARK-44294 URL: https://issues.apache.org/jira/browse/SPARK-44294 Project: Spark Issue Type: