[jira] [Updated] (SPARK-50566) RocksDB Style Improve

2024-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50566: --- Labels: pull-request-available (was: ) > RocksDB Style Improve > - > >

[jira] [Updated] (SPARK-50565) Add transformWithState correctness test

2024-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50565: --- Labels: pull-request-available (was: ) > Add transformWithState correctness test >

[jira] [Created] (SPARK-50565) Add transformWithState correctness test

2024-12-12 Thread Wei Liu (Jira)
Wei Liu created SPARK-50565: --- Summary: Add transformWithState correctness test Key: SPARK-50565 URL: https://issues.apache.org/jira/browse/SPARK-50565 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-50564) Upgrade protobuf Python package to 5.29.1

2024-12-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-50564: Summary: Upgrade protobuf Python package to 5.29.1 Key: SPARK-50564 URL: https://issues.apache.org/jira/browse/SPARK-50564 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-50563) Upgrade protobuf-java to 4.29.1

2024-12-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-50563: Summary: Upgrade protobuf-java to 4.29.1 Key: SPARK-50563 URL: https://issues.apache.org/jira/browse/SPARK-50563 Project: Spark Issue Type: Improvement Com

[jira] [Updated] (SPARK-50562) Apply Python 3.11 image in Java 21 daily build

2024-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50562: --- Labels: pull-request-available (was: ) > Apply Python 3.11 image in Java 21 daily build > -

[jira] [Created] (SPARK-50562) Apply Python 3.11 image in Java 21 daily build

2024-12-12 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50562: - Summary: Apply Python 3.11 image in Java 21 daily build Key: SPARK-50562 URL: https://issues.apache.org/jira/browse/SPARK-50562 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-49883) Integrate with RocksDB and RocksDBFileManager

2024-12-12 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-49883. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48355 [https://gi

[jira] [Created] (SPARK-50561) uniform() causes internal error with floating point seed

2024-12-12 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-50561: Summary: uniform() causes internal error with floating point seed Key: SPARK-50561 URL: https://issues.apache.org/jira/browse/SPARK-50561 Project: Spark Issu

[jira] [Created] (SPARK-50560) randstr(-1) causes Java stacktrace and argument types are too restrictive

2024-12-12 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-50560: Summary: randstr(-1) causes Java stacktrace and argument types are too restrictive Key: SPARK-50560 URL: https://issues.apache.org/jira/browse/SPARK-50560 Project: Sp

[jira] [Resolved] (SPARK-48416) Support related nested WITH expression

2024-12-12 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-48416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48416. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49093 [https://gith

[jira] [Updated] (SPARK-50559) Store Union, Except and Intersect operator's output as lazy val

2024-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50559: --- Labels: pull-request-available (was: ) > Store Union, Except and Intersect operator's outpu

[jira] [Created] (SPARK-50559) Store Union, Except and Intersect operator's output as lazy val

2024-12-12 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50559: Summary: Store Union, Except and Intersect operator's output as lazy val Key: SPARK-50559 URL: https://issues.apache.org/jira/browse/SPARK-50559 Project: Spar

[jira] [Created] (SPARK-50558) Do not log all values for In and InSet if there are many

2024-12-12 Thread Jan-Ole Sasse (Jira)
Jan-Ole Sasse created SPARK-50558: - Summary: Do not log all values for In and InSet if there are many Key: SPARK-50558 URL: https://issues.apache.org/jira/browse/SPARK-50558 Project: Spark Is

[jira] [Commented] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2024-12-12 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905292#comment-17905292 ] Asif commented on SPARK-45943: -- will try to debug and open PR if possible. > DataSourceV2R

[jira] [Commented] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2024-12-12 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905291#comment-17905291 ] Asif commented on SPARK-45943: -- The exception seen is: [INTERNAL_ERROR] BUG: computeStats

[jira] [Reopened] (SPARK-45943) DataSourceV2Relation.computeStats throws IllegalStateException in test mode

2024-12-12 Thread Asif (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asif reopened SPARK-45943: -- This issue, it appears , is not fixed in entirety. I am seeing this issue in the test of the following PR: [http

[jira] [Created] (SPARK-50557) Add RuntimeConf.contains(..)

2024-12-12 Thread Jira
Herman van Hövell created SPARK-50557: - Summary: Add RuntimeConf.contains(..) Key: SPARK-50557 URL: https://issues.apache.org/jira/browse/SPARK-50557 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-50556) Document development workflow with interfaces

2024-12-12 Thread Jira
Herman van Hövell created SPARK-50556: - Summary: Document development workflow with interfaces Key: SPARK-50556 URL: https://issues.apache.org/jira/browse/SPARK-50556 Project: Spark Issue

[jira] [Commented] (SPARK-33720) Support submit to k8s only with token

2024-12-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905267#comment-17905267 ] Dongjoon Hyun commented on SPARK-33720: --- BTW, please use Apache Spark 4.0.0-previe

[jira] [Commented] (SPARK-33720) Support submit to k8s only with token

2024-12-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905266#comment-17905266 ] Dongjoon Hyun commented on SPARK-33720: --- Thank you for reporting, [~apiwoni]. Plea

[jira] [Resolved] (SPARK-50554) Add a separate docker file for Python 3.11 daily coverage build

2024-12-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50554. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49165 [https://

[jira] [Assigned] (SPARK-50554) Add a separate docker file for Python 3.11 daily coverage build

2024-12-12 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50554: - Assignee: Ruifeng Zheng > Add a separate docker file for Python 3.11 daily coverage bui

[jira] [Updated] (SPARK-50555) Broken support for disabling hostname verification based on insecure-skip-tls-verify in KUBECONFIG

2024-12-12 Thread Andre Piwoni (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andre Piwoni updated SPARK-50555: - Description: SPARK-33720 via [PR #30684|https://github.com/apache/spark/pull/30684] broke usage

[jira] [Created] (SPARK-50555) Broken support for disabling hostname verification based on insecure-skip-tls-verify in KUBECONFIG

2024-12-12 Thread Andre Piwoni (Jira)
Andre Piwoni created SPARK-50555: Summary: Broken support for disabling hostname verification based on insecure-skip-tls-verify in KUBECONFIG Key: SPARK-50555 URL: https://issues.apache.org/jira/browse/SPARK-50555

[jira] [Commented] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2024-12-12 Thread Anthony Sgro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905239#comment-17905239 ] Anthony Sgro commented on SPARK-49872: -- love the approach, thank you [~steven.aerts

[jira] [Comment Edited] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2024-12-12 Thread Rhys Jones (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905197#comment-17905197 ] Rhys Jones edited comment on SPARK-49872 at 12/12/24 2:17 PM:

[jira] [Commented] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2024-12-12 Thread Rhys Jones (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905197#comment-17905197 ] Rhys Jones commented on SPARK-49872: I'd +1 the approach in [~steven.aerts] PR here.

[jira] [Resolved] (SPARK-50545) AccessControlException should be thrown even if ignoreCorruptFiles is enabled

2024-12-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-50545. -- Fix Version/s: 4.0.0 3.5.4 Resolution: Fixed > AccessControlException should

[jira] [Created] (SPARK-50554) Add a separate docker file for Python 3.11 daily coverage build

2024-12-12 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50554: - Summary: Add a separate docker file for Python 3.11 daily coverage build Key: SPARK-50554 URL: https://issues.apache.org/jira/browse/SPARK-50554 Project: Spark

[jira] [Updated] (SPARK-50554) Add a separate docker file for Python 3.11 daily coverage build

2024-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50554: --- Labels: pull-request-available (was: ) > Add a separate docker file for Python 3.11 daily c

[jira] [Commented] (SPARK-50545) AccessControlException should be thrown even if ignoreCorruptFiles is enabled

2024-12-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905157#comment-17905157 ] Yang Jie commented on SPARK-50545: -- Issue resolved by pull request 49162 https://githu

[jira] [Assigned] (SPARK-50545) AccessControlException should be thrown even if ignoreCorruptFiles is enabled

2024-12-12 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-50545: Assignee: Cheng Pan > AccessControlException should be thrown even if ignoreCorruptFiles is enabl

[jira] [Commented] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2024-12-12 Thread Steven Aerts (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17905053#comment-17905053 ] Steven Aerts commented on SPARK-49872: -- Hi, I created a competing [pull request|ht

[jira] [Resolved] (SPARK-50552) Add a separate docker file for PyPy 3.10 daily build

2024-12-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50552. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49160 [https://

[jira] [Assigned] (SPARK-50552) Add a separate docker file for PyPy 3.10 daily build

2024-12-12 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50552: - Assignee: Ruifeng Zheng > Add a separate docker file for PyPy 3.10 daily build > --

[jira] [Updated] (SPARK-49872) Spark History UI -- StreamConstraintsException: String length (20054016) exceeds the maximum length (20000000)

2024-12-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49872: --- Labels: pull-request-available (was: ) > Spark History UI -- StreamConstraintsException: St