[jira] [Created] (SPARK-48238) Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter

Cheng Pan created SPARK-48238: - Summary: Spark fail to start due to class o.a.h.yarn.server.webproxy.amfilter.AmIpFilter is not a jakarta.servlet.Filter Key: SPARK-48238 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Updated] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48237: -- Issue Type: Bug (was: Improvement) > After executing `test-dependencies.sh`, the dir `dev/pr-

[jira] [Assigned] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48237: - Assignee: BingKun Pan > After executing `test-dependencies.sh`, the dir `dev/pr-deps` s

[jira] [Resolved] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48237. --- Fix Version/s: 3.4.4 3.5.2 4.0.0 Resolution: Fix

[jira] [Updated] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

[ https://issues.apache.org/jira/browse/SPARK-48237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48237: --- Labels: pull-request-available (was: ) > After executing `test-dependencies.sh`, the dir `d

[jira] [Created] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted

BingKun Pan created SPARK-48237: --- Summary: After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted Key: SPARK-48237 URL: https://issues.apache.org/jira/browse/SPARK-48237 Projec

[jira] [Resolved] (SPARK-48236) Add `commons-lang:commons-lang:2.6` back to support legacy Hive UDF jars

[ https://issues.apache.org/jira/browse/SPARK-48236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48236. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46528 [https://

[jira] [Commented] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845522#comment-17845522 ] Dongjoon Hyun commented on SPARK-48230: --- We will revisit this dependency. > Remov

[jira] [Updated] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48230: -- Fix Version/s: (was: 4.0.0) > Remove unused jodd-core > --- > >

[jira] [Updated] (SPARK-48220) Allow passing PyArrow Table to createDataFrame()

[ https://issues.apache.org/jira/browse/SPARK-48220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48220: --- Labels: pull-request-available (was: ) > Allow passing PyArrow Table to createDataFrame() >

[jira] [Updated] (SPARK-48236) Add `commons-lang:commons-lang:2.6` back to support legacy Hive UDF jars

[ https://issues.apache.org/jira/browse/SPARK-48236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48236: --- Labels: pull-request-available (was: ) > Add `commons-lang:commons-lang:2.6` back to suppor

[jira] [Updated] (SPARK-48229) inputFile expressions (all collations)

[ https://issues.apache.org/jira/browse/SPARK-48229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48229: --- Labels: pull-request-available (was: ) > inputFile expressions (all collations) > -

[jira] [Resolved] (SPARK-48144) canPlanAsBroadcastHashJoin should respect shuffle join hints

[ https://issues.apache.org/jira/browse/SPARK-48144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48144. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46401 [https://

[jira] [Assigned] (SPARK-48144) canPlanAsBroadcastHashJoin should respect shuffle join hints

[ https://issues.apache.org/jira/browse/SPARK-48144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48144: - Assignee: Fredrik Klauß > canPlanAsBroadcastHashJoin should respect shuffle join hints

[jira] [Commented] (SPARK-45720) Upgrade AWS SDK to v2 for Spark Kinesis connector

[ https://issues.apache.org/jira/browse/SPARK-45720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845426#comment-17845426 ] junyuc25 commented on SPARK-45720: -- Hi [~dongjoon] , I rebased the PR as discussed. Tha

[jira] [Assigned] (SPARK-47441) Do not add log link for unmanaged AM in Spark UI

[ https://issues.apache.org/jira/browse/SPARK-47441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47441: - Assignee: Yuming Wang > Do not add log link for unmanaged AM in Spark UI >

[jira] [Resolved] (SPARK-47441) Do not add log link for unmanaged AM in Spark UI

[ https://issues.apache.org/jira/browse/SPARK-47441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47441. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45565 [https://

[jira] [Assigned] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48235: - Assignee: Fredrik Klauß (was: Dongjoon Hyun) > Directly pass join instead of all argum

[jira] [Updated] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48235: -- Reporter: Fredrik Klauß (was: Dongjoon Hyun) > Directly pass join instead of all arguments to

[jira] [Resolved] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48235. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46525 [https://

[jira] [Assigned] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48235: - Assignee: Dongjoon Hyun > Directly pass join instead of all arguments to getBroadcastBu

[jira] [Updated] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

[ https://issues.apache.org/jira/browse/SPARK-48235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48235: --- Labels: pull-request-available (was: ) > Directly pass join instead of all arguments to get

[jira] [Created] (SPARK-48235) Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide

Dongjoon Hyun created SPARK-48235: - Summary: Directly pass join instead of all arguments to getBroadcastBuildSide and getShuffleHashJoinBuildSide Key: SPARK-48235 URL: https://issues.apache.org/jira/browse/SPARK-4

[jira] [Assigned] (SPARK-48146) Fix error with aggregate function in With child

[ https://issues.apache.org/jira/browse/SPARK-48146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-48146: --- Assignee: Kelvin Jiang > Fix error with aggregate function in With child >

[jira] [Resolved] (SPARK-48146) Fix error with aggregate function in With child

[ https://issues.apache.org/jira/browse/SPARK-48146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-48146. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46443 [https://gith

[jira] [Commented] (SPARK-48092) Spark images are based of Python 3.8 which is soon EOL

[ https://issues.apache.org/jira/browse/SPARK-48092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17845363#comment-17845363 ] sadha chilukoori commented on SPARK-48092: -- [~mayurmadnani] I'm looking for opp

[jira] [Updated] (SPARK-47599) MLLib: Migrate logWarn with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47599: --- Labels: pull-request-available (was: ) > MLLib: Migrate logWarn with variables to structure

[jira] [Updated] (SPARK-30538) A not very elegant way to control ouput small file

[ https://issues.apache.org/jira/browse/SPARK-30538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-30538: --- Labels: pull-request-available (was: ) > A not very elegant way to control ouput small fil

[jira] [Updated] (SPARK-48234) Invalid previous reader checks in Vectorized DELTA_BYTE_ARRAY parquet decoder

[ https://issues.apache.org/jira/browse/SPARK-48234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48234: --- Labels: pull-request-available (was: ) > Invalid previous reader checks in Vectorized DELTA

[jira] [Created] (SPARK-48234) Invalid previous reader checks in Vectorized DELTA_BYTE_ARRAY parquet decoder

Yulia Tsareva created SPARK-48234: - Summary: Invalid previous reader checks in Vectorized DELTA_BYTE_ARRAY parquet decoder Key: SPARK-48234 URL: https://issues.apache.org/jira/browse/SPARK-48234 Proje

[jira] [Updated] (SPARK-48155) PropagateEmpty relation cause LogicalQueryStage only with broadcast without join then execute failed

[ https://issues.apache.org/jira/browse/SPARK-48155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48155: --- Labels: pull-request-available (was: ) > PropagateEmpty relation cause LogicalQueryStage on

[jira] [Assigned] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

[ https://issues.apache.org/jira/browse/SPARK-48232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-48232: Assignee: Hyukjin Kwon > Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3

[jira] [Resolved] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

[ https://issues.apache.org/jira/browse/SPARK-48232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-48232. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46522 [https://gi

[jira] [Resolved] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-48230. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46520 [https://

[jira] [Updated] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

[ https://issues.apache.org/jira/browse/SPARK-48232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-48232: --- Labels: pull-request-available (was: ) > Fix 'pyspark.sql.tests.connect.test_connect_sessio

[jira] [Created] (SPARK-48232) Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build

Hyukjin Kwon created SPARK-48232: Summary: Fix 'pyspark.sql.tests.connect.test_connect_session' in Python 3.12 build Key: SPARK-48232 URL: https://issues.apache.org/jira/browse/SPARK-48232 Project: Sp

[jira] [Assigned] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48231: - Assignee: Cheng Pan > Remove unused CodeHaus Jackson dependencies > ---

[jira] [Assigned] (SPARK-48230) Remove unused jodd-core

[ https://issues.apache.org/jira/browse/SPARK-48230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-48230: - Assignee: Cheng Pan > Remove unused jodd-core > --- > >

[jira] [Updated] (SPARK-48231) Remove unused CodeHaus Jackson dependencies

[ https://issues.apache.org/jira/browse/SPARK-48231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-48231: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Remove unused CodeHaus