[jira] [Resolved] (SPARK-45333) Fix one unit mistake related to spark.eventLog.buffer.kb

[ https://issues.apache.org/jira/browse/SPARK-45333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45333. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 42294

[jira] [Assigned] (SPARK-45333) Fix one unit mistake related to spark.eventLog.buffer.kb

[ https://issues.apache.org/jira/browse/SPARK-45333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45333: Assignee: Mengran Lan > Fix one unit mistake related to spark.eventLog.buffer.kb >

[jira] [Updated] (SPARK-45333) Fix one unit mistake related to spark.eventLog.buffer.kb

[ https://issues.apache.org/jira/browse/SPARK-45333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45333: --- Labels: pull-request-available (was: ) > Fix one unit mistake related to

[jira] [Created] (SPARK-45333) Fix one unit mistake related to spark.eventLog.buffer.kb

Mengran Lan created SPARK-45333: --- Summary: Fix one unit mistake related to spark.eventLog.buffer.kb Key: SPARK-45333 URL: https://issues.apache.org/jira/browse/SPARK-45333 Project: Spark Issue

[jira] [Created] (SPARK-45332) Fix one unit mistake related to spark.eventLog.buffer.kb

Mengran Lan created SPARK-45332: --- Summary: Fix one unit mistake related to spark.eventLog.buffer.kb Key: SPARK-45332 URL: https://issues.apache.org/jira/browse/SPARK-45332 Project: Spark Issue

[jira] [Created] (SPARK-45331) Upgrade Scala to 2.13.12

Yang Jie created SPARK-45331: Summary: Upgrade Scala to 2.13.12 Key: SPARK-45331 URL: https://issues.apache.org/jira/browse/SPARK-45331 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-45330) Upgrade ammonite to 2.6.0

Yang Jie created SPARK-45330: Summary: Upgrade ammonite to 2.6.0 Key: SPARK-45330 URL: https://issues.apache.org/jira/browse/SPARK-45330 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45329) DataFrame methods avoid pandas conversion if possible

[ https://issues.apache.org/jira/browse/SPARK-45329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45329: --- Labels: pull-request-available (was: ) > DataFrame methods avoid pandas conversion if

[jira] [Created] (SPARK-45329) DataFrame methods avoid pandas conversion if possible

Ruifeng Zheng created SPARK-45329: - Summary: DataFrame methods avoid pandas conversion if possible Key: SPARK-45329 URL: https://issues.apache.org/jira/browse/SPARK-45329 Project: Spark

[jira] [Assigned] (SPARK-45315) Drop JDK 8/11 and make JDK 17 by default

[ https://issues.apache.org/jira/browse/SPARK-45315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45315: Assignee: Hyukjin Kwon > Drop JDK 8/11 and make JDK 17 by default >

[jira] [Updated] (SPARK-45315) Drop JDK 8/11 and make JDK 17 by default

[ https://issues.apache.org/jira/browse/SPARK-45315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45315: -- Labels: releasenotes (was: ) > Drop JDK 8/11 and make JDK 17 by default >

[jira] [Updated] (SPARK-45248) Slow HTTP Denial of Service Attack【jetty server in spark】

[ https://issues.apache.org/jira/browse/SPARK-45248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-45248: - Issue Type: Improvement (was: Bug) Priority: Minor (was: Major) > Slow HTTP Denial of

[jira] [Resolved] (SPARK-45248) Slow HTTP Denial of Service Attack【jetty server in spark】

[ https://issues.apache.org/jira/browse/SPARK-45248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-45248. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43078

[jira] [Assigned] (SPARK-45248) Slow HTTP Denial of Service Attack【jetty server in spark】

[ https://issues.apache.org/jira/browse/SPARK-45248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-45248: Assignee: chenyu > Slow HTTP Denial of Service Attack【jetty server in spark】 >

[jira] [Updated] (SPARK-45328) Remove Hive support prior to 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-45328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45328: --- Labels: pull-request-available (was: ) > Remove Hive support prior to 2.0.0 >

[jira] [Resolved] (SPARK-45299) Remove JDK 8 workaround in UtilsSuite

[ https://issues.apache.org/jira/browse/SPARK-45299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45299. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43084

[jira] [Assigned] (SPARK-45299) Remove JDK 8 workaround in UtilsSuite

[ https://issues.apache.org/jira/browse/SPARK-45299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45299: - Assignee: Hyukjin Kwon > Remove JDK 8 workaround in UtilsSuite >

[jira] [Resolved] (SPARK-45300) Remove JDK 8 workaround in TimestampFormatterSuite

[ https://issues.apache.org/jira/browse/SPARK-45300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45300. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43085

[jira] [Assigned] (SPARK-45300) Remove JDK 8 workaround in TimestampFormatterSuite

[ https://issues.apache.org/jira/browse/SPARK-45300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45300: - Assignee: Hyukjin Kwon > Remove JDK 8 workaround in TimestampFormatterSuite >

[jira] [Created] (SPARK-45328) Remove Hive support prior to 2.0.0

Hyukjin Kwon created SPARK-45328: Summary: Remove Hive support prior to 2.0.0 Key: SPARK-45328 URL: https://issues.apache.org/jira/browse/SPARK-45328 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-45182) Ignore task completion from old stage after retrying indeterminate stages

[ https://issues.apache.org/jira/browse/SPARK-45182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-45182. - Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-45182) Ignore task completion from old stage after retrying indeterminate stages

[ https://issues.apache.org/jira/browse/SPARK-45182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-45182: --- Assignee: Mayur Bhosale > Ignore task completion from old stage after retrying

[jira] [Resolved] (SPARK-45318) Merge the test cases from `SingletonRepl2Suite/Repl2Suite` back into `SingletonReplSuite/ReplSuite`

[ https://issues.apache.org/jira/browse/SPARK-45318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45318. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43104

[jira] [Assigned] (SPARK-45318) Merge the test cases from `SingletonRepl2Suite/Repl2Suite` back into `SingletonReplSuite/ReplSuite`

[ https://issues.apache.org/jira/browse/SPARK-45318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45318: - Assignee: Yang Jie > Merge the test cases from `SingletonRepl2Suite/Repl2Suite` back

[jira] [Assigned] (SPARK-45312) Support toggle display/hide plan svg on execution page

[ https://issues.apache.org/jira/browse/SPARK-45312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45312: - Assignee: Kent Yao > Support toggle display/hide plan svg on execution page >

[jira] [Resolved] (SPARK-45312) Support toggle display/hide plan svg on execution page

[ https://issues.apache.org/jira/browse/SPARK-45312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45312. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43099

[jira] [Resolved] (SPARK-45325) Upgrade Avro to 1.11.3

[ https://issues.apache.org/jira/browse/SPARK-45325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45325. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43110

[jira] [Assigned] (SPARK-45325) Upgrade Avro to 1.11.3

[ https://issues.apache.org/jira/browse/SPARK-45325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45325: - Assignee: Dongjoon Hyun > Upgrade Avro to 1.11.3 > -- > >

[jira] [Resolved] (SPARK-44126) Migration shuffle to decommissioned executor should not count as block failure

[ https://issues.apache.org/jira/browse/SPARK-44126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wu Yi resolved SPARK-44126. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 41905

[jira] [Assigned] (SPARK-44126) Migration shuffle to decommissioned executor should not count as block failure

[ https://issues.apache.org/jira/browse/SPARK-44126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wu Yi reassigned SPARK-44126: - Assignee: Zhongwei Zhu > Migration shuffle to decommissioned executor should not count as block

[jira] [Updated] (SPARK-45273) Http header Attack【HttpSecurityFilter】

[ https://issues.apache.org/jira/browse/SPARK-45273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45273: --- Labels: pull-request-available (was: ) > Http header Attack【HttpSecurityFilter】 >

[jira] [Assigned] (SPARK-45317) Handle null filename in stack traces of exceptions

[ https://issues.apache.org/jira/browse/SPARK-45317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45317: Assignee: Yihong He > Handle null filename in stack traces of exceptions >

[jira] [Resolved] (SPARK-45317) Handle null filename in stack traces of exceptions

[ https://issues.apache.org/jira/browse/SPARK-45317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45317. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43103

[jira] [Resolved] (SPARK-44550) Wrong semantics for null IN (empty list)

[ https://issues.apache.org/jira/browse/SPARK-44550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-44550. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43068

[jira] [Updated] (SPARK-45327) Upgrade zstd-jni to 1.5.5-6

[ https://issues.apache.org/jira/browse/SPARK-45327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45327: --- Labels: pull-request-available (was: ) > Upgrade zstd-jni to 1.5.5-6 >

[jira] [Created] (SPARK-45327) Upgrade zstd-jni to 1.5.5-6

BingKun Pan created SPARK-45327: --- Summary: Upgrade zstd-jni to 1.5.5-6 Key: SPARK-45327 URL: https://issues.apache.org/jira/browse/SPARK-45327 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45310) Mapstatus location type changed from external shuffle service to executor after decommission migration

[ https://issues.apache.org/jira/browse/SPARK-45310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45310: --- Labels: pull-request-available (was: ) > Mapstatus location type changed from external

[jira] [Updated] (SPARK-43380) Fix Avro data type conversion issues to avoid producing incorrect results

[ https://issues.apache.org/jira/browse/SPARK-43380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-43380: --- Labels: pull-request-available (was: ) > Fix Avro data type conversion issues to avoid

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Description: I have a spark task that occasionally runs for a long time and does not finished. Usually

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Description: I have a spark task that occasionally runs for a long time and does not finished. Usually

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Attachment: driver.stack executor1.stack executor2.stack > The driver

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Attachment: (was: driver日志.jpg) > The driver did not receive the StatusUpdate sent by the executor

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Attachment: driver log.jpg > The driver did not receive the StatusUpdate sent by the executor >

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Attachment: executor log.png > The driver did not receive the StatusUpdate sent by the executor >

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Description: I have a spark task that occasionally runs for a long time and does not finished. Usually

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Attachment: driver-submit.log > The driver did not receive the StatusUpdate sent by the executor >

[jira] [Updated] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

[ https://issues.apache.org/jira/browse/SPARK-45326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Echo Lee updated SPARK-45326: - Attachment: driver日志.jpg > The driver did not receive the StatusUpdate sent by the executor >

[jira] [Created] (SPARK-45326) The driver did not receive the StatusUpdate sent by the executor

Echo Lee created SPARK-45326: Summary: The driver did not receive the StatusUpdate sent by the executor Key: SPARK-45326 URL: https://issues.apache.org/jira/browse/SPARK-45326 Project: Spark

[jira] [Updated] (SPARK-41341) Wait shuffle fetch to finish when decommission executor

[ https://issues.apache.org/jira/browse/SPARK-41341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41341: --- Labels: pull-request-available (was: ) > Wait shuffle fetch to finish when decommission

[jira] [Updated] (SPARK-45325) Upgrade Avro to 1.11.3

[ https://issues.apache.org/jira/browse/SPARK-45325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45325: --- Labels: pull-request-available (was: ) > Upgrade Avro to 1.11.3 > -- >

[jira] [Created] (SPARK-45325) Upgrade Avro to 1.11.3

Dongjoon Hyun created SPARK-45325: - Summary: Upgrade Avro to 1.11.3 Key: SPARK-45325 URL: https://issues.apache.org/jira/browse/SPARK-45325 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-45324) pyspark 3.5.0 missing in pypi

[ https://issues.apache.org/jira/browse/SPARK-45324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768931#comment-17768931 ] Hussein Awala commented on SPARK-45324: --- I found this in the announcement email: > (Please note:

[jira] [Commented] (SPARK-45324) pyspark 3.5.0 missing in pypi

[ https://issues.apache.org/jira/browse/SPARK-45324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768927#comment-17768927 ] Hussein Awala commented on SPARK-45324: --- I haven't found any CI jobs calling `release-build.sh

[jira] [Commented] (SPARK-45324) pyspark 3.5.0 missing in pypi

[ https://issues.apache.org/jira/browse/SPARK-45324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768923#comment-17768923 ] Hussein Awala commented on SPARK-45324: --- I was going to report the same issue, the published doc

[jira] [Updated] (SPARK-43990) Upgrade kubernetes-client to 6.7.2

[ https://issues.apache.org/jira/browse/SPARK-43990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43990: -- Summary: Upgrade kubernetes-client to 6.7.2 (was: Upgrade kubernetes-client to 6.7.1) >

[jira] [Created] (SPARK-45324) pyspark 3.5.0 missing in pypi

raphaelauv created SPARK-45324: -- Summary: pyspark 3.5.0 missing in pypi Key: SPARK-45324 URL: https://issues.apache.org/jira/browse/SPARK-45324 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-45322) Use ProcessHandle to get pid directly

[ https://issues.apache.org/jira/browse/SPARK-45322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45322. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43107

[jira] [Assigned] (SPARK-45322) Use ProcessHandle to get pid directly

[ https://issues.apache.org/jira/browse/SPARK-45322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45322: - Assignee: Dongjoon Hyun > Use ProcessHandle to get pid directly >

[jira] [Updated] (SPARK-45323) Upgrade snappy to 1.1.10.4

[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-45323: Affects Version/s: 3.5.1 > Upgrade snappy to 1.1.10.4 > -- > >

[jira] [Updated] (SPARK-45323) Upgrade snappy to 1.1.10.4

[ https://issues.apache.org/jira/browse/SPARK-45323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45323: --- Labels: pull-request-available (was: ) > Upgrade snappy to 1.1.10.4 >

[jira] [Created] (SPARK-45323) Upgrade snappy to 1.1.10.4

Bjørn Jørgensen created SPARK-45323: --- Summary: Upgrade snappy to 1.1.10.4 Key: SPARK-45323 URL: https://issues.apache.org/jira/browse/SPARK-45323 Project: Spark Issue Type: Dependency

[jira] [Updated] (SPARK-44817) SPIP: Incremental Stats Collection

[ https://issues.apache.org/jira/browse/SPARK-44817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Raushan updated SPARK-44817: --- Summary: SPIP: Incremental Stats Collection (was: Incremental Stats Collection) > SPIP:

[jira] (SPARK-44817) Incremental Stats Collection

[ https://issues.apache.org/jira/browse/SPARK-44817 ] Rakesh Raushan deleted comment on SPARK-44817: was (Author: rakson): [~gurwls223] [~cloud_fan] [~dongjoon] I have added an SPIP document. Does this feature seem useful to you? >

[jira] [Resolved] (SPARK-43711) Support `pyspark.ml.feature.Bucketizer` and `pyspark.mllib.stat.KernelDensity` to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43711. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43051

[jira] [Resolved] (SPARK-44372) Enable KernelDensity within Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-44372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44372. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43051

[jira] [Assigned] (SPARK-44372) Enable KernelDensity within Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-44372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44372: - Assignee: Haejoon Lee > Enable KernelDensity within Spark Connect >

[jira] [Assigned] (SPARK-43711) Support `pyspark.ml.feature.Bucketizer` and `pyspark.mllib.stat.KernelDensity` to work with Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43711: - Assignee: Haejoon Lee > Support `pyspark.ml.feature.Bucketizer` and >

[jira] [Updated] (SPARK-45322) Use ProcessHandle to get pid directly

[ https://issues.apache.org/jira/browse/SPARK-45322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45322: -- Parent: SPARK-43831 Issue Type: Sub-task (was: Improvement) > Use ProcessHandle to

[jira] [Updated] (SPARK-45322) Use ProcessHandle to get pid directly

[ https://issues.apache.org/jira/browse/SPARK-45322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45322: --- Labels: pull-request-available (was: ) > Use ProcessHandle to get pid directly >

[jira] [Created] (SPARK-45322) Use ProcessHandle to get pid directly

Dongjoon Hyun created SPARK-45322: - Summary: Use ProcessHandle to get pid directly Key: SPARK-45322 URL: https://issues.apache.org/jira/browse/SPARK-45322 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42886) ClassNotFoundException: scala.math.Ordering$Reverse

[ https://issues.apache.org/jira/browse/SPARK-42886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768801#comment-17768801 ] Joey Pereira commented on SPARK-42886: -- Adding another anecdote here. I've got a codebase on Scala

[jira] [Assigned] (SPARK-45304) Remove test classloader workaround for SBT build

[ https://issues.apache.org/jira/browse/SPARK-45304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45304: - Assignee: Hyukjin Kwon > Remove test classloader workaround for SBT build >

[jira] [Resolved] (SPARK-45304) Remove test classloader workaround for SBT build

[ https://issues.apache.org/jira/browse/SPARK-45304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45304. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43090

[jira] [Updated] (SPARK-44751) XML: Implement FIleFormat Interface

[ https://issues.apache.org/jira/browse/SPARK-44751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44751: --- Labels: pull-request-available (was: ) > XML: Implement FIleFormat Interface >

[jira] [Comment Edited] (SPARK-45318) Merge the test cases from `SingletonRepl2Suite/Repl2Suite` back into `SingletonReplSuite/ReplSuite`

[ https://issues.apache.org/jira/browse/SPARK-45318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768795#comment-17768795 ] Yang Jie edited comment on SPARK-45318 at 9/25/23 5:20 PM: --- [~gurwls223] I've

[jira] [Resolved] (SPARK-45301) Remove org.scala-lang scala-library added for JDK 11 workaround

[ https://issues.apache.org/jira/browse/SPARK-45301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45301. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43086

[jira] [Updated] (SPARK-45301) Remove org.scala-lang scala-library added for JDK 11 workaround

[ https://issues.apache.org/jira/browse/SPARK-45301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45301: --- Labels: pull-request-available (was: ) > Remove org.scala-lang scala-library added for JDK

[jira] [Assigned] (SPARK-45301) Remove org.scala-lang scala-library added for JDK 11 workaround

[ https://issues.apache.org/jira/browse/SPARK-45301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45301: - Assignee: Hyukjin Kwon > Remove org.scala-lang scala-library added for JDK 11

[jira] [Commented] (SPARK-45318) Merge the test cases from `SingletonRepl2Suite/Repl2Suite` back into `SingletonReplSuite/ReplSuite`

[ https://issues.apache.org/jira/browse/SPARK-45318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768795#comment-17768795 ] Yang Jie commented on SPARK-45318: -- [~gurwls223] I've made this as a subtask of SPARK-45314, please

[jira] [Updated] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

[ https://issues.apache.org/jira/browse/SPARK-45321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45321: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Clean up the unnecessary Scala

[jira] [Resolved] (SPARK-45305) Remove JDK 8 workaround added SPARK-32999

[ https://issues.apache.org/jira/browse/SPARK-45305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45305. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43092

[jira] [Updated] (SPARK-45318) Merge the test cases from `SingletonRepl2Suite/Repl2Suite` back into `SingletonReplSuite/ReplSuite`

[ https://issues.apache.org/jira/browse/SPARK-45318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-45318: - Parent: SPARK-45314 Issue Type: Sub-task (was: Improvement) > Merge the test cases from

[jira] [Assigned] (SPARK-45305) Remove JDK 8 workaround added SPARK-32999

[ https://issues.apache.org/jira/browse/SPARK-45305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45305: - Assignee: Hyukjin Kwon > Remove JDK 8 workaround added SPARK-32999 >

[jira] [Comment Edited] (SPARK-45314) Drop Scala 2.12 and make Scala 2.13 by default

[ https://issues.apache.org/jira/browse/SPARK-45314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768789#comment-17768789 ] Yang Jie edited comment on SPARK-45314 at 9/25/23 5:07 PM: --- This is great.

[jira] [Commented] (SPARK-45314) Drop Scala 2.12 and make Scala 2.13 by default

[ https://issues.apache.org/jira/browse/SPARK-45314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768789#comment-17768789 ] Yang Jie commented on SPARK-45314: -- This is great.                 > Drop Scala 2.12 and make Scala

[jira] [Assigned] (SPARK-45303) Remove JDK 8/11 workaround in KryoSerializerBenchmark

[ https://issues.apache.org/jira/browse/SPARK-45303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45303: - Assignee: Hyukjin Kwon > Remove JDK 8/11 workaround in KryoSerializerBenchmark >

[jira] [Resolved] (SPARK-45303) Remove JDK 8/11 workaround in KryoSerializerBenchmark

[ https://issues.apache.org/jira/browse/SPARK-45303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45303. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43088

[jira] [Updated] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

[ https://issues.apache.org/jira/browse/SPARK-45321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45321: --- Labels: pull-request-available (was: ) > Clean up the unnecessary Scala 2.12 related

[jira] [Created] (SPARK-45321) Clean up the unnecessary Scala 2.12 related binary files.

Yang Jie created SPARK-45321: Summary: Clean up the unnecessary Scala 2.12 related binary files. Key: SPARK-45321 URL: https://issues.apache.org/jira/browse/SPARK-45321 Project: Spark Issue

[jira] [Assigned] (SPARK-45313) Inline `Iterators#size` and remove `Iterators.scala`

[ https://issues.apache.org/jira/browse/SPARK-45313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-45313: Assignee: Yang Jie > Inline `Iterators#size` and remove `Iterators.scala` >

[jira] [Resolved] (SPARK-45313) Inline `Iterators#size` and remove `Iterators.scala`

[ https://issues.apache.org/jira/browse/SPARK-45313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-45313. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43100

[jira] [Resolved] (SPARK-45320) Update Benchmarkresult for InMemoryColumnarBenchmark.

[ https://issues.apache.org/jira/browse/SPARK-45320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45320. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43105

[jira] [Assigned] (SPARK-45320) Update Benchmarkresult for InMemoryColumnarBenchmark.

[ https://issues.apache.org/jira/browse/SPARK-45320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45320: - Assignee: Yang Jie > Update Benchmarkresult for InMemoryColumnarBenchmark. >

[jira] [Updated] (SPARK-45154) Pyspark DecisionTreeClassifier: results and tree structure in spark3 very different from that of the spark2 version on the same data and with the same hyperparameters.

[ https://issues.apache.org/jira/browse/SPARK-45154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oumar Nour updated SPARK-45154: --- Description: Hello, I have an engine running on spark2 using a DecisionTreeClassifier model using

[jira] [Updated] (SPARK-45320) Update Benchmarkresult for InMemoryColumnarBenchmark.

[ https://issues.apache.org/jira/browse/SPARK-45320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45320: --- Labels: pull-request-available (was: ) > Update Benchmarkresult for

[jira] [Created] (SPARK-45320) Update Benchmarkresult for InMemoryColumnarBenchmark.

Yang Jie created SPARK-45320: Summary: Update Benchmarkresult for InMemoryColumnarBenchmark. Key: SPARK-45320 URL: https://issues.apache.org/jira/browse/SPARK-45320 Project: Spark Issue Type:

[jira] [Updated] (SPARK-45319) SHOW COLUMNS namespace is not catalog-aware

[ https://issues.apache.org/jira/browse/SPARK-45319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Johnson updated SPARK-45319: - Description: Today, the namespace argument of {{SHOW COLUMNS}} command is only partly

[jira] [Updated] (SPARK-45319) SHOW COLUMNS namespace is not catalog-aware

[ https://issues.apache.org/jira/browse/SPARK-45319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Johnson updated SPARK-45319: - Description: Today, the namespace argument of {{SHOW COLUMNS}} command is only partly

[jira] [Updated] (SPARK-45319) SHOW COLUMNS namespace is not catalog-aware

[ https://issues.apache.org/jira/browse/SPARK-45319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Johnson updated SPARK-45319: - Description: Today, the namespace argument of {{SHOW COLUMNS}} command is only partly

[jira] [Updated] (SPARK-45319) SHOW COLUMNS namespace is not catalog-aware

[ https://issues.apache.org/jira/browse/SPARK-45319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Johnson updated SPARK-45319: - Description: Today, the namespace argument of {{SHOW COLUMNS}} command is only partly

  1   2   3   >