[jira] [Created] (SPARK-46028) Make `Column.__getitem__` accept input column

Ruifeng Zheng created SPARK-46028: - Summary: Make `Column.__getitem__` accept input column Key: SPARK-46028 URL: https://issues.apache.org/jira/browse/SPARK-46028 Project: Spark Issue Type:

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788306#comment-17788306 ] Wenchen Fan commented on SPARK-45649: - This has a bug. I've uploaded the test data. You can

[jira] [Updated] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-45649: Attachment: test_table.parquet.zip > Unify the prepare framework for `OffsetWindowFunctionFrame`

[jira] [Commented] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788307#comment-17788307 ] Wenchen Fan commented on SPARK-45649: - I'm reverting the commit. > Unify the prepare framework for

[jira] [Reopened] (SPARK-45649) Unify the prepare framework for `OffsetWindowFunctionFrame`

[ https://issues.apache.org/jira/browse/SPARK-45649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-45649: - > Unify the prepare framework for `OffsetWindowFunctionFrame` >

[jira] [Updated] (SPARK-46027) Add `Python 3.12` to the Daily Python Github Action job

[ https://issues.apache.org/jira/browse/SPARK-46027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46027: --- Labels: pull-request-available (was: ) > Add `Python 3.12` to the Daily Python Github

[jira] [Created] (SPARK-46027) Add `Python 3.12` to the Daily Python Github Action job

Hyukjin Kwon created SPARK-46027: Summary: Add `Python 3.12` to the Daily Python Github Action job Key: SPARK-46027 URL: https://issues.apache.org/jira/browse/SPARK-46027 Project: Spark

[jira] [Assigned] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

[ https://issues.apache.org/jira/browse/SPARK-46004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46004: Assignee: BingKun Pan > Refine docstring of `DataFrame.dropna/fillna/replace` >

[jira] [Resolved] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

[ https://issues.apache.org/jira/browse/SPARK-46004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46004. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43907

[jira] [Updated] (SPARK-46026) Refine docstring of UDTF

[ https://issues.apache.org/jira/browse/SPARK-46026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46026: --- Labels: pull-request-available (was: ) > Refine docstring of UDTF >

[jira] [Created] (SPARK-46026) Refine docstring of UDTF

Hyukjin Kwon created SPARK-46026: Summary: Refine docstring of UDTF Key: SPARK-46026 URL: https://issues.apache.org/jira/browse/SPARK-46026 Project: Spark Issue Type: Sub-task

[jira] [Deleted] (SPARK-46025) Support Python 3.12 in PySpark

[ https://issues.apache.org/jira/browse/SPARK-46025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46025: - > Support Python 3.12 in PySpark > -- > > Key:

[jira] [Updated] (SPARK-46025) Support Python 3.12 in PySpark

[ https://issues.apache.org/jira/browse/SPARK-46025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46025: - Issue Type: Improvement (was: Bug) > Support Python 3.12 in PySpark >

[jira] [Created] (SPARK-46025) Support Python 3.12 in PySpark

Hyukjin Kwon created SPARK-46025: Summary: Support Python 3.12 in PySpark Key: SPARK-46025 URL: https://issues.apache.org/jira/browse/SPARK-46025 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46024) Document parameters and examples for RuntimeConf get, set and unset

[ https://issues.apache.org/jira/browse/SPARK-46024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46024: --- Labels: pull-request-available (was: ) > Document parameters and examples for RuntimeConf

[jira] [Updated] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

[ https://issues.apache.org/jira/browse/SPARK-46021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46021: --- Labels: pull-request-available (was: ) > Support canceling future jobs belonging to a

[jira] [Created] (SPARK-46024) Document parameters and examples for RuntimeConf get, set and unset

Hyukjin Kwon created SPARK-46024: Summary: Document parameters and examples for RuntimeConf get, set and unset Key: SPARK-46024 URL: https://issues.apache.org/jira/browse/SPARK-46024 Project: Spark

[jira] [Comment Edited] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788270#comment-17788270 ] Marc Le Bihan edited comment on SPARK-45311 at 11/21/23 6:31 AM: -

[jira] [Commented] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788270#comment-17788270 ] Marc Le Bihan commented on SPARK-45311: --- Thanks, that's a good news. I'll check if this 3.4.2 in

[jira] [Updated] (SPARK-46023) Annotate parameters at docstrings in pyspark.sql module

[ https://issues.apache.org/jira/browse/SPARK-46023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46023: --- Labels: pull-request-available (was: ) > Annotate parameters at docstrings in pyspark.sql

[jira] [Created] (SPARK-46023) Annotate parameters at docstrings in pyspark.sql module

Hyukjin Kwon created SPARK-46023: Summary: Annotate parameters at docstrings in pyspark.sql module Key: SPARK-46023 URL: https://issues.apache.org/jira/browse/SPARK-46023 Project: Spark

[jira] [Created] (SPARK-46022) Remove deprecated functions APIs from documents

Haejoon Lee created SPARK-46022: --- Summary: Remove deprecated functions APIs from documents Key: SPARK-46022 URL: https://issues.apache.org/jira/browse/SPARK-46022 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46017) PySpark doc build doesn't work properly on Mac

[ https://issues.apache.org/jira/browse/SPARK-46017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46017: Summary: PySpark doc build doesn't work properly on Mac (was: PySpark doc build doesn't work

[jira] [Updated] (SPARK-46017) PySpark doc build doesn't work properly on Mac

[ https://issues.apache.org/jira/browse/SPARK-46017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46017: Description: PySpark doc build is working properly on GitHub CI, but doesn't work properly on

[jira] [Updated] (SPARK-46019) Fix HiveThriftServer2ListenerSuite and ThriftServerPageSuite failed when there are running on local

[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46019: Summary: Fix HiveThriftServer2ListenerSuite and ThriftServerPageSuite failed when there are

[jira] [Updated] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46019: Affects Version/s: (was: 3.5.0) (was: 3.4.1) > Fix when

[jira] [Resolved] (SPARK-46020) Add `Python 3.12` to Infra docker image

[ https://issues.apache.org/jira/browse/SPARK-46020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46020. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43922

[jira] [Created] (SPARK-46021) Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call

Xinyi Yu created SPARK-46021: Summary: Support canceling future jobs belonging to a certain job group on `cancelJobGroup` call Key: SPARK-46021 URL: https://issues.apache.org/jira/browse/SPARK-46021

[jira] [Assigned] (SPARK-46020) Add `Python 3.12` to Infra docker image

[ https://issues.apache.org/jira/browse/SPARK-46020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46020: - Assignee: Dongjoon Hyun > Add `Python 3.12` to Infra docker image >

[jira] [Created] (SPARK-46020) Add `Python 3.12` to Infra docker image

Dongjoon Hyun created SPARK-46020: - Summary: Add `Python 3.12` to Infra docker image Key: SPARK-46020 URL: https://issues.apache.org/jira/browse/SPARK-46020 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46020) Add `Python 3.12` to Infra docker image

[ https://issues.apache.org/jira/browse/SPARK-46020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46020: --- Labels: pull-request-available (was: ) > Add `Python 3.12` to Infra docker image >

[jira] [Updated] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46019: --- Labels: pull-request-available (was: ) > Fix when `HiveThriftServer2ListenerSuite` and

[jira] [Updated] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

[ https://issues.apache.org/jira/browse/SPARK-46019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46019: Component/s: Tests > Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed

[jira] [Updated] (SPARK-45833) Document state data source - reader

[ https://issues.apache.org/jira/browse/SPARK-45833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45833: --- Labels: pull-request-available (was: ) > Document state data source - reader >

[jira] [Created] (SPARK-46019) Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally

BingKun Pan created SPARK-46019: --- Summary: Fix when `HiveThriftServer2ListenerSuite` and `ThriftServerPageSuite` failed to run locally Key: SPARK-46019 URL: https://issues.apache.org/jira/browse/SPARK-46019

[jira] [Updated] (SPARK-46018) driver fails to start properly in standalone cluster deployment mode

[ https://issues.apache.org/jira/browse/SPARK-46018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiejiankun updated SPARK-46018: --- Description: Without adding the `SPARK_LOCAL_HOSTNAME` attribute to spark-env.sh It is possible to

[jira] [Created] (SPARK-46018) driver fails to start properly in standalone cluster deployment mode

xiejiankun created SPARK-46018: -- Summary: driver fails to start properly in standalone cluster deployment mode Key: SPARK-46018 URL: https://issues.apache.org/jira/browse/SPARK-46018 Project: Spark

[jira] [Updated] (SPARK-46017) PySpark doc build doesn't work properly on local environment

[ https://issues.apache.org/jira/browse/SPARK-46017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46017: Summary: PySpark doc build doesn't work properly on local environment (was: PySpark doc build

[jira] [Created] (SPARK-46017) PySpark doc build doesn't work properly on local env

Haejoon Lee created SPARK-46017: --- Summary: PySpark doc build doesn't work properly on local env Key: SPARK-46017 URL: https://issues.apache.org/jira/browse/SPARK-46017 Project: Spark Issue

[jira] [Assigned] (SPARK-46015) Fix broken link for Koalas issues

[ https://issues.apache.org/jira/browse/SPARK-46015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46015: Assignee: Haejoon Lee > Fix broken link for Koalas issues >

[jira] [Resolved] (SPARK-46015) Fix broken link for Koalas issues

[ https://issues.apache.org/jira/browse/SPARK-46015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46015. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43918

[jira] [Resolved] (SPARK-46014) Run RocksDBStateStoreStreamingAggregationSuite on a dedicated JVM

[ https://issues.apache.org/jira/browse/SPARK-46014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46014. --- Fix Version/s: 4.0.0 3.5.1 Resolution: Fixed This is resolved via

[jira] [Resolved] (SPARK-46012) EventLogFileReader should not read rolling logs if appStatus is missing

[ https://issues.apache.org/jira/browse/SPARK-46012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46012. --- Fix Version/s: 3.3.4 3.5.1 4.0.0

[jira] [Resolved] (SPARK-44867) Refactor Spark Connect Docs to incorporate Scala setup

[ https://issues.apache.org/jira/browse/SPARK-44867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44867. -- Fix Version/s: 3.5.0 Assignee: Venkata Sai Akhil Gudesa Resolution: Fixed

[jira] [Resolved] (SPARK-45929) support grouping set operation in dataframe api

[ https://issues.apache.org/jira/browse/SPARK-45929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45929. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43813

[jira] [Assigned] (SPARK-45929) support grouping set operation in dataframe api

[ https://issues.apache.org/jira/browse/SPARK-45929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45929: Assignee: JacobZheng > support grouping set operation in dataframe api >

[jira] [Resolved] (SPARK-45856) Move ArtifactManager from Spark Connect into SparkSession (sql/core)

[ https://issues.apache.org/jira/browse/SPARK-45856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45856. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43735

[jira] [Created] (SPARK-46016) Fix the script for Supported pandas API to work properly

Haejoon Lee created SPARK-46016: --- Summary: Fix the script for Supported pandas API to work properly Key: SPARK-46016 URL: https://issues.apache.org/jira/browse/SPARK-46016 Project: Spark Issue

[jira] [Updated] (SPARK-46015) Fix broken link for Koalas issues

[ https://issues.apache.org/jira/browse/SPARK-46015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46015: --- Labels: pull-request-available (was: ) > Fix broken link for Koalas issues >

[jira] [Created] (SPARK-46015) Fix broken link for Koalas issues

Haejoon Lee created SPARK-46015: --- Summary: Fix broken link for Koalas issues Key: SPARK-46015 URL: https://issues.apache.org/jira/browse/SPARK-46015 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-46014) Run RocksDBStateStoreStreamingAggregationSuite on a dedicated JVM

[ https://issues.apache.org/jira/browse/SPARK-46014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46014: - Assignee: Dongjoon Hyun > Run RocksDBStateStoreStreamingAggregationSuite on a

[jira] [Updated] (SPARK-46013) Improve basic datasource examples

[ https://issues.apache.org/jira/browse/SPARK-46013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46013: --- Labels: pull-request-available (was: ) > Improve basic datasource examples >

[jira] [Updated] (SPARK-46014) Run RocksDBStateStoreStreamingAggregationSuite on a dedicated JVM

[ https://issues.apache.org/jira/browse/SPARK-46014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46014: -- Summary: Run RocksDBStateStoreStreamingAggregationSuite on a dedicated JVM (was: Run

[jira] [Updated] (SPARK-46014) Run RocksDBStateStoreStreamingAggregationSuite on a dedicate JVM

[ https://issues.apache.org/jira/browse/SPARK-46014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46014: --- Labels: pull-request-available (was: ) > Run RocksDBStateStoreStreamingAggregationSuite on

[jira] [Created] (SPARK-46014) Run RocksDBStateStoreStreamingAggregationSuite on a dedicate JVM

Dongjoon Hyun created SPARK-46014: - Summary: Run RocksDBStateStoreStreamingAggregationSuite on a dedicate JVM Key: SPARK-46014 URL: https://issues.apache.org/jira/browse/SPARK-46014 Project: Spark

[jira] [Updated] (SPARK-44767) Plugin API for PySpark and SparkR workers

[ https://issues.apache.org/jira/browse/SPARK-44767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44767: --- Labels: pull-request-available (was: ) > Plugin API for PySpark and SparkR workers >

[jira] [Updated] (SPARK-44781) Runtime filter should supports reuse exchange if it can reduce the data size of application side

[ https://issues.apache.org/jira/browse/SPARK-44781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44781: --- Labels: pull-request-available (was: ) > Runtime filter should supports reuse exchange if

[jira] [Created] (SPARK-46013) Improve basic datasource examples

Allison Wang created SPARK-46013: Summary: Improve basic datasource examples Key: SPARK-46013 URL: https://issues.apache.org/jira/browse/SPARK-46013 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-45927) Update `path` handling in Python data source

[ https://issues.apache.org/jira/browse/SPARK-45927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45927: - Assignee: Allison Wang > Update `path` handling in Python data source >

[jira] [Resolved] (SPARK-45927) Update `path` handling in Python data source

[ https://issues.apache.org/jira/browse/SPARK-45927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45927. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43809

[jira] [Assigned] (SPARK-45998) Remove redundant type cast

[ https://issues.apache.org/jira/browse/SPARK-45998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45998: - Assignee: Yang Jie > Remove redundant type cast > -- > >

[jira] [Resolved] (SPARK-45998) Remove redundant type cast

[ https://issues.apache.org/jira/browse/SPARK-45998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45998. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43899

[jira] [Assigned] (SPARK-46012) EventLogFileReader should not read rolling logs if appStatus is missing

[ https://issues.apache.org/jira/browse/SPARK-46012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46012: - Assignee: Dongjoon Hyun > EventLogFileReader should not read rolling logs if appStatus

[jira] [Updated] (SPARK-46012) EventLogFileReader should not read rolling logs if appStatus is missing

[ https://issues.apache.org/jira/browse/SPARK-46012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46012: -- Parent: SPARK-45869 Issue Type: Sub-task (was: Bug) > EventLogFileReader should not

[jira] [Commented] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788157#comment-17788157 ] Gera Shegalov commented on SPARK-44973: --- 3.0.3 is the oldest version on my box and it exhibits the

[jira] [Updated] (SPARK-46012) EventLogFileReader should not read rolling logs if appStatus is missing

[ https://issues.apache.org/jira/browse/SPARK-46012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46012: -- Affects Version/s: 3.4.1 3.3.3 3.2.4

[jira] [Updated] (SPARK-46012) EventLogFileReader should not read rolling logs if appStatus is missing

[ https://issues.apache.org/jira/browse/SPARK-46012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46012: --- Labels: pull-request-available (was: ) > EventLogFileReader should not read rolling logs

[jira] [Updated] (SPARK-46012) EventLogFileReader should not read rolling logs if appStatus is missing

[ https://issues.apache.org/jira/browse/SPARK-46012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46012: -- Summary: EventLogFileReader should not read rolling logs if appStatus is missing (was:

[jira] [Created] (SPARK-46012) EventLogFileReader should not read rolling even logs if appStatus is missing

Dongjoon Hyun created SPARK-46012: - Summary: EventLogFileReader should not read rolling even logs if appStatus is missing Key: SPARK-46012 URL: https://issues.apache.org/jira/browse/SPARK-46012

[jira] [Comment Edited] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787619#comment-17787619 ] Mark Jarvin edited comment on SPARK-44973 at 11/20/23 8:56 PM: --- I believe

[jira] [Updated] (SPARK-46011) Spark Connect session heartbeat / keepalive

[ https://issues.apache.org/jira/browse/SPARK-46011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46011: --- Labels: pull-request-available (was: ) > Spark Connect session heartbeat / keepalive >

[jira] [Created] (SPARK-46011) Spark Connect session heartbeat / keepalive

Juliusz Sompolski created SPARK-46011: - Summary: Spark Connect session heartbeat / keepalive Key: SPARK-46011 URL: https://issues.apache.org/jira/browse/SPARK-46011 Project: Spark Issue

[jira] [Resolved] (SPARK-46002) Upgrade to Python 3.9 in SQL test

[ https://issues.apache.org/jira/browse/SPARK-46002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46002. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43902

[jira] [Assigned] (SPARK-46002) Upgrade to Python 3.9 in SQL test

[ https://issues.apache.org/jira/browse/SPARK-46002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46002: - Assignee: Ruifeng Zheng > Upgrade to Python 3.9 in SQL test >

[jira] [Updated] (SPARK-46010) Upgrade Node.js to 18.X

[ https://issues.apache.org/jira/browse/SPARK-46010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46010: --- Labels: pull-request-available (was: ) > Upgrade Node.js to 18.X > ---

[jira] [Created] (SPARK-46010) Upgrade Node.js to 18.X

Bjørn Jørgensen created SPARK-46010: --- Summary: Upgrade Node.js to 18.X Key: SPARK-46010 URL: https://issues.apache.org/jira/browse/SPARK-46010 Project: Spark Issue Type: Dependency upgrade

[jira] [Commented] (SPARK-21928) ClassNotFoundException for custom Kryo registrator class during serde in netty threads

[ https://issues.apache.org/jira/browse/SPARK-21928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788104#comment-17788104 ] Shivam Sharma commented on SPARK-21928: --- I am getting this intermittent failure on spark 2.4.3

[jira] [Commented] (SPARK-29251) intermittent serialization failures in spark

[ https://issues.apache.org/jira/browse/SPARK-29251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788101#comment-17788101 ] Shivam Sharma commented on SPARK-29251: --- I am also getting the same issue, did you find the fix?

[jira] [Updated] (SPARK-43393) Sequence expression can overflow

[ https://issues.apache.org/jira/browse/SPARK-43393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-43393: -- Fix Version/s: 3.3.4 > Sequence expression can overflow > >

[jira] [Resolved] (SPARK-46005) Upgrade scikit-learn to 1.3.2

[ https://issues.apache.org/jira/browse/SPARK-46005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46005. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43905

[jira] [Resolved] (SPARK-46007) Add `AmmoniteTest` test tag and mark `ReplE2ESuite`

[ https://issues.apache.org/jira/browse/SPARK-46007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46007. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43909

[jira] [Resolved] (SPARK-45937) Fix documentation of spark.executor.maxNumFailures

[ https://issues.apache.org/jira/browse/SPARK-45937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-45937. --- Resolution: Duplicate > Fix documentation of spark.executor.maxNumFailures >

[jira] [Updated] (SPARK-45699) Fix "Widening conversion from `TypeA` to `TypeB` is deprecated because it loses precision"

[ https://issues.apache.org/jira/browse/SPARK-45699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45699: --- Labels: pull-request-available (was: ) > Fix "Widening conversion from `TypeA` to `TypeB`

[jira] [Updated] (SPARK-46009) Merge the parse rule of PercentileCont and PercentileDisc into functionCall

[ https://issues.apache.org/jira/browse/SPARK-46009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46009: --- Labels: pull-request-available (was: ) > Merge the parse rule of PercentileCont and

[jira] [Updated] (SPARK-46009) Merge the parse rule of PercentileCont and PercentileDisc into functionCall

[ https://issues.apache.org/jira/browse/SPARK-46009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46009: --- Description: Spark SQL parser have a special rule to parse

[jira] [Assigned] (SPARK-46007) Add `AmmoniteTest` test tag and mark `ReplE2ESuite`

[ https://issues.apache.org/jira/browse/SPARK-46007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46007: - Assignee: Dongjoon Hyun > Add `AmmoniteTest` test tag and mark `ReplE2ESuite` >

[jira] [Updated] (SPARK-46009) Merge the parse rule of PercentileCont and PercentileDisc into functionCall

[ https://issues.apache.org/jira/browse/SPARK-46009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46009: --- Description: Spark SQL parse have a special rule to parse

[jira] [Updated] (SPARK-46009) Merge the parse rule of PercentileCont and PercentileDisc into functionCall

[ https://issues.apache.org/jira/browse/SPARK-46009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaan Geng updated SPARK-46009: --- Description: Spark SQL parse have a special rule to parse

[jira] [Created] (SPARK-46009) Merge the parse rule of PercentileCont and PercentileDisc into functionCall

Jiaan Geng created SPARK-46009: -- Summary: Merge the parse rule of PercentileCont and PercentileDisc into functionCall Key: SPARK-46009 URL: https://issues.apache.org/jira/browse/SPARK-46009 Project:

[jira] [Updated] (SPARK-46007) Add `AmmoniteTest` test tag and mark `ReplE2ESuite`

[ https://issues.apache.org/jira/browse/SPARK-46007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46007: -- Summary: Add `AmmoniteTest` test tag and mark `ReplE2ESuite` (was: Add `AmmoniteTest` and

[jira] [Created] (SPARK-46008) Add spark-sql-viz-test.js to test spark-sql-viz.js

Kent Yao created SPARK-46008: Summary: Add spark-sql-viz-test.js to test spark-sql-viz.js Key: SPARK-46008 URL: https://issues.apache.org/jira/browse/SPARK-46008 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46007) Add `AmmoniteTest` and mark `ReplE2ESuite`

[ https://issues.apache.org/jira/browse/SPARK-46007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46007: -- Description: - https://github.com/com-lihaoyi/Ammonite/issues/276 > Add `AmmoniteTest` and

[jira] [Created] (SPARK-46007) Add `AmmoniteTest` and mark `ReplE2ESuite`

Dongjoon Hyun created SPARK-46007: - Summary: Add `AmmoniteTest` and mark `ReplE2ESuite` Key: SPARK-46007 URL: https://issues.apache.org/jira/browse/SPARK-46007 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

[ https://issues.apache.org/jira/browse/SPARK-46004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46004: --- Labels: pull-request-available (was: ) > Refine docstring of

[jira] [Commented] (SPARK-45937) Fix documentation of spark.executor.maxNumFailures

[ https://issues.apache.org/jira/browse/SPARK-45937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787926#comment-17787926 ] Cheng Pan commented on SPARK-45937: --- [~tgraves] sorry, I missed this ticket and opened a new one

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46006: --- Labels: pull-request-available (was: ) > YarnAllocator miss clean

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Attachment: image-2023-11-20-17-56-56-507.png > YarnAllocator miss clean

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Attachment: image-2023-11-20-17-56-45-212.png > YarnAllocator miss clean

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

  1   2   >