[jira] [Created] (SPARK-46004) Refine docstring of `DataFrame.dropna/fillna/replace`

BingKun Pan created SPARK-46004: --- Summary: Refine docstring of `DataFrame.dropna/fillna/replace` Key: SPARK-46004 URL: https://issues.apache.org/jira/browse/SPARK-46004 Project: Spark Issue

[jira] [Updated] (SPARK-46003) Create an ui-test module with Jest

[ https://issues.apache.org/jira/browse/SPARK-46003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46003: --- Labels: pull-request-available (was: ) > Create an ui-test module with Jest >

[jira] [Created] (SPARK-46003) Create an ui-test module with Jest

Kent Yao created SPARK-46003: Summary: Create an ui-test module with Jest Key: SPARK-46003 URL: https://issues.apache.org/jira/browse/SPARK-46003 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46002) Upgrade to Python 3.10 in SQL test

[ https://issues.apache.org/jira/browse/SPARK-46002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46002: --- Labels: pull-request-available (was: ) > Upgrade to Python 3.10 in SQL test >

[jira] [Created] (SPARK-46002) Upgrade to Python 3.10 in SQL test

Ruifeng Zheng created SPARK-46002: - Summary: Upgrade to Python 3.10 in SQL test Key: SPARK-46002 URL: https://issues.apache.org/jira/browse/SPARK-46002 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46001) Spark UI Test Improvements

Kent Yao created SPARK-46001: Summary: Spark UI Test Improvements Key: SPARK-46001 URL: https://issues.apache.org/jira/browse/SPARK-46001 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46000) The `Install JavaScript linter dependencies` task that was tested on the 3.x day has disappeared.

Yang Jie created SPARK-46000: Summary: The `Install JavaScript linter dependencies` task that was tested on the 3.x day has disappeared. Key: SPARK-46000 URL: https://issues.apache.org/jira/browse/SPARK-46000

[jira] [Updated] (SPARK-45999) Use dedicated `PandasProduct` in `cumprod`

[ https://issues.apache.org/jira/browse/SPARK-45999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45999: --- Labels: pull-request-available (was: ) > Use dedicated `PandasProduct` in `cumprod` >

[jira] [Created] (SPARK-45999) Use dedicated `PandasProduct` in `cumprod`

Ruifeng Zheng created SPARK-45999: - Summary: Use dedicated `PandasProduct` in `cumprod` Key: SPARK-45999 URL: https://issues.apache.org/jira/browse/SPARK-45999 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-45997) Remove deprecated APIs from legacy Koalas

[ https://issues.apache.org/jira/browse/SPARK-45997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-45997: - Assignee: Haejoon Lee > Remove deprecated APIs from legacy Koalas >

[jira] [Resolved] (SPARK-45997) Remove deprecated APIs from legacy Koalas

[ https://issues.apache.org/jira/browse/SPARK-45997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45997. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43896

[jira] [Resolved] (SPARK-45982) re-org R package installations

[ https://issues.apache.org/jira/browse/SPARK-45982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45982. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43881

[jira] [Assigned] (SPARK-45982) re-org R package installations

[ https://issues.apache.org/jira/browse/SPARK-45982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45982: - Assignee: Ruifeng Zheng > re-org R package installations >

[jira] [Assigned] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45996: Assignee: Hyukjin Kwon > Show proper dependency requirement messages for Spark Connect >

[jira] [Resolved] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45996. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43894

[jira] [Updated] (SPARK-45998) Remove redundant type cast

[ https://issues.apache.org/jira/browse/SPARK-45998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45998: --- Labels: pull-request-available (was: ) > Remove redundant type cast >

[jira] [Created] (SPARK-45998) Remove redundant type cast

Yang Jie created SPARK-45998: Summary: Remove redundant type cast Key: SPARK-45998 URL: https://issues.apache.org/jira/browse/SPARK-45998 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-45861) Add user guide for dataframe creation

[ https://issues.apache.org/jira/browse/SPARK-45861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45861: --- Labels: pull-request-available (was: ) > Add user guide for dataframe creation >

[jira] [Assigned] (SPARK-45942) Only do the thread interruption check for putIterator on executors

[ https://issues.apache.org/jira/browse/SPARK-45942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45942: Assignee: Huanli Wang > Only do the thread interruption check for putIterator on

[jira] [Resolved] (SPARK-45942) Only do the thread interruption check for putIterator on executors

[ https://issues.apache.org/jira/browse/SPARK-45942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45942. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43823

[jira] [Updated] (SPARK-45997) Remove deprecated APIs from legacy Koalas

[ https://issues.apache.org/jira/browse/SPARK-45997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45997: --- Labels: pull-request-available (was: ) > Remove deprecated APIs from legacy Koalas >

[jira] [Updated] (SPARK-34503) Use zstd for spark.eventLog.compression.codec by default

[ https://issues.apache.org/jira/browse/SPARK-34503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-34503: --- Labels: pull-request-available releasenotes (was: releasenotes) > Use zstd for

[jira] [Updated] (SPARK-45997) Remove deprecated APIs from legacy Koalas

[ https://issues.apache.org/jira/browse/SPARK-45997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-45997: Summary: Remove deprecated APIs from legacy Koalas (was: Remove deprecated Koalas signatures) >

[jira] [Updated] (SPARK-45997) Remove deprecated Koalas signatures

[ https://issues.apache.org/jira/browse/SPARK-45997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-45997: Description: We should remove the deprecated Koalas signatures to cleanup the API surface. (was:

[jira] [Updated] (SPARK-45997) Remove deprecated Koalas signatures

[ https://issues.apache.org/jira/browse/SPARK-45997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-45997: Summary: Remove deprecated Koalas signatures (was: Update Koalas Migration Guide) > Remove

[jira] [Created] (SPARK-45997) Update Koalas Migration Guide

Haejoon Lee created SPARK-45997: --- Summary: Update Koalas Migration Guide Key: SPARK-45997 URL: https://issues.apache.org/jira/browse/SPARK-45997 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-45986) Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45986: Assignee: Hyukjin Kwon (was: Dongjoon Hyun) > Fix

[jira] [Resolved] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45995. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43893

[jira] [Assigned] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45995: - Assignee: Hyukjin Kwon > Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor >

[jira] [Assigned] (SPARK-45986) Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45986: - Assignee: Dongjoon Hyun > Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11

[jira] [Resolved] (SPARK-45986) Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45986. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43892

[jira] [Updated] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-45996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45996: --- Labels: pull-request-available (was: ) > Show proper dependency requirement messages for

[jira] [Created] (SPARK-45996) Show proper dependency requirement messages for Spark Connect

Hyukjin Kwon created SPARK-45996: Summary: Show proper dependency requirement messages for Spark Connect Key: SPARK-45996 URL: https://issues.apache.org/jira/browse/SPARK-45996 Project: Spark

[jira] [Assigned] (SPARK-45994) Change description-file to description_file

[ https://issues.apache.org/jira/browse/SPARK-45994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45994: Assignee: Bjørn Jørgensen > Change description-file to description_file >

[jira] [Resolved] (SPARK-45994) Change description-file to description_file

[ https://issues.apache.org/jira/browse/SPARK-45994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45994. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43891

[jira] [Updated] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-45995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45995: --- Labels: pull-request-available (was: ) > Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

[jira] [Created] (SPARK-45995) Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor

Hyukjin Kwon created SPARK-45995: Summary: Upgrade R version from 4.3.1 to 4.3.2 in AppVeyor Key: SPARK-45995 URL: https://issues.apache.org/jira/browse/SPARK-45995 Project: Spark Issue

[jira] [Updated] (SPARK-35148) Support traversal pruning in transformUpWithNewOutput

[ https://issues.apache.org/jira/browse/SPARK-35148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-35148: --- Labels: pull-request-available (was: ) > Support traversal pruning in

[jira] [Updated] (SPARK-44758) Support memory limit configurable

[ https://issues.apache.org/jira/browse/SPARK-44758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44758: --- Labels: pull-request-available (was: ) > Support memory limit configurable >

[jira] [Updated] (SPARK-45986) Fix `pyspark.ml.torch.tests.test_distributor` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45986: --- Labels: pull-request-available (was: ) > Fix `pyspark.ml.torch.tests.test_distributor` in

[jira] [Resolved] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45988. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45989. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in

[jira] [Updated] (SPARK-45994) Change description-file to description_file

[ https://issues.apache.org/jira/browse/SPARK-45994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45994: --- Labels: pull-request-available (was: ) > Change description-file to description_file >

[jira] [Created] (SPARK-45994) Change description-file to description_file

Bjørn Jørgensen created SPARK-45994: --- Summary: Change description-file to description_file Key: SPARK-45994 URL: https://issues.apache.org/jira/browse/SPARK-45994 Project: Spark Issue

[jira] [Resolved] (SPARK-45992) Switch from fgrep to grep -F

[ https://issues.apache.org/jira/browse/SPARK-45992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45992. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43889

[jira] [Assigned] (SPARK-45992) Switch from fgrep to grep -F

[ https://issues.apache.org/jira/browse/SPARK-45992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45992: - Assignee: Bjørn Jørgensen > Switch from fgrep to grep -F >

[jira] [Commented] (SPARK-44445) Upgrade htmlunit from 2.70 to 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787625#comment-17787625 ] Ronald Brill commented on SPARK-5: -- [~bjornjorgensen] i think you are talking about the

[jira] [Comment Edited] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787619#comment-17787619 ] Mark Jarvin edited comment on SPARK-44973 at 11/19/23 4:19 PM: --- I believe

[jira] [Commented] (SPARK-44973) CONV('-9223372036854775808', 10, -2) throws ArrayIndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-44973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787619#comment-17787619 ] Mark Jarvin commented on SPARK-44973: - I believe it's affected back to 3.3.1:

[jira] [Created] (SPARK-45993) -target is deprecated: Use -release instead

Bjørn Jørgensen created SPARK-45993: --- Summary: -target is deprecated: Use -release instead Key: SPARK-45993 URL: https://issues.apache.org/jira/browse/SPARK-45993 Project: Spark Issue

[jira] [Updated] (SPARK-45992) Switch from fgrep to grep -F

[ https://issues.apache.org/jira/browse/SPARK-45992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-45992: Summary: Switch from fgrep to grep -F (was: Switch form fgrep to grep -F) > Switch from

[jira] [Updated] (SPARK-45992) Switch form fgrep to grep -F

[ https://issues.apache.org/jira/browse/SPARK-45992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45992: --- Labels: pull-request-available (was: ) > Switch form fgrep to grep -F >

[jira] [Created] (SPARK-45992) Switch form fgrep to grep -F

Bjørn Jørgensen created SPARK-45992: --- Summary: Switch form fgrep to grep -F Key: SPARK-45992 URL: https://issues.apache.org/jira/browse/SPARK-45992 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-44445) Upgrade htmlunit from 2.70 to 3.3.0

[ https://issues.apache.org/jira/browse/SPARK-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787600#comment-17787600 ] Bjørn Jørgensen commented on SPARK-5: - Yes, thank you that will be real grate. This is a

[jira] [Updated] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45988: --- Labels: pull-request-available (was: ) > Fix

[jira] [Assigned] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45989: - Assignee: Dongjoon Hyun > Fix

[jira] [Assigned] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11

[ https://issues.apache.org/jira/browse/SPARK-45988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-45988: - Assignee: Dongjoon Hyun > Fix `pyspark.pandas.tests.computation.test_apply_func` in

[jira] [Updated] (SPARK-45981) Improve Python language test coverage

[ https://issues.apache.org/jira/browse/SPARK-45981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45981: -- Labels: releasenotes (was: ) > Improve Python language test coverage >

[jira] [Updated] (SPARK-45990) Upgrade `protobuf` to 4.25.1 to support `Python 3.11`

[ https://issues.apache.org/jira/browse/SPARK-45990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-45990: -- Labels: releasenotes (was: pull-request-available) > Upgrade `protobuf` to 4.25.1 to support

[jira] [Resolved] (SPARK-45991) Upgrade `protobuf-java` to 3.25.1 to match with protobuf 4.25.1

[ https://issues.apache.org/jira/browse/SPARK-45991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-45991. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43886