[jira] [Updated] (SPARK-46674) Remove the Hive Index methods in HiveShim

2024-01-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46674: - Summary: Remove the Hive Index methods in HiveShim (was: Remove the Hive Index methods) > Remove the

[jira] [Updated] (SPARK-46667) XML: Throw error on multiple XML data source

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46667: --- Labels: pull-request-available (was: ) > XML: Throw error on multiple XML data source >

[jira] [Created] (SPARK-46674) Remove the Hive Index methods

2024-01-10 Thread Kent Yao (Jira)
Kent Yao created SPARK-46674: Summary: Remove the Hive Index methods Key: SPARK-46674 URL: https://issues.apache.org/jira/browse/SPARK-46674 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-46673) Refine docstring `aes_encrypt\aes_decrypt\try_aes_decrypt`

2024-01-10 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46673: --- Summary: Refine docstring `aes_encrypt\aes_decrypt\try_aes_decrypt` Key: SPARK-46673 URL: https://issues.apache.org/jira/browse/SPARK-46673 Project: Spark

[jira] [Updated] (SPARK-46673) Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt`

2024-01-10 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-46673: Summary: Refine docstring `aes_encrypt/aes_decrypt/try_aes_decrypt` (was: Refine docstring

[jira] [Updated] (SPARK-46672) Upgrade log4j2 to 2.22.1

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46672: --- Labels: pull-request-available (was: ) > Upgrade log4j2 to 2.22.1 >

[jira] [Created] (SPARK-46672) Upgrade log4j2 to 2.22.1

2024-01-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-46672: Summary: Upgrade log4j2 to 2.22.1 Key: SPARK-46672 URL: https://issues.apache.org/jira/browse/SPARK-46672 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46614. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/44679 > Refine docstring >

[jira] [Assigned] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46614: Assignee: BingKun Pan > Refine docstring >

[jira] [Resolved] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-4. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44676

[jira] [Assigned] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-4: Assignee: Hyukjin Kwon > Make lxml as an optional testing dependency in test_session >

[jira] [Created] (SPARK-46671) InferFiltersFromConstraint rule is creating a redundant filter

2024-01-10 Thread Asif (Jira)
Asif created SPARK-46671: Summary: InferFiltersFromConstraint rule is creating a redundant filter Key: SPARK-46671 URL: https://issues.apache.org/jira/browse/SPARK-46671 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46670: --- Labels: pull-request-available (was: ) > Make DataSourceManager isolated and self

[jira] [Created] (SPARK-46670) Make DataSourceManager isolated and self clone-able

2024-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46670: Summary: Make DataSourceManager isolated and self clone-able Key: SPARK-46670 URL: https://issues.apache.org/jira/browse/SPARK-46670 Project: Spark Issue

[jira] [Updated] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46668: --- Labels: pull-request-available (was: ) > Parallelize Sphinx build of Python API docs >

[jira] [Resolved] (SPARK-46669) Bump Kubernetes Client 6.10.0

2024-01-10 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan resolved SPARK-46669. --- Resolution: Duplicate > Bump Kubernetes Client 6.10.0 > - > >

[jira] [Created] (SPARK-46669) Bump Kubernetes Client 6.10.0

2024-01-10 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-46669: - Summary: Bump Kubernetes Client 6.10.0 Key: SPARK-46669 URL: https://issues.apache.org/jira/browse/SPARK-46669 Project: Spark Issue Type: Dependency upgrade

[jira] [Created] (SPARK-46668) Parallelize Sphinx build of Python API docs

2024-01-10 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46668: Summary: Parallelize Sphinx build of Python API docs Key: SPARK-46668 URL: https://issues.apache.org/jira/browse/SPARK-46668 Project: Spark Issue

[jira] [Updated] (SPARK-46653) Code-gen for full outer sort merge join output line by line

2024-01-10 Thread Mingliang Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Zhu updated SPARK-46653: -- Description: Be consistent with closing code-gen, avoid oom when the parent of SortMergeJoin

[jira] [Assigned] (SPARK-46575) Make HiveThriftServer2.startWithContext DevelopApi retriable

2024-01-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46575: Assignee: Kent Yao > Make HiveThriftServer2.startWithContext DevelopApi retriable >

[jira] [Created] (SPARK-46667) XML: Throw error on multiple XML data source

2024-01-10 Thread Sandip Agarwala (Jira)
Sandip Agarwala created SPARK-46667: --- Summary: XML: Throw error on multiple XML data source Key: SPARK-46667 URL: https://issues.apache.org/jira/browse/SPARK-46667 Project: Spark Issue

[jira] [Resolved] (SPARK-46575) Make HiveThriftServer2.startWithContext DevelopApi retriable

2024-01-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46575. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44575

[jira] [Updated] (SPARK-46614) Refine docstring `make_timestamp/make_timestamp_ltz/make_timestamp_ntz/make_ym_interval`

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46614: --- Labels: pull-request-available (was: ) > Refine docstring >

[jira] [Assigned] (SPARK-46656) Split `GroupbyParitySplitApplyTests`

2024-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46656: - Assignee: Ruifeng Zheng > Split `GroupbyParitySplitApplyTests` >

[jira] [Resolved] (SPARK-46656) Split `GroupbyParitySplitApplyTests`

2024-01-10 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46656. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44664

[jira] [Resolved] (SPARK-46642) Add `getMessageTemplate` to PySpark error framework

2024-01-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-46642. - Resolution: Won't Fix > Add `getMessageTemplate` to PySpark error framework >

[jira] [Updated] (SPARK-46638) Create API to acquire execution memory for 'eval' and 'terminate' methods

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46638: --- Labels: pull-request-available (was: ) > Create API to acquire execution memory for 'eval'

[jira] [Assigned] (SPARK-46662) Upgrade kubernetes-client to 6.10.0

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46662: - Assignee: Bjørn Jørgensen > Upgrade kubernetes-client to 6.10.0 >

[jira] [Resolved] (SPARK-46662) Upgrade kubernetes-client to 6.10.0

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46662. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44672

[jira] [Resolved] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46658. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44667

[jira] [Assigned] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46658: Assignee: Nicholas Chammas > Loosen Ruby dependency specs for doc build >

[jira] [Updated] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-4: --- Labels: pull-request-available (was: ) > Make lxml as an optional testing dependency in

[jira] [Created] (SPARK-46666) Make lxml as an optional testing dependency in test_session

2024-01-10 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-4: Summary: Make lxml as an optional testing dependency in test_session Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark

[jira] [Updated] (SPARK-46665) Remove Pandas dependency for pyspark.testing

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46665: --- Labels: pull-request-available (was: ) > Remove Pandas dependency for pyspark.testing >

[jira] [Created] (SPARK-46665) Remove Pandas dependency for pyspark.testing

2024-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46665: --- Summary: Remove Pandas dependency for pyspark.testing Key: SPARK-46665 URL: https://issues.apache.org/jira/browse/SPARK-46665 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46662) Upgrade kubernetes-client to 6.10.0

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46662: --- Labels: pull-request-available (was: ) > Upgrade kubernetes-client to 6.10.0 >

[jira] [Updated] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases

2024-01-10 Thread Nikhil Sheoran (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikhil Sheoran updated SPARK-46640: --- Fix Version/s: (was: 4.0.0) > RemoveRedundantAliases does not account for

[jira] [Created] (SPARK-46662) Upgrade kubernetes-client to 6.10.0

2024-01-10 Thread Jira
Bjørn Jørgensen created SPARK-46662: --- Summary: Upgrade kubernetes-client to 6.10.0 Key: SPARK-46662 URL: https://issues.apache.org/jira/browse/SPARK-46662 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46657) Install `lxml` in Python 3.12

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46657. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44666

[jira] [Assigned] (SPARK-46657) Install `lxml` in Python 3.12

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46657: - Assignee: Dongjoon Hyun > Install `lxml` in Python 3.12 >

[jira] [Updated] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46660: --- Labels: pull-request-available (was: ) > ReattachExecute requests do not refresh aliveness

[jira] [Updated] (SPARK-46661) Add customizable property spark.dynamicAllocation.lastExecutorIdleTimeout for last remaining executor, defaulting to spark.dynamicAllocation.executorIdleTimeout

2024-01-10 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-46661: Description: when using dynamicAllocation, the parameter

[jira] [Created] (SPARK-46661) Add customizable property spark.dynamicAllocation.lastExecutorIdleTimeout for last remaining executor, defaulting to spark.dynamicAllocation.executorIdleTimeout

2024-01-10 Thread Arnaud Nauwynck (Jira)
Arnaud Nauwynck created SPARK-46661: --- Summary: Add customizable property spark.dynamicAllocation.lastExecutorIdleTimeout for last remaining executor, defaulting to spark.dynamicAllocation.executorIdleTimeout Key: SPARK-46661

[jira] [Created] (SPARK-46660) ReattachExecute requests do not refresh aliveness of SessionHolder

2024-01-10 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-46660: Summary: ReattachExecute requests do not refresh aliveness of SessionHolder Key: SPARK-46660 URL: https://issues.apache.org/jira/browse/SPARK-46660

[jira] [Updated] (SPARK-46659) Add customizable TaskScheduling param, to avoid randomly choosing executor for tasks, and downscale on low micro-batches activity

2024-01-10 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-46659: Description: When using dynamicAllocation (but not spark.decommission.enabled=true) with

[jira] [Updated] (SPARK-46659) Add customizable TaskScheduling param, to avoid randomly choosing executor for tasks, and downscale on low micro-batches activity

2024-01-10 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-46659: Description: When using dynamicAllocation (but not spark.decommission.enabled=true) with

[jira] [Updated] (SPARK-46659) Add customizable TaskScheduling param, to avoid randomly choosing executor for tasks, and downscale on low micro-batches activity

2024-01-10 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-46659: Description: When using dynamicAllocation (but not spark.decommission.enabled=true) with

[jira] [Created] (SPARK-46659) Add customizable TaskScheduling param, to avoid randomly choosing executor for tasks, and downscale on low micro-batches activity

2024-01-10 Thread Arnaud Nauwynck (Jira)
Arnaud Nauwynck created SPARK-46659: --- Summary: Add customizable TaskScheduling param, to avoid randomly choosing executor for tasks, and downscale on low micro-batches activity Key: SPARK-46659 URL:

[jira] [Updated] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46658: --- Labels: pull-request-available (was: ) > Loosen Ruby dependency specs for doc build >

[jira] [Updated] (SPARK-42199) groupByKey creates columns that may conflict with exising columns

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-42199: --- Labels: pull-request-available (was: ) > groupByKey creates columns that may conflict with

[jira] [Created] (SPARK-46658) Loosen Ruby dependency specs for doc build

2024-01-10 Thread Nicholas Chammas (Jira)
Nicholas Chammas created SPARK-46658: Summary: Loosen Ruby dependency specs for doc build Key: SPARK-46658 URL: https://issues.apache.org/jira/browse/SPARK-46658 Project: Spark Issue

[jira] [Commented] (SPARK-44173) Make Spark an sbt build only project

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805237#comment-17805237 ] Dongjoon Hyun commented on SPARK-44173: --- IIRC, there is a discussion about this and we decided to

[jira] [Comment Edited] (SPARK-44173) Make Spark an sbt build only project

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805237#comment-17805237 ] Dongjoon Hyun edited comment on SPARK-44173 at 1/10/24 5:40 PM: IIRC,

[jira] [Updated] (SPARK-46657) Install `lxml` in Python 3.12

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46657: --- Labels: pull-request-available (was: ) > Install `lxml` in Python 3.12 >

[jira] [Created] (SPARK-46657) Install `lxml` in Python 3.12

2024-01-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46657: - Summary: Install `lxml` in Python 3.12 Key: SPARK-46657 URL: https://issues.apache.org/jira/browse/SPARK-46657 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46547) Fix deadlock issue between maintenance thread and streaming agg physical operators

2024-01-10 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46547. -- Fix Version/s: 3.5.1 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-46653) Code-gen for full outer sort merge join output line by line

2024-01-10 Thread Mingliang Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Zhu updated SPARK-46653: -- Description: Be consistent with closing code-gen, avoid oom when there are a large number of

[jira] [Updated] (SPARK-46654) df.show() of pyspark displayed different results between Regular Spark and Spark Connect

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46654: --- Labels: pull-request-available (was: ) > df.show() of pyspark displayed different results

[jira] [Updated] (SPARK-46656) Split `GroupbyParitySplitApplyTests`

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46656: --- Labels: pull-request-available (was: ) > Split `GroupbyParitySplitApplyTests` >

[jira] [Created] (SPARK-46656) Split `GroupbyParitySplitApplyTests`

2024-01-10 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46656: - Summary: Split `GroupbyParitySplitApplyTests` Key: SPARK-46656 URL: https://issues.apache.org/jira/browse/SPARK-46656 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-46257) Upgrade Derby to 10.16.1.1

2024-01-10 Thread Laurenceau Julien (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805059#comment-17805059 ] Laurenceau Julien edited comment on SPARK-46257 at 1/10/24 10:36 AM: -

[jira] [Commented] (SPARK-46257) Upgrade Derby to 10.16.1.1

2024-01-10 Thread Laurenceau Julien (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805059#comment-17805059 ] Laurenceau Julien commented on SPARK-46257: --- Yes you are right. The only version that fix

[jira] [Assigned] (SPARK-46652) Remove `Snappy` from `TPCDSQueryBenchmark` benchmark case name

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46652: - Assignee: Dongjoon Hyun > Remove `Snappy` from `TPCDSQueryBenchmark` benchmark case

[jira] [Resolved] (SPARK-46652) Remove `Snappy` from `TPCDSQueryBenchmark` benchmark case name

2024-01-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46652. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44657

[jira] [Assigned] (SPARK-46650) Replace AtomicBoolean with volatile boolean

2024-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46650: -- Assignee: (was: Apache Spark) > Replace AtomicBoolean with volatile boolean >

[jira] [Resolved] (SPARK-46635) Refine docstring of `from_csv/schema_of_csv/to_csv`

2024-01-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46635. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44639

[jira] [Assigned] (SPARK-46635) Refine docstring of `from_csv/schema_of_csv/to_csv`

2024-01-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46635: Assignee: Yang Jie > Refine docstring of `from_csv/schema_of_csv/to_csv` >