[jira] [Updated] (SPARK-46112) Implement lint check for PySpark custom errors

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46112: Summary: Implement lint check for PySpark custom errors (was: Enforce usage of PySpark-specific

[jira] [Updated] (SPARK-46112) Enforce usage of PySpark-specific Exceptions over built-in Python Exceptions

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46112: --- Labels: pull-request-available (was: ) > Enforce usage of PySpark-specific Exceptions over

[jira] [Updated] (SPARK-46282) Create a Standalone Page for DataFrame API in PySpark Documentation

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46282: --- Labels: pull-request-available (was: ) > Create a Standalone Page for DataFrame API in

[jira] [Updated] (SPARK-46282) Create a Standalone Page for DataFrame API in PySpark Documentation

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46282: Summary: Create a Standalone Page for DataFrame API in PySpark Documentation (was: Create

[jira] [Updated] (SPARK-46282) Create a Standalone Page for DataFrame API in PySpark Documentation

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46282: Description: Previously, the DataFrame API content was nested under the Spark SQL section. This

[jira] [Created] (SPARK-46282) Create dedicated page for DataFrame API

2023-12-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46282: --- Summary: Create dedicated page for DataFrame API Key: SPARK-46282 URL: https://issues.apache.org/jira/browse/SPARK-46282 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46281) Remove unused code in `pyspark.pandas.tests.computation.*`

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46281: --- Labels: pull-request-available (was: ) > Remove unused code in

[jira] [Created] (SPARK-46281) Remove unused code in `pyspark.pandas.tests.computation.*`

2023-12-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46281: - Summary: Remove unused code in `pyspark.pandas.tests.computation.*` Key: SPARK-46281 URL: https://issues.apache.org/jira/browse/SPARK-46281 Project: Spark

[jira] [Updated] (SPARK-46281) Remove unused code in `pyspark.pandas.tests.computation.*`

2023-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46281: -- Priority: Minor (was: Major) > Remove unused code in `pyspark.pandas.tests.computation.*` >

[jira] [Resolved] (SPARK-46278) Re-organize `GroupByTests`

2023-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46278. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44196

[jira] [Assigned] (SPARK-46278) Re-organize `GroupByTests`

2023-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46278: - Assignee: Haejoon Lee > Re-organize `GroupByTests` > -- > >

[jira] [Updated] (SPARK-46280) Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46280: --- Labels: pull-request-available (was: ) > Move test_parity_frame_resample and

[jira] [Created] (SPARK-46280) Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample

2023-12-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46280: - Summary: Move test_parity_frame_resample and test_parity_series_resample to pyspark.pandas.tests.connect.resample Key: SPARK-46280 URL:

[jira] [Updated] (SPARK-46240) Add ExecutedPlanPrepRules to SparkSessionExtensions

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46240: --- Labels: pull-request-available (was: ) > Add ExecutedPlanPrepRules to

[jira] [Commented] (SPARK-46279) Support write partition values to data files

2023-12-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793520#comment-17793520 ] Snoot.io commented on SPARK-46279: -- User 'lzlfred' has created a pull request for this issue:

[jira] [Commented] (SPARK-46279) Support write partition values to data files

2023-12-05 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793519#comment-17793519 ] Snoot.io commented on SPARK-46279: -- User 'lzlfred' has created a pull request for this issue:

[jira] [Resolved] (SPARK-46263) Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions.

2023-12-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46263. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44179

[jira] [Updated] (SPARK-46240) Add ExecutedPlanPrepRules to SparkSessionExtensions

2023-12-05 Thread jiang13021 (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiang13021 updated SPARK-46240: --- Description: Some rules (Rule[SparkPlan]) are applied when preparing for the executedPlan.

[jira] [Created] (SPARK-46279) Support write partition values to data files

2023-12-05 Thread fred liu (Jira)
fred liu created SPARK-46279: Summary: Support write partition values to data files Key: SPARK-46279 URL: https://issues.apache.org/jira/browse/SPARK-46279 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-46257) Upgrade Derby to 10.16.1.1

2023-12-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-46257. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44174

[jira] [Assigned] (SPARK-46257) Upgrade Derby to 10.16.1.1

2023-12-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-46257: Assignee: Yang Jie > Upgrade Derby to 10.16.1.1 > -- > >

[jira] [Resolved] (SPARK-44977) Upgrade Derby to 10.15.1.3+

2023-12-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44977. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44174

[jira] [Updated] (SPARK-46278) Re-organize `GroupByTests`

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46278: --- Labels: pull-request-available (was: ) > Re-organize `GroupByTests` >

[jira] [Resolved] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46226. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44143

[jira] [Assigned] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46226: Assignee: Haejoon Lee > Migrate all remaining RuntimeError into PySpark error framework

[jira] [Resolved] (SPARK-40609) Casts types according to bucket info for Equality expression

2023-12-05 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40609. - Fix Version/s: 4.0.0 Resolution: Duplicate Issue fixed by SPARK-46219. > Casts types

[jira] [Created] (SPARK-46278) Re-organize `GroupByTests`

2023-12-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46278: --- Summary: Re-organize `GroupByTests` Key: SPARK-46278 URL: https://issues.apache.org/jira/browse/SPARK-46278 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46044) Improve test coverage of udf.py

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46044. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43947

[jira] [Resolved] (SPARK-46241) Fix error handling routine so it wouldn't fall into infinite recursion

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46241. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44144

[jira] [Assigned] (SPARK-46241) Fix error handling routine so it wouldn't fall into infinite recursion

2023-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46241: Assignee: Alice Sayutina > Fix error handling routine so it wouldn't fall into infinite

[jira] [Updated] (SPARK-46277) Validate startup urls with the config to set

2023-12-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46277: - Attachment: image-2023-12-05-15-39-08-830.png > Validate startup urls with the config to set >

[jira] [Updated] (SPARK-46277) Validate startup urls with the config to set

2023-12-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46277: - Description: !image-2023-12-05-15-39-08-830.png! > Validate startup urls with the config to set

[jira] [Updated] (SPARK-46277) Validate startup urls with the config being set

2023-12-05 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-46277: - Summary: Validate startup urls with the config being set (was: Validate startup urls with the

[jira] [Updated] (SPARK-46277) Validate startup urls with the config to set

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46277: --- Labels: pull-request-available (was: ) > Validate startup urls with the config to set >

[jira] [Created] (SPARK-46277) Validate startup urls with the config to set

2023-12-05 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-46277: Summary: Validate startup urls with the config to set Key: SPARK-46277 URL: https://issues.apache.org/jira/browse/SPARK-46277 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-45580) Subquery changes the output schema of the outer query

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-45580: --- Labels: pull-request-available (was: ) > Subquery changes the output schema of the outer

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

2023-12-05 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated SPARK-46275: - Description: Consider a protobuf with two fields {{message Person { string name = 1; int id =

[jira] [Commented] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

2023-12-05 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793453#comment-17793453 ] Raghu Angadi commented on SPARK-46275: -- Context from [~gengliang] about `from_avro()` behavior:

[jira] [Updated] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

2023-12-05 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated SPARK-46275: - Description: Consider a protobuf with two fields {{message Person { string name = 1; int id =

[jira] [Created] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

2023-12-05 Thread Raghu Angadi (Jira)
Raghu Angadi created SPARK-46275: Summary: Protobuf: Permissive mode should return null rather than struct with null fields Key: SPARK-46275 URL: https://issues.apache.org/jira/browse/SPARK-46275

[jira] [Updated] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46274: --- Labels: pull-request-available (was: ) > Range operator computeStats() proper long

[jira] [Updated] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-05 Thread Kelvin Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kelvin Jiang updated SPARK-46274: - Issue Type: Bug (was: Improvement) > Range operator computeStats() proper long conversions >

[jira] [Created] (SPARK-46274) Range operator computeStats() proper long conversions

2023-12-05 Thread Kelvin Jiang (Jira)
Kelvin Jiang created SPARK-46274: Summary: Range operator computeStats() proper long conversions Key: SPARK-46274 URL: https://issues.apache.org/jira/browse/SPARK-46274 Project: Spark Issue

[jira] [Updated] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46272: --- Labels: pull-request-available (was: ) > Support CTAS using DSv2 sources >

[jira] [Commented] (SPARK-37571) decouple amplab jenkins from spark website, builds and tests

2023-12-05 Thread Shane Knapp (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793420#comment-17793420 ] Shane Knapp commented on SPARK-37571: - a blast from the past!  XD sounds good to me...  there are

[jira] [Updated] (SPARK-34234) Remove TreeNodeException that didn't work

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-34234: --- Labels: pull-request-available (was: ) > Remove TreeNodeException that didn't work >

[jira] [Created] (SPARK-46273) Support INSERT INTO/OVERWRITE using DSv2 sources

2023-12-05 Thread Allison Wang (Jira)
Allison Wang created SPARK-46273: Summary: Support INSERT INTO/OVERWRITE using DSv2 sources Key: SPARK-46273 URL: https://issues.apache.org/jira/browse/SPARK-46273 Project: Spark Issue Type:

[jira] [Created] (SPARK-46272) Support CTAS using DSv2 sources

2023-12-05 Thread Allison Wang (Jira)
Allison Wang created SPARK-46272: Summary: Support CTAS using DSv2 sources Key: SPARK-46272 URL: https://issues.apache.org/jira/browse/SPARK-46272 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-46268) Re-organize `StatsTests`

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46268: - Assignee: Ruifeng Zheng > Re-organize `StatsTests` > > >

[jira] [Resolved] (SPARK-46268) Re-organize `StatsTests`

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46268. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44185

[jira] [Updated] (SPARK-46271) Remove unused properties in pyspark.pandas.tests.groupby.*

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46271: --- Labels: pull-request-available (was: ) > Remove unused properties in

[jira] [Resolved] (SPARK-46271) Remove unused properties in pyspark.pandas.tests.groupby.*

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46271. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44188

[jira] [Assigned] (SPARK-46271) Remove unused properties in pyspark.pandas.tests.groupby.*

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46271: - Assignee: Dongjoon Hyun > Remove unused properties in pyspark.pandas.tests.groupby.* >

[jira] [Assigned] (SPARK-46271) Remove unused properties in pyspark.pandas.tests.groupby.*

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46271: - Assignee: Ruifeng Zheng (was: Dongjoon Hyun) > Remove unused properties in

[jira] [Assigned] (SPARK-46266) Re-organize `NumOpsTests`

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46266: - Assignee: Ruifeng Zheng > Re-organize `NumOpsTests` > - > >

[jira] [Resolved] (SPARK-46266) Re-organize `NumOpsTests`

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46266. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44182

[jira] [Created] (SPARK-46271) Remove unused properties in pyspark.pandas.tests.groupby.*

2023-12-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46271: - Summary: Remove unused properties in pyspark.pandas.tests.groupby.* Key: SPARK-46271 URL: https://issues.apache.org/jira/browse/SPARK-46271 Project: Spark

[jira] [Resolved] (SPARK-46259) Add appropriate link for error class usage documentation.

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46259. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44175

[jira] [Assigned] (SPARK-46259) Add appropriate link for error class usage documentation.

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46259: - Assignee: Haejoon Lee > Add appropriate link for error class usage documentation. >

[jira] [Resolved] (SPARK-46265) New assertions in AddArtifact RPC make the connect client incompatible with older clusters

2023-12-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-46265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-46265. --- Fix Version/s: 4.0.0 Assignee: Niranjan Jayakar Resolution: Fixed >

[jira] [Resolved] (SPARK-46219) Unwrap cast in join predicates

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46219. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44133

[jira] [Resolved] (SPARK-46269) Enable more NumPy compatibility function tests

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46269. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44186

[jira] [Assigned] (SPARK-46269) Enable more NumPy compatibility function tests

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46269: - Assignee: Haejoon Lee > Enable more NumPy compatibility function tests >

[jira] [Commented] (SPARK-37571) decouple amplab jenkins from spark website, builds and tests

2023-12-05 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793347#comment-17793347 ] Nicholas Chammas commented on SPARK-37571: -- Since we've

[jira] [Resolved] (SPARK-37647) Expose percentile function in Scala/Python APIs

2023-12-05 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-37647. -- Resolution: Fixed It looks like this got added as part of Spark 3.5:

[jira] [Updated] (SPARK-44977) Upgrade Derby to 10.15.1.3+

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-44977: --- Labels: pull-request-available (was: ) > Upgrade Derby to 10.15.1.3+ >

[jira] [Commented] (SPARK-33133) History server fails when loading invalid rolling event logs

2023-12-05 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793270#comment-17793270 ] Adam Binford commented on SPARK-33133: -- I never got around to fixing the issue creating the event

[jira] [Updated] (SPARK-46270) Use java14 instanceof expressions to replace the java8 instanceof statement

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46270: --- Labels: pull-request-available (was: ) > Use java14 instanceof expressions to replace the

[jira] [Created] (SPARK-46270) Use java14 instanceof expressions to replace the java8 instanceof statement

2023-12-05 Thread Jiaan Geng (Jira)
Jiaan Geng created SPARK-46270: -- Summary: Use java14 instanceof expressions to replace the java8 instanceof statement Key: SPARK-46270 URL: https://issues.apache.org/jira/browse/SPARK-46270 Project:

[jira] [Updated] (SPARK-46269) Enable more NumPy compatibility function tests

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46269: Summary: Enable more NumPy compatibility function tests (was: Enable more NumPy function tests)

[jira] [Updated] (SPARK-46269) Enable more NumPy function tests

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46269: --- Labels: pull-request-available (was: ) > Enable more NumPy function tests >

[jira] [Updated] (SPARK-46269) Enable more NumPy function tests

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46269: Summary: Enable more NumPy function tests (was: Enable NumPy function tests that marked as flaky

[jira] [Updated] (SPARK-46269) Enable NumPy function tests that marked as flaky before.

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46269: Summary: Enable NumPy function tests that marked as flaky before. (was: Enable more NumPy

[jira] [Created] (SPARK-46269) Enable more NumPy function tests

2023-12-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46269: --- Summary: Enable more NumPy function tests Key: SPARK-46269 URL: https://issues.apache.org/jira/browse/SPARK-46269 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46268) Re-organize `StatsTests`

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46268: --- Labels: pull-request-available (was: ) > Re-organize `StatsTests` >

[jira] [Created] (SPARK-46268) Re-organize `StatsTests`

2023-12-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46268: - Summary: Re-organize `StatsTests` Key: SPARK-46268 URL: https://issues.apache.org/jira/browse/SPARK-46268 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-46256. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44172

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-46256: Assignee: Kent Yao > Parallel Compression Support for ZSTD >

[jira] [Created] (SPARK-46267) critical vunerability with a fix in Derby

2023-12-05 Thread Laurenceau Julien (Jira)
Laurenceau Julien created SPARK-46267: - Summary: critical vunerability with a fix in Derby Key: SPARK-46267 URL: https://issues.apache.org/jira/browse/SPARK-46267 Project: Spark Issue

[jira] [Updated] (SPARK-46266) Re-organize `NumOpsTests`

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46266: --- Labels: pull-request-available (was: ) > Re-organize `NumOpsTests` >

[jira] [Created] (SPARK-46266) Re-organize `NumOpsTests`

2023-12-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-46266: - Summary: Re-organize `NumOpsTests` Key: SPARK-46266 URL: https://issues.apache.org/jira/browse/SPARK-46266 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-46262) Enable test for np.left_shift for Pandas-on-Spark object.

2023-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-46262: - Assignee: Haejoon Lee > Enable test for np.left_shift for Pandas-on-Spark object. >

[jira] [Resolved] (SPARK-46262) Enable test for np.left_shift for Pandas-on-Spark object.

2023-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46262. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44178

[jira] [Resolved] (SPARK-46264) Re-organize the resampling tests

2023-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-46264. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44180

[jira] [Commented] (SPARK-46247) Invalid bucket file error when reading from bucketed table created with PathOutputCommitProtocol

2023-12-05 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-46247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793207#comment-17793207 ] Никита Соколов commented on SPARK-46247: Can be bypassed by the following configuration during

[jira] [Created] (SPARK-46265) New assertions in AddArtifact RPC make the connect client incompatible with older clusters

2023-12-05 Thread Niranjan Jayakar (Jira)
Niranjan Jayakar created SPARK-46265: Summary: New assertions in AddArtifact RPC make the connect client incompatible with older clusters Key: SPARK-46265 URL:

[jira] [Updated] (SPARK-46265) New assertions in AddArtifact RPC make the connect client incompatible with older clusters

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46265: --- Labels: pull-request-available (was: ) > New assertions in AddArtifact RPC make the

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46256: -- Assignee: Apache Spark > Parallel Compression Support for ZSTD >

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46256: -- Assignee: (was: Apache Spark) > Parallel Compression Support for ZSTD >

[jira] [Assigned] (SPARK-46263) Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions.

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46263: -- Assignee: Apache Spark > Clean up unnecessary `SeqOps.view` and `ArrayOps.view`

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46256: -- Assignee: (was: Apache Spark) > Parallel Compression Support for ZSTD >

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46256: -- Assignee: Apache Spark > Parallel Compression Support for ZSTD >

[jira] [Assigned] (SPARK-46263) Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions.

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46263: -- Assignee: Apache Spark > Clean up unnecessary `SeqOps.view` and `ArrayOps.view`

[jira] [Assigned] (SPARK-46263) Clean up unnecessary `SeqOps.view` and `ArrayOps.view` conversions.

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46263: -- Assignee: (was: Apache Spark) > Clean up unnecessary `SeqOps.view` and

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46256: -- Assignee: (was: Apache Spark) > Parallel Compression Support for ZSTD >

[jira] [Assigned] (SPARK-46256) Parallel Compression Support for ZSTD

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46256: -- Assignee: Apache Spark > Parallel Compression Support for ZSTD >

[jira] [Assigned] (SPARK-46264) Re-organize the resampling tests

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46264: -- Assignee: Apache Spark > Re-organize the resampling tests >

[jira] [Resolved] (SPARK-46258) Add RocksDBPersistenceEngine

2023-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46258. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44173

[jira] [Commented] (SPARK-33133) History server fails when loading invalid rolling event logs

2023-12-05 Thread liran avi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793187#comment-17793187 ] liran avi commented on SPARK-33133: --- hi [~kimahriman]  did you manage to solve this issue? I faced

[jira] [Updated] (SPARK-46264) Re-organize the resampling tests

2023-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46264: --- Labels: pull-request-available (was: ) > Re-organize the resampling tests >

  1   2   >