[jira] [Assigned] (SPARK-40947) Upgrade pandas to 1.5.1

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40947: Assignee: (was: Apache Spark) > Upgrade pandas to 1.5.1 > --- >

[jira] [Assigned] (SPARK-40947) Upgrade pandas to 1.5.1

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40947: Assignee: Apache Spark > Upgrade pandas to 1.5.1 > --- > >

[jira] [Commented] (SPARK-40947) Upgrade pandas to 1.5.1

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625444#comment-17625444 ] Apache Spark commented on SPARK-40947: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-40947) Upgrade pandas to 1.5.1

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625445#comment-17625445 ] Apache Spark commented on SPARK-40947: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-40947) Upgrade pandas to 1.5.1

2022-10-27 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625439#comment-17625439 ] Haejoon Lee commented on SPARK-40947: - I'm working on it > Upgrade pandas to 1.5.1 >

[jira] [Created] (SPARK-40947) Upgrade pandas to 1.5.1

2022-10-27 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-40947: --- Summary: Upgrade pandas to 1.5.1 Key: SPARK-40947 URL: https://issues.apache.org/jira/browse/SPARK-40947 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40936) Refactor `AnalysisTest#assertAnalysisErrorClass` by reusing the `SparkFunSuite#checkError`

2022-10-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40936: - Summary: Refactor `AnalysisTest#assertAnalysisErrorClass` by reusing the `SparkFunSuite#checkError`

[jira] [Assigned] (SPARK-40926) Refactor server side tests to only use DataFrame API

2022-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40926: --- Assignee: Rui Wang > Refactor server side tests to only use DataFrame API >

[jira] [Resolved] (SPARK-40926) Refactor server side tests to only use DataFrame API

2022-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40926. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38406

[jira] [Resolved] (SPARK-39778) Improve error messages: step 3

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39778. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38398

[jira] [Updated] (SPARK-40924) Unhex function works incorrectly when input has uneven number of symbols

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40924: - Fix Version/s: 3.3.2 > Unhex function works incorrectly when input has uneven number of symbols >

[jira] [Resolved] (SPARK-40862) Unexpected operators when rewriting scalar subqueries with non-deterministic expressions

2022-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40862. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38336

[jira] [Created] (SPARK-40946) Introduce a new DataSource V2 interface SupportsPushDownClusterKeys

2022-10-27 Thread Huaxin Gao (Jira)
Huaxin Gao created SPARK-40946: -- Summary: Introduce a new DataSource V2 interface SupportsPushDownClusterKeys Key: SPARK-40946 URL: https://issues.apache.org/jira/browse/SPARK-40946 Project: Spark

[jira] [Assigned] (SPARK-40862) Unexpected operators when rewriting scalar subqueries with non-deterministic expressions

2022-10-27 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40862: --- Assignee: Allison Wang > Unexpected operators when rewriting scalar subqueries with

[jira] [Resolved] (SPARK-40896) Fix doctest for `Index.(isin|isnull|notnull)` to work properly with pandas 1.5

2022-10-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40896. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37955

[jira] [Resolved] (SPARK-40512) Upgrade pandas to 1.5.0

2022-10-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40512. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37955

[jira] [Assigned] (SPARK-40512) Upgrade pandas to 1.5.0

2022-10-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40512: - Assignee: Haejoon Lee > Upgrade pandas to 1.5.0 > --- > >

[jira] [Assigned] (SPARK-40896) Fix doctest for `Index.(isin|isnull|notnull)` to work properly with pandas 1.5

2022-10-27 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40896: - Assignee: Haejoon Lee > Fix doctest for `Index.(isin|isnull|notnull)` to work properly

[jira] [Resolved] (SPARK-40892) Loosen the requirement of window_time rule - allow multiple window_time calls

2022-10-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-40892. -- Fix Version/s: 3.4.0 Assignee: Jungtaek Lim Resolution: Fixed Issue resolved

[jira] [Commented] (SPARK-40889) Check error classes in PlanResolutionSuite

2022-10-27 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625365#comment-17625365 ] BingKun Pan commented on SPARK-40889: - Doing > Check error classes in PlanResolutionSuite >

[jira] [Resolved] (SPARK-40941) Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17`

2022-10-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40941. --- Fix Version/s: 3.4.0 Assignee: Dongjoon Hyun Resolution: Fixed This is

[jira] [Updated] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40940: - Fix Version/s: (was: 3.4.0) > Fix the unsupported ops checker to allow chaining of stateful

[jira] [Commented] (SPARK-40934) pyspark.pandas.read_csv parses dates, but docs state otherwise

2022-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625362#comment-17625362 ] Hyukjin Kwon commented on SPARK-40934: -- [~soxofaan] are you interested in a PR? >

[jira] [Commented] (SPARK-40931) Need to Speed ​​up unpacking when reading the next group in VectorizedRleValuesReader

2022-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625361#comment-17625361 ] Hyukjin Kwon commented on SPARK-40931: -- [~GGZ] it'd be great if you provide the benchmark codes and

[jira] [Resolved] (SPARK-35904) Collapse above RebalancePartitions

2022-10-27 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-35904. - Resolution: Not A Problem > Collapse above RebalancePartitions >

[jira] [Commented] (SPARK-40945) Support built-in function to truncate numbers

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625355#comment-17625355 ] Apache Spark commented on SPARK-40945: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40945) Support built-in function to truncate numbers

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40945: Assignee: Apache Spark > Support built-in function to truncate numbers >

[jira] [Assigned] (SPARK-40945) Support built-in function to truncate numbers

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40945: Assignee: (was: Apache Spark) > Support built-in function to truncate numbers >

[jira] [Commented] (SPARK-40945) Support built-in function to truncate numbers

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625354#comment-17625354 ] Apache Spark commented on SPARK-40945: -- User 'vinodkc' has created a pull request for this issue:

[jira] [Commented] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625353#comment-17625353 ] Apache Spark commented on SPARK-40944: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40944: Assignee: (was: Apache Spark) > Relax ordering constraint for CREATE TABLE column

[jira] [Assigned] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40944: Assignee: Apache Spark > Relax ordering constraint for CREATE TABLE column options >

[jira] [Created] (SPARK-40945) Support built-in function to truncate numbers

2022-10-27 Thread Vinod KC (Jira)
Vinod KC created SPARK-40945: Summary: Support built-in function to truncate numbers Key: SPARK-40945 URL: https://issues.apache.org/jira/browse/SPARK-40945 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-40944: --- Description: Currently the grammar for each CREATE TABLE column is: createOrReplaceTableColType :

[jira] [Updated] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-40944: --- Description: Currently the grammar for each CREATE TABLE column is: createOrReplaceTableColType :

[jira] [Updated] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-40944: --- Description: Currently the grammar for each CREATE TABLE column is: createOrReplaceTableColType :

[jira] [Created] (SPARK-40944) Relax ordering constraint for CREATE TABLE column options

2022-10-27 Thread Daniel (Jira)
Daniel created SPARK-40944: -- Summary: Relax ordering constraint for CREATE TABLE column options Key: SPARK-40944 URL: https://issues.apache.org/jira/browse/SPARK-40944 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40895) Upgrade Arrow to 10.0.0

2022-10-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40895. --- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed This is resolved

[jira] [Created] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

2022-10-27 Thread Ben Zhang (Jira)
Ben Zhang created SPARK-40943: - Summary: Make MSCK optional in MSCK REPAIR TABLE commands Key: SPARK-40943 URL: https://issues.apache.org/jira/browse/SPARK-40943 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-40942) Allow for negative initial watermark value

2022-10-27 Thread Alex Balikov (Jira)
Alex Balikov created SPARK-40942: Summary: Allow for negative initial watermark value Key: SPARK-40942 URL: https://issues.apache.org/jira/browse/SPARK-40942 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40941) Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17`

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40941: Assignee: Apache Spark > Use Java 17 in K8s Dockerfile by default and remove

[jira] [Commented] (SPARK-40941) Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17`

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625324#comment-17625324 ] Apache Spark commented on SPARK-40941: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-40941) Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17`

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40941: Assignee: (was: Apache Spark) > Use Java 17 in K8s Dockerfile by default and remove

[jira] [Created] (SPARK-40941) Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17`

2022-10-27 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-40941: - Summary: Use Java 17 in K8s Dockerfile by default and remove `Dockerfile.java17` Key: SPARK-40941 URL: https://issues.apache.org/jira/browse/SPARK-40941 Project:

[jira] [Created] (SPARK-40940) Fix the unsupported ops checker to allow chaining of stateful operators

2022-10-27 Thread Alex Balikov (Jira)
Alex Balikov created SPARK-40940: Summary: Fix the unsupported ops checker to allow chaining of stateful operators Key: SPARK-40940 URL: https://issues.apache.org/jira/browse/SPARK-40940 Project:

[jira] [Created] (SPARK-40939) Release a shaded version of Apache Spark / shade jars on main jar

2022-10-27 Thread Almog Tavor (Jira)
Almog Tavor created SPARK-40939: --- Summary: Release a shaded version of Apache Spark / shade jars on main jar Key: SPARK-40939 URL: https://issues.apache.org/jira/browse/SPARK-40939 Project: Spark

[jira] [Commented] (SPARK-40937) Support programming APIs for update/delete/merge

2022-10-27 Thread Shixiong Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625249#comment-17625249 ] Shixiong Zhu commented on SPARK-40937: -- cc [~cloud_fan]  > Support programming APIs for

[jira] [Commented] (SPARK-40924) Unhex function works incorrectly when input has uneven number of symbols

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625243#comment-17625243 ] Apache Spark commented on SPARK-40924: -- User 'vitaliili-db' has created a pull request for this

[jira] [Commented] (SPARK-40924) Unhex function works incorrectly when input has uneven number of symbols

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625242#comment-17625242 ] Apache Spark commented on SPARK-40924: -- User 'vitaliili-db' has created a pull request for this

[jira] [Assigned] (SPARK-40938) Support Alias for every Relation

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40938: Assignee: Apache Spark > Support Alias for every Relation >

[jira] [Commented] (SPARK-40938) Support Alias for every Relation

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625240#comment-17625240 ] Apache Spark commented on SPARK-40938: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40938) Support Alias for every Relation

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40938: Assignee: (was: Apache Spark) > Support Alias for every Relation >

[jira] [Created] (SPARK-40938) Support Alias for every Relation

2022-10-27 Thread Rui Wang (Jira)
Rui Wang created SPARK-40938: Summary: Support Alias for every Relation Key: SPARK-40938 URL: https://issues.apache.org/jira/browse/SPARK-40938 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-40937) Support programming APIs for update/delete/merge

2022-10-27 Thread Shixiong Zhu (Jira)
Shixiong Zhu created SPARK-40937: Summary: Support programming APIs for update/delete/merge Key: SPARK-40937 URL: https://issues.apache.org/jira/browse/SPARK-40937 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.2-5

2022-10-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40935. --- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed This is resolved

[jira] [Assigned] (SPARK-40936) Simplify AnalysisTest#assertAnalysisErrorClass method

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40936: Assignee: (was: Apache Spark) > Simplify AnalysisTest#assertAnalysisErrorClass

[jira] [Assigned] (SPARK-40936) Simplify AnalysisTest#assertAnalysisErrorClass method

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40936: Assignee: Apache Spark > Simplify AnalysisTest#assertAnalysisErrorClass method >

[jira] [Commented] (SPARK-40936) Simplify AnalysisTest#assertAnalysisErrorClass method

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625088#comment-17625088 ] Apache Spark commented on SPARK-40936: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-40936) Simplify AnalysisTest#assertAnalysisErrorClass method

2022-10-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-40936: Summary: Simplify AnalysisTest#assertAnalysisErrorClass method Key: SPARK-40936 URL: https://issues.apache.org/jira/browse/SPARK-40936 Project: Spark Issue Type:

[jira] [Commented] (SPARK-36392) pandas fixed width file support

2022-10-27 Thread John Ayoub (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625069#comment-17625069 ] John Ayoub commented on SPARK-36392: Awesome, thank you! > pandas fixed width file support >

[jira] [Commented] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.2-5

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625063#comment-17625063 ] Apache Spark commented on SPARK-40935: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.2-5

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625061#comment-17625061 ] Apache Spark commented on SPARK-40935: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.2-5

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40935: Assignee: Apache Spark > Upgrade ZSTD-JNI to 1.5.2-5 > --- > >

[jira] [Assigned] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.2-5

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40935: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.5.2-5 >

[jira] [Updated] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.2-5

2022-10-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40935: - Summary: Upgrade ZSTD-JNI to 1.5.2-5 (was: Upgrade ZSTD-JNI to 1.5.0-5) > Upgrade ZSTD-JNI to 1.5.2-5

[jira] [Created] (SPARK-40935) Upgrade ZSTD-JNI to 1.5.0-5

2022-10-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-40935: Summary: Upgrade ZSTD-JNI to 1.5.0-5 Key: SPARK-40935 URL: https://issues.apache.org/jira/browse/SPARK-40935 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-40920) SVD: matrix U has wrong row order

2022-10-27 Thread Leonard Papenmeier (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625053#comment-17625053 ] Leonard Papenmeier commented on SPARK-40920: Using  .repartition(10), .toIndexedRowMatrix(),

[jira] [Assigned] (SPARK-40910) Replace UnsupportedOperationException with SparkUnsupportedOperationException

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40910: Assignee: BingKun Pan > Replace UnsupportedOperationException with

[jira] [Resolved] (SPARK-40910) Replace UnsupportedOperationException with SparkUnsupportedOperationException

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40910. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38387

[jira] [Assigned] (SPARK-40924) Unhex function works incorrectly when input has uneven number of symbols

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40924: Assignee: Vitalii Li (was: Max Gekk) > Unhex function works incorrectly when input has uneven

[jira] [Assigned] (SPARK-40924) Unhex function works incorrectly when input has uneven number of symbols

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40924: Assignee: Max Gekk > Unhex function works incorrectly when input has uneven number of symbols >

[jira] [Resolved] (SPARK-40924) Unhex function works incorrectly when input has uneven number of symbols

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40924. -- Resolution: Fixed Resolved by merging https://github.com/apache/spark/pull/38402 to master. > Unhex

[jira] [Commented] (SPARK-40371) Migrate type check failures of NthValue and NTile onto error classes

2022-10-27 Thread BingKun Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625037#comment-17625037 ] BingKun Pan commented on SPARK-40371: - I work on it. > Migrate type check failures of NthValue and

[jira] [Assigned] (SPARK-40922) pyspark.pandas.read_csv supports reading multiple files, but that is undocumented

2022-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40922: Assignee: Stefaan Lippens > pyspark.pandas.read_csv supports reading multiple files, but

[jira] [Resolved] (SPARK-40922) pyspark.pandas.read_csv supports reading multiple files, but that is undocumented

2022-10-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40922. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38399

[jira] [Assigned] (SPARK-40751) Migrate type check failures of high order functions onto error classes

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40751: Assignee: BingKun Pan > Migrate type check failures of high order functions onto error classes >

[jira] [Resolved] (SPARK-40751) Migrate type check failures of high order functions onto error classes

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40751. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38359

[jira] [Created] (SPARK-40934) pyspark.pandas.read_csv parses dates, but docs state otherwise

2022-10-27 Thread Stefaan Lippens (Jira)
Stefaan Lippens created SPARK-40934: --- Summary: pyspark.pandas.read_csv parses dates, but docs state otherwise Key: SPARK-40934 URL: https://issues.apache.org/jira/browse/SPARK-40934 Project: Spark

[jira] [Commented] (SPARK-38005) Support cleaning up merged shuffle files and state from external shuffle service

2022-10-27 Thread Mars (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625006#comment-17625006 ] Mars commented on SPARK-38005: -- [~mridulm80] [~csingh] Hi~ I want to take this issue. I had understood some

[jira] [Commented] (SPARK-40933) Make df.stat.{cov, corr} consistent with sql functions

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625000#comment-17625000 ] Apache Spark commented on SPARK-40933: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-40932) Barrier: messages for allGather will be overridden by the following barrier APIs

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40932: Assignee: Apache Spark > Barrier: messages for allGather will be overridden by the

[jira] [Commented] (SPARK-40932) Barrier: messages for allGather will be overridden by the following barrier APIs

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625002#comment-17625002 ] Apache Spark commented on SPARK-40932: -- User 'wbo4958' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40932) Barrier: messages for allGather will be overridden by the following barrier APIs

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40932: Assignee: (was: Apache Spark) > Barrier: messages for allGather will be overridden

[jira] [Commented] (SPARK-40932) Barrier: messages for allGather will be overridden by the following barrier APIs

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17625001#comment-17625001 ] Apache Spark commented on SPARK-40932: -- User 'wbo4958' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40933) Make df.stat.{cov, corr} consistent with sql functions

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40933: Assignee: Apache Spark > Make df.stat.{cov, corr} consistent with sql functions >

[jira] [Assigned] (SPARK-40933) Make df.stat.{cov, corr} consistent with sql functions

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40933: Assignee: (was: Apache Spark) > Make df.stat.{cov, corr} consistent with sql

[jira] [Created] (SPARK-40933) Make df.stat.{cov, corr} consistent with sql functions

2022-10-27 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-40933: - Summary: Make df.stat.{cov, corr} consistent with sql functions Key: SPARK-40933 URL: https://issues.apache.org/jira/browse/SPARK-40933 Project: Spark

[jira] [Updated] (SPARK-40932) Barrier: messages for allGather will be overridden by the following barrier APIs

2022-10-27 Thread Bobby Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated SPARK-40932: --- Description: When I was working on an internal project which has not been opened source. I found

[jira] [Resolved] (SPARK-40759) Migrate type check failures of time window onto error classes

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40759. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38394

[jira] [Assigned] (SPARK-40759) Migrate type check failures of time window onto error classes

2022-10-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40759: Assignee: Yang Jie > Migrate type check failures of time window onto error classes >

[jira] [Created] (SPARK-40932) Barrier: messages for allGather will be overridden by the following barrier APIs

2022-10-27 Thread Bobby Wang (Jira)
Bobby Wang created SPARK-40932: -- Summary: Barrier: messages for allGather will be overridden by the following barrier APIs Key: SPARK-40932 URL: https://issues.apache.org/jira/browse/SPARK-40932

[jira] [Commented] (SPARK-40928) Upgrade actions/setup-python to v4

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624966#comment-17624966 ] Apache Spark commented on SPARK-40928: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-40928) Upgrade actions/setup-python to v4

2022-10-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624964#comment-17624964 ] Apache Spark commented on SPARK-40928: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-40858) Cleanup github action warning

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624965#comment-17624965 ] Yikun Jiang commented on SPARK-40858: - All warning cleanup:

[jira] (SPARK-40858) Cleanup github action warning

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40858 ] Yikun Jiang deleted comment on SPARK-40858: - was (Author: hyukjin.kwon): Issue resolved by pull request 38408 [https://github.com/apache/spark/pull/38408] > Cleanup github action warning >

[jira] (SPARK-40858) Cleanup github action warning

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40858 ] Yikun Jiang deleted comment on SPARK-40858: - was (Author: apachespark): User 'Yikun' has created a pull request for this issue: https://github.com/apache/spark/pull/38408 > Cleanup github

[jira] [Assigned] (SPARK-40928) Upgrade actions/setup-python to v4

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang reassigned SPARK-40928: --- Assignee: Yikun Jiang > Upgrade actions/setup-python to v4 >

[jira] (SPARK-40858) Cleanup github action warning

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40858 ] Yikun Jiang deleted comment on SPARK-40858: - was (Author: apachespark): User 'Yikun' has created a pull request for this issue: https://github.com/apache/spark/pull/38408 > Cleanup github

[jira] [Resolved] (SPARK-40928) Upgrade actions/setup-python to v4

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang resolved SPARK-40928. - Resolution: Fixed > Upgrade actions/setup-python to v4 > -- > >

[jira] [Commented] (SPARK-40928) Upgrade actions/setup-python to v4

2022-10-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17624962#comment-17624962 ] Yikun Jiang commented on SPARK-40928: - Issue resolved by pull request 38408

  1   2   >