[jira] [Created] (SPARK-44064) Maven test `ProductAggSuite` aborted

Yang Jie created SPARK-44064: Summary: Maven test `ProductAggSuite` aborted Key: SPARK-44064 URL: https://issues.apache.org/jira/browse/SPARK-44064 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-44064) Maven test `ProductAggSuite` aborted

[ https://issues.apache.org/jira/browse/SPARK-44064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-44064: - Issue Type: Bug (was: Improvement) > Maven test `ProductAggSuite` aborted >

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732851#comment-17732851 ] Yuming Wang commented on SPARK-44058: - This is used to connect Hive metastore 0.12. > Remove

[jira] [Commented] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024

[ https://issues.apache.org/jira/browse/SPARK-43259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732843#comment-17732843 ] Abhijeet Singh commented on SPARK-43259: i want to work on this issue. raised a pr for same

[jira] [Updated] (SPARK-43937) Add ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Summary: Add ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python (was: Add

[jira] [Updated] (SPARK-43937) Add not,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Description: Add following functions: * -not- * -if- * ifnull * isnotnull * equal_null *

[jira] [Updated] (SPARK-43937) Add not,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43937: -- Summary: Add not,ifnull,isnotnull,equal_null,nullif,nvl,nvl2 to Scala and Python (was: Add

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732840#comment-17732840 ] Aman Raj commented on SPARK-44058: -- [~yumwang] In that case this function of createPartition is not

[jira] [Resolved] (SPARK-44063) Revert SPARK-44047

[ https://issues.apache.org/jira/browse/SPARK-44063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-44063. - Resolution: Won't Fix It's my local environmental issue. > Revert SPARK-44047 >

[jira] [Created] (SPARK-44063) Revert SPARK-44047

BingKun Pan created SPARK-44063: --- Summary: Revert SPARK-44047 Key: SPARK-44063 URL: https://issues.apache.org/jira/browse/SPARK-44063 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-43926) Add array_agg, array_size, cardinality, count_min_sketch,mask,named_struct,json_* to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732825#comment-17732825 ] Ruifeng Zheng commented on SPARK-43926: --- [~ivoson] many thanks, please go ahead > Add array_agg,

[jira] [Assigned] (SPARK-43627) Enable pyspark.pandas.spark.functions.skew in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43627: - Assignee: Ruifeng Zheng > Enable pyspark.pandas.spark.functions.skew in Spark Connect.

[jira] [Assigned] (SPARK-43626) Enable pyspark.pandas.spark.functions.kurt in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43626: - Assignee: Ruifeng Zheng > Enable pyspark.pandas.spark.functions.kurt in Spark Connect.

[jira] [Resolved] (SPARK-43941) Add any_value, approx_percentile,count_if,first_value,histogram_numeric,last_value to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43941. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41588

[jira] [Assigned] (SPARK-43941) Add any_value, approx_percentile,count_if,first_value,histogram_numeric,last_value to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43941: - Assignee: jiaan.geng > Add any_value, >

[jira] [Resolved] (SPARK-43659) Enable OpsOnDiffFramesEnabledSlowParityTests.test_series_eq

[ https://issues.apache.org/jira/browse/SPARK-43659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43659. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41582

[jira] [Assigned] (SPARK-43659) Enable OpsOnDiffFramesEnabledSlowParityTests.test_series_eq

[ https://issues.apache.org/jira/browse/SPARK-43659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43659: - Assignee: Haejoon Lee > Enable OpsOnDiffFramesEnabledSlowParityTests.test_series_eq >

[jira] [Commented] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732806#comment-17732806 ] Yuming Wang commented on SPARK-44058: - For Hive 0.13 and later, we use

[jira] [Assigned] (SPARK-43975) DataSource V2: Handle UPDATE commands for group-based sources

[ https://issues.apache.org/jira/browse/SPARK-43975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43975: - Assignee: Anton Okolnychyi > DataSource V2: Handle UPDATE commands for group-based

[jira] [Resolved] (SPARK-43975) DataSource V2: Handle UPDATE commands for group-based sources

[ https://issues.apache.org/jira/browse/SPARK-43975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43975. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41600

[jira] [Created] (SPARK-44062) Add PySparkTestBase unit test class

Amanda Liu created SPARK-44062: -- Summary: Add PySparkTestBase unit test class Key: SPARK-44062 URL: https://issues.apache.org/jira/browse/SPARK-44062 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44061) Add assert_df_equality util function

Amanda Liu created SPARK-44061: -- Summary: Add assert_df_equality util function Key: SPARK-44061 URL: https://issues.apache.org/jira/browse/SPARK-44061 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-44060) Code-gen for build side outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated SPARK-44060: -- Description: Here, build side outer join means LEFT OUTER join with build left, or RIGHT OUTER join

[jira] [Updated] (SPARK-44060) Code-gen for build side outer shuffled hash join

[ https://issues.apache.org/jira/browse/SPARK-44060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated SPARK-44060: -- Description: Here, build side outer join means LEFT OUTER join with build left, or RIGHT OUTER join

[jira] [Created] (SPARK-44060) Code-gen for build side outer shuffled hash join

Szehon Ho created SPARK-44060: - Summary: Code-gen for build side outer shuffled hash join Key: SPARK-44060 URL: https://issues.apache.org/jira/browse/SPARK-44060 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43440) Support registration of an Arrow Python UDF

[ https://issues.apache.org/jira/browse/SPARK-43440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43440: - Summary: Support registration of an Arrow Python UDF (was: Support registration of an

[jira] [Updated] (SPARK-43893) Non-atomic data type support in Arrow Python UDF

[ https://issues.apache.org/jira/browse/SPARK-43893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43893: - Summary: Non-atomic data type support in Arrow Python UDF (was: Non-atomic data type support

[jira] [Updated] (SPARK-43412) Introduce `SQL_ARROW_BATCHED_UDF` EvalType for Arrow Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-43412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43412: - Summary: Introduce `SQL_ARROW_BATCHED_UDF` EvalType for Arrow Python UDFs (was: Introduce

[jira] [Updated] (SPARK-43082) Arrow Python UDFs in Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-43082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43082: - Summary: Arrow Python UDFs in Spark Connect (was: Arrow-optimized Python UDFs in Spark

[jira] [Updated] (SPARK-42893) Block Arrow Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-42893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-42893: - Summary: Block Arrow Python UDFs (was: Block Arrow-optimized Python UDFs) > Block Arrow Python

[jira] [Updated] (SPARK-40307) Introduce Arrow Python UDFs

[ https://issues.apache.org/jira/browse/SPARK-40307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-40307: - Summary: Introduce Arrow Python UDFs (was: Introduce Arrow-optimized Python UDFs) > Introduce

[jira] [Updated] (SPARK-43903) Improve ArrayType input support in Arrow Python UDF

[ https://issues.apache.org/jira/browse/SPARK-43903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43903: - Summary: Improve ArrayType input support in Arrow Python UDF (was: Improve ArrayType input

[jira] [Updated] (SPARK-43903) Improve ArrayType input support in Arrow-optimized Python UDF

[ https://issues.apache.org/jira/browse/SPARK-43903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43903: - Summary: Improve ArrayType input support in Arrow-optimized Python UDF (was: Non-atomic data

[jira] [Updated] (SPARK-43893) Non-atomic data type support in Arrow-optimized Python UDF

[ https://issues.apache.org/jira/browse/SPARK-43893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-43893: - Summary: Non-atomic data type support in Arrow-optimized Python UDF (was: StructType

[jira] [Commented] (SPARK-44057) Mark all `local-cluster` tests as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-44057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732751#comment-17732751 ] GridGain Integration commented on SPARK-44057: -- User 'dongjoon-hyun' has created a pull

[jira] [Assigned] (SPARK-44057) Mark all `local-cluster` tests as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-44057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44057: - Assignee: Dongjoon Hyun > Mark all `local-cluster` tests as `ExtendedSQLTest` >

[jira] [Resolved] (SPARK-44057) Mark all `local-cluster` tests as `ExtendedSQLTest`

[ https://issues.apache.org/jira/browse/SPARK-44057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44057. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41601

[jira] [Commented] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732747#comment-17732747 ] Dongjoon Hyun commented on SPARK-44041: --- Nice! Looking forwarding to seeing it. > Upgrade

[jira] [Updated] (SPARK-44059) Add named argument support for SQL functions

[ https://issues.apache.org/jira/browse/SPARK-44059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Yu updated SPARK-44059: --- Description: Today, there is increasing demand for named argument functions, especially as we

[jira] [Created] (SPARK-44059) Add named argument support for SQL functions

Richard Yu created SPARK-44059: -- Summary: Add named argument support for SQL functions Key: SPARK-44059 URL: https://issues.apache.org/jira/browse/SPARK-44059 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

[ https://issues.apache.org/jira/browse/SPARK-44058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Raj updated SPARK-44058: - Description: Spark's HiveShim.scala calls this particular method in Hive :

[jira] [Created] (SPARK-44058) Remove deprecated API usage in HiveShim.scala

Aman Raj created SPARK-44058: Summary: Remove deprecated API usage in HiveShim.scala Key: SPARK-44058 URL: https://issues.apache.org/jira/browse/SPARK-44058 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-44057) Mark all `local-cluster` tests as `ExtendedSQLTest`

Dongjoon Hyun created SPARK-44057: - Summary: Mark all `local-cluster` tests as `ExtendedSQLTest` Key: SPARK-44057 URL: https://issues.apache.org/jira/browse/SPARK-44057 Project: Spark Issue

[jira] [Commented] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732668#comment-17732668 ] Dongjoon Hyun commented on SPARK-44053: --- Apache ORC 1.9.0 PR will arrive soon in this month. >

[jira] [Updated] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44053: -- Affects Version/s: 3.5.0 > Update ORC to 1.8.4 > --- > > Key:

[jira] [Updated] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-44053: -- Fix Version/s: 3.4.1 > Update ORC to 1.8.4 > --- > > Key:

[jira] [Created] (SPARK-44056) Improve error message when UDF execution fails

Rob Reeves created SPARK-44056: -- Summary: Improve error message when UDF execution fails Key: SPARK-44056 URL: https://issues.apache.org/jira/browse/SPARK-44056 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44053. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41593

[jira] [Assigned] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44053: - Assignee: Yiqun Zhang > Update ORC to 1.8.4 > --- > >

[jira] [Created] (SPARK-44055) Remove redundant `override` from `CheckpointRDD`

Yang Jie created SPARK-44055: Summary: Remove redundant `override` from `CheckpointRDD` Key: SPARK-44055 URL: https://issues.apache.org/jira/browse/SPARK-44055 Project: Spark Issue Type:

[jira] [Closed] (SPARK-43819) Barrier Executor Stage Not Retried on Task Failure

[ https://issues.apache.org/jira/browse/SPARK-43819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Tieman closed SPARK-43819. -- > Barrier Executor Stage Not Retried on Task Failure >

[jira] [Commented] (SPARK-43819) Barrier Executor Stage Not Retried on Task Failure

[ https://issues.apache.org/jira/browse/SPARK-43819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732599#comment-17732599 ] Matthew Tieman commented on SPARK-43819: After further debugging I found the issue was a

[jira] [Resolved] (SPARK-43819) Barrier Executor Stage Not Retried on Task Failure

[ https://issues.apache.org/jira/browse/SPARK-43819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Tieman resolved SPARK-43819. Resolution: Not A Problem > Barrier Executor Stage Not Retried on Task Failure >

[jira] [Commented] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732572#comment-17732572 ] Yang Jie commented on SPARK-44041: -- I will give a pr when it can be downloaded from Maven > Upgrade

[jira] [Comment Edited] (SPARK-44041) Upgrade ammonite to 2.5.9

[ https://issues.apache.org/jira/browse/SPARK-44041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732572#comment-17732572 ] Yang Jie edited comment on SPARK-44041 at 6/14/23 3:03 PM: --- I will give a pr

[jira] [Created] (SPARK-44054) Make test cases inherit SparkFunSuite have a default timeout

Yang Jie created SPARK-44054: Summary: Make test cases inherit SparkFunSuite have a default timeout Key: SPARK-44054 URL: https://issues.apache.org/jira/browse/SPARK-44054 Project: Spark Issue

[jira] [Assigned] (SPARK-44047) Upgrade google guava for connect from 31.0.1-jre to 32.0.1-jre

[ https://issues.apache.org/jira/browse/SPARK-44047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reassigned SPARK-44047: Assignee: BingKun Pan > Upgrade google guava for connect from 31.0.1-jre to 32.0.1-jre >

[jira] [Resolved] (SPARK-44047) Upgrade google guava for connect from 31.0.1-jre to 32.0.1-jre

[ https://issues.apache.org/jira/browse/SPARK-44047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-44047. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41581

[jira] [Resolved] (SPARK-44051) Split `pyspark.pandas.tests.connect.data_type_ops.test_parity_num_ops`

[ https://issues.apache.org/jira/browse/SPARK-44051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44051. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41591

[jira] [Assigned] (SPARK-44051) Split `pyspark.pandas.tests.connect.data_type_ops.test_parity_num_ops`

[ https://issues.apache.org/jira/browse/SPARK-44051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44051: - Assignee: Ruifeng Zheng > Split

[jira] [Commented] (SPARK-44004) Assign name & improve error message for frequent LEGACY errors.

[ https://issues.apache.org/jira/browse/SPARK-44004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732465#comment-17732465 ] ASF GitHub Bot commented on SPARK-44004: User 'itholic' has created a pull request for this

[jira] [Commented] (SPARK-44004) Assign name & improve error message for frequent LEGACY errors.

[ https://issues.apache.org/jira/browse/SPARK-44004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732464#comment-17732464 ] ASF GitHub Bot commented on SPARK-44004: User 'itholic' has created a pull request for this

[jira] [Commented] (SPARK-44040) Incorrect result after count distinct

[ https://issues.apache.org/jira/browse/SPARK-44040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732461#comment-17732461 ] ASF GitHub Bot commented on SPARK-44040: User 'wangyum' has created a pull request for this

[jira] [Commented] (SPARK-43915) Assign names to the error class _LEGACY_ERROR_TEMP_[2438-2445]

[ https://issues.apache.org/jira/browse/SPARK-43915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732459#comment-17732459 ] ASF GitHub Bot commented on SPARK-43915: User 'beliefer' has created a pull request for this

[jira] [Commented] (SPARK-44044) Improve Error message for SQL Window functions

[ https://issues.apache.org/jira/browse/SPARK-44044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732456#comment-17732456 ] ASF GitHub Bot commented on SPARK-44044: User 'siying' has created a pull request for this

[jira] [Commented] (SPARK-44044) Improve Error message for SQL Window functions

[ https://issues.apache.org/jira/browse/SPARK-44044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732455#comment-17732455 ] ASF GitHub Bot commented on SPARK-44044: User 'siying' has created a pull request for this

[jira] [Updated] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Zhang updated SPARK-44053: Affects Version/s: 3.4.1 (was: 3.5.0) > Update ORC to 1.8.4 >

[jira] [Commented] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732447#comment-17732447 ] Yiqun Zhang commented on SPARK-44053: - Our plan is to spark 3.4.1 upgrade to ORC 1.8.4 spark 3.5.0

[jira] [Updated] (SPARK-44053) Update ORC to 1.8.4

[ https://issues.apache.org/jira/browse/SPARK-44053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-44053: Affects Version/s: 3.5.0 (was: 3.4.1) > Update ORC to 1.8.4 >

[jira] [Created] (SPARK-44053) Update ORC to 1.8.4

Yiqun Zhang created SPARK-44053: --- Summary: Update ORC to 1.8.4 Key: SPARK-44053 URL: https://issues.apache.org/jira/browse/SPARK-44053 Project: Spark Issue Type: Bug Components:

[jira] [Assigned] (SPARK-43645) Enable pyspark.pandas.spark.functions.stddev in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43645: - Assignee: Ruifeng Zheng > Enable pyspark.pandas.spark.functions.stddev in Spark

[jira] [Assigned] (SPARK-43931) Add make_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43931: - Assignee: BingKun Pan > Add make_* functions to Scala and Python >

[jira] [Resolved] (SPARK-43931) Add make_* functions to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43931. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41477

[jira] [Resolved] (SPARK-43622) Enable pyspark.pandas.spark.functions.var in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43622. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41589

[jira] [Resolved] (SPARK-43645) Enable pyspark.pandas.spark.functions.stddev in Spark Connect.

[ https://issues.apache.org/jira/browse/SPARK-43645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43645. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41589

[jira] [Resolved] (SPARK-44035) Split `pyspark.pandas.tests.connect.test_parity_ops_on_diff_frames_slow`

[ https://issues.apache.org/jira/browse/SPARK-44035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44035. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41565

[jira] [Assigned] (SPARK-44035) Split `pyspark.pandas.tests.connect.test_parity_ops_on_diff_frames_slow`

[ https://issues.apache.org/jira/browse/SPARK-44035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44035: - Assignee: Ruifeng Zheng > Split

[jira] [Assigned] (SPARK-44048) Remove sql-migration-old.md

[ https://issues.apache.org/jira/browse/SPARK-44048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44048: - Assignee: Yuming Wang > Remove sql-migration-old.md > --- > >

[jira] [Resolved] (SPARK-44048) Remove sql-migration-old.md

[ https://issues.apache.org/jira/browse/SPARK-44048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44048. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41583

[jira] [Assigned] (SPARK-43963) DataSource V2: Handle MERGE commands for group-based sources

[ https://issues.apache.org/jira/browse/SPARK-43963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-43963: - Assignee: Anton Okolnychyi > DataSource V2: Handle MERGE commands for group-based

[jira] [Resolved] (SPARK-43963) DataSource V2: Handle MERGE commands for group-based sources

[ https://issues.apache.org/jira/browse/SPARK-43963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-43963. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41577

[jira] [Resolved] (SPARK-44049) Fix KubernetesSuite to use `inNamespace` for validating driver pod cleanup

[ https://issues.apache.org/jira/browse/SPARK-44049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-44049. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41586

[jira] [Assigned] (SPARK-44049) Fix KubernetesSuite to use `inNamespace` for validating driver pod cleanup

[ https://issues.apache.org/jira/browse/SPARK-44049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-44049: - Assignee: Dongjoon Hyun > Fix KubernetesSuite to use `inNamespace` for validating

[jira] [Created] (SPARK-44052) Add util to get proper Column or DataFrame class for Spark Connect.

Haejoon Lee created SPARK-44052: --- Summary: Add util to get proper Column or DataFrame class for Spark Connect. Key: SPARK-44052 URL: https://issues.apache.org/jira/browse/SPARK-44052 Project: Spark

[jira] [Commented] (SPARK-43928) Add bit operations to Scala and Python

[ https://issues.apache.org/jira/browse/SPARK-43928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17732391#comment-17732391 ] jiaan.geng commented on SPARK-43928: OK. Let me do it. > Add bit operations to Scala and Python >

[jira] [Created] (SPARK-44051) Split `pyspark.pandas.tests.connect.data_type_ops.test_parity_num_ops`

Ruifeng Zheng created SPARK-44051: - Summary: Split `pyspark.pandas.tests.connect.data_type_ops.test_parity_num_ops` Key: SPARK-44051 URL: https://issues.apache.org/jira/browse/SPARK-44051 Project: