[jira] [Assigned] (SPARK-42992) Introduce PySparkRuntimeError

[ https://issues.apache.org/jira/browse/SPARK-42992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42992: - Assignee: Haejoon Lee > Introduce PySparkRuntimeError > -

[jira] [Resolved] (SPARK-42992) Introduce PySparkRuntimeError

[ https://issues.apache.org/jira/browse/SPARK-42992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42992. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40617

[jira] [Resolved] (SPARK-43275) Migrate Spark Connect GroupedData error into error class

[ https://issues.apache.org/jira/browse/SPARK-43275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43275. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40938

[jira] [Assigned] (SPARK-43275) Migrate Spark Connect GroupedData error into error class

[ https://issues.apache.org/jira/browse/SPARK-43275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43275: - Assignee: Haejoon Lee > Migrate Spark Connect GroupedData error into error class >

[jira] [Resolved] (SPARK-43274) Introduce `PySparkNotImplementError`

[ https://issues.apache.org/jira/browse/SPARK-43274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43274. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40938

[jira] [Assigned] (SPARK-43274) Introduce `PySparkNotImplementError`

[ https://issues.apache.org/jira/browse/SPARK-43274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43274: - Assignee: Haejoon Lee > Introduce `PySparkNotImplementError` >

[jira] [Updated] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame

[ https://issues.apache.org/jira/browse/SPARK-43291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43291: Summary: Match behavior for DataFrame.cov on string DataFrame (was: Re-enable test for

[jira] [Created] (SPARK-43291) Re-enable test for DataFrame.cov on string DataFrame.

Haejoon Lee created SPARK-43291: --- Summary: Re-enable test for DataFrame.cov on string DataFrame. Key: SPARK-43291 URL: https://issues.apache.org/jira/browse/SPARK-43291 Project: Spark Issue

[jira] [Created] (SPARK-43290) Support IV and AAD optional parameters for aes_encrypt

Steve Weis created SPARK-43290: -- Summary: Support IV and AAD optional parameters for aes_encrypt Key: SPARK-43290 URL: https://issues.apache.org/jira/browse/SPARK-43290 Project: Spark Issue

[jira] [Assigned] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null`

[ https://issues.apache.org/jira/browse/SPARK-43156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43156: --- Assignee: Jack Chen > Correctness COUNT bug in correlated scalar subselect with `COUNT(*)

[jira] [Resolved] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null`

[ https://issues.apache.org/jira/browse/SPARK-43156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43156. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40946

[jira] [Resolved] (SPARK-43276) Migrate Spark Connect Window errors into error class

[ https://issues.apache.org/jira/browse/SPARK-43276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43276. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40939

[jira] [Assigned] (SPARK-43276) Migrate Spark Connect Window errors into error class

[ https://issues.apache.org/jira/browse/SPARK-43276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43276: - Assignee: Haejoon Lee > Migrate Spark Connect Window errors into error class >

[jira] [Assigned] (SPARK-43289) PySpark UDF supports python package dependencies

[ https://issues.apache.org/jira/browse/SPARK-43289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-43289: -- Assignee: Weichen Xu > PySpark UDF supports python package dependencies >

[jira] [Created] (SPARK-43289) PySpark UDF supports python package dependencies

Weichen Xu created SPARK-43289: -- Summary: PySpark UDF supports python package dependencies Key: SPARK-43289 URL: https://issues.apache.org/jira/browse/SPARK-43289 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-43277) Clean up deprecation hadoop api usage in Yarn module

[ https://issues.apache.org/jira/browse/SPARK-43277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43277. -- Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Created] (SPARK-43288) DataSourceV2: CREATE TABLE LIKE

John Zhuge created SPARK-43288: -- Summary: DataSourceV2: CREATE TABLE LIKE Key: SPARK-43288 URL: https://issues.apache.org/jira/browse/SPARK-43288 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-43020) Refactoring similar error classes such as `NOT_XXX`.

[ https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43020: Description: We should consolidate the error classes that have a similar error messages into

[jira] [Updated] (SPARK-43020) Refactoring similar error classes such as `NOT_XXX`.

[ https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43020: Description: We should consolidate the error classes that have a similar error messages into

[jira] [Updated] (SPARK-43020) Refactoring similar error classes such as `NOT_XXX`.

[ https://issues.apache.org/jira/browse/SPARK-43020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-43020: Summary: Refactoring similar error classes such as `NOT_XXX`. (was: Add main error class for

[jira] [Updated] (SPARK-43280) Reimplement the protobuf breaking change checker script

[ https://issues.apache.org/jira/browse/SPARK-43280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43280: -- Summary: Reimplement the protobuf breaking change checker script (was: Improve the protobuf

[jira] [Assigned] (SPARK-43136) Scala mapGroup, coGroup

[ https://issues.apache.org/jira/browse/SPARK-43136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-43136: - Assignee: Zhen Li > Scala mapGroup, coGroup > --- > >

[jira] [Resolved] (SPARK-43136) Scala mapGroup, coGroup

[ https://issues.apache.org/jira/browse/SPARK-43136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43136. --- Fix Version/s: 3.5.0 Resolution: Fixed > Scala mapGroup, coGroup >

[jira] [Updated] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed

[ https://issues.apache.org/jira/browse/SPARK-43287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-43287: Description: How to reproduce: # Start a scala client

[jira] [Updated] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed

[ https://issues.apache.org/jira/browse/SPARK-43287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-43287: Description: How to reproduce: # Start a scala client

[jira] [Updated] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed

[ https://issues.apache.org/jira/browse/SPARK-43287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-43287: Description: How to reproduce: # Start a scala client

[jira] [Created] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed

Wei Liu created SPARK-43287: --- Summary: Connect JVM client REPL not correctly shut down if killed Key: SPARK-43287 URL: https://issues.apache.org/jira/browse/SPARK-43287 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17

[ https://issues.apache.org/jira/browse/SPARK-43285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43285. --- Fix Version/s: 3.5.0 Resolution: Fixed > ReplE2ESuite consistently fails

[jira] [Assigned] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17

[ https://issues.apache.org/jira/browse/SPARK-43285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-43285: - Assignee: Venkata Sai Akhil Gudesa > ReplE2ESuite consistently fails with JDK

[jira] [Created] (SPARK-43286) Update CBC mode in aes_encrypt()/aes_decrypt() to not use KDF

Steve Weis created SPARK-43286: -- Summary: Update CBC mode in aes_encrypt()/aes_decrypt() to not use KDF Key: SPARK-43286 URL: https://issues.apache.org/jira/browse/SPARK-43286 Project: Spark

[jira] [Updated] (SPARK-43284) _metadata.file_path regression

[ https://issues.apache.org/jira/browse/SPARK-43284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Lewis updated SPARK-43284: Summary: _metadata.file_path regression (was: _metadata.file_path) > _metadata.file_path

[jira] [Updated] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17

[ https://issues.apache.org/jira/browse/SPARK-43285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-43285: - Description:

[jira] [Created] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17

Venkata Sai Akhil Gudesa created SPARK-43285: Summary: ReplE2ESuite consistently fails with JDK 17 Key: SPARK-43285 URL: https://issues.apache.org/jira/browse/SPARK-43285 Project: Spark

[jira] [Created] (SPARK-43284) _metadata.file_path

David Lewis created SPARK-43284: --- Summary: _metadata.file_path Key: SPARK-43284 URL: https://issues.apache.org/jira/browse/SPARK-43284 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43283) _metadata.file_path returns unescaled URLs

David Lewis created SPARK-43283: --- Summary: _metadata.file_path returns unescaled URLs Key: SPARK-43283 URL: https://issues.apache.org/jira/browse/SPARK-43283 Project: Spark Issue Type:

[jira] [Commented] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null`

[ https://issues.apache.org/jira/browse/SPARK-43156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716312#comment-17716312 ] Ignite TC Bot commented on SPARK-43156: --- User 'jchen5' has created a pull request for this issue:

[jira] [Commented] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty

[ https://issues.apache.org/jira/browse/SPARK-43098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716313#comment-17716313 ] Ignite TC Bot commented on SPARK-43098: --- User 'jchen5' has created a pull request for this issue:

[jira] [Commented] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716289#comment-17716289 ] Jia Fan commented on SPARK-36112: - Hi, [~allisonwang-db] I checked the code. Seem like the only work is

[jira] [Updated] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution

[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-43225: - Issue Type: Improvement (was: Bug) > Remove jackson-core-asl and jackson-mapper-asl from

[jira] [Updated] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution

[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-43225: - Priority: Minor (was: Major) > Remove jackson-core-asl and jackson-mapper-asl from pre-built

[jira] [Resolved] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution

[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-43225. -- Fix Version/s: 3.5.0 Assignee: Yuming Wang Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-42798) Upgrade protobuf-java to 3.22.2

[ https://issues.apache.org/jira/browse/SPARK-42798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42798: - Priority: Minor (was: Major) > Upgrade protobuf-java to 3.22.2 >

[jira] [Resolved] (SPARK-42798) Upgrade protobuf-java to 3.22.2

[ https://issues.apache.org/jira/browse/SPARK-42798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42798. -- Fix Version/s: 3.5.0 Assignee: Yang Jie Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries

[ https://issues.apache.org/jira/browse/SPARK-36112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Fan updated SPARK-36112: Attachment: image-2023-04-25-21-51-55-961.png > Enable DecorrelateInnerQuery for IN/EXISTS subqueries >

[jira] [Comment Edited] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation

[ https://issues.apache.org/jira/browse/SPARK-39753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716268#comment-17716268 ] Jean-Christophe Lefebvre edited comment on SPARK-39753 at 4/25/23 1:40 PM:

[jira] [Commented] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation

[ https://issues.apache.org/jira/browse/SPARK-39753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716268#comment-17716268 ] Jean-Christophe Lefebvre commented on SPARK-39753: -- Any developpement on this ticket?

[jira] [Created] (SPARK-43282) Investigate DataFrame.sort_values with pandas behavior.

Haejoon Lee created SPARK-43282: --- Summary: Investigate DataFrame.sort_values with pandas behavior. Key: SPARK-43282 URL: https://issues.apache.org/jira/browse/SPARK-43282 Project: Spark Issue

[jira] [Comment Edited] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression

[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716135#comment-17716135 ] Andrew Grigorev edited comment on SPARK-43273 at 4/25/23 12:56 PM: ---

[jira] [Created] (SPARK-43281) Fix concurrent writer does not update file metrics

XiDuo You created SPARK-43281: - Summary: Fix concurrent writer does not update file metrics Key: SPARK-43281 URL: https://issues.apache.org/jira/browse/SPARK-43281 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43272) Replace reflection w/ direct calling for `SparkHadoopUtil#createFile`

[ https://issues.apache.org/jira/browse/SPARK-43272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716236#comment-17716236 ] Nikita Awasthi commented on SPARK-43272: User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-43142) DSL expressions fail on attribute with special characters

[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43142. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40902

[jira] [Updated] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression

[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grigorev updated SPARK-43273: Description: hadoop-parquet version should be updated to 1.3.0 (together with other

[jira] [Updated] (SPARK-43280) Improve the protobuf breaking change checker script

[ https://issues.apache.org/jira/browse/SPARK-43280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43280: -- Summary: Improve the protobuf breaking change checker script (was: Improve the protobuf

[jira] [Updated] (SPARK-43280) Improve the protobuf breaking change script

[ https://issues.apache.org/jira/browse/SPARK-43280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-43280: -- Priority: Major (was: Blocker) > Improve the protobuf breaking change script >

[jira] [Created] (SPARK-43280) Improve the protobuf breaking change script

Ruifeng Zheng created SPARK-43280: - Summary: Improve the protobuf breaking change script Key: SPARK-43280 URL: https://issues.apache.org/jira/browse/SPARK-43280 Project: Spark Issue Type:

[jira] [Created] (SPARK-43279) Cleanup unused members from `SparkHadoopUtil`

Yang Jie created SPARK-43279: Summary: Cleanup unused members from `SparkHadoopUtil` Key: SPARK-43279 URL: https://issues.apache.org/jira/browse/SPARK-43279 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43278) Exception in thread "main" java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer;

[ https://issues.apache.org/jira/browse/SPARK-43278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangjiguang0719 updated SPARK-43278: - Description: Java version: 1.8.0_331, Apache Maven 3.8.4 I run next steps: # git

[jira] [Created] (SPARK-43278) Exception in thread "main" java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer;

jiangjiguang0719 created SPARK-43278: Summary: Exception in thread "main" java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer; Key: SPARK-43278 URL:

[jira] [Commented] (SPARK-42940) Session management support streaming connect

[ https://issues.apache.org/jira/browse/SPARK-42940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716181#comment-17716181 ] ASF GitHub Bot commented on SPARK-42940: User 'rangadi' has created a pull request for this

[jira] [Resolved] (SPARK-43204) Align MERGE assignments with table attributes

[ https://issues.apache.org/jira/browse/SPARK-43204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43204. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40919

[jira] [Assigned] (SPARK-43204) Align MERGE assignments with table attributes

[ https://issues.apache.org/jira/browse/SPARK-43204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43204: --- Assignee: Anton Okolnychyi > Align MERGE assignments with table attributes >

[jira] [Created] (SPARK-43277) Clean up deprecation hadoop api usage in Yarn module

Yang Jie created SPARK-43277: Summary: Clean up deprecation hadoop api usage in Yarn module Key: SPARK-43277 URL: https://issues.apache.org/jira/browse/SPARK-43277 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-43226) Define extractors for file-constant metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-43226. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40885

[jira] [Assigned] (SPARK-43226) Define extractors for file-constant metadata columns

[ https://issues.apache.org/jira/browse/SPARK-43226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-43226: --- Assignee: Ryan Johnson > Define extractors for file-constant metadata columns >

[jira] [Assigned] (SPARK-43243) Add Level param to df.printSchema for Python API

[ https://issues.apache.org/jira/browse/SPARK-43243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43243: - Assignee: Khalid Mammadov > Add Level param to df.printSchema for Python API >

[jira] [Resolved] (SPARK-43243) Add Level param to df.printSchema for Python API

[ https://issues.apache.org/jira/browse/SPARK-43243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43243. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40916

[jira] [Created] (SPARK-43276) Migrate Spark Connect Window errors into error class

Haejoon Lee created SPARK-43276: --- Summary: Migrate Spark Connect Window errors into error class Key: SPARK-43276 URL: https://issues.apache.org/jira/browse/SPARK-43276 Project: Spark Issue

[jira] [Created] (SPARK-43275) Migrate Spark Connect GroupedData error into error class

Haejoon Lee created SPARK-43275: --- Summary: Migrate Spark Connect GroupedData error into error class Key: SPARK-43275 URL: https://issues.apache.org/jira/browse/SPARK-43275 Project: Spark Issue

[jira] [Created] (SPARK-43274) Introduce `PySparkNotImplementError`

Haejoon Lee created SPARK-43274: --- Summary: Introduce `PySparkNotImplementError` Key: SPARK-43274 URL: https://issues.apache.org/jira/browse/SPARK-43274 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-43231) Reduce the memory requirement in torch-related tests

[ https://issues.apache.org/jira/browse/SPARK-43231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43231. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40874

[jira] [Assigned] (SPARK-43231) Reduce the memory requirement in torch-related tests

[ https://issues.apache.org/jira/browse/SPARK-43231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43231: - Assignee: Ruifeng Zheng > Reduce the memory requirement in torch-related tests >

[jira] [Commented] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression

[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716135#comment-17716135 ] Andrew Grigorev commented on SPARK-43273: - Just as a icing on the cake - Clickhouse accidently

[jira] [Updated] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression

[ https://issues.apache.org/jira/browse/SPARK-43273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grigorev updated SPARK-43273: Description: hadoop-parquet version should be updated to 1.3.0   {code:java}

[jira] [Created] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression

Andrew Grigorev created SPARK-43273: --- Summary: Spark can't read parquet files with a newer LZ4_RAW compression Key: SPARK-43273 URL: https://issues.apache.org/jira/browse/SPARK-43273 Project: Spark

[jira] [Commented] (SPARK-43250) Assign a name to the error class _LEGACY_ERROR_TEMP_2014

[ https://issues.apache.org/jira/browse/SPARK-43250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716118#comment-17716118 ] Max Gekk commented on SPARK-43250: -- [~amousavigourabi] Sure, go ahead. > Assign a name to the error

[jira] [Created] (SPARK-43272) Replace reflection w/ direct calling for `SparkHadoopUtil#createFile`

Yang Jie created SPARK-43272: Summary: Replace reflection w/ direct calling for `SparkHadoopUtil#createFile` Key: SPARK-43272 URL: https://issues.apache.org/jira/browse/SPARK-43272 Project: Spark

[jira] [Assigned] (SPARK-43260) Migrate the Spark SQL pandas arrow type errors into error class.

[ https://issues.apache.org/jira/browse/SPARK-43260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43260: - Assignee: Haejoon Lee > Migrate the Spark SQL pandas arrow type errors into error

[jira] [Resolved] (SPARK-43260) Migrate the Spark SQL pandas arrow type errors into error class.

[ https://issues.apache.org/jira/browse/SPARK-43260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43260. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40924

[jira] [Resolved] (SPARK-43144) Scala: DataStreamReader table() API

[ https://issues.apache.org/jira/browse/SPARK-43144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43144. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40887