[jira] [Created] (SPARK-40101) `include an external JAR in SparkR` in core module but need

Yang Jie created SPARK-40101: Summary: `include an external JAR in SparkR` in core module but need Key: SPARK-40101 URL: https://issues.apache.org/jira/browse/SPARK-40101 Project: Spark Issue T

[jira] [Updated] (SPARK-40101) `include an external JAR in SparkR` in core module but need antlr

[ https://issues.apache.org/jira/browse/SPARK-40101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40101: - Summary: `include an external JAR in SparkR` in core module but need antlr (was: `include an external J

[jira] [Updated] (SPARK-40101) `include an external JAR in SparkR` in core module but need antlr4

[ https://issues.apache.org/jira/browse/SPARK-40101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-40101: - Summary: `include an external JAR in SparkR` in core module but need antlr4 (was: `include an external

[jira] [Updated] (SPARK-40080) Adds additional EliminateSorts before LimitPushDown

[ https://issues.apache.org/jira/browse/SPARK-40080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-40080: Summary: Adds additional EliminateSorts before LimitPushDown (was: Move EliminateSorts before Lim

[jira] [Commented] (SPARK-39887) Expression transform error

[ https://issues.apache.org/jira/browse/SPARK-39887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580137#comment-17580137 ] Apache Spark commented on SPARK-39887: -- User 'peter-toth' has created a pull reques

[jira] [Commented] (SPARK-40101) `include an external JAR in SparkR` in core module but need antlr4

[ https://issues.apache.org/jira/browse/SPARK-40101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580140#comment-17580140 ] Yang Jie commented on SPARK-40101: -- cc [~hyukjin.kwon]  Do you have any suggestions abo

[jira] [Resolved] (SPARK-40067) Add table name to Spark plan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-40067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40067. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37505 [https://gith

[jira] [Assigned] (SPARK-40067) Add table name to Spark plan node in SparkUI

[ https://issues.apache.org/jira/browse/SPARK-40067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-40067: --- Assignee: Sumeet > Add table name to Spark plan node in SparkUI > -

[jira] [Resolved] (SPARK-40013) DS V2 expressions should have the default toString

[ https://issues.apache.org/jira/browse/SPARK-40013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-40013. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37494 [https://gith

[jira] [Commented] (SPARK-38648) SPIP: Simplified API for DL Inferencing

[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580153#comment-17580153 ] Varun Kruthiventi commented on SPARK-38648: --- Support for integration with DL f

[jira] [Created] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

Yi kaifei created SPARK-40102: - Summary: Use SparkException instead of IllegalStateException in SparkPlan Key: SPARK-40102 URL: https://issues.apache.org/jira/browse/SPARK-40102 Project: Spark I

[jira] [Updated] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-40102: -- Description: This pr aims to  > Use SparkException instead of IllegalStateException in SparkPlan > ---

[jira] [Updated] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi kaifei updated SPARK-40102: -- Description: This pr aims to use SparkException instead of IllegalStateException in SparkPlan, for det

[jira] [Assigned] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40102: Assignee: Apache Spark > Use SparkException instead of IllegalStateException in SparkPlan

[jira] [Commented] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580162#comment-17580162 ] Apache Spark commented on SPARK-40102: -- User 'yikf' has created a pull request for

[jira] [Assigned] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40102: Assignee: (was: Apache Spark) > Use SparkException instead of IllegalStateException i

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580176#comment-17580176 ] Max Gekk commented on SPARK-39184: -- Resolved by https://github.com/apache/spark/pull/37

[jira] [Resolved] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39184. -- Target Version/s: 3.4.0, 3.3.1, 3.2.3 Assignee: Bruce Robbins Resolution: Fixed

[jira] [Updated] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39184: - Fix Version/s: 3.4.0 3.3.1 3.2.3 > ArrayIndexOutOfBoundsException

[jira] [Updated] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39184: - Target Version/s: (was: 3.4.0, 3.3.1, 3.2.3) > ArrayIndexOutOfBoundsException for some date/time seque

[jira] [Commented] (SPARK-39934) takeRDD in R is slow

[ https://issues.apache.org/jira/browse/SPARK-39934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580183#comment-17580183 ] deshanxiao commented on SPARK-39934: [~hyukjin.kwon] I have confirmed the code below

[jira] [Created] (SPARK-40103) Support read.csv in SparkR

deshanxiao created SPARK-40103: -- Summary: Support read.csv in SparkR Key: SPARK-40103 URL: https://issues.apache.org/jira/browse/SPARK-40103 Project: Spark Issue Type: Improvement Comp

[jira] [Created] (SPARK-40104) MillisToTimestamp overflows on Long.MAX_VALUE

Morten Telling created SPARK-40104: -- Summary: MillisToTimestamp overflows on Long.MAX_VALUE Key: SPARK-40104 URL: https://issues.apache.org/jira/browse/SPARK-40104 Project: Spark Issue Type:

[jira] [Updated] (SPARK-40103) Support read/write.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-40103: --- Summary: Support read/write.csv() in SparkR (was: Support read.csv() in SparkR) > Support read/wri

[jira] [Updated] (SPARK-40103) Support read.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-40103: --- Summary: Support read.csv() in SparkR (was: Support read.csv in SparkR) > Support read.csv() in Spa

[jira] [Updated] (SPARK-40103) Support read.csv in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-40103: --- Description: Today, all major languages support the DataFrameReader.csv API, only R is missing. we

[jira] [Updated] (SPARK-40103) Support read/write.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-40103: --- Issue Type: New Feature (was: Improvement) > Support read/write.csv() in SparkR > -

[jira] [Updated] (SPARK-40103) Support read/write.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] deshanxiao updated SPARK-40103: --- Description: Today, almost languages support the DataFrameReader.csv API, only R is missing. we nee

[jira] [Created] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

XiDuo You created SPARK-40105: - Summary: Improve repartition in ReplaceCTERefWithRepartition Key: SPARK-40105 URL: https://issues.apache.org/jira/browse/SPARK-40105 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-40100) Add DataType class for Int128 type

[ https://issues.apache.org/jira/browse/SPARK-40100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-40100: --- Summary: Add DataType class for Int128 type (was: Add Int128 type) > Add DataType class for Int128

[jira] [Assigned] (SPARK-40100) Add DataType class for Int128 type

[ https://issues.apache.org/jira/browse/SPARK-40100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40100: Assignee: Apache Spark > Add DataType class for Int128 type > ---

[jira] [Assigned] (SPARK-40100) Add DataType class for Int128 type

[ https://issues.apache.org/jira/browse/SPARK-40100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40100: Assignee: (was: Apache Spark) > Add DataType class for Int128 type >

[jira] [Commented] (SPARK-40100) Add DataType class for Int128 type

[ https://issues.apache.org/jira/browse/SPARK-40100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580234#comment-17580234 ] Apache Spark commented on SPARK-40100: -- User 'beliefer' has created a pull request

[jira] (SPARK-40100) Add DataType class for Int128 type

[ https://issues.apache.org/jira/browse/SPARK-40100 ] jiaan.geng deleted comment on SPARK-40100: was (Author: beliefer): I'm working on. > Add DataType class for Int128 type > -- > > Key: SPARK-40

[jira] [Updated] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-40105: -- Description: If cte can not inlined, the ReplaceCTERefWithRepartition will add repartition to force a

[jira] [Commented] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580279#comment-17580279 ] Apache Spark commented on SPARK-40105: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40105: Assignee: (was: Apache Spark) > Improve repartition in ReplaceCTERefWithRepartition >

[jira] [Updated] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-40105: -- Description: If cte can not inlined, the ReplaceCTERefWithRepartition will add repartition to force a

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40105: Assignee: Apache Spark > Improve repartition in ReplaceCTERefWithRepartition > --

[jira] [Resolved] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37980. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37228 [https://gith

[jira] [Assigned] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37980: --- Assignee: Ala Luszczak > Extend METADATA column to support row indices for file based data

[jira] [Resolved] (SPARK-40042) Make pyspark.sql.streaming.query examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40042. -- Fix Version/s: 3.4.0 Assignee: Qian Sun Resolution: Fixed Resolved by https://

[jira] [Updated] (SPARK-40042) Make pyspark.sql.streaming.query examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40042: - Priority: Minor (was: Major) > Make pyspark.sql.streaming.query examples self-contained > -

[jira] [Resolved] (SPARK-40036) LevelDB/RocksDBIterator.next should return false after iterator or db close

[ https://issues.apache.org/jira/browse/SPARK-40036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40036. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by https://

[jira] [Commented] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580326#comment-17580326 ] Max Gekk commented on SPARK-40102: -- [~kaifeiYi] Please, open a sub-task of https://iss

[jira] [Updated] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40102: - Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Use SparkException instead of Ill

[jira] [Resolved] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40102. -- Resolution: Fixed Issue resolved by pull request 37535 [https://github.com/apache/spark/pull/37535] >

[jira] [Assigned] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40102: Assignee: Yi kaifei > Use SparkException instead of IllegalStateException in SparkPlan >

[jira] [Created] (SPARK-40106) Task failure handlers should always run if the task failed

Ryan Johnson created SPARK-40106: Summary: Task failure handlers should always run if the task failed Key: SPARK-40106 URL: https://issues.apache.org/jira/browse/SPARK-40106 Project: Spark Is

[jira] [Commented] (SPARK-40106) Task failure handlers should always run if the task failed

[ https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580339#comment-17580339 ] Apache Spark commented on SPARK-40106: -- User 'ryan-johnson-databricks' has created

[jira] [Assigned] (SPARK-40106) Task failure handlers should always run if the task failed

[ https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40106: Assignee: Apache Spark > Task failure handlers should always run if the task failed > ---

[jira] [Assigned] (SPARK-40106) Task failure handlers should always run if the task failed

[ https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40106: Assignee: (was: Apache Spark) > Task failure handlers should always run if the task f

[jira] [Commented] (SPARK-40089) Doring of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580360#comment-17580360 ] Robert Joseph Evans commented on SPARK-40089: - I have been trying to come up

[jira] [Commented] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure

[ https://issues.apache.org/jira/browse/SPARK-37442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580369#comment-17580369 ] Dongjoon Hyun commented on SPARK-37442: --- Hi, [~irelandbird]. Apache Spark 2.4 and

[jira] [Commented] (SPARK-40089) Doring of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580377#comment-17580377 ] Robert Joseph Evans commented on SPARK-40089: - Never mind I figured out that

[jira] [Updated] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated SPARK-40089: Summary: Sorting of at least Decimal(20, 2) fails for some values near the max. (

[jira] [Created] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

Allison Wang created SPARK-40107: Summary: Pull out empty2null conversion from FileFormatWriter Key: SPARK-40107 URL: https://issues.apache.org/jira/browse/SPARK-40107 Project: Spark Issue Ty

[jira] [Updated] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-40107: - Description: This is a follow-up for SPARK-37287. We can pull out the physical project to conver

[jira] [Commented] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580426#comment-17580426 ] Apache Spark commented on SPARK-40107: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40107: Assignee: Apache Spark > Pull out empty2null conversion from FileFormatWriter > -

[jira] [Assigned] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40107: Assignee: (was: Apache Spark) > Pull out empty2null conversion from FileFormatWriter

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580431#comment-17580431 ] Maksim Grinman commented on SPARK-38330: Apologize ahead of time as I did not un

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580431#comment-17580431 ] Maksim Grinman edited comment on SPARK-38330 at 8/16/22 7:38 PM: -

[jira] [Commented] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580434#comment-17580434 ] Robert Joseph Evans commented on SPARK-40089: - I put up a PR https://github.

[jira] [Commented] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580437#comment-17580437 ] Apache Spark commented on SPARK-40089: -- User 'revans2' has created a pull request f

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40089: Assignee: Apache Spark > Sorting of at least Decimal(20, 2) fails for some values near th

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40089: Assignee: Apache Spark > Sorting of at least Decimal(20, 2) fails for some values near th

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40089: Assignee: (was: Apache Spark) > Sorting of at least Decimal(20, 2) fails for some val

[jira] [Resolved] (SPARK-36511) Remove ColumnIO once PARQUET-2050 is released in Parquet 1.13

[ https://issues.apache.org/jira/browse/SPARK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36511. -- Fix Version/s: 3.4.0 Assignee: BingKun Pan Resolution: Fixed Resolved by https

[jira] [Commented] (SPARK-36511) Remove ColumnIO once PARQUET-2050 is released in Parquet 1.13

[ https://issues.apache.org/jira/browse/SPARK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580448#comment-17580448 ] Apache Spark commented on SPARK-36511: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580459#comment-17580459 ] Marcelo Rossini Castro commented on SPARK-40063: Yes, when I do this on

[jira] [Comment Edited] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580459#comment-17580459 ] Marcelo Rossini Castro edited comment on SPARK-40063 at 8/16/22 8:33 PM: -

[jira] [Created] (SPARK-40108) JDBC connection to Hive Metastore fails without first calling any .jdbc call

In-Ho Yi created SPARK-40108: Summary: JDBC connection to Hive Metastore fails without first calling any .jdbc call Key: SPARK-40108 URL: https://issues.apache.org/jira/browse/SPARK-40108 Project: Spark

[jira] [Created] (SPARK-40109) New SQL function: get()

Gengliang Wang created SPARK-40109: -- Summary: New SQL function: get() Key: SPARK-40109 URL: https://issues.apache.org/jira/browse/SPARK-40109 Project: Spark Issue Type: Sub-task Co

[jira] [Assigned] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40109: Assignee: Gengliang Wang (was: Apache Spark) > New SQL function: get() > ---

[jira] [Assigned] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40109: Assignee: Apache Spark (was: Gengliang Wang) > New SQL function: get() > ---

[jira] [Commented] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580501#comment-17580501 ] Apache Spark commented on SPARK-40109: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580502#comment-17580502 ] Apache Spark commented on SPARK-40109: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-40110) Add JDBCWithAQESuite

Kazuyuki Tanimura created SPARK-40110: - Summary: Add JDBCWithAQESuite Key: SPARK-40110 URL: https://issues.apache.org/jira/browse/SPARK-40110 Project: Spark Issue Type: Test Com

[jira] [Assigned] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40111: - Assignee: Ruifeng Zheng > Make pyspark.rdd examples self-contained > --

[jira] [Created] (SPARK-40111) Make pyspark.rdd examples self-contained

Ruifeng Zheng created SPARK-40111: - Summary: Make pyspark.rdd examples self-contained Key: SPARK-40111 URL: https://issues.apache.org/jira/browse/SPARK-40111 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-40112) Improve the TO_BINARY() function

Vitalii Li created SPARK-40112: -- Summary: Improve the TO_BINARY() function Key: SPARK-40112 URL: https://issues.apache.org/jira/browse/SPARK-40112 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-40112: --- Description: Original description SPARK-37507: {quote}to_binary(expr, fmt) is a common function avai

[jira] [Assigned] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40112: Assignee: Apache Spark > Improve the TO_BINARY() function > -

[jira] [Assigned] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40112: Assignee: (was: Apache Spark) > Improve the TO_BINARY() function > --

[jira] [Commented] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580517#comment-17580517 ] Apache Spark commented on SPARK-40112: -- User 'vitaliili-db' has created a pull requ

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580519#comment-17580519 ] Apache Spark commented on SPARK-39184: -- User 'bersprockets' has created a pull requ

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580518#comment-17580518 ] Hyukjin Kwon commented on SPARK-40063: -- [~marcelorossini] what's your "Default Inde

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580521#comment-17580521 ] Apache Spark commented on SPARK-39184: -- User 'bersprockets' has created a pull requ

[jira] [Commented] (SPARK-40103) Support read/write.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580522#comment-17580522 ] Hyukjin Kwon commented on SPARK-40103: -- The main problem is that the signature conf

[jira] [Commented] (SPARK-40101) `include an external JAR in SparkR` in core module but need antlr4

[ https://issues.apache.org/jira/browse/SPARK-40101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580535#comment-17580535 ] Hyukjin Kwon commented on SPARK-40101: -- I think mvn install won't work. It has to b

[jira] [Resolved] (SPARK-40075) Refactor kafka010.JsonUtils to use Jackson instead of Json4s

[ https://issues.apache.org/jira/browse/SPARK-40075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40075. -- Resolution: Won't Fix > Refactor kafka010.JsonUtils to use Jackson instead of Json4s > ---

[jira] [Resolved] (SPARK-40046) Use Jackson instead of json4s to serialize `RocksDBMetrics`

[ https://issues.apache.org/jira/browse/SPARK-40046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40046. -- Resolution: Won't Fix > Use Jackson instead of json4s to serialize `RocksDBMetrics` >

[jira] [Assigned] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39975: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.4.5 > ---

[jira] [Commented] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580539#comment-17580539 ] Apache Spark commented on SPARK-39975: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39975: Assignee: Apache Spark > Upgrade rocksdbjni to 7.4.5 > --- > >

[jira] [Assigned] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40110: Assignee: (was: Apache Spark) > Add JDBCWithAQESuite > > >

[jira] [Assigned] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40110: Assignee: Apache Spark > Add JDBCWithAQESuite > > >

[jira] [Commented] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580545#comment-17580545 ] Apache Spark commented on SPARK-40110: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580546#comment-17580546 ] Apache Spark commented on SPARK-40110: -- User 'kazuyukitanimura' has created a pull

  1   2   >