[jira] [Commented] (SPARK-40103) Support read/write.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580623#comment-17580623 ] deshanxiao commented on SPARK-40103: Yes read.csv, read.csv2 have benn used in R uti

[jira] [Updated] (SPARK-40116) Remove Arrow in AppVeyor for now

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40116: - Summary: Remove Arrow in AppVeyor for now (was: Pin Arrow version to 8.0.0 in AppVeyor) > Remo

[jira] [Resolved] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40116. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37546 [https://gi

[jira] [Resolved] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

[ https://issues.apache.org/jira/browse/SPARK-40117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40117. -- Fix Version/s: 3.3.1 3.1.4 3.2.3 3.4.0

[jira] [Assigned] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

[ https://issues.apache.org/jira/browse/SPARK-40117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40117: Assignee: Wenli Looi > Convert condition to java in DataFrameWriterV2.overwrite > ---

[jira] [Assigned] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40116: Assignee: Hyukjin Kwon > Pin Arrow version to 8.0.0 in AppVeyor > ---

[jira] [Updated] (SPARK-40113) Reactor ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40113: - Summary: Reactor ParquetScanBuilder DataSourceV2 interface implementation (was: Unify ParquetScanBuilder DataSo

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:53 AM: -

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:52 AM: -

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:50 AM: -

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:49 AM: -

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:48 AM: -

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:49 AM: -

[jira] [Comment Edited] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg edited comment on SPARK-22588 at 8/17/22 5:49 AM: -

[jira] [Commented] (SPARK-22588) SPARK: Load Data from Dataframe or RDD to DynamoDB / dealing with null values

[ https://issues.apache.org/jira/browse/SPARK-22588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580598#comment-17580598 ] Vivek Garg commented on SPARK-22588: According to the [Salesforce CPQ Certification

[jira] [Commented] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

[ https://issues.apache.org/jira/browse/SPARK-40117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580588#comment-17580588 ] Apache Spark commented on SPARK-40117: -- User 'looi' has created a pull request for

[jira] [Commented] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

[ https://issues.apache.org/jira/browse/SPARK-40117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580587#comment-17580587 ] Apache Spark commented on SPARK-40117: -- User 'looi' has created a pull request for

[jira] [Assigned] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

[ https://issues.apache.org/jira/browse/SPARK-40117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40117: Assignee: (was: Apache Spark) > Convert condition to java in DataFrameWriterV2.overwr

[jira] [Assigned] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

[ https://issues.apache.org/jira/browse/SPARK-40117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40117: Assignee: Apache Spark > Convert condition to java in DataFrameWriterV2.overwrite > -

[jira] [Created] (SPARK-40117) Convert condition to java in DataFrameWriterV2.overwrite

Wenli Looi created SPARK-40117: -- Summary: Convert condition to java in DataFrameWriterV2.overwrite Key: SPARK-40117 URL: https://issues.apache.org/jira/browse/SPARK-40117 Project: Spark Issue Ty

[jira] [Commented] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580574#comment-17580574 ] Apache Spark commented on SPARK-40116: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40116: Assignee: Apache Spark > Pin Arrow version to 8.0.0 in AppVeyor > ---

[jira] [Assigned] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40116: Assignee: (was: Apache Spark) > Pin Arrow version to 8.0.0 in AppVeyor >

[jira] [Commented] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

[ https://issues.apache.org/jira/browse/SPARK-40116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580573#comment-17580573 ] Apache Spark commented on SPARK-40116: -- User 'HyukjinKwon' has created a pull reque

[jira] [Created] (SPARK-40116) Pin Arrow version to 8.0.0 in AppVeyor

Hyukjin Kwon created SPARK-40116: Summary: Pin Arrow version to 8.0.0 in AppVeyor Key: SPARK-40116 URL: https://issues.apache.org/jira/browse/SPARK-40116 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-40115) Pin Arrow version to 8.0.0 in AppVeyor

Hyukjin Kwon created SPARK-40115: Summary: Pin Arrow version to 8.0.0 in AppVeyor Key: SPARK-40115 URL: https://issues.apache.org/jira/browse/SPARK-40115 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-40114) Arrow 9.0.0 support with SparkR

Hyukjin Kwon created SPARK-40114: Summary: Arrow 9.0.0 support with SparkR Key: SPARK-40114 URL: https://issues.apache.org/jira/browse/SPARK-40114 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-40113) Unify ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40113: - Priority: Minor (was: Major) > Unify ParquetScanBuilder DataSourceV2 interface implementation > ---

[jira] [Assigned] (SPARK-40113) Unify ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40113: Assignee: Apache Spark > Unify ParquetScanBuilder DataSourceV2 interface implementation >

[jira] [Assigned] (SPARK-40113) Unify ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40113: Assignee: (was: Apache Spark) > Unify ParquetScanBuilder DataSourceV2 interface imple

[jira] [Commented] (SPARK-40113) Unify ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580551#comment-17580551 ] Apache Spark commented on SPARK-40113: -- User 'yabola' has created a pull request fo

[jira] [Updated] (SPARK-40113) Unify ParquetScanBuilder DataSourceV2 interface implementation

[ https://issues.apache.org/jira/browse/SPARK-40113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mars updated SPARK-40113: - Summary: Unify ParquetScanBuilder DataSourceV2 interface implementation (was: Unified ParquetScanBuilder DataSo

[jira] [Created] (SPARK-40113) Unified ParquetScanBuilder DataSourceV2 interface implementation

Mars created SPARK-40113: Summary: Unified ParquetScanBuilder DataSourceV2 interface implementation Key: SPARK-40113 URL: https://issues.apache.org/jira/browse/SPARK-40113 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38648) SPIP: Simplified API for DL Inferencing

[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580548#comment-17580548 ] Yikun Jiang commented on SPARK-38648: - By the way, just curious, is this SPIP expect

[jira] [Commented] (SPARK-38648) SPIP: Simplified API for DL Inferencing

[ https://issues.apache.org/jira/browse/SPARK-38648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580547#comment-17580547 ] Yikun Jiang commented on SPARK-38648: - If we want to run onnx directly, we might wan

[jira] [Commented] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580545#comment-17580545 ] Apache Spark commented on SPARK-40110: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580546#comment-17580546 ] Apache Spark commented on SPARK-40110: -- User 'kazuyukitanimura' has created a pull

[jira] [Assigned] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40110: Assignee: Apache Spark > Add JDBCWithAQESuite > > >

[jira] [Assigned] (SPARK-40110) Add JDBCWithAQESuite

[ https://issues.apache.org/jira/browse/SPARK-40110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40110: Assignee: (was: Apache Spark) > Add JDBCWithAQESuite > > >

[jira] [Assigned] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39975: Assignee: Apache Spark > Upgrade rocksdbjni to 7.4.5 > --- > >

[jira] [Commented] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580539#comment-17580539 ] Apache Spark commented on SPARK-39975: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39975) Upgrade rocksdbjni to 7.4.5

[ https://issues.apache.org/jira/browse/SPARK-39975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39975: Assignee: (was: Apache Spark) > Upgrade rocksdbjni to 7.4.5 > ---

[jira] [Resolved] (SPARK-40046) Use Jackson instead of json4s to serialize `RocksDBMetrics`

[ https://issues.apache.org/jira/browse/SPARK-40046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40046. -- Resolution: Won't Fix > Use Jackson instead of json4s to serialize `RocksDBMetrics` >

[jira] [Resolved] (SPARK-40075) Refactor kafka010.JsonUtils to use Jackson instead of Json4s

[ https://issues.apache.org/jira/browse/SPARK-40075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40075. -- Resolution: Won't Fix > Refactor kafka010.JsonUtils to use Jackson instead of Json4s > ---

[jira] [Commented] (SPARK-40101) `include an external JAR in SparkR` in core module but need antlr4

[ https://issues.apache.org/jira/browse/SPARK-40101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580535#comment-17580535 ] Hyukjin Kwon commented on SPARK-40101: -- I think mvn install won't work. It has to b

[jira] [Commented] (SPARK-40103) Support read/write.csv() in SparkR

[ https://issues.apache.org/jira/browse/SPARK-40103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580522#comment-17580522 ] Hyukjin Kwon commented on SPARK-40103: -- The main problem is that the signature conf

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580521#comment-17580521 ] Apache Spark commented on SPARK-39184: -- User 'bersprockets' has created a pull requ

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580518#comment-17580518 ] Hyukjin Kwon commented on SPARK-40063: -- [~marcelorossini] what's your "Default Inde

[jira] [Commented] (SPARK-39184) ArrayIndexOutOfBoundsException for some date/time sequences in some time-zones

[ https://issues.apache.org/jira/browse/SPARK-39184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580519#comment-17580519 ] Apache Spark commented on SPARK-39184: -- User 'bersprockets' has created a pull requ

[jira] [Commented] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580517#comment-17580517 ] Apache Spark commented on SPARK-40112: -- User 'vitaliili-db' has created a pull requ

[jira] [Assigned] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40112: Assignee: Apache Spark > Improve the TO_BINARY() function > -

[jira] [Assigned] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40112: Assignee: (was: Apache Spark) > Improve the TO_BINARY() function > --

[jira] [Updated] (SPARK-40112) Improve the TO_BINARY() function

[ https://issues.apache.org/jira/browse/SPARK-40112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-40112: --- Description: Original description SPARK-37507: {quote}to_binary(expr, fmt) is a common function avai

[jira] [Created] (SPARK-40112) Improve the TO_BINARY() function

Vitalii Li created SPARK-40112: -- Summary: Improve the TO_BINARY() function Key: SPARK-40112 URL: https://issues.apache.org/jira/browse/SPARK-40112 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-40111) Make pyspark.rdd examples self-contained

Ruifeng Zheng created SPARK-40111: - Summary: Make pyspark.rdd examples self-contained Key: SPARK-40111 URL: https://issues.apache.org/jira/browse/SPARK-40111 Project: Spark Issue Type: Sub-ta

[jira] [Assigned] (SPARK-40111) Make pyspark.rdd examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40111: - Assignee: Ruifeng Zheng > Make pyspark.rdd examples self-contained > --

[jira] [Created] (SPARK-40110) Add JDBCWithAQESuite

Kazuyuki Tanimura created SPARK-40110: - Summary: Add JDBCWithAQESuite Key: SPARK-40110 URL: https://issues.apache.org/jira/browse/SPARK-40110 Project: Spark Issue Type: Test Com

[jira] [Commented] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580502#comment-17580502 ] Apache Spark commented on SPARK-40109: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580501#comment-17580501 ] Apache Spark commented on SPARK-40109: -- User 'gengliangwang' has created a pull req

[jira] [Assigned] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40109: Assignee: Apache Spark (was: Gengliang Wang) > New SQL function: get() > ---

[jira] [Assigned] (SPARK-40109) New SQL function: get()

[ https://issues.apache.org/jira/browse/SPARK-40109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40109: Assignee: Gengliang Wang (was: Apache Spark) > New SQL function: get() > ---

[jira] [Created] (SPARK-40109) New SQL function: get()

Gengliang Wang created SPARK-40109: -- Summary: New SQL function: get() Key: SPARK-40109 URL: https://issues.apache.org/jira/browse/SPARK-40109 Project: Spark Issue Type: Sub-task Co

[jira] [Created] (SPARK-40108) JDBC connection to Hive Metastore fails without first calling any .jdbc call

In-Ho Yi created SPARK-40108: Summary: JDBC connection to Hive Metastore fails without first calling any .jdbc call Key: SPARK-40108 URL: https://issues.apache.org/jira/browse/SPARK-40108 Project: Spark

[jira] [Comment Edited] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580459#comment-17580459 ] Marcelo Rossini Castro edited comment on SPARK-40063 at 8/16/22 8:33 PM: -

[jira] [Commented] (SPARK-40063) pyspark.pandas .apply() changing rows ordering

[ https://issues.apache.org/jira/browse/SPARK-40063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580459#comment-17580459 ] Marcelo Rossini Castro commented on SPARK-40063: Yes, when I do this on

[jira] [Commented] (SPARK-36511) Remove ColumnIO once PARQUET-2050 is released in Parquet 1.13

[ https://issues.apache.org/jira/browse/SPARK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580448#comment-17580448 ] Apache Spark commented on SPARK-36511: -- User 'panbingkun' has created a pull reques

[jira] [Resolved] (SPARK-36511) Remove ColumnIO once PARQUET-2050 is released in Parquet 1.13

[ https://issues.apache.org/jira/browse/SPARK-36511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-36511. -- Fix Version/s: 3.4.0 Assignee: BingKun Pan Resolution: Fixed Resolved by https

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40089: Assignee: (was: Apache Spark) > Sorting of at least Decimal(20, 2) fails for some val

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40089: Assignee: Apache Spark > Sorting of at least Decimal(20, 2) fails for some values near th

[jira] [Assigned] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40089: Assignee: Apache Spark > Sorting of at least Decimal(20, 2) fails for some values near th

[jira] [Commented] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580437#comment-17580437 ] Apache Spark commented on SPARK-40089: -- User 'revans2' has created a pull request f

[jira] [Commented] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580434#comment-17580434 ] Robert Joseph Evans commented on SPARK-40089: - I put up a PR https://github.

[jira] [Comment Edited] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580431#comment-17580431 ] Maksim Grinman edited comment on SPARK-38330 at 8/16/22 7:38 PM: -

[jira] [Commented] (SPARK-38330) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

[ https://issues.apache.org/jira/browse/SPARK-38330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580431#comment-17580431 ] Maksim Grinman commented on SPARK-38330: Apologize ahead of time as I did not un

[jira] [Assigned] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40107: Assignee: (was: Apache Spark) > Pull out empty2null conversion from FileFormatWriter

[jira] [Assigned] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40107: Assignee: Apache Spark > Pull out empty2null conversion from FileFormatWriter > -

[jira] [Commented] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580426#comment-17580426 ] Apache Spark commented on SPARK-40107: -- User 'allisonwang-db' has created a pull re

[jira] [Updated] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allison Wang updated SPARK-40107: - Description: This is a follow-up for SPARK-37287. We can pull out the physical project to conver

[jira] [Created] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

Allison Wang created SPARK-40107: Summary: Pull out empty2null conversion from FileFormatWriter Key: SPARK-40107 URL: https://issues.apache.org/jira/browse/SPARK-40107 Project: Spark Issue Ty

[jira] [Updated] (SPARK-40089) Sorting of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Joseph Evans updated SPARK-40089: Summary: Sorting of at least Decimal(20, 2) fails for some values near the max. (

[jira] [Commented] (SPARK-40089) Doring of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580377#comment-17580377 ] Robert Joseph Evans commented on SPARK-40089: - Never mind I figured out that

[jira] [Commented] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure

[ https://issues.apache.org/jira/browse/SPARK-37442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580369#comment-17580369 ] Dongjoon Hyun commented on SPARK-37442: --- Hi, [~irelandbird]. Apache Spark 2.4 and

[jira] [Commented] (SPARK-40089) Doring of at least Decimal(20, 2) fails for some values near the max.

[ https://issues.apache.org/jira/browse/SPARK-40089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580360#comment-17580360 ] Robert Joseph Evans commented on SPARK-40089: - I have been trying to come up

[jira] [Assigned] (SPARK-40106) Task failure handlers should always run if the task failed

[ https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40106: Assignee: (was: Apache Spark) > Task failure handlers should always run if the task f

[jira] [Assigned] (SPARK-40106) Task failure handlers should always run if the task failed

[ https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40106: Assignee: Apache Spark > Task failure handlers should always run if the task failed > ---

[jira] [Commented] (SPARK-40106) Task failure handlers should always run if the task failed

[ https://issues.apache.org/jira/browse/SPARK-40106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580339#comment-17580339 ] Apache Spark commented on SPARK-40106: -- User 'ryan-johnson-databricks' has created

[jira] [Created] (SPARK-40106) Task failure handlers should always run if the task failed

Ryan Johnson created SPARK-40106: Summary: Task failure handlers should always run if the task failed Key: SPARK-40106 URL: https://issues.apache.org/jira/browse/SPARK-40106 Project: Spark Is

[jira] [Assigned] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-40102: Assignee: Yi kaifei > Use SparkException instead of IllegalStateException in SparkPlan >

[jira] [Resolved] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40102. -- Resolution: Fixed Issue resolved by pull request 37535 [https://github.com/apache/spark/pull/37535] >

[jira] [Updated] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40102: - Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Use SparkException instead of Ill

[jira] [Commented] (SPARK-40102) Use SparkException instead of IllegalStateException in SparkPlan

[ https://issues.apache.org/jira/browse/SPARK-40102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580326#comment-17580326 ] Max Gekk commented on SPARK-40102: -- [~kaifeiYi] Please, open a sub-task of https://iss

[jira] [Resolved] (SPARK-40036) LevelDB/RocksDBIterator.next should return false after iterator or db close

[ https://issues.apache.org/jira/browse/SPARK-40036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40036. -- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed Resolved by https://

[jira] [Resolved] (SPARK-40042) Make pyspark.sql.streaming.query examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40042. -- Fix Version/s: 3.4.0 Assignee: Qian Sun Resolution: Fixed Resolved by https://

[jira] [Updated] (SPARK-40042) Make pyspark.sql.streaming.query examples self-contained

[ https://issues.apache.org/jira/browse/SPARK-40042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40042: - Priority: Minor (was: Major) > Make pyspark.sql.streaming.query examples self-contained > -

[jira] [Assigned] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37980: --- Assignee: Ala Luszczak > Extend METADATA column to support row indices for file based data

[jira] [Resolved] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37980. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37228 [https://gith

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40105: Assignee: Apache Spark > Improve repartition in ReplaceCTERefWithRepartition > --

[jira] [Updated] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-40105: -- Description: If cte can not inlined, the ReplaceCTERefWithRepartition will add repartition to force a

[jira] [Assigned] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40105: Assignee: (was: Apache Spark) > Improve repartition in ReplaceCTERefWithRepartition >

[jira] [Commented] (SPARK-40105) Improve repartition in ReplaceCTERefWithRepartition

[ https://issues.apache.org/jira/browse/SPARK-40105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580279#comment-17580279 ] Apache Spark commented on SPARK-40105: -- User 'ulysses-you' has created a pull reque

  1   2   >