[jira] [Assigned] (SPARK-43328) Add latest timestamp on no-execution trigger for Idle event in streaming query listener

2023-05-01 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-43328: Assignee: Jungtaek Lim > Add latest timestamp on no-execution trigger for Idle event in s

[jira] [Resolved] (SPARK-43328) Add latest timestamp on no-execution trigger for Idle event in streaming query listener

2023-05-01 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-43328. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41001 [https://gi

[jira] [Updated] (SPARK-43337) Asc/desc arrow icons for sorting column does not get displayed in the table column for

2023-05-01 Thread Maytas Monsereenusorn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maytas Monsereenusorn updated SPARK-43337: -- Attachment: Screen Shot 2023-05-01 at 10.39.00 PM.png > Asc/desc arrow icons f

[jira] [Updated] (SPARK-43337) Asc/desc arrow icons for sorting column does not get displayed in the table column for

2023-05-01 Thread Maytas Monsereenusorn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maytas Monsereenusorn updated SPARK-43337: -- Description: The sorting icon is not displayed when the column is clicked to s

[jira] [Updated] (SPARK-43337) Asc/desc arrow icons for sorting column does not get displayed in the table column for

2023-05-01 Thread Maytas Monsereenusorn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maytas Monsereenusorn updated SPARK-43337: -- Attachment: image (4).png > Asc/desc arrow icons for sorting column does not g

[jira] [Updated] (SPARK-43337) Asc/desc arrow icons for sorting column does not get displayed in the table column for

2023-05-01 Thread Maytas Monsereenusorn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maytas Monsereenusorn updated SPARK-43337: -- Description: The sorting icon is not displayed when the column is clicked to s

[jira] [Created] (SPARK-43337) Asc/desc arrow icons for sorting column does not get displayed in the table column for

2023-05-01 Thread Maytas Monsereenusorn (Jira)
Maytas Monsereenusorn created SPARK-43337: - Summary: Asc/desc arrow icons for sorting column does not get displayed in the table column for Key: SPARK-43337 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Created] (SPARK-43336) Casting between Timestamp and TimestampNTZ requires timezone

2023-05-01 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-43336: -- Summary: Casting between Timestamp and TimestampNTZ requires timezone Key: SPARK-43336 URL: https://issues.apache.org/jira/browse/SPARK-43336 Project: Spark

[jira] [Commented] (SPARK-43318) spark reader csv and json support wholetext parameters

2023-05-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718407#comment-17718407 ] Hyukjin Kwon commented on SPARK-43318: -- Spark reader CSV supports multiline that wi

[jira] [Resolved] (SPARK-43307) Migrate PandasUDF value errors into error class

2023-05-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43307. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40976 [https://

[jira] [Assigned] (SPARK-43307) Migrate PandasUDF value errors into error class

2023-05-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43307: - Assignee: Haejoon Lee > Migrate PandasUDF value errors into error class > -

[jira] [Resolved] (SPARK-43314) Migrate Spark Connect client errors into error class

2023-05-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43314. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40985 [https://

[jira] [Assigned] (SPARK-43314) Migrate Spark Connect client errors into error class

2023-05-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43314: - Assignee: Haejoon Lee > Migrate Spark Connect client errors into error class >

[jira] [Assigned] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0

2023-05-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-43304: - Assignee: Haejoon Lee > Enable test_to_latex by supporting jinja2>=3.0.0 >

[jira] [Resolved] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0

2023-05-01 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-43304. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40973 [https://

[jira] [Resolved] (SPARK-42585) Streaming createDataFrame implementation

2023-05-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42585. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40827 [https://gi

[jira] [Resolved] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43330. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41004 [https://gi

[jira] [Assigned] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43330: Assignee: KyungWon Park > Typo in sql-migration-guide.md > --

[jira] [Comment Edited] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718216#comment-17718216 ] KyungWon Park edited comment on SPARK-43330 at 5/2/23 12:23 AM: --

[jira] [Commented] (SPARK-43267) Support creating data frame from a Postgres table that contains user-defined array column

2023-05-01 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718376#comment-17718376 ] Ignite TC Bot commented on SPARK-43267: --- User 'juliuszsompolski' has created a pul

[jira] [Created] (SPARK-43335) Migrate remaining Connect/SparkSQL errors into error classes

2023-05-01 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-43335: --- Summary: Migrate remaining Connect/SparkSQL errors into error classes Key: SPARK-43335 URL: https://issues.apache.org/jira/browse/SPARK-43335 Project: Spark I

[jira] [Resolved] (SPARK-43323) DataFrame.toPandas with Arrow enabled should handle exceptions properly

2023-05-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43323. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40998 [https://gi

[jira] [Assigned] (SPARK-43323) DataFrame.toPandas with Arrow enabled should handle exceptions properly

2023-05-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43323: Assignee: Takuya Ueshin > DataFrame.toPandas with Arrow enabled should handle exceptions

[jira] [Assigned] (SPARK-41766) Handle decommission request sent before executor registration

2023-05-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41766: - Assignee: Zhongwei Zhu > Handle decommission request sent before executor registration

[jira] [Resolved] (SPARK-41766) Handle decommission request sent before executor registration

2023-05-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41766. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39280 [https://

[jira] [Updated] (SPARK-43324) DataSource V2: Handle UPDATE commands for delta-based sources

2023-05-01 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-43324: - Parent: SPARK-35801 Issue Type: Sub-task (was: Improvement) > DataSource V2: Ha

[jira] [Updated] (SPARK-43324) DataSource V2: Handle UPDATE commands for delta-based sources

2023-05-01 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-43324: - Issue Type: Improvement (was: Bug) > DataSource V2: Handle UPDATE commands for delta-ba

[jira] [Created] (SPARK-43334) Error while serializing ExecutorPeakMetricsDistributions into API JSON response

2023-05-01 Thread Thejdeep (Jira)
Thejdeep created SPARK-43334: Summary: Error while serializing ExecutorPeakMetricsDistributions into API JSON response Key: SPARK-43334 URL: https://issues.apache.org/jira/browse/SPARK-43334 Project: Spar

[jira] [Created] (SPARK-43333) Name union type members after types

2023-05-01 Thread Jose Gonzalez (Jira)
Jose Gonzalez created SPARK-4: - Summary: Name union type members after types Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-43223) KeyValueGroupedDataset#agg

2023-05-01 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718346#comment-17718346 ] Ignite TC Bot commented on SPARK-43223: --- User 'zhenlineo' has created a pull reque

[jira] [Commented] (SPARK-43321) Impl Dataset#JoinWith

2023-05-01 Thread Ignite TC Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718345#comment-17718345 ] Ignite TC Bot commented on SPARK-43321: --- User 'zhenlineo' has created a pull reque

[jira] [Commented] (SPARK-43206) Connect Better StreamingQueryException

2023-05-01 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718343#comment-17718343 ] GridGain Integration commented on SPARK-43206: -- User 'WweiL' has created a

[jira] [Created] (SPARK-43332) Allow ChannelBuilder extensions

2023-05-01 Thread Martin Grund (Jira)
Martin Grund created SPARK-43332: Summary: Allow ChannelBuilder extensions Key: SPARK-43332 URL: https://issues.apache.org/jira/browse/SPARK-43332 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-43311) RocksDB state store provider memory management enhancements

2023-05-01 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-43311: Assignee: Anish Shrigondekar > RocksDB state store provider memory management enhancement

[jira] [Resolved] (SPARK-43311) RocksDB state store provider memory management enhancements

2023-05-01 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-43311. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40981 [https://gi

[jira] [Created] (SPARK-43331) Spark Connect - SparkSession interruptAll

2023-05-01 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-43331: - Summary: Spark Connect - SparkSession interruptAll Key: SPARK-43331 URL: https://issues.apache.org/jira/browse/SPARK-43331 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-43206) Connect Better StreamingQueryException

2023-05-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-43206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43206. --- Fix Version/s: 3.5.0 Assignee: Wei Liu Resolution: Fixed > Connect B

[jira] [Resolved] (SPARK-43143) Scala: Add StreamingQuery awaitTermination() API

2023-05-01 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-43143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-43143. --- Fix Version/s: 3.5.0 Assignee: Wei Liu Resolution: Fixed > Scala: Ad

[jira] [Comment Edited] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718216#comment-17718216 ] KyungWon Park edited comment on SPARK-43330 at 5/1/23 4:19 PM: ---

[jira] [Updated] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KyungWon Park updated SPARK-43330: -- Description: There is a minor typo in [sql-migration-guide.md|#L154]   | - In Spark 3.2, `TRA

[jira] [Commented] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718216#comment-17718216 ] KyungWon Park commented on SPARK-43330: --- I have created a PR with a fix- [https://

[jira] [Updated] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KyungWon Park updated SPARK-43330: -- Description: There is a minor typo in [sql-migration-guide.md|https://github.com/apache/spark

[jira] [Updated] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KyungWon Park updated SPARK-43330: -- Description: There is a minor typo in [[sql-migration-guide.md|https://github.com/apache/spar

[jira] [Updated] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KyungWon Park updated SPARK-43330: -- Description: There is a minor typo in [sql-migration-guide.md|https://github.com/apache/spark

[jira] [Updated] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KyungWon Park updated SPARK-43330: -- Description: There is a minor typo in [sql-migration-guide.md|#L154]]   | - In Spark 3.2, `TR

[jira] [Created] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
KyungWon Park created SPARK-43330: - Summary: Typo in sql-migration-guide.md Key: SPARK-43330 URL: https://issues.apache.org/jira/browse/SPARK-43330 Project: Spark Issue Type: Bug Co

[jira] [Updated] (SPARK-43330) Typo in sql-migration-guide.md

2023-05-01 Thread KyungWon Park (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KyungWon Park updated SPARK-43330: -- Description: There is a minor typo in [sql-migration-guide.md|#L154]   | - In Spark 3.2, `TRA

[jira] [Commented] (SPARK-43252) Assign a name to the error class _LEGACY_ERROR_TEMP_2016

2023-05-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17718186#comment-17718186 ] ASF GitHub Bot commented on SPARK-43252: User 'luizfna' has created a pull reque