[jira] [Resolved] (SPARK-42525) collapse two adjacent windows with the same partition/order in subquery

[ https://issues.apache.org/jira/browse/SPARK-42525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42525. - Fix Version/s: 3.5.0 Assignee: zhuml Resolution: Fixed > collapse two adjacent

[jira] [Comment Edited] (SPARK-42582) Persisted RDD blocks can be inconsistent if the RDD computation is indeterminate

[ https://issues.apache.org/jira/browse/SPARK-42582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693579#comment-17693579 ] Tengfei Huang edited comment on SPARK-42582 at 2/26/23 3:27 AM: This is

[jira] [Assigned] (SPARK-42560) Implement ColumnName

[ https://issues.apache.org/jira/browse/SPARK-42560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42560: - Assignee: Herman van Hövell > Implement ColumnName > > >

[jira] [Comment Edited] (SPARK-42582) Persisted RDD blocks can be inconsistent if the RDD computation is indeterminate

[ https://issues.apache.org/jira/browse/SPARK-42582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693579#comment-17693579 ] Tengfei Huang edited comment on SPARK-42582 at 2/26/23 3:27 AM: This is

[jira] [Commented] (SPARK-42582) Persisted RDD blocks can be inconsistent if the RDD computation is indeterminate

[ https://issues.apache.org/jira/browse/SPARK-42582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693579#comment-17693579 ] Tengfei Huang commented on SPARK-42582: --- This is also discussed in PR:

[jira] [Created] (SPARK-42582) Persisted RDD blocks can be inconsistent if the RDD computation is indeterminate

Tengfei Huang created SPARK-42582: - Summary: Persisted RDD blocks can be inconsistent if the RDD computation is indeterminate Key: SPARK-42582 URL: https://issues.apache.org/jira/browse/SPARK-42582

[jira] [Commented] (SPARK-42580) Add initial typed Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-42580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693577#comment-17693577 ] Apache Spark commented on SPARK-42580: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-42580) Add initial typed Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-42580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693578#comment-17693578 ] Apache Spark commented on SPARK-42580: -- User 'hvanhovell' has created a pull request for this

[jira] [Created] (SPARK-42581) Add SparkSession implicits

Herman van Hövell created SPARK-42581: - Summary: Add SparkSession implicits Key: SPARK-42581 URL: https://issues.apache.org/jira/browse/SPARK-42581 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-42580) Add initial typed Dataset APIs

Herman van Hövell created SPARK-42580: - Summary: Add initial typed Dataset APIs Key: SPARK-42580 URL: https://issues.apache.org/jira/browse/SPARK-42580 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-42564) Implement Dataset.version and Dataset.time

[ https://issues.apache.org/jira/browse/SPARK-42564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42564: - Assignee: BingKun Pan > Implement Dataset.version and Dataset.time >

[jira] [Resolved] (SPARK-42576) Add 2nd groupBy method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-42576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42576. --- Fix Version/s: 3.4.1 Resolution: Fixed > Add 2nd groupBy method to Dataset >

[jira] [Commented] (SPARK-42573) Enable binary compatibility tests for SparkSession/Dataset/Column/functions

[ https://issues.apache.org/jira/browse/SPARK-42573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693566#comment-17693566 ] Apache Spark commented on SPARK-42573: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42576) Add 2nd groupBy method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-42576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42576: Assignee: Rui Wang (was: Apache Spark) > Add 2nd groupBy method to Dataset >

[jira] [Commented] (SPARK-42576) Add 2nd groupBy method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-42576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693557#comment-17693557 ] Apache Spark commented on SPARK-42576: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42576) Add 2nd groupBy method to Dataset

[ https://issues.apache.org/jira/browse/SPARK-42576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42576: Assignee: Apache Spark (was: Rui Wang) > Add 2nd groupBy method to Dataset >

[jira] [Commented] (SPARK-42569) Throw unsupported exceptions for non-supported API

[ https://issues.apache.org/jira/browse/SPARK-42569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693552#comment-17693552 ] Apache Spark commented on SPARK-42569: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Created] (SPARK-42579) Extend function.lit() to match Literal.apply()

Herman van Hövell created SPARK-42579: - Summary: Extend function.lit() to match Literal.apply() Key: SPARK-42579 URL: https://issues.apache.org/jira/browse/SPARK-42579 Project: Spark

[jira] [Resolved] (SPARK-42570) Fix DataFrameReader to use the default source

[ https://issues.apache.org/jira/browse/SPARK-42570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42570. --- Fix Version/s: 3.4.1 Assignee: Takuya Ueshin Resolution: Fixed >

[jira] [Created] (SPARK-42578) Add JDBC to DataFrameWriter

Herman van Hövell created SPARK-42578: - Summary: Add JDBC to DataFrameWriter Key: SPARK-42578 URL: https://issues.apache.org/jira/browse/SPARK-42578 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-42538) `functions#lit` support more types

[ https://issues.apache.org/jira/browse/SPARK-42538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell reassigned SPARK-42538: - Epic Link: SPARK-42554 Assignee: Yang Jie > `functions#lit` support more

[jira] [Resolved] (SPARK-42538) `functions#lit` support more types

[ https://issues.apache.org/jira/browse/SPARK-42538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42538. --- Fix Version/s: 3.4.1 Resolution: Fixed > `functions#lit` support more types

[jira] [Updated] (SPARK-42569) Throw unsupported exceptions for non-supported API

[ https://issues.apache.org/jira/browse/SPARK-42569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42569: -- Epic Link: SPARK-42554 > Throw unsupported exceptions for non-supported API >

[jira] [Commented] (SPARK-42569) Throw unsupported exceptions for non-supported API

[ https://issues.apache.org/jira/browse/SPARK-42569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693513#comment-17693513 ] Herman van Hövell commented on SPARK-42569: --- First PR merged. We still need to do persist. >

[jira] [Resolved] (SPARK-42561) Add TempView APIs to Dataset

[ https://issues.apache.org/jira/browse/SPARK-42561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42561. --- Fix Version/s: 3.4.1 Resolution: Fixed > Add TempView APIs to Dataset >

[jira] [Resolved] (SPARK-42575) Replace `AnyFunSuite` with `ConnectFunSuite` for scala client tests

[ https://issues.apache.org/jira/browse/SPARK-42575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42575. --- Fix Version/s: 3.4.1 Assignee: Zhen Li Resolution: Fixed > Replace

[jira] [Resolved] (SPARK-42573) Enable binary compatibility tests for SparkSession/Dataset/Column/functions

[ https://issues.apache.org/jira/browse/SPARK-42573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42573. --- Fix Version/s: 3.4.1 Assignee: Zhen Li Resolution: Fixed > Enable

[jira] [Updated] (SPARK-40376) `np.bool` will be deprecated

[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-40376: - Fix Version/s: 3.3.3 > `np.bool` will be deprecated > > >

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693467#comment-17693467 ] kevinshin commented on SPARK-42550: --- https://github.com/apache/kyuubi/issues/4416 > table directory

[jira] [Resolved] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42550. - Resolution: Cannot Reproduce > table directory will lost on hdfs when `INSERT OVERWRITE` faild

[jira] [Commented] (SPARK-42550) table directory will lost on hdfs when `INSERT OVERWRITE` faild

[ https://issues.apache.org/jira/browse/SPARK-42550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693457#comment-17693457 ] kevinshin commented on SPARK-42550: --- It seems like my environment problem, I can't reproduce this

[jira] [Assigned] (SPARK-42567) Track state store provider load time and log warning if it exceeds a threshold

[ https://issues.apache.org/jira/browse/SPARK-42567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42567: Assignee: Anish Shrigondekar > Track state store provider load time and log warning if

[jira] [Resolved] (SPARK-42567) Track state store provider load time and log warning if it exceeds a threshold

[ https://issues.apache.org/jira/browse/SPARK-42567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42567. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40163

[jira] [Assigned] (SPARK-42566) RocksDB StateStore lock acquisition should happen after getting input iterator from inputRDD

[ https://issues.apache.org/jira/browse/SPARK-42566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-42566: Assignee: Huanli Wang > RocksDB StateStore lock acquisition should happen after getting

[jira] [Resolved] (SPARK-42566) RocksDB StateStore lock acquisition should happen after getting input iterator from inputRDD

[ https://issues.apache.org/jira/browse/SPARK-42566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-42566. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40162

[jira] [Created] (SPARK-42577) A large stage could run indefinitely due to executor lost

wuyi created SPARK-42577: Summary: A large stage could run indefinitely due to executor lost Key: SPARK-42577 URL: https://issues.apache.org/jira/browse/SPARK-42577 Project: Spark Issue Type: