[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Updated] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-46006: -- Description: We meet a case that user call sc.stop() after run all custom code, but stuck in some

[jira] [Created] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop

2023-11-20 Thread angerszhu (Jira)
angerszhu created SPARK-46006: - Summary: YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop Key: SPARK-46006 URL: https://issues.apache.org/jira/browse/SPARK-46006

[jira] [Commented] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"

2023-11-20 Thread Giambattista Bloisi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787917#comment-17787917 ] Giambattista Bloisi commented on SPARK-45311: - This is likely a duplicate of

[jira] [Resolved] (SPARK-45999) Use dedicated `PandasProduct` in `cumprod`

2023-11-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-45999. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43901

[jira] [Updated] (SPARK-46002) Upgrade to Python 3.9 in SQL test

2023-11-20 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46002: -- Summary: Upgrade to Python 3.9 in SQL test (was: Upgrade to Python 3.10 in SQL test) >

[jira] [Commented] (SPARK-45982) re-org R package installations

2023-11-20 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787878#comment-17787878 ] GridGain Integration commented on SPARK-45982: -- User 'zhengruifeng' has created a pull

[jira] [Commented] (SPARK-45982) re-org R package installations

2023-11-20 Thread GridGain Integration (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787877#comment-17787877 ] GridGain Integration commented on SPARK-45982: -- User 'zhengruifeng' has created a pull

[jira] [Updated] (SPARK-32846) Support createDataFrame from an RDD of pd.DataFrames

2023-11-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-32846: --- Labels: arrow pandas pull-request-available sql (was: arrow pandas sql) > Support

<    1   2