[jira] [Commented] (SPARK-34693) Support null in conversions to and from Arrow

[ https://issues.apache.org/jira/browse/SPARK-34693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304266#comment-17304266 ] Laurens commented on SPARK-34693: - {code:java} def tps(df) -> pd.DataFrame["workflow_id": int,

[jira] [Commented] (SPARK-34680) Spark hangs when out of diskspace

[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299668#comment-17299668 ] Laurens commented on SPARK-34680: - Seems like it's hard to reproduce, another run failed with the same

[jira] [Created] (SPARK-34693) Support null in conversions to and from Arrow

Laurens created SPARK-34693: --- Summary: Support null in conversions to and from Arrow Key: SPARK-34693 URL: https://issues.apache.org/jira/browse/SPARK-34693 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298921#comment-17298921 ] Laurens edited comment on SPARK-33489 at 3/10/21, 3:55 PM: --- I just hit this

[jira] [Commented] (SPARK-33489) Support null for conversion from and to Arrow type

[ https://issues.apache.org/jira/browse/SPARK-33489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298921#comment-17298921 ] Laurens commented on SPARK-33489: - I just hit this issue using spark 3.1.1 using Koalas 1.7.0

[jira] [Comment Edited] (SPARK-34680) Spark hangs when out of diskspace

[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298849#comment-17298849 ] Laurens edited comment on SPARK-34680 at 3/10/21, 1:55 PM: --- Setup code (master

[jira] [Commented] (SPARK-34680) Spark hangs when out of diskspace

[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298849#comment-17298849 ] Laurens commented on SPARK-34680: - Setup code (master is determined by slurm like 'node008`,

[jira] [Updated] (SPARK-34680) Spark hangs when out of diskspace

[ https://issues.apache.org/jira/browse/SPARK-34680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurens updated SPARK-34680: Description: Parsing a workflow using Koalas, I noticed a stage is hanging for 8 hours already. I

[jira] [Created] (SPARK-34680) Spark hangs when out of diskspace

Laurens created SPARK-34680: --- Summary: Spark hangs when out of diskspace Key: SPARK-34680 URL: https://issues.apache.org/jira/browse/SPARK-34680 Project: Spark Issue Type: Bug