[jira] [Created] (SPARK-45675) Specify number of partitions when creating spark dataframe from pandas dataframe

Jelmer Kuperus created SPARK-45675: -- Summary: Specify number of partitions when creating spark dataframe from pandas dataframe Key: SPARK-45675 URL: https://issues.apache.org/jira/browse/SPARK-45675

[jira] [Updated] (SPARK-42622) StackOverflowError reading json that does not conform to schema

[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jelmer Kuperus updated SPARK-42622: --- Description: Databricks runtime 12.1 uses a pre-release version of spark 3.4.x we

[jira] [Updated] (SPARK-42622) StackOverflowError reading json that does not conform to schema

[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jelmer Kuperus updated SPARK-42622: --- Flags: Patch,Important Patch available here https://github.com/apache/spark/pull/40219 >

[jira] [Created] (SPARK-42622) StackOverflowError reading json that does not conform to schema

Jelmer Kuperus created SPARK-42622: -- Summary: StackOverflowError reading json that does not conform to schema Key: SPARK-42622 URL: https://issues.apache.org/jira/browse/SPARK-42622 Project: Spark

[jira] [Comment Edited] (SPARK-27710) ClassNotFoundException: $line196400984558.$read$ in OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034532#comment-17034532 ] Jelmer Kuperus edited comment on SPARK-27710 at 2/12/20 8:11 AM: - This

[jira] [Commented] (SPARK-27710) ClassNotFoundException: $line196400984558.$read$ in OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035135#comment-17035135 ] Jelmer Kuperus commented on SPARK-27710: Turns out it was this

[jira] [Comment Edited] (SPARK-27710) ClassNotFoundException: $line196400984558.$read$ in OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034532#comment-17034532 ] Jelmer Kuperus edited comment on SPARK-27710 at 2/11/20 3:07 PM: - This

[jira] [Commented] (SPARK-27710) ClassNotFoundException: $line196400984558.$read$ in OuterScopes

[ https://issues.apache.org/jira/browse/SPARK-27710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17034532#comment-17034532 ] Jelmer Kuperus commented on SPARK-27710: This also happens in Apache Toree   {code:java} val

[jira] [Comment Edited] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516856#comment-16516856 ] Jelmer Kuperus edited comment on SPARK-5158 at 6/19/18 9:33 AM: I ended

[jira] [Comment Edited] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516856#comment-16516856 ] Jelmer Kuperus edited comment on SPARK-5158 at 6/19/18 9:32 AM: I ended

[jira] [Commented] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516856#comment-16516856 ] Jelmer Kuperus commented on SPARK-5158: --- I ended up with the following workaround which at first

[jira] [Commented] (SPARK-18750) spark should be able to control the number of executor and should not throw stack overslow

[ https://issues.apache.org/jira/browse/SPARK-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833386#comment-15833386 ] Jelmer Kuperus commented on SPARK-18750: I am seeing the exact same issue when using dynamic