[jira] [Commented] (SPARK-34510) .foreachPartition command hangs when ran inside Python package but works when ran from Python file outside the package on EMR

2021-03-31 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312460#comment-17312460 ] Sean R. Owen commented on SPARK-34510: -- Got it. Without more detail or errors, or a repro against

[jira] [Commented] (SPARK-34510) .foreachPartition command hangs when ran inside Python package but works when ran from Python file outside the package on EMR

2021-03-30 Thread Yuriy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311978#comment-17311978 ] Yuriy commented on SPARK-34510: --- Sean, the code is not actually performing any S3 operations, if you take

[jira] [Commented] (SPARK-34510) .foreachPartition command hangs when ran inside Python package but works when ran from Python file outside the package on EMR

2021-03-24 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307879#comment-17307879 ] Sean R. Owen commented on SPARK-34510: -- Firstly, does this happen on Apache Spark or just EMR? Are