[
https://issues.apache.org/jira/browse/SPARK-32993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhao yufei updated SPARK-32993:
-------------------------------
Description:
same pyspark program, previously it works ok,
but these few days it always keep hang after running some time. the task is
simple, fetch images from url and use PIL image library to process images
finally write to tensorflow tfrecords file
was:same pyspark program, previously it works ok, but these few days it
alwayes keep hang after running some time. the task is simple, fetch images
from url and use PIL image libary to process images finally write to tensorflow
tfrecords file
> pyspark on yarn executor hang after some time
> ----------------------------------------------
>
> Key: SPARK-32993
> URL: https://issues.apache.org/jira/browse/SPARK-32993
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.0.0
> Reporter: zhao yufei
> Priority: Minor
>
> same pyspark program, previously it works ok,
> but these few days it always keep hang after running some time. the task is
> simple, fetch images from url and use PIL image library to process images
> finally write to tensorflow tfrecords file
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
