Github user srowen commented on the issue:
https://github.com/apache/spark/pull/21664
@caneGuy can you help me see why returning from this method aborts the job
but throwing an error doesn't? If so, yeah that's not good. Why not just catch
all exceptions instead of NonFatal only?
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/21664
I think this patch will fix 'job hanging' problem @jerryshao @jiangxb1987
---
-
To unsubscribe, e-mail:
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21664
I agree we shall fall the job instead of let the job stay hanging.
---
-
To unsubscribe, e-mail:
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/21664
The problem is that the job hanging,and user will be misleading since no
more information print.
---
-
To unsubscribe, e-mail:
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21664
You already got an uncaught exception, there's no need to add warning log.
Besides, this is a fatal error, how will let the job continue with such error?
---
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/21664
@jerryshao I think at least we should print a warning,not let job
hanging?Thanks
---
-
To unsubscribe, e-mail:
Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/21664
The issue is not introduced by Spark itself, it is introduced by user code,
is it better to fix in the user side rather than in Spark? Besides, I'm not so
sure that Spark should take
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/21664
@jiangxb1987 Thanks, i update the description of this pr.Stage 33 never be
scheduled.and job not abort
---
-
To unsubscribe,
Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/21664
Unfortunately, I can't even track which line in Spark have hit the
exception from the image you posted.
---
-
To
Github user caneGuy commented on the issue:
https://github.com/apache/spark/pull/21664
I have post an image on the jira @jiangxb1987
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional
10 matches
Mail list logo
