[
https://issues.apache.org/jira/browse/SPARK-25180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588035#comment-16588035
]
Steve Loughran commented on SPARK-25180:
----------------------------------------
FWIW, there was no in-progress data at the dest store, so either task commit
process failed before the actual output committer's commitTask() method was
called, or the abort operation cleaned up before that notification message
failed to send. Either way: no in-flight data to clean up.
> Spark standalone failure in Utils.doFetchFile() if nslookup of local hostname
> fails
> -----------------------------------------------------------------------------------
>
> Key: SPARK-25180
> URL: https://issues.apache.org/jira/browse/SPARK-25180
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.0
> Environment: mac laptop running on a corporate guest wifi, presumably
> a wifi with odd DNS settings.
> Reporter: Steve Loughran
> Priority: Minor
>
> trying to save work on spark standalone can fail if netty RPC cannot
> determine the hostname. While that's a valid failure on a real cluster, in
> standalone falling back to localhost rather than inferred "hw13176.lan" value
> may be the better option.
> note also, the abort* call failed; NPE.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
