[
https://issues.apache.org/jira/browse/OOZIE-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519209#comment-16519209
]
Ahmed edited comment on OOZIE-3294 at 6/25/18 5:20 AM:
-------------------------------------------------------
[~andras.piros] Thanks for the quick response,
Yes we are doing oozie shell actions. post your comment i evaluated all the
servers with the spark-submit available, i see 1 node is *not installed* with
the client(suspecting that node is causing intermittent issue sometimes if the
oozie calls its action and YARN runs on that node & the failure Error is
noticed.)
Rephrasing the question:
How do i exactly identifiy node without the programme spark-submit is causing
failure as the oozie error logs says "*no such file+(but does not specify the
hostname+)*". is there a way to find the exact failure node ? currently we did
manual evaluation on each host (what if in large production setup of thousand
of nodes,[manual validation would not be possible,]) How do we identify the
host.
Regards
-Ahmed
was (Author: big-d):
[~andras.piros] Thanks for the quick response,
Yes we are doing oozie shell actions. post your comment i evaluated all the
servers with the spark-submit available, i see 1 node is not installed with the
client(suspecting that node is causing intermittent issue sometimes if the
oozie calls its action and YARN runs on that node & the failure Error is
noticed.)
How do i exactly identifiy node without the programme spark-submit is causing
failure as the error logs says no such file. is there a way to find the exact
failure cause on that specific node ?
How do we fix this going forward? does installing the spark-client resolves
this or we stop the nodemanager on this host and enable on other node?
Regards
-Ahmed
> Launcher exception: java.io.IOException
> ---------------------------------------
>
> Key: OOZIE-3294
> URL: https://issues.apache.org/jira/browse/OOZIE-3294
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: 4.2.0
> Reporter: Ahmed
> Priority: Major
>
> Hi ,
> There is an intermittent issue in oozie workflow, where the oozie action
> fails sometimes with file not found error for some actions of spark-submit or
> sqoop. (The issue is intermittent.)
>
> I am using hadoop - 2.7.3
> oozie version-4.2.0
>
> "Launcher exception: java.io.IOException Cannot run program "./spark-submit"
> (in directory "/usr/hdp/current/spark2-client/bin"): error=2, No such file or
> directory"
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
