[
https://issues.apache.org/jira/browse/TEZ-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034216#comment-14034216
]
Bikas Saha commented on TEZ-1117:
---------------------------------
Clarification
New config to determine session app status. tez_am_session_fail_on_dag_failure.
Default set to false.
Tez default behavior - App for the session shuts down with failed status only
when the app has an internal error. Status of the DAGs that ran in that session
dont matter.
When Pig submits a set of DAGs such that failure of any DAG should fail the
script then set the config to true. Session app will fail when the first DAG
fails. This meets user specification.
When Pig submits a set of DAGs such that script should continue despite partial
failures, then set the configs to false (default). Session app will continue to
run despite DAG failures and succeed. This meets user spec since user wanted
the script to succeed despite partial failure.
Beyond this, we can make more fine grained rules etc but I would like to avoid
coding Pig exit status logic into Tez. If further combinations are needed, then
we could think of allowing the user to specify final status in the
session.shutdown() call. Users can decide based on their rules whether its a
successful execution or not and ask the app to reflect that.
> Option to make YARN application failed on dag failure
> -----------------------------------------------------
>
> Key: TEZ-1117
> URL: https://issues.apache.org/jira/browse/TEZ-1117
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
>
> Can we have an configuration to make the Application status FAILED on
> termination if one of the DAGs fail? It is very confusing for users to see
> the application SUCCEEDED.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
