Are you running multiple DAGs in a session or a single DAG? If you are running a single DAG then there is no benefit from sessions. If the code follows the recommendations per the 0.5 API then the same code can run in session or non-session mode based on config. So it should be easy for you to not use session mode when not necessary.
Bikas *From:* Bikas Saha [mailto:[email protected]] *Sent:* Friday, August 15, 2014 10:44 AM *To:* [email protected] *Subject:* RE: DAG failed but YARN app successful Are you using sessions? *From:* Johannes Zillmann [mailto:[email protected]] *Sent:* Friday, August 15, 2014 1:29 AM *To:* [email protected] *Subject:* DAG failed but YARN app successful Hey guys, just wandering, is it intended behaviour that the yarn app is showed as success even if a DAG fails ? Like: Johannes -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
