I suggest one thing you can do is to open another thread for this feature request
"Having functionality in Spark to allow queries to be gathered and analyzed" and see what forum responds to it. HTH LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Wed, 3 Feb 2021 at 11:17, Arpan Bhandari <arpan3...@gmail.com> wrote: > Yes Mich, > > Mapping the spark sql query that got executed corresponding to an > application Id on yarn would greatly help in analyzing and debugging the > query for any potential problems. > > > Thanks, > Arpan Bhandari > > > > -- > Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
